Jun 14 21:33:19.439482 ip-10-0-142-95 systemd[1]: Starting Kubernetes Kubelet... Jun 14 21:33:19.754306 ip-10-0-142-95 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 21:33:19.754306 ip-10-0-142-95 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 14 21:33:19.754306 ip-10-0-142-95 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 21:33:19.754306 ip-10-0-142-95 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 14 21:33:19.754306 ip-10-0-142-95 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 21:33:19.756076 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.756010 2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 14 21:33:19.762359 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762336 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 21:33:19.762359 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762356 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 21:33:19.762359 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762360 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 21:33:19.762359 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762363 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 21:33:19.762359 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762366 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 21:33:19.762536 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762369 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 21:33:19.762536 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762372 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 21:33:19.762536 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762374 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 21:33:19.762536 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762378 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 21:33:19.762536 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762380 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 21:33:19.762536 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762383 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 21:33:19.762536 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762385 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 21:33:19.762536 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762388 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 21:33:19.762536 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762390 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 21:33:19.762536 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762393 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 21:33:19.762536 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762395 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 21:33:19.762536 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762398 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 21:33:19.762536 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762400 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 21:33:19.762536 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762404 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 21:33:19.762536 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762408 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 21:33:19.762536 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762411 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 21:33:19.762536 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762414 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 21:33:19.762536 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762416 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 21:33:19.762536 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762419 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 21:33:19.762536 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762422 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 21:33:19.763001 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762425 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 21:33:19.763001 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762428 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 21:33:19.763001 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762430 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 21:33:19.763001 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762433 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 21:33:19.763001 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762436 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 21:33:19.763001 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762438 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 21:33:19.763001 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762441 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 21:33:19.763001 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762446 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 21:33:19.763001 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762449 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 21:33:19.763001 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762453 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 21:33:19.763001 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762455 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 21:33:19.763001 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762457 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 21:33:19.763001 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762461 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 21:33:19.763001 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762466 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 21:33:19.763001 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762469 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 21:33:19.763001 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762472 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 21:33:19.763001 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762475 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 21:33:19.763001 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762478 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 21:33:19.763001 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762480 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 21:33:19.763550 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762483 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 21:33:19.763550 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762486 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 21:33:19.763550 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762488 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 21:33:19.763550 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762490 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 21:33:19.763550 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762492 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 21:33:19.763550 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762495 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 21:33:19.763550 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762497 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 21:33:19.763550 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762500 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 21:33:19.763550 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762502 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 21:33:19.763550 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762504 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 21:33:19.763550 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762507 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 21:33:19.763550 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762509 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 21:33:19.763550 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762511 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 21:33:19.763550 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762514 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 21:33:19.763550 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762516 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 21:33:19.763550 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762519 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 21:33:19.763550 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762521 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 21:33:19.763550 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762524 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 21:33:19.763550 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762526 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 21:33:19.763550 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762529 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 21:33:19.764024 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762531 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 21:33:19.764024 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762534 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 21:33:19.764024 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762536 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 21:33:19.764024 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762538 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 21:33:19.764024 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762541 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 21:33:19.764024 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762543 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 21:33:19.764024 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762548 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 21:33:19.764024 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762552 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 21:33:19.764024 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762556 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 21:33:19.764024 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762558 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 21:33:19.764024 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762561 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 21:33:19.764024 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762563 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 21:33:19.764024 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762566 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 21:33:19.764024 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762568 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 21:33:19.764024 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762571 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 21:33:19.764024 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762573 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 21:33:19.764024 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762576 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 21:33:19.764024 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762579 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 21:33:19.764024 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762582 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 21:33:19.764508 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762591 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 21:33:19.764508 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762593 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 21:33:19.764508 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762596 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 21:33:19.764508 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762598 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 21:33:19.764508 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762600 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 21:33:19.764508 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762603 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 14 21:33:19.764508 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762605 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 21:33:19.764508 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762608 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 21:33:19.764508 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762610 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 21:33:19.764508 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762613 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 21:33:19.764508 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762615 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 21:33:19.764508 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762618 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 21:33:19.764508 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762620 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 21:33:19.764508 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762623 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 21:33:19.764508 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762626 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 21:33:19.764508 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.762628 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 21:33:19.764508 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763354 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 21:33:19.764508 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763361 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 21:33:19.764508 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763363 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 21:33:19.764508 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763367 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 21:33:19.764988 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763370 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 21:33:19.764988 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763372 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 21:33:19.764988 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763375 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 21:33:19.764988 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763378 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 21:33:19.764988 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763380 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 21:33:19.764988 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763383 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 21:33:19.764988 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763386 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 21:33:19.764988 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763388 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 21:33:19.764988 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763391 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 21:33:19.764988 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763394 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 21:33:19.764988 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763396 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 21:33:19.764988 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763399 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 21:33:19.764988 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763401 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 21:33:19.764988 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763404 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 21:33:19.764988 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763407 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 21:33:19.764988 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763409 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 21:33:19.764988 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763412 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 21:33:19.764988 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763414 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 21:33:19.764988 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763417 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 21:33:19.764988 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763420 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 21:33:19.765494 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763422 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 21:33:19.765494 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763427 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 21:33:19.765494 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763431 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 21:33:19.765494 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763434 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 21:33:19.765494 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763437 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 21:33:19.765494 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763439 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 21:33:19.765494 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763442 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 21:33:19.765494 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763445 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 21:33:19.765494 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763447 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 21:33:19.765494 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763450 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 21:33:19.765494 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763453 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 21:33:19.765494 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763455 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 21:33:19.765494 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763458 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 21:33:19.765494 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763461 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 21:33:19.765494 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763464 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 21:33:19.765494 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763467 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 21:33:19.765494 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763470 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 14 21:33:19.765494 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763472 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 21:33:19.765494 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763475 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 21:33:19.765949 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763477 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 21:33:19.765949 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763479 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 21:33:19.765949 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763482 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 21:33:19.765949 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763484 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 21:33:19.765949 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763486 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 21:33:19.765949 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763489 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 21:33:19.765949 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763491 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 21:33:19.765949 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763494 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 21:33:19.765949 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763497 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 21:33:19.765949 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763499 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 21:33:19.765949 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763502 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 21:33:19.765949 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763504 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 21:33:19.765949 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763507 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 21:33:19.765949 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763509 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 21:33:19.765949 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763512 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 21:33:19.765949 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763515 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 21:33:19.765949 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763517 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 21:33:19.765949 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763520 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 21:33:19.765949 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763522 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 21:33:19.765949 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763525 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 21:33:19.766462 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763530 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 21:33:19.766462 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763534 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 21:33:19.766462 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763537 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 21:33:19.766462 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763541 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 21:33:19.766462 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763544 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 21:33:19.766462 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763546 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 21:33:19.766462 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763549 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 21:33:19.766462 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763551 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 21:33:19.766462 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763554 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 21:33:19.766462 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763557 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 21:33:19.766462 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763560 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 21:33:19.766462 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763562 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 21:33:19.766462 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763565 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 21:33:19.766462 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763567 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 21:33:19.766462 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763570 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 21:33:19.766462 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763572 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 21:33:19.766462 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763574 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 21:33:19.766462 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763577 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 21:33:19.766462 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763579 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 21:33:19.766462 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763582 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 21:33:19.766931 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763585 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 21:33:19.766931 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763587 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 21:33:19.766931 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763590 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 21:33:19.766931 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763592 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 21:33:19.766931 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763595 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 21:33:19.766931 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763597 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 21:33:19.766931 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763601 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 21:33:19.766931 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763604 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 21:33:19.766931 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763607 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 21:33:19.766931 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763610 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 21:33:19.766931 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763612 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 21:33:19.766931 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763614 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 21:33:19.766931 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763617 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 21:33:19.766931 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763620 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 21:33:19.766931 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763623 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 21:33:19.766931 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763625 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 21:33:19.766931 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763994 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 21:33:19.766931 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.763999 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 21:33:19.766931 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764001 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 21:33:19.767414 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764004 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 21:33:19.767414 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764008 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 21:33:19.767414 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764011 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 21:33:19.767414 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764014 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 21:33:19.767414 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764017 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 21:33:19.767414 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764019 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 21:33:19.767414 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764022 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 21:33:19.767414 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764024 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 21:33:19.767414 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764027 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 21:33:19.767414 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764030 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 21:33:19.767414 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764033 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 21:33:19.767414 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764035 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 21:33:19.767414 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764038 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 21:33:19.767414 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764041 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 21:33:19.767414 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764044 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 14 21:33:19.767414 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764047 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 21:33:19.767414 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764049 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 21:33:19.767414 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764052 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 21:33:19.767414 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764054 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 21:33:19.767414 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764057 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 21:33:19.767908 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764059 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 21:33:19.767908 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764062 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 21:33:19.767908 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764064 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 21:33:19.767908 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764066 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 21:33:19.767908 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764069 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 21:33:19.767908 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764071 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 21:33:19.767908 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764073 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 21:33:19.767908 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764076 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 21:33:19.767908 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764079 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 21:33:19.767908 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764082 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 21:33:19.767908 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764084 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 21:33:19.767908 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764087 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 21:33:19.767908 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764089 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 21:33:19.767908 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764092 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 21:33:19.767908 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764094 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 21:33:19.767908 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764097 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 21:33:19.767908 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764099 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 21:33:19.767908 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764101 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 21:33:19.767908 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764104 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 21:33:19.768387 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764106 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 21:33:19.768387 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764111 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 21:33:19.768387 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764113 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 21:33:19.768387 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764116 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 21:33:19.768387 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764118 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 21:33:19.768387 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764121 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 21:33:19.768387 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764123 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 21:33:19.768387 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764126 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 21:33:19.768387 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764128 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 21:33:19.768387 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764131 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 21:33:19.768387 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764133 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 21:33:19.768387 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764136 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 21:33:19.768387 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764138 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 21:33:19.768387 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764141 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 21:33:19.768387 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764144 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 21:33:19.768387 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764146 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 21:33:19.768387 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764149 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 21:33:19.768387 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764151 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 21:33:19.768387 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764153 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 21:33:19.768387 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764156 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 21:33:19.768887 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764158 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 21:33:19.768887 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764161 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 21:33:19.768887 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764163 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 21:33:19.768887 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764166 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 21:33:19.768887 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764169 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 21:33:19.768887 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764171 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 21:33:19.768887 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764174 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 21:33:19.768887 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764176 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 21:33:19.768887 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764179 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 21:33:19.768887 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764182 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 21:33:19.768887 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764184 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 21:33:19.768887 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764186 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 21:33:19.768887 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764189 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 21:33:19.768887 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764193 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 21:33:19.768887 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764195 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 21:33:19.768887 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764198 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 21:33:19.768887 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764202 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 21:33:19.768887 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764205 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 21:33:19.768887 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764230 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 21:33:19.768887 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764233 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 21:33:19.769414 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764237 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 21:33:19.769414 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764241 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 21:33:19.769414 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764244 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 21:33:19.769414 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764247 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 21:33:19.769414 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764250 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 21:33:19.769414 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764253 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 21:33:19.769414 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764256 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 21:33:19.769414 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764260 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 21:33:19.769414 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764263 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 21:33:19.769414 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764265 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 21:33:19.769414 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764268 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 21:33:19.769414 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764271 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 21:33:19.769414 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764273 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 21:33:19.769414 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764276 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 21:33:19.769414 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764278 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 21:33:19.769414 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764280 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 21:33:19.769414 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764283 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 21:33:19.769414 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764349 2563 flags.go:64] FLAG: --address="0.0.0.0" Jun 14 21:33:19.769414 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764356 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 14 21:33:19.769414 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764362 2563 flags.go:64] FLAG: --anonymous-auth="true" Jun 14 21:33:19.769885 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764368 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 14 21:33:19.769885 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764374 2563 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 14 21:33:19.769885 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764379 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 14 21:33:19.769885 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764385 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 14 21:33:19.769885 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764391 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 14 21:33:19.769885 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764396 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 14 21:33:19.769885 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764399 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 14 21:33:19.769885 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764402 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 14 21:33:19.769885 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764406 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 14 21:33:19.769885 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764409 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 14 21:33:19.769885 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764412 2563 flags.go:64] FLAG: --cgroup-root="" Jun 14 21:33:19.769885 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764414 2563 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 14 21:33:19.769885 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764417 2563 flags.go:64] FLAG: --client-ca-file="" Jun 14 21:33:19.769885 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764421 2563 flags.go:64] FLAG: --cloud-provider="external" Jun 14 21:33:19.769885 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764423 2563 flags.go:64] FLAG: --cluster-dns="[]" Jun 14 21:33:19.769885 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764428 2563 flags.go:64] FLAG: --cluster-domain="" Jun 14 21:33:19.769885 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764431 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 14 21:33:19.769885 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764436 2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 14 21:33:19.769885 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764439 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 14 21:33:19.769885 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764442 2563 flags.go:64] FLAG: --container-log-max-files="5" Jun 14 21:33:19.769885 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764446 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 14 21:33:19.769885 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764449 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 14 21:33:19.769885 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764451 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 14 21:33:19.770542 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764455 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 14 21:33:19.770542 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764458 2563 flags.go:64] FLAG: --contention-profiling="false" Jun 14 21:33:19.770542 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764461 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 14 21:33:19.770542 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764463 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 14 21:33:19.770542 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764466 2563 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 14 21:33:19.770542 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764469 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 14 21:33:19.770542 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764473 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 14 21:33:19.770542 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764476 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 14 21:33:19.770542 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764488 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 14 21:33:19.770542 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764491 2563 flags.go:64] FLAG: --enable-load-reader="false" Jun 14 21:33:19.770542 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764495 2563 flags.go:64] FLAG: --enable-server="true" Jun 14 21:33:19.770542 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764497 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 14 21:33:19.770542 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764501 2563 flags.go:64] FLAG: --event-burst="100" Jun 14 21:33:19.770542 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764504 2563 flags.go:64] FLAG: --event-qps="50" Jun 14 21:33:19.770542 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764508 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 14 21:33:19.770542 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764511 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 14 21:33:19.770542 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764514 2563 flags.go:64] FLAG: --eviction-hard="" Jun 14 21:33:19.770542 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764518 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 14 21:33:19.770542 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764521 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 14 21:33:19.770542 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764524 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 14 21:33:19.770542 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764526 2563 flags.go:64] FLAG: --eviction-soft="" Jun 14 21:33:19.770542 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764529 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 14 21:33:19.770542 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764532 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 14 21:33:19.770542 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764535 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 14 21:33:19.770542 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764538 2563 flags.go:64] FLAG: --experimental-mounter-path="" Jun 14 21:33:19.771146 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764541 2563 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 14 21:33:19.771146 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764545 2563 flags.go:64] FLAG: --fail-swap-on="true" Jun 14 21:33:19.771146 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764548 2563 flags.go:64] FLAG: --feature-gates="" Jun 14 21:33:19.771146 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764551 2563 flags.go:64] FLAG: --file-check-frequency="20s" Jun 14 21:33:19.771146 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764554 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 14 21:33:19.771146 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764557 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 14 21:33:19.771146 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764559 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 14 21:33:19.771146 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764562 2563 flags.go:64] FLAG: --healthz-port="10248" Jun 14 21:33:19.771146 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764565 2563 flags.go:64] FLAG: --help="false" Jun 14 21:33:19.771146 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764568 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-142-95.ec2.internal" Jun 14 21:33:19.771146 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764571 2563 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 14 21:33:19.771146 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764573 2563 flags.go:64] FLAG: --http-check-frequency="20s" Jun 14 21:33:19.771146 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764576 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 14 21:33:19.771146 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764580 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 14 21:33:19.771146 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764583 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 14 21:33:19.771146 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764586 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 14 21:33:19.771146 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764589 2563 flags.go:64] FLAG: --image-service-endpoint="" Jun 14 21:33:19.771146 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764591 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 14 21:33:19.771146 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764594 2563 flags.go:64] FLAG: --kube-api-burst="100" Jun 14 21:33:19.771146 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764596 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 14 21:33:19.771146 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764599 2563 flags.go:64] FLAG: --kube-api-qps="50" Jun 14 21:33:19.771146 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764603 2563 flags.go:64] FLAG: --kube-reserved="" Jun 14 21:33:19.771146 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764606 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 14 21:33:19.771146 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764608 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 14 21:33:19.771747 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764611 2563 flags.go:64] FLAG: --kubelet-cgroups="" Jun 14 21:33:19.771747 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764614 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 14 21:33:19.771747 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764616 2563 flags.go:64] FLAG: --lock-file="" Jun 14 21:33:19.771747 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764619 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 14 21:33:19.771747 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764622 2563 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 14 21:33:19.771747 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764625 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 14 21:33:19.771747 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764630 2563 flags.go:64] FLAG: --log-json-split-stream="false" Jun 14 21:33:19.771747 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764634 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 14 21:33:19.771747 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764636 2563 flags.go:64] FLAG: --log-text-split-stream="false" Jun 14 21:33:19.771747 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764640 2563 flags.go:64] FLAG: --logging-format="text" Jun 14 21:33:19.771747 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764643 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 14 21:33:19.771747 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764646 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 14 21:33:19.771747 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764648 2563 flags.go:64] FLAG: --manifest-url="" Jun 14 21:33:19.771747 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764651 2563 flags.go:64] FLAG: --manifest-url-header="" Jun 14 21:33:19.771747 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764655 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 14 21:33:19.771747 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764658 2563 flags.go:64] FLAG: --max-open-files="1000000" Jun 14 21:33:19.771747 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764662 2563 flags.go:64] FLAG: --max-pods="110" Jun 14 21:33:19.771747 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764665 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 14 21:33:19.771747 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764667 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 14 21:33:19.771747 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764670 2563 flags.go:64] FLAG: --memory-manager-policy="None" Jun 14 21:33:19.771747 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764672 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 14 21:33:19.771747 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764675 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 14 21:33:19.771747 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764678 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 14 21:33:19.771747 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764680 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 14 21:33:19.771747 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764687 2563 flags.go:64] FLAG: --node-status-max-images="50" Jun 14 21:33:19.772360 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764690 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 14 21:33:19.772360 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764692 2563 flags.go:64] FLAG: --oom-score-adj="-999" Jun 14 21:33:19.772360 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764695 2563 flags.go:64] FLAG: --pod-cidr="" Jun 14 21:33:19.772360 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764698 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 14 21:33:19.772360 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764703 2563 flags.go:64] FLAG: --pod-manifest-path="" Jun 14 21:33:19.772360 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764708 2563 flags.go:64] FLAG: --pod-max-pids="-1" Jun 14 21:33:19.772360 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764711 2563 flags.go:64] FLAG: --pods-per-core="0" Jun 14 21:33:19.772360 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764713 2563 flags.go:64] FLAG: --port="10250" Jun 14 21:33:19.772360 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764716 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 14 21:33:19.772360 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764719 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03680139c11701fae" Jun 14 21:33:19.772360 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764722 2563 flags.go:64] FLAG: --qos-reserved="" Jun 14 21:33:19.772360 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764724 2563 flags.go:64] FLAG: --read-only-port="10255" Jun 14 21:33:19.772360 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764727 2563 flags.go:64] FLAG: --register-node="true" Jun 14 21:33:19.772360 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764730 2563 flags.go:64] FLAG: --register-with-taints="" Jun 14 21:33:19.772360 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764733 2563 flags.go:64] FLAG: --registry-burst="10" Jun 14 21:33:19.772360 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764736 2563 flags.go:64] FLAG: --registry-qps="5" Jun 14 21:33:19.772360 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764740 2563 flags.go:64] FLAG: --reserved-cpus="" Jun 14 21:33:19.772360 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764743 2563 flags.go:64] FLAG: --reserved-memory="" Jun 14 21:33:19.772360 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764746 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 14 21:33:19.772360 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764749 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 14 21:33:19.772360 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764752 2563 flags.go:64] FLAG: --rotate-certificates="false" Jun 14 21:33:19.772360 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764755 2563 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 14 21:33:19.772360 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764757 2563 flags.go:64] FLAG: --runonce="false" Jun 14 21:33:19.772360 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764760 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 14 21:33:19.772360 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764763 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 14 21:33:19.772962 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764766 2563 flags.go:64] FLAG: --seccomp-default="false" Jun 14 21:33:19.772962 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764768 2563 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 14 21:33:19.772962 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764771 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 14 21:33:19.772962 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764774 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 14 21:33:19.772962 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764776 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 14 21:33:19.772962 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764779 2563 flags.go:64] FLAG: --storage-driver-password="root" Jun 14 21:33:19.772962 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764782 2563 flags.go:64] FLAG: --storage-driver-secure="false" Jun 14 21:33:19.772962 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764785 2563 flags.go:64] FLAG: --storage-driver-table="stats" Jun 14 21:33:19.772962 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764788 2563 flags.go:64] FLAG: --storage-driver-user="root" Jun 14 21:33:19.772962 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764790 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 14 21:33:19.772962 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764793 2563 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 14 21:33:19.772962 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764796 2563 flags.go:64] FLAG: --system-cgroups="" Jun 14 21:33:19.772962 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764799 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 14 21:33:19.772962 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764804 2563 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 14 21:33:19.772962 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764807 2563 flags.go:64] FLAG: --tls-cert-file="" Jun 14 21:33:19.772962 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764810 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 14 21:33:19.772962 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764813 2563 flags.go:64] FLAG: --tls-min-version="" Jun 14 21:33:19.772962 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764816 2563 flags.go:64] FLAG: --tls-private-key-file="" Jun 14 21:33:19.772962 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764819 2563 flags.go:64] FLAG: --topology-manager-policy="none" Jun 14 21:33:19.772962 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764821 2563 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 14 21:33:19.772962 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764824 2563 flags.go:64] FLAG: --topology-manager-scope="container" Jun 14 21:33:19.772962 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764826 2563 flags.go:64] FLAG: --v="2" Jun 14 21:33:19.772962 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764830 2563 flags.go:64] FLAG: --version="false" Jun 14 21:33:19.772962 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764842 2563 flags.go:64] FLAG: --vmodule="" Jun 14 21:33:19.772962 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764850 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 14 21:33:19.773575 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.764853 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 14 21:33:19.773575 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764977 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 21:33:19.773575 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764980 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 21:33:19.773575 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764983 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 21:33:19.773575 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764986 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 21:33:19.773575 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764989 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 21:33:19.773575 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764992 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 21:33:19.773575 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764995 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 21:33:19.773575 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.764997 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 21:33:19.773575 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765000 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 21:33:19.773575 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765003 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 21:33:19.773575 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765005 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 21:33:19.773575 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765007 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 21:33:19.773575 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765009 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 21:33:19.773575 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765012 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 21:33:19.773575 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765015 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 21:33:19.773575 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765017 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 21:33:19.773575 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765020 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 21:33:19.773575 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765022 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 21:33:19.773575 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765026 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 21:33:19.773575 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765028 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 21:33:19.774118 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765031 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 21:33:19.774118 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765033 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 21:33:19.774118 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765036 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 21:33:19.774118 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765038 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 21:33:19.774118 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765040 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 21:33:19.774118 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765043 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 21:33:19.774118 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765046 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 21:33:19.774118 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765048 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 21:33:19.774118 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765051 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 21:33:19.774118 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765054 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 21:33:19.774118 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765057 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 21:33:19.774118 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765060 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 21:33:19.774118 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765062 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 21:33:19.774118 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765065 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 21:33:19.774118 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765067 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 21:33:19.774118 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765069 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 21:33:19.774118 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765072 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 21:33:19.774118 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765075 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 21:33:19.774118 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765077 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 21:33:19.774118 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765080 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 21:33:19.774614 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765082 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 21:33:19.774614 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765084 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 21:33:19.774614 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765087 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 21:33:19.774614 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765089 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 21:33:19.774614 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765092 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 21:33:19.774614 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765094 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 21:33:19.774614 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765097 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 21:33:19.774614 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765099 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 21:33:19.774614 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765102 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 21:33:19.774614 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765106 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 21:33:19.774614 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765110 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 21:33:19.774614 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765113 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 21:33:19.774614 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765116 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 21:33:19.774614 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765119 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 21:33:19.774614 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765122 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 21:33:19.774614 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765124 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 21:33:19.774614 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765128 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 21:33:19.774614 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765130 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 21:33:19.774614 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765133 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 21:33:19.775085 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765136 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 21:33:19.775085 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765138 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 21:33:19.775085 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765143 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 21:33:19.775085 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765147 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 21:33:19.775085 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765150 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 21:33:19.775085 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765153 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 21:33:19.775085 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765156 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 21:33:19.775085 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765159 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 21:33:19.775085 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765162 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 21:33:19.775085 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765165 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 21:33:19.775085 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765167 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 21:33:19.775085 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765170 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 21:33:19.775085 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765172 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 21:33:19.775085 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765175 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 21:33:19.775085 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765177 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 21:33:19.775085 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765180 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 21:33:19.775085 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765182 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 21:33:19.775085 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765185 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 21:33:19.775085 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765187 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 21:33:19.775660 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765189 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 21:33:19.775660 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765192 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 21:33:19.775660 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765194 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 21:33:19.775660 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765197 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 21:33:19.775660 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765201 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 21:33:19.775660 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765203 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 21:33:19.775660 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765206 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 21:33:19.775660 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765223 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 14 21:33:19.775660 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765226 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 21:33:19.775660 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765229 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 21:33:19.775660 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765231 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 21:33:19.775660 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765234 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 21:33:19.775660 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765236 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 21:33:19.775660 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765238 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 21:33:19.775660 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765241 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 21:33:19.775660 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765245 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 21:33:19.775660 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765247 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 21:33:19.775660 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765250 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 21:33:19.775660 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765253 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 21:33:19.775660 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765256 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 21:33:19.776127 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.765259 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 21:33:19.776127 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.765774 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 21:33:19.776127 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.772011 2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 14 21:33:19.776127 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.772100 2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 14 21:33:19.776127 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.772135 2563 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 14 21:33:19.776127 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.772144 2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 14 21:33:19.776127 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772205 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 21:33:19.776127 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772226 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 21:33:19.776127 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772230 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 21:33:19.776127 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772233 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 21:33:19.776127 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772236 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 21:33:19.776127 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772239 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 21:33:19.776127 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772242 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 21:33:19.776127 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772244 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 21:33:19.776127 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772247 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 21:33:19.776652 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772250 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 21:33:19.776652 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772252 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 21:33:19.776652 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772255 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 21:33:19.776652 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772257 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 21:33:19.776652 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772260 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 21:33:19.776652 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772263 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 21:33:19.776652 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772265 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 21:33:19.776652 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772268 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 21:33:19.776652 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772270 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 21:33:19.776652 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772272 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 21:33:19.776652 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772275 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 21:33:19.776652 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772277 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 21:33:19.776652 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772281 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 21:33:19.776652 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772285 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 21:33:19.776652 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772288 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 21:33:19.776652 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772290 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 21:33:19.776652 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772293 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 21:33:19.776652 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772295 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 21:33:19.776652 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772298 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 21:33:19.776652 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772300 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 21:33:19.777138 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772309 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 21:33:19.777138 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772312 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 21:33:19.777138 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772315 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 21:33:19.777138 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772317 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 21:33:19.777138 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772320 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 21:33:19.777138 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772323 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 21:33:19.777138 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772325 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 21:33:19.777138 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772328 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 21:33:19.777138 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772330 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 21:33:19.777138 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772333 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 21:33:19.777138 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772335 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 21:33:19.777138 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772337 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 21:33:19.777138 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772340 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 21:33:19.777138 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772342 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 14 21:33:19.777138 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772345 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 21:33:19.777138 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772347 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 21:33:19.777138 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772350 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 21:33:19.777138 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772352 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 21:33:19.777138 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772355 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 21:33:19.777138 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772357 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 21:33:19.777911 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772359 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 21:33:19.777911 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772362 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 21:33:19.777911 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772364 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 21:33:19.777911 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772367 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 21:33:19.777911 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772369 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 21:33:19.777911 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772372 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 21:33:19.777911 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772375 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 21:33:19.777911 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772377 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 21:33:19.777911 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772379 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 21:33:19.777911 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772382 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 21:33:19.777911 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772384 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 21:33:19.777911 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772387 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 21:33:19.777911 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772390 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 21:33:19.777911 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772399 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 21:33:19.777911 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772402 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 21:33:19.777911 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772404 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 21:33:19.777911 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772407 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 21:33:19.777911 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772409 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 21:33:19.777911 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772411 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 21:33:19.777911 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772414 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 21:33:19.778760 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772417 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 21:33:19.778760 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772421 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 21:33:19.778760 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772424 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 21:33:19.778760 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772427 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 21:33:19.778760 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772430 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 21:33:19.778760 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772432 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 21:33:19.778760 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772435 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 21:33:19.778760 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772437 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 21:33:19.778760 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772440 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 21:33:19.778760 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772442 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 21:33:19.778760 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772445 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 21:33:19.778760 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772447 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 21:33:19.778760 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772450 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 21:33:19.778760 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772454 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 21:33:19.778760 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772458 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 21:33:19.778760 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772468 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 21:33:19.778760 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772470 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 21:33:19.778760 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772474 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 21:33:19.778760 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772484 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 21:33:19.779233 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772488 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 21:33:19.779233 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772491 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 21:33:19.779233 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772494 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 21:33:19.779233 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772497 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 21:33:19.779233 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772499 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 21:33:19.779233 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772503 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 21:33:19.779233 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772506 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 21:33:19.779233 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772515 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 21:33:19.779233 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772517 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 21:33:19.779233 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772520 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 21:33:19.779233 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772522 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 21:33:19.779233 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.772528 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 21:33:19.779233 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772664 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 21:33:19.779233 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772669 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 21:33:19.779233 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772672 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 21:33:19.779794 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772675 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 21:33:19.779794 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772677 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 21:33:19.779794 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772680 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 21:33:19.779794 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772683 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 21:33:19.779794 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772685 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 21:33:19.779794 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772687 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 21:33:19.779794 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772690 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 21:33:19.779794 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772692 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 21:33:19.779794 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772694 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 21:33:19.779794 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772697 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 21:33:19.779794 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772699 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 21:33:19.779794 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772701 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 21:33:19.779794 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772704 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 21:33:19.779794 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772706 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 21:33:19.779794 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772708 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 21:33:19.779794 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772711 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 21:33:19.779794 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772713 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 21:33:19.779794 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772715 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 14 21:33:19.779794 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772719 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 21:33:19.779794 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772722 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 21:33:19.780317 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772725 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 21:33:19.780317 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772727 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 21:33:19.780317 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772730 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 21:33:19.780317 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772732 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 21:33:19.780317 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772735 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 21:33:19.780317 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772743 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 21:33:19.780317 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772746 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 21:33:19.780317 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772748 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 21:33:19.780317 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772751 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 21:33:19.780317 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772753 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 21:33:19.780317 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772756 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 21:33:19.780317 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772758 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 21:33:19.780317 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772760 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 21:33:19.780317 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772763 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 21:33:19.780317 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772766 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 21:33:19.780317 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772770 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 21:33:19.780317 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772773 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 21:33:19.780317 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772775 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 21:33:19.780317 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772778 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 21:33:19.780813 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772781 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 21:33:19.780813 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772783 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 21:33:19.780813 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772786 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 21:33:19.780813 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772788 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 21:33:19.780813 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772790 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 21:33:19.780813 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772793 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 21:33:19.780813 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772795 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 21:33:19.780813 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772798 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 21:33:19.780813 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772800 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 21:33:19.780813 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772802 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 21:33:19.780813 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772805 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 21:33:19.780813 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772807 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 21:33:19.780813 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772810 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 21:33:19.780813 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772812 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 21:33:19.780813 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772814 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 21:33:19.780813 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772817 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 21:33:19.780813 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772819 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 21:33:19.780813 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772822 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 21:33:19.780813 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772824 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 21:33:19.781466 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772832 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 21:33:19.781466 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772835 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 21:33:19.781466 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772837 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 21:33:19.781466 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772840 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 21:33:19.781466 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772843 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 21:33:19.781466 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772845 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 21:33:19.781466 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772847 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 21:33:19.781466 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772851 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 21:33:19.781466 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772854 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 21:33:19.781466 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772857 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 21:33:19.781466 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772859 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 21:33:19.781466 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772862 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 21:33:19.781466 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772864 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 21:33:19.781466 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772867 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 21:33:19.781466 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772869 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 21:33:19.781466 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772872 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 21:33:19.781466 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772874 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 21:33:19.781466 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772876 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 21:33:19.781466 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772879 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 21:33:19.781466 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772881 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 21:33:19.782161 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772883 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 21:33:19.782161 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772886 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 21:33:19.782161 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772903 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 21:33:19.782161 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772906 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 21:33:19.782161 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772909 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 21:33:19.782161 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772912 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 21:33:19.782161 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772915 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 21:33:19.782161 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772917 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 21:33:19.782161 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772920 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 21:33:19.782161 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772923 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 21:33:19.782161 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772925 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 21:33:19.782161 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772928 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 21:33:19.782161 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772930 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 21:33:19.782161 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772938 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 21:33:19.782161 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772941 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 21:33:19.782161 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772943 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 21:33:19.782161 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772946 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 21:33:19.782161 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:19.772948 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 21:33:19.782739 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.772953 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 21:33:19.782739 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.773072 2563 server.go:962] "Client rotation is on, will bootstrap in background" Jun 14 21:33:19.782739 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.775146 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 14 21:33:19.782739 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.776314 2563 server.go:1019] "Starting client certificate rotation" Jun 14 21:33:19.782739 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.776440 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 14 21:33:19.782739 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.776500 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 14 21:33:19.782739 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.778613 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 14 21:33:19.789918 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.789893 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 14 21:33:19.802953 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.802930 2563 log.go:25] "Validated CRI v1 runtime API" Jun 14 21:33:19.805718 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.805704 2563 log.go:25] "Validated CRI v1 image API" Jun 14 21:33:19.806618 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.806595 2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 14 21:33:19.809832 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.809815 2563 fs.go:135] Filesystem UUIDs: map[4c4f9353-e865-4338-9217-e6feecfe8b15:/dev/nvme0n1p3 58410ccb-80db-4ad0-902e-1d96809ccf56:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jun 14 21:33:19.809883 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.809833 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 14 21:33:19.813293 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.813278 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 14 21:33:19.814578 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.814476 2563 manager.go:216] Machine: {Timestamp:2026-06-14 21:33:19.814017262 +0000 UTC m=+0.278617998 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102196 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e102242c42909bd951674a0393338 SystemUUID:ec2e1022-42c4-2909-bd95-1674a0393338 BootID:079ebae5-6bac-4170-8e98-1eb80427594c Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:73:28:1e:0e:1d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:73:28:1e:0e:1d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9a:b5:66:84:72:88 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 14 21:33:19.814578 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.814573 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 14 21:33:19.814672 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.814661 2563 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 14 21:33:19.816261 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.816235 2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 14 21:33:19.816391 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.816265 2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-95.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 14 21:33:19.817339 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.817328 2563 topology_manager.go:138] "Creating topology manager with none policy" Jun 14 21:33:19.817377 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.817343 2563 container_manager_linux.go:309] "Creating device plugin manager" Jun 14 21:33:19.817377 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.817350 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 14 21:33:19.817963 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.817953 2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 14 21:33:19.819440 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.819430 2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 14 21:33:19.823463 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.823451 2563 state_mem.go:36] "Initialized new in-memory state store" Jun 14 21:33:19.823573 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.823563 2563 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 14 21:33:19.823604 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.823592 2563 kubelet.go:486] "Attempting to sync node with API server" Jun 14 21:33:19.823604 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.823602 2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 14 21:33:19.823653 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.823611 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 14 21:33:19.823653 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.823619 2563 kubelet.go:398] "Adding apiserver pod source" Jun 14 21:33:19.823653 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.823628 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 14 21:33:19.823976 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.823963 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 14 21:33:19.824030 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.823984 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 14 21:33:19.828831 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.826381 2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 14 21:33:19.828831 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.827842 2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 14 21:33:19.828831 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.827876 2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 14 21:33:19.828831 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.828019 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 14 21:33:19.828831 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.828032 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 14 21:33:19.828831 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.828038 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 14 21:33:19.828831 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.828043 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 14 21:33:19.828831 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.828051 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 14 21:33:19.828831 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.828056 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 14 21:33:19.828831 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.828472 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 14 21:33:19.828831 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.828556 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 14 21:33:19.828831 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.828566 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 14 21:33:19.828831 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.828573 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 14 21:33:19.828831 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.828618 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 14 21:33:19.828831 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.828628 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 14 21:33:19.829622 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.829609 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 14 21:33:19.829670 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.829626 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 14 21:33:19.832649 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.832634 2563 server.go:1268] "Started kubelet" Jun 14 21:33:19.835386 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.835133 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 14 21:33:19.835460 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.832729 2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 14 21:33:19.835460 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.835431 2563 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 14 21:33:19.835760 ip-10-0-142-95 systemd[1]: Started Kubernetes Kubelet. Jun 14 21:33:19.836483 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.835986 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-m2kgw" Jun 14 21:33:19.837583 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.837231 2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 14 21:33:19.838100 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.838080 2563 server.go:310] "Adding debug handlers to kubelet server" Jun 14 21:33:19.840765 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:19.840738 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-95.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 14 21:33:19.840863 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:19.840738 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 14 21:33:19.840863 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.840752 2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-95.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 14 21:33:19.841442 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:19.840689 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-95.ec2.internal.18b91012a30b12a9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-95.ec2.internal,UID:ip-10-0-142-95.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-95.ec2.internal,},FirstTimestamp:2026-06-14 21:33:19.832609449 +0000 UTC m=+0.297210187,LastTimestamp:2026-06-14 21:33:19.832609449 +0000 UTC m=+0.297210187,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-95.ec2.internal,}" Jun 14 21:33:19.841540 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.841524 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-m2kgw" Jun 14 21:33:19.843647 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:19.843628 2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 14 21:33:19.844997 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.844977 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 14 21:33:19.844997 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.844990 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 14 21:33:19.845171 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:19.845156 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-95.ec2.internal\" not found" Jun 14 21:33:19.845575 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.845555 2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 14 21:33:19.845702 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.845683 2563 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 14 21:33:19.845702 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.845703 2563 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 14 21:33:19.845884 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.845870 2563 factory.go:55] Registering systemd factory Jun 14 21:33:19.845930 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.845905 2563 factory.go:223] Registration of the systemd container factory successfully Jun 14 21:33:19.846127 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.846108 2563 reconstruct.go:97] "Volume reconstruction finished" Jun 14 21:33:19.846127 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.846127 2563 reconciler.go:29] "Reconciler: start to sync state" Jun 14 21:33:19.846287 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.846115 2563 factory.go:153] Registering CRI-O factory Jun 14 21:33:19.846287 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.846151 2563 factory.go:223] Registration of the crio container factory successfully Jun 14 21:33:19.846287 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.846196 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 14 21:33:19.846287 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.846240 2563 factory.go:103] Registering Raw factory Jun 14 21:33:19.846287 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.846255 2563 manager.go:1196] Started watching for new ooms in manager Jun 14 21:33:19.846674 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.846661 2563 manager.go:349] Starting recovery of all containers Jun 14 21:33:19.846750 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:19.846712 2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-95.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 14 21:33:19.847143 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:19.847106 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 14 21:33:19.856788 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.856774 2563 manager.go:354] Recovery completed Jun 14 21:33:19.861170 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.861157 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 21:33:19.863056 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.863043 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-95.ec2.internal" event="NodeHasSufficientMemory" Jun 14 21:33:19.863112 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.863069 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-95.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 21:33:19.863112 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.863079 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-95.ec2.internal" event="NodeHasSufficientPID" Jun 14 21:33:19.863597 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.863582 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 14 21:33:19.863664 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.863597 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 14 21:33:19.863664 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.863614 2563 state_mem.go:36] "Initialized new in-memory state store" Jun 14 21:33:19.863725 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.863596 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 21:33:19.864284 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.864269 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-95.ec2.internal" event="NodeHasSufficientMemory" Jun 14 21:33:19.864323 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.864298 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-95.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 21:33:19.864323 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.864310 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-95.ec2.internal" event="NodeHasSufficientPID" Jun 14 21:33:19.865687 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.865675 2563 policy_none.go:49] "None policy: Start" Jun 14 21:33:19.865726 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.865691 2563 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 14 21:33:19.865726 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.865702 2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 14 21:33:19.867649 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.867638 2563 policy_none.go:47] "Start" Jun 14 21:33:19.902755 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.902742 2563 manager.go:337] "Starting Device Plugin manager" Jun 14 21:33:19.929954 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:19.902789 2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 14 21:33:19.929954 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.902802 2563 server.go:87] "Starting device plugin registration server" Jun 14 21:33:19.929954 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.903031 2563 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 14 21:33:19.929954 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.903043 2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 14 21:33:19.929954 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.903165 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 14 21:33:19.929954 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.903280 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 14 21:33:19.929954 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.903291 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 14 21:33:19.929954 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:19.903947 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 14 21:33:19.929954 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:19.903999 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-95.ec2.internal\" not found" Jun 14 21:33:19.929954 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.914142 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 14 21:33:19.929954 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.915367 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 14 21:33:19.929954 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.915395 2563 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 14 21:33:19.929954 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.915413 2563 kubelet.go:2448] "Starting kubelet main sync loop" Jun 14 21:33:19.929954 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:19.915481 2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 14 21:33:19.929954 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:19.917370 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 21:33:20.003510 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:20.003484 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 21:33:20.004265 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:20.004249 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-95.ec2.internal" event="NodeHasSufficientMemory" Jun 14 21:33:20.004344 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:20.004278 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-95.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 21:33:20.004344 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:20.004289 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-95.ec2.internal" event="NodeHasSufficientPID" Jun 14 21:33:20.004344 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:20.004311 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-95.ec2.internal" Jun 14 21:33:20.011895 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:20.011881 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-95.ec2.internal" Jun 14 21:33:20.011947 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:20.011900 2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-95.ec2.internal\": node \"ip-10-0-142-95.ec2.internal\" not found" Jun 14 21:33:20.015774 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:20.015751 2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-95.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-95.ec2.internal"] Jun 14 21:33:20.015836 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:20.015802 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 21:33:20.017089 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:20.017072 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-95.ec2.internal" event="NodeHasSufficientMemory" Jun 14 21:33:20.017181 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:20.017099 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-95.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 21:33:20.017181 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:20.017108 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-95.ec2.internal" event="NodeHasSufficientPID" Jun 14 21:33:20.019309 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:20.019297 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 21:33:20.019432 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:20.019417 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-95.ec2.internal" Jun 14 21:33:20.019467 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:20.019448 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 21:33:20.019969 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:20.019952 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-95.ec2.internal" event="NodeHasSufficientMemory" Jun 14 21:33:20.019969 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:20.019971 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-95.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 21:33:20.020084 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:20.019979 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-95.ec2.internal" event="NodeHasSufficientPID" Jun 14 21:33:20.020084 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:20.020006 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-95.ec2.internal" event="NodeHasSufficientMemory" Jun 14 21:33:20.020084 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:20.020025 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-95.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 21:33:20.020084 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:20.020037 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-95.ec2.internal" event="NodeHasSufficientPID" Jun 14 21:33:20.022182 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:20.022161 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-95.ec2.internal" Jun 14 21:33:20.022247 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:20.022185 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 21:33:20.022808 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:20.022794 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-95.ec2.internal" event="NodeHasSufficientMemory" Jun 14 21:33:20.022869 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:20.022816 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-95.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 21:33:20.022869 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:20.022825 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-95.ec2.internal" event="NodeHasSufficientPID" Jun 14 21:33:20.026151 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:20.026135 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-95.ec2.internal\" not found" Jun 14 21:33:20.047038 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:20.047021 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f490b35b80d897116aecbebc7de818c1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-95.ec2.internal\" (UID: \"f490b35b80d897116aecbebc7de818c1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-95.ec2.internal" Jun 14 21:33:20.047102 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:20.047043 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f490b35b80d897116aecbebc7de818c1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-95.ec2.internal\" (UID: \"f490b35b80d897116aecbebc7de818c1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-95.ec2.internal" Jun 14 21:33:20.047102 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:20.047060 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3c99a3657720963dc97fd6269d6795a7-config\") pod \"kube-apiserver-proxy-ip-10-0-142-95.ec2.internal\" (UID: \"3c99a3657720963dc97fd6269d6795a7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-95.ec2.internal" Jun 14 21:33:20.049692 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:20.049679 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-95.ec2.internal\" not found" node="ip-10-0-142-95.ec2.internal" Jun 14 21:33:20.053907 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:20.053891 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-95.ec2.internal\" not found" node="ip-10-0-142-95.ec2.internal" Jun 14 21:33:20.126758 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:20.126741 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-95.ec2.internal\" not found" Jun 14 21:33:20.148075 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:20.148056 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f490b35b80d897116aecbebc7de818c1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-95.ec2.internal\" (UID: \"f490b35b80d897116aecbebc7de818c1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-95.ec2.internal" Jun 14 21:33:20.148124 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:20.148082 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f490b35b80d897116aecbebc7de818c1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-95.ec2.internal\" (UID: \"f490b35b80d897116aecbebc7de818c1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-95.ec2.internal" Jun 14 21:33:20.148124 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:20.148097 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3c99a3657720963dc97fd6269d6795a7-config\") pod \"kube-apiserver-proxy-ip-10-0-142-95.ec2.internal\" (UID: \"3c99a3657720963dc97fd6269d6795a7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-95.ec2.internal" Jun 14 21:33:20.148184 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:20.148146 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3c99a3657720963dc97fd6269d6795a7-config\") pod \"kube-apiserver-proxy-ip-10-0-142-95.ec2.internal\" (UID: \"3c99a3657720963dc97fd6269d6795a7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-95.ec2.internal" Jun 14 21:33:20.148184 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:20.148153 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f490b35b80d897116aecbebc7de818c1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-95.ec2.internal\" (UID: \"f490b35b80d897116aecbebc7de818c1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-95.ec2.internal" Jun 14 21:33:20.148184 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:20.148175 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f490b35b80d897116aecbebc7de818c1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-95.ec2.internal\" (UID: \"f490b35b80d897116aecbebc7de818c1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-95.ec2.internal" Jun 14 21:33:20.227224 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:20.227183 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-95.ec2.internal\" not found" Jun 14 21:33:20.327993 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:20.327978 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-95.ec2.internal\" not found" Jun 14 21:33:20.351328 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:20.351313 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-95.ec2.internal" Jun 14 21:33:20.357280 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:20.357262 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-95.ec2.internal" Jun 14 21:33:20.428704 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:20.428679 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-95.ec2.internal\" not found" Jun 14 21:33:20.529152 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:20.529121 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-95.ec2.internal\" not found" Jun 14 21:33:20.629671 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:20.629624 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-95.ec2.internal\" not found" Jun 14 21:33:20.730068 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:20.730048 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-95.ec2.internal\" not found" Jun 14 21:33:20.776495 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:20.776475 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 14 21:33:20.777182 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:20.776601 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 14 21:33:20.830922 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:20.830900 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-95.ec2.internal\" not found" Jun 14 21:33:20.847469 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:20.847442 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-13 21:28:19 +0000 UTC" deadline="2027-12-14 08:37:20.34250542 +0000 UTC" Jun 14 21:33:20.847469 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:20.847468 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13139h3m59.495040236s" Jun 14 21:33:20.862138 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:20.862118 2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 21:33:20.882138 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:20.882090 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c99a3657720963dc97fd6269d6795a7.slice/crio-0defb8e186baf6893ddb543d1db25ef041504e6c696b6e4b98f4236fa8a0dda3 WatchSource:0}: Error finding container 0defb8e186baf6893ddb543d1db25ef041504e6c696b6e4b98f4236fa8a0dda3: Status 404 returned error can't find the container with id 0defb8e186baf6893ddb543d1db25ef041504e6c696b6e4b98f4236fa8a0dda3 Jun 14 21:33:20.882827 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:20.882808 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf490b35b80d897116aecbebc7de818c1.slice/crio-35d18987607b8735a22ae5dd6351402c0b9f24290ce9460db3bf92392cc231a3 WatchSource:0}: Error finding container 35d18987607b8735a22ae5dd6351402c0b9f24290ce9460db3bf92392cc231a3: Status 404 returned error can't find the container with id 35d18987607b8735a22ae5dd6351402c0b9f24290ce9460db3bf92392cc231a3 Jun 14 21:33:20.887726 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:20.887699 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 21:33:20.919040 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:20.918864 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-95.ec2.internal" event={"ID":"f490b35b80d897116aecbebc7de818c1","Type":"ContainerStarted","Data":"35d18987607b8735a22ae5dd6351402c0b9f24290ce9460db3bf92392cc231a3"} Jun 14 21:33:20.919866 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:20.919847 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-95.ec2.internal" event={"ID":"3c99a3657720963dc97fd6269d6795a7","Type":"ContainerStarted","Data":"0defb8e186baf6893ddb543d1db25ef041504e6c696b6e4b98f4236fa8a0dda3"} Jun 14 21:33:20.945797 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:20.945781 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-95.ec2.internal" Jun 14 21:33:20.959266 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:20.959251 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 14 21:33:20.960734 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:20.960722 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-95.ec2.internal" Jun 14 21:33:20.969002 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:20.968982 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 14 21:33:21.066258 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.066232 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 21:33:21.127855 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.127836 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 21:33:21.670549 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.670519 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 21:33:21.825156 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.825125 2563 apiserver.go:52] "Watching apiserver" Jun 14 21:33:21.835007 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.834973 2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 14 21:33:21.835361 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.835340 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-142-95.ec2.internal","openshift-dns/node-resolver-l7htv","openshift-multus/multus-additional-cni-plugins-tnc2v","openshift-multus/multus-v8kl4","openshift-multus/network-metrics-daemon-g5wz8","openshift-ovn-kubernetes/ovnkube-node-bkzms","kube-system/global-pull-secret-syncer-snfcq","kube-system/konnectivity-agent-r69lf","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfd5l","openshift-cluster-node-tuning-operator/tuned-gc4zx","openshift-image-registry/node-ca-dsmrq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-95.ec2.internal","openshift-network-diagnostics/network-check-target-8dt84","openshift-network-operator/iptables-alerter-g9tbl"] Jun 14 21:33:21.837840 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.837814 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l7htv" Jun 14 21:33:21.840014 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.839989 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tnc2v" Jun 14 21:33:21.840653 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.840632 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 14 21:33:21.840752 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.840634 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5k8hj\"" Jun 14 21:33:21.840752 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.840632 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 14 21:33:21.842312 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.842294 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.842470 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.842455 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 14 21:33:21.842667 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.842651 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 14 21:33:21.842667 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.842662 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 14 21:33:21.842774 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.842713 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-jd8kw\"" Jun 14 21:33:21.842774 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.842666 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 14 21:33:21.842868 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.842808 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 14 21:33:21.844543 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.844525 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5wz8" Jun 14 21:33:21.844647 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:21.844596 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5wz8" podUID="ab5e49aa-95ae-4957-8dca-5642fc6e0336" Jun 14 21:33:21.844647 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.844627 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-k5k86\"" Jun 14 21:33:21.844969 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.844954 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 14 21:33:21.845790 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.845772 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 14 21:33:21.847831 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.847813 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.850083 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.850068 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-snfcq" Jun 14 21:33:21.850181 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:21.850122 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-snfcq" podUID="95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb" Jun 14 21:33:21.854632 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.854607 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 14 21:33:21.855171 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.855149 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 14 21:33:21.855267 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.855184 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vmhrf\"" Jun 14 21:33:21.855372 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.855353 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 14 21:33:21.855461 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.855444 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 14 21:33:21.855601 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.855584 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 14 21:33:21.855727 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.855711 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 14 21:33:21.855790 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.855774 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r69lf" Jun 14 21:33:21.856185 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.856159 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e564eb22-98d2-4710-91ec-e8cbc19a5885-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tnc2v\" (UID: \"e564eb22-98d2-4710-91ec-e8cbc19a5885\") " pod="openshift-multus/multus-additional-cni-plugins-tnc2v" Jun 14 21:33:21.856284 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.856224 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fab653ef-3379-4e6c-9efe-2a0994436f73-tmp-dir\") pod \"node-resolver-l7htv\" (UID: \"fab653ef-3379-4e6c-9efe-2a0994436f73\") " pod="openshift-dns/node-resolver-l7htv" Jun 14 21:33:21.856284 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.856261 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e564eb22-98d2-4710-91ec-e8cbc19a5885-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tnc2v\" (UID: \"e564eb22-98d2-4710-91ec-e8cbc19a5885\") " pod="openshift-multus/multus-additional-cni-plugins-tnc2v" Jun 14 21:33:21.856391 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.856291 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfd5l" Jun 14 21:33:21.856391 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.856306 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/49595b6e-3eb8-4a20-a992-2fcdf940fc28-hostroot\") pod \"multus-v8kl4\" (UID: \"49595b6e-3eb8-4a20-a992-2fcdf940fc28\") " pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.856391 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.856367 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49595b6e-3eb8-4a20-a992-2fcdf940fc28-etc-kubernetes\") pod \"multus-v8kl4\" (UID: \"49595b6e-3eb8-4a20-a992-2fcdf940fc28\") " pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.856537 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.856406 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-host-run-netns\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.856537 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.856451 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-run-systemd\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.856537 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.856522 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-log-socket\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.856688 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.856560 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-host-run-ovn-kubernetes\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.856688 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.856617 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6p9k\" (UniqueName: \"kubernetes.io/projected/e564eb22-98d2-4710-91ec-e8cbc19a5885-kube-api-access-p6p9k\") pod \"multus-additional-cni-plugins-tnc2v\" (UID: \"e564eb22-98d2-4710-91ec-e8cbc19a5885\") " pod="openshift-multus/multus-additional-cni-plugins-tnc2v" Jun 14 21:33:21.856688 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.856648 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e564eb22-98d2-4710-91ec-e8cbc19a5885-os-release\") pod \"multus-additional-cni-plugins-tnc2v\" (UID: \"e564eb22-98d2-4710-91ec-e8cbc19a5885\") " pod="openshift-multus/multus-additional-cni-plugins-tnc2v" Jun 14 21:33:21.856688 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.856675 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/49595b6e-3eb8-4a20-a992-2fcdf940fc28-host-var-lib-cni-multus\") pod \"multus-v8kl4\" (UID: \"49595b6e-3eb8-4a20-a992-2fcdf940fc28\") " pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.856870 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.856702 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/49595b6e-3eb8-4a20-a992-2fcdf940fc28-multus-daemon-config\") pod \"multus-v8kl4\" (UID: \"49595b6e-3eb8-4a20-a992-2fcdf940fc28\") " pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.856870 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.856751 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/49595b6e-3eb8-4a20-a992-2fcdf940fc28-host-run-multus-certs\") pod \"multus-v8kl4\" (UID: \"49595b6e-3eb8-4a20-a992-2fcdf940fc28\") " pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.856870 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.856774 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-etc-openvswitch\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.856870 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.856802 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.857055 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.856875 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/49595b6e-3eb8-4a20-a992-2fcdf940fc28-host-run-k8s-cni-cncf-io\") pod \"multus-v8kl4\" (UID: \"49595b6e-3eb8-4a20-a992-2fcdf940fc28\") " pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.857055 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.856947 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fab653ef-3379-4e6c-9efe-2a0994436f73-hosts-file\") pod \"node-resolver-l7htv\" (UID: \"fab653ef-3379-4e6c-9efe-2a0994436f73\") " pod="openshift-dns/node-resolver-l7htv" Jun 14 21:33:21.857055 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.856990 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/49595b6e-3eb8-4a20-a992-2fcdf940fc28-os-release\") pod \"multus-v8kl4\" (UID: \"49595b6e-3eb8-4a20-a992-2fcdf940fc28\") " pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.857055 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.857047 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/49595b6e-3eb8-4a20-a992-2fcdf940fc28-multus-socket-dir-parent\") pod \"multus-v8kl4\" (UID: \"49595b6e-3eb8-4a20-a992-2fcdf940fc28\") " pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.857251 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.857088 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab5e49aa-95ae-4957-8dca-5642fc6e0336-metrics-certs\") pod \"network-metrics-daemon-g5wz8\" (UID: \"ab5e49aa-95ae-4957-8dca-5642fc6e0336\") " pod="openshift-multus/network-metrics-daemon-g5wz8" Jun 14 21:33:21.857251 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.857128 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-run-openvswitch\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.857251 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.857156 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-node-log\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.857386 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.857305 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/49595b6e-3eb8-4a20-a992-2fcdf940fc28-cni-binary-copy\") pod \"multus-v8kl4\" (UID: \"49595b6e-3eb8-4a20-a992-2fcdf940fc28\") " pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.857386 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.857351 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-ovn-node-metrics-cert\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.857476 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.857391 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh4jm\" (UniqueName: \"kubernetes.io/projected/ab5e49aa-95ae-4957-8dca-5642fc6e0336-kube-api-access-jh4jm\") pod \"network-metrics-daemon-g5wz8\" (UID: \"ab5e49aa-95ae-4957-8dca-5642fc6e0336\") " pod="openshift-multus/network-metrics-daemon-g5wz8" Jun 14 21:33:21.857476 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.857459 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-var-lib-openvswitch\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.857576 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.857509 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-host-cni-netd\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.857576 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.857555 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-env-overrides\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.857677 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.857594 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-ovnkube-script-lib\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.857677 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.857643 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lz78h\" (UniqueName: \"kubernetes.io/projected/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-kube-api-access-lz78h\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.857772 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.857728 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/49595b6e-3eb8-4a20-a992-2fcdf940fc28-host-var-lib-cni-bin\") pod \"multus-v8kl4\" (UID: \"49595b6e-3eb8-4a20-a992-2fcdf940fc28\") " pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.857821 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.857767 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/49595b6e-3eb8-4a20-a992-2fcdf940fc28-multus-conf-dir\") pod \"multus-v8kl4\" (UID: \"49595b6e-3eb8-4a20-a992-2fcdf940fc28\") " pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.857821 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.857775 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gc4zx" Jun 14 21:33:21.857821 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.857803 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tb7nw\" (UniqueName: \"kubernetes.io/projected/49595b6e-3eb8-4a20-a992-2fcdf940fc28-kube-api-access-tb7nw\") pod \"multus-v8kl4\" (UID: \"49595b6e-3eb8-4a20-a992-2fcdf940fc28\") " pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.857970 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.857858 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-systemd-units\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.858781 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.858307 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-ovnkube-config\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.858781 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.858348 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e564eb22-98d2-4710-91ec-e8cbc19a5885-cnibin\") pod \"multus-additional-cni-plugins-tnc2v\" (UID: \"e564eb22-98d2-4710-91ec-e8cbc19a5885\") " pod="openshift-multus/multus-additional-cni-plugins-tnc2v" Jun 14 21:33:21.858781 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.858373 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/49595b6e-3eb8-4a20-a992-2fcdf940fc28-system-cni-dir\") pod \"multus-v8kl4\" (UID: \"49595b6e-3eb8-4a20-a992-2fcdf940fc28\") " pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.858781 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.858417 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/49595b6e-3eb8-4a20-a992-2fcdf940fc28-multus-cni-dir\") pod \"multus-v8kl4\" (UID: \"49595b6e-3eb8-4a20-a992-2fcdf940fc28\") " pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.858781 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.858440 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/49595b6e-3eb8-4a20-a992-2fcdf940fc28-cnibin\") pod \"multus-v8kl4\" (UID: \"49595b6e-3eb8-4a20-a992-2fcdf940fc28\") " pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.858781 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.858461 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-host-kubelet\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.858781 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.858483 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-host-slash\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.858781 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.858525 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-run-ovn\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.858781 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.858550 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-host-cni-bin\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.858781 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.858573 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/49595b6e-3eb8-4a20-a992-2fcdf940fc28-host-run-netns\") pod \"multus-v8kl4\" (UID: \"49595b6e-3eb8-4a20-a992-2fcdf940fc28\") " pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.858781 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.858598 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49595b6e-3eb8-4a20-a992-2fcdf940fc28-host-var-lib-kubelet\") pod \"multus-v8kl4\" (UID: \"49595b6e-3eb8-4a20-a992-2fcdf940fc28\") " pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.858781 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.858636 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lz44q\" (UniqueName: \"kubernetes.io/projected/fab653ef-3379-4e6c-9efe-2a0994436f73-kube-api-access-lz44q\") pod \"node-resolver-l7htv\" (UID: \"fab653ef-3379-4e6c-9efe-2a0994436f73\") " pod="openshift-dns/node-resolver-l7htv" Jun 14 21:33:21.858781 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.858672 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e564eb22-98d2-4710-91ec-e8cbc19a5885-system-cni-dir\") pod \"multus-additional-cni-plugins-tnc2v\" (UID: \"e564eb22-98d2-4710-91ec-e8cbc19a5885\") " pod="openshift-multus/multus-additional-cni-plugins-tnc2v" Jun 14 21:33:21.858781 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.858705 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e564eb22-98d2-4710-91ec-e8cbc19a5885-cni-binary-copy\") pod \"multus-additional-cni-plugins-tnc2v\" (UID: \"e564eb22-98d2-4710-91ec-e8cbc19a5885\") " pod="openshift-multus/multus-additional-cni-plugins-tnc2v" Jun 14 21:33:21.858781 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.858760 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e564eb22-98d2-4710-91ec-e8cbc19a5885-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tnc2v\" (UID: \"e564eb22-98d2-4710-91ec-e8cbc19a5885\") " pod="openshift-multus/multus-additional-cni-plugins-tnc2v" Jun 14 21:33:21.859387 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.859064 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-27w7q\"" Jun 14 21:33:21.859387 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.859279 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 14 21:33:21.859471 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.859460 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 14 21:33:21.859784 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.859636 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 14 21:33:21.859784 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.859652 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 14 21:33:21.859784 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.859675 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wl77n\"" Jun 14 21:33:21.859784 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.859677 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 14 21:33:21.860562 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.860395 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 14 21:33:21.860651 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.860608 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 14 21:33:21.860651 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.860634 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-s8wjv\"" Jun 14 21:33:21.860973 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.860954 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dsmrq" Jun 14 21:33:21.862133 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.862110 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 14 21:33:21.864102 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.864080 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 14 21:33:21.864314 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.864300 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 14 21:33:21.864394 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.864312 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 14 21:33:21.864484 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.864458 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dt84" Jun 14 21:33:21.864592 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.864529 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9xm85\"" Jun 14 21:33:21.864592 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:21.864573 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dt84" podUID="60997d9b-5a4e-4d38-8337-21cb8c551d0e" Jun 14 21:33:21.865826 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.865805 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-g9tbl" Jun 14 21:33:21.868338 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.868303 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 14 21:33:21.868338 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.868321 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 14 21:33:21.868478 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.868310 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jpfmw\"" Jun 14 21:33:21.868478 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.868305 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 14 21:33:21.886231 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.886197 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cwzjw" Jun 14 21:33:21.895374 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.895358 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cwzjw" Jun 14 21:33:21.947389 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.947334 2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 14 21:33:21.959129 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.959110 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-var-lib-openvswitch\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.959311 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.959140 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-ovnkube-script-lib\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.959311 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.959164 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz78h\" (UniqueName: \"kubernetes.io/projected/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-kube-api-access-lz78h\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.959311 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.959205 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2cd4f68b-6453-4fa4-a522-77a515ee960f-sys\") pod \"tuned-gc4zx\" (UID: \"2cd4f68b-6453-4fa4-a522-77a515ee960f\") " pod="openshift-cluster-node-tuning-operator/tuned-gc4zx" Jun 14 21:33:21.959311 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.959245 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-var-lib-openvswitch\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.959460 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.959367 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2cd4f68b-6453-4fa4-a522-77a515ee960f-etc-tuned\") pod \"tuned-gc4zx\" (UID: \"2cd4f68b-6453-4fa4-a522-77a515ee960f\") " pod="openshift-cluster-node-tuning-operator/tuned-gc4zx" Jun 14 21:33:21.959460 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.959409 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/49595b6e-3eb8-4a20-a992-2fcdf940fc28-multus-conf-dir\") pod \"multus-v8kl4\" (UID: \"49595b6e-3eb8-4a20-a992-2fcdf940fc28\") " pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.959460 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.959428 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tb7nw\" (UniqueName: \"kubernetes.io/projected/49595b6e-3eb8-4a20-a992-2fcdf940fc28-kube-api-access-tb7nw\") pod \"multus-v8kl4\" (UID: \"49595b6e-3eb8-4a20-a992-2fcdf940fc28\") " pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.959460 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.959443 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-systemd-units\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.959665 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.959460 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2cd4f68b-6453-4fa4-a522-77a515ee960f-run\") pod \"tuned-gc4zx\" (UID: \"2cd4f68b-6453-4fa4-a522-77a515ee960f\") " pod="openshift-cluster-node-tuning-operator/tuned-gc4zx" Jun 14 21:33:21.959665 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.959482 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d9d9b760-032d-43e3-b5a5-f834f5060412-sys-fs\") pod \"aws-ebs-csi-driver-node-rfd5l\" (UID: \"d9d9b760-032d-43e3-b5a5-f834f5060412\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfd5l" Jun 14 21:33:21.959665 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.959549 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/49595b6e-3eb8-4a20-a992-2fcdf940fc28-multus-conf-dir\") pod \"multus-v8kl4\" (UID: \"49595b6e-3eb8-4a20-a992-2fcdf940fc28\") " pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.959665 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.959612 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e564eb22-98d2-4710-91ec-e8cbc19a5885-cnibin\") pod \"multus-additional-cni-plugins-tnc2v\" (UID: \"e564eb22-98d2-4710-91ec-e8cbc19a5885\") " pod="openshift-multus/multus-additional-cni-plugins-tnc2v" Jun 14 21:33:21.959665 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.959647 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-systemd-units\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.959902 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.959705 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/49595b6e-3eb8-4a20-a992-2fcdf940fc28-system-cni-dir\") pod \"multus-v8kl4\" (UID: \"49595b6e-3eb8-4a20-a992-2fcdf940fc28\") " pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.959902 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.959712 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e564eb22-98d2-4710-91ec-e8cbc19a5885-cnibin\") pod \"multus-additional-cni-plugins-tnc2v\" (UID: \"e564eb22-98d2-4710-91ec-e8cbc19a5885\") " pod="openshift-multus/multus-additional-cni-plugins-tnc2v" Jun 14 21:33:21.959902 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.959783 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/49595b6e-3eb8-4a20-a992-2fcdf940fc28-system-cni-dir\") pod \"multus-v8kl4\" (UID: \"49595b6e-3eb8-4a20-a992-2fcdf940fc28\") " pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.959902 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.959807 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/49595b6e-3eb8-4a20-a992-2fcdf940fc28-cnibin\") pod \"multus-v8kl4\" (UID: \"49595b6e-3eb8-4a20-a992-2fcdf940fc28\") " pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.960057 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.959917 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-run-ovn\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.960305 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.960169 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-ovnkube-script-lib\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.960388 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.959827 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-run-ovn\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.960448 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.960382 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cd4f68b-6453-4fa4-a522-77a515ee960f-var-lib-kubelet\") pod \"tuned-gc4zx\" (UID: \"2cd4f68b-6453-4fa4-a522-77a515ee960f\") " pod="openshift-cluster-node-tuning-operator/tuned-gc4zx" Jun 14 21:33:21.960448 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.960418 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/82ba6948-a910-4e5e-8783-3c981623181c-agent-certs\") pod \"konnectivity-agent-r69lf\" (UID: \"82ba6948-a910-4e5e-8783-3c981623181c\") " pod="kube-system/konnectivity-agent-r69lf" Jun 14 21:33:21.960448 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.960425 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/49595b6e-3eb8-4a20-a992-2fcdf940fc28-cnibin\") pod \"multus-v8kl4\" (UID: \"49595b6e-3eb8-4a20-a992-2fcdf940fc28\") " pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.960576 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.960456 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-host-run-netns\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.960576 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.960549 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-host-run-netns\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.965263 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.960740 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-log-socket\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.965263 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.960810 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-ovnkube-config\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.965263 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.960855 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb-original-pull-secret\") pod \"global-pull-secret-syncer-snfcq\" (UID: \"95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb\") " pod="kube-system/global-pull-secret-syncer-snfcq" Jun 14 21:33:21.965263 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.960890 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e564eb22-98d2-4710-91ec-e8cbc19a5885-system-cni-dir\") pod \"multus-additional-cni-plugins-tnc2v\" (UID: \"e564eb22-98d2-4710-91ec-e8cbc19a5885\") " pod="openshift-multus/multus-additional-cni-plugins-tnc2v" Jun 14 21:33:21.965263 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.960922 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e564eb22-98d2-4710-91ec-e8cbc19a5885-cni-binary-copy\") pod \"multus-additional-cni-plugins-tnc2v\" (UID: \"e564eb22-98d2-4710-91ec-e8cbc19a5885\") " pod="openshift-multus/multus-additional-cni-plugins-tnc2v" Jun 14 21:33:21.965263 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.960949 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2cd4f68b-6453-4fa4-a522-77a515ee960f-host\") pod \"tuned-gc4zx\" (UID: \"2cd4f68b-6453-4fa4-a522-77a515ee960f\") " pod="openshift-cluster-node-tuning-operator/tuned-gc4zx" Jun 14 21:33:21.965263 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.960993 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/49595b6e-3eb8-4a20-a992-2fcdf940fc28-hostroot\") pod \"multus-v8kl4\" (UID: \"49595b6e-3eb8-4a20-a992-2fcdf940fc28\") " pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.965263 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.961020 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49595b6e-3eb8-4a20-a992-2fcdf940fc28-etc-kubernetes\") pod \"multus-v8kl4\" (UID: \"49595b6e-3eb8-4a20-a992-2fcdf940fc28\") " pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.965263 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.961065 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-run-systemd\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.965263 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.961103 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-host-run-ovn-kubernetes\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.965263 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.961136 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb-kubelet-config\") pod \"global-pull-secret-syncer-snfcq\" (UID: \"95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb\") " pod="kube-system/global-pull-secret-syncer-snfcq" Jun 14 21:33:21.965263 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.961164 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2cd4f68b-6453-4fa4-a522-77a515ee960f-etc-systemd\") pod \"tuned-gc4zx\" (UID: \"2cd4f68b-6453-4fa4-a522-77a515ee960f\") " pod="openshift-cluster-node-tuning-operator/tuned-gc4zx" Jun 14 21:33:21.965263 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.961265 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6c41cf46-cb82-49f4-8d57-d6ac4df58684-serviceca\") pod \"node-ca-dsmrq\" (UID: \"6c41cf46-cb82-49f4-8d57-d6ac4df58684\") " pod="openshift-image-registry/node-ca-dsmrq" Jun 14 21:33:21.965263 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.961310 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/49595b6e-3eb8-4a20-a992-2fcdf940fc28-host-var-lib-cni-multus\") pod \"multus-v8kl4\" (UID: \"49595b6e-3eb8-4a20-a992-2fcdf940fc28\") " pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.965263 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.961395 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2cd4f68b-6453-4fa4-a522-77a515ee960f-etc-sysconfig\") pod \"tuned-gc4zx\" (UID: \"2cd4f68b-6453-4fa4-a522-77a515ee960f\") " pod="openshift-cluster-node-tuning-operator/tuned-gc4zx" Jun 14 21:33:21.965263 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.961506 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9769\" (UniqueName: \"kubernetes.io/projected/0605cbd9-4413-4172-bb98-5122e21fd9cc-kube-api-access-p9769\") pod \"iptables-alerter-g9tbl\" (UID: \"0605cbd9-4413-4172-bb98-5122e21fd9cc\") " pod="openshift-network-operator/iptables-alerter-g9tbl" Jun 14 21:33:21.965263 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.961590 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fab653ef-3379-4e6c-9efe-2a0994436f73-hosts-file\") pod \"node-resolver-l7htv\" (UID: \"fab653ef-3379-4e6c-9efe-2a0994436f73\") " pod="openshift-dns/node-resolver-l7htv" Jun 14 21:33:21.966098 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.961614 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab5e49aa-95ae-4957-8dca-5642fc6e0336-metrics-certs\") pod \"network-metrics-daemon-g5wz8\" (UID: \"ab5e49aa-95ae-4957-8dca-5642fc6e0336\") " pod="openshift-multus/network-metrics-daemon-g5wz8" Jun 14 21:33:21.966098 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.961657 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-run-openvswitch\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.966098 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.961684 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d9d9b760-032d-43e3-b5a5-f834f5060412-socket-dir\") pod \"aws-ebs-csi-driver-node-rfd5l\" (UID: \"d9d9b760-032d-43e3-b5a5-f834f5060412\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfd5l" Jun 14 21:33:21.966098 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.961727 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-ovn-node-metrics-cert\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.966098 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.961754 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d9d9b760-032d-43e3-b5a5-f834f5060412-device-dir\") pod \"aws-ebs-csi-driver-node-rfd5l\" (UID: \"d9d9b760-032d-43e3-b5a5-f834f5060412\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfd5l" Jun 14 21:33:21.966098 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.961776 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f4lt\" (UniqueName: \"kubernetes.io/projected/6c41cf46-cb82-49f4-8d57-d6ac4df58684-kube-api-access-9f4lt\") pod \"node-ca-dsmrq\" (UID: \"6c41cf46-cb82-49f4-8d57-d6ac4df58684\") " pod="openshift-image-registry/node-ca-dsmrq" Jun 14 21:33:21.966098 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.961922 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh4jm\" (UniqueName: \"kubernetes.io/projected/ab5e49aa-95ae-4957-8dca-5642fc6e0336-kube-api-access-jh4jm\") pod \"network-metrics-daemon-g5wz8\" (UID: \"ab5e49aa-95ae-4957-8dca-5642fc6e0336\") " pod="openshift-multus/network-metrics-daemon-g5wz8" Jun 14 21:33:21.966098 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.961952 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-host-cni-netd\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.966098 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.961986 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-env-overrides\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.966098 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.962027 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb-dbus\") pod \"global-pull-secret-syncer-snfcq\" (UID: \"95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb\") " pod="kube-system/global-pull-secret-syncer-snfcq" Jun 14 21:33:21.966098 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.962128 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2cd4f68b-6453-4fa4-a522-77a515ee960f-etc-kubernetes\") pod \"tuned-gc4zx\" (UID: \"2cd4f68b-6453-4fa4-a522-77a515ee960f\") " pod="openshift-cluster-node-tuning-operator/tuned-gc4zx" Jun 14 21:33:21.966098 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.962190 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/82ba6948-a910-4e5e-8783-3c981623181c-konnectivity-ca\") pod \"konnectivity-agent-r69lf\" (UID: \"82ba6948-a910-4e5e-8783-3c981623181c\") " pod="kube-system/konnectivity-agent-r69lf" Jun 14 21:33:21.966098 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.962237 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/49595b6e-3eb8-4a20-a992-2fcdf940fc28-host-var-lib-cni-bin\") pod \"multus-v8kl4\" (UID: \"49595b6e-3eb8-4a20-a992-2fcdf940fc28\") " pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.966098 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.962298 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2cd4f68b-6453-4fa4-a522-77a515ee960f-etc-sysctl-d\") pod \"tuned-gc4zx\" (UID: \"2cd4f68b-6453-4fa4-a522-77a515ee960f\") " pod="openshift-cluster-node-tuning-operator/tuned-gc4zx" Jun 14 21:33:21.966098 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.962323 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d9d9b760-032d-43e3-b5a5-f834f5060412-etc-selinux\") pod \"aws-ebs-csi-driver-node-rfd5l\" (UID: \"d9d9b760-032d-43e3-b5a5-f834f5060412\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfd5l" Jun 14 21:33:21.966098 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.962388 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6c41cf46-cb82-49f4-8d57-d6ac4df58684-host\") pod \"node-ca-dsmrq\" (UID: \"6c41cf46-cb82-49f4-8d57-d6ac4df58684\") " pod="openshift-image-registry/node-ca-dsmrq" Jun 14 21:33:21.966098 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.962441 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0605cbd9-4413-4172-bb98-5122e21fd9cc-iptables-alerter-script\") pod \"iptables-alerter-g9tbl\" (UID: \"0605cbd9-4413-4172-bb98-5122e21fd9cc\") " pod="openshift-network-operator/iptables-alerter-g9tbl" Jun 14 21:33:21.966749 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.962470 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0605cbd9-4413-4172-bb98-5122e21fd9cc-host-slash\") pod \"iptables-alerter-g9tbl\" (UID: \"0605cbd9-4413-4172-bb98-5122e21fd9cc\") " pod="openshift-network-operator/iptables-alerter-g9tbl" Jun 14 21:33:21.966749 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.962522 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/49595b6e-3eb8-4a20-a992-2fcdf940fc28-multus-cni-dir\") pod \"multus-v8kl4\" (UID: \"49595b6e-3eb8-4a20-a992-2fcdf940fc28\") " pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.966749 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.962566 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fab653ef-3379-4e6c-9efe-2a0994436f73-hosts-file\") pod \"node-resolver-l7htv\" (UID: \"fab653ef-3379-4e6c-9efe-2a0994436f73\") " pod="openshift-dns/node-resolver-l7htv" Jun 14 21:33:21.966749 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.962574 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-host-kubelet\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.966749 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.962624 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-host-slash\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.966749 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.962622 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-host-kubelet\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.966749 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.962660 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-host-cni-bin\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.966749 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.962694 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2cd4f68b-6453-4fa4-a522-77a515ee960f-etc-modprobe-d\") pod \"tuned-gc4zx\" (UID: \"2cd4f68b-6453-4fa4-a522-77a515ee960f\") " pod="openshift-cluster-node-tuning-operator/tuned-gc4zx" Jun 14 21:33:21.966749 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.962726 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2cd4f68b-6453-4fa4-a522-77a515ee960f-tmp\") pod \"tuned-gc4zx\" (UID: \"2cd4f68b-6453-4fa4-a522-77a515ee960f\") " pod="openshift-cluster-node-tuning-operator/tuned-gc4zx" Jun 14 21:33:21.966749 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:21.962731 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 21:33:21.966749 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.962760 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d9d9b760-032d-43e3-b5a5-f834f5060412-registration-dir\") pod \"aws-ebs-csi-driver-node-rfd5l\" (UID: \"d9d9b760-032d-43e3-b5a5-f834f5060412\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfd5l" Jun 14 21:33:21.966749 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.962793 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/49595b6e-3eb8-4a20-a992-2fcdf940fc28-host-run-netns\") pod \"multus-v8kl4\" (UID: \"49595b6e-3eb8-4a20-a992-2fcdf940fc28\") " pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.966749 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:21.962814 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab5e49aa-95ae-4957-8dca-5642fc6e0336-metrics-certs podName:ab5e49aa-95ae-4957-8dca-5642fc6e0336 nodeName:}" failed. No retries permitted until 2026-06-14 21:33:22.462794927 +0000 UTC m=+2.927395669 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab5e49aa-95ae-4957-8dca-5642fc6e0336-metrics-certs") pod "network-metrics-daemon-g5wz8" (UID: "ab5e49aa-95ae-4957-8dca-5642fc6e0336") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 21:33:21.966749 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.962838 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/49595b6e-3eb8-4a20-a992-2fcdf940fc28-host-run-netns\") pod \"multus-v8kl4\" (UID: \"49595b6e-3eb8-4a20-a992-2fcdf940fc28\") " pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.966749 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.962850 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49595b6e-3eb8-4a20-a992-2fcdf940fc28-host-var-lib-kubelet\") pod \"multus-v8kl4\" (UID: \"49595b6e-3eb8-4a20-a992-2fcdf940fc28\") " pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.966749 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.962888 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-log-socket\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.966749 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.962902 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz44q\" (UniqueName: \"kubernetes.io/projected/fab653ef-3379-4e6c-9efe-2a0994436f73-kube-api-access-lz44q\") pod \"node-resolver-l7htv\" (UID: \"fab653ef-3379-4e6c-9efe-2a0994436f73\") " pod="openshift-dns/node-resolver-l7htv" Jun 14 21:33:21.967293 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.962934 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e564eb22-98d2-4710-91ec-e8cbc19a5885-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tnc2v\" (UID: \"e564eb22-98d2-4710-91ec-e8cbc19a5885\") " pod="openshift-multus/multus-additional-cni-plugins-tnc2v" Jun 14 21:33:21.967293 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.962978 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e564eb22-98d2-4710-91ec-e8cbc19a5885-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tnc2v\" (UID: \"e564eb22-98d2-4710-91ec-e8cbc19a5885\") " pod="openshift-multus/multus-additional-cni-plugins-tnc2v" Jun 14 21:33:21.967293 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.963003 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fab653ef-3379-4e6c-9efe-2a0994436f73-tmp-dir\") pod \"node-resolver-l7htv\" (UID: \"fab653ef-3379-4e6c-9efe-2a0994436f73\") " pod="openshift-dns/node-resolver-l7htv" Jun 14 21:33:21.967293 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.963033 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e564eb22-98d2-4710-91ec-e8cbc19a5885-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tnc2v\" (UID: \"e564eb22-98d2-4710-91ec-e8cbc19a5885\") " pod="openshift-multus/multus-additional-cni-plugins-tnc2v" Jun 14 21:33:21.967293 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.963067 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.967293 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.963101 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2x8n\" (UniqueName: \"kubernetes.io/projected/2cd4f68b-6453-4fa4-a522-77a515ee960f-kube-api-access-q2x8n\") pod \"tuned-gc4zx\" (UID: \"2cd4f68b-6453-4fa4-a522-77a515ee960f\") " pod="openshift-cluster-node-tuning-operator/tuned-gc4zx" Jun 14 21:33:21.967293 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.963227 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4s9c\" (UniqueName: \"kubernetes.io/projected/60997d9b-5a4e-4d38-8337-21cb8c551d0e-kube-api-access-h4s9c\") pod \"network-check-target-8dt84\" (UID: \"60997d9b-5a4e-4d38-8337-21cb8c551d0e\") " pod="openshift-network-diagnostics/network-check-target-8dt84" Jun 14 21:33:21.967293 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.963255 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d9d9b760-032d-43e3-b5a5-f834f5060412-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rfd5l\" (UID: \"d9d9b760-032d-43e3-b5a5-f834f5060412\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfd5l" Jun 14 21:33:21.967293 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.963283 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjtv4\" (UniqueName: \"kubernetes.io/projected/d9d9b760-032d-43e3-b5a5-f834f5060412-kube-api-access-cjtv4\") pod \"aws-ebs-csi-driver-node-rfd5l\" (UID: \"d9d9b760-032d-43e3-b5a5-f834f5060412\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfd5l" Jun 14 21:33:21.967293 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.963315 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6p9k\" (UniqueName: \"kubernetes.io/projected/e564eb22-98d2-4710-91ec-e8cbc19a5885-kube-api-access-p6p9k\") pod \"multus-additional-cni-plugins-tnc2v\" (UID: \"e564eb22-98d2-4710-91ec-e8cbc19a5885\") " pod="openshift-multus/multus-additional-cni-plugins-tnc2v" Jun 14 21:33:21.967293 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.963386 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-ovnkube-config\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.967293 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.963391 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e564eb22-98d2-4710-91ec-e8cbc19a5885-os-release\") pod \"multus-additional-cni-plugins-tnc2v\" (UID: \"e564eb22-98d2-4710-91ec-e8cbc19a5885\") " pod="openshift-multus/multus-additional-cni-plugins-tnc2v" Jun 14 21:33:21.967293 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.963491 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e564eb22-98d2-4710-91ec-e8cbc19a5885-system-cni-dir\") pod \"multus-additional-cni-plugins-tnc2v\" (UID: \"e564eb22-98d2-4710-91ec-e8cbc19a5885\") " pod="openshift-multus/multus-additional-cni-plugins-tnc2v" Jun 14 21:33:21.967293 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.963578 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/49595b6e-3eb8-4a20-a992-2fcdf940fc28-multus-daemon-config\") pod \"multus-v8kl4\" (UID: \"49595b6e-3eb8-4a20-a992-2fcdf940fc28\") " pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.967293 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.963624 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/49595b6e-3eb8-4a20-a992-2fcdf940fc28-host-run-multus-certs\") pod \"multus-v8kl4\" (UID: \"49595b6e-3eb8-4a20-a992-2fcdf940fc28\") " pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.967293 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.963738 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-run-systemd\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.967985 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.963770 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-host-run-ovn-kubernetes\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.967985 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.963823 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/49595b6e-3eb8-4a20-a992-2fcdf940fc28-hostroot\") pod \"multus-v8kl4\" (UID: \"49595b6e-3eb8-4a20-a992-2fcdf940fc28\") " pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.967985 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.963862 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-host-slash\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.967985 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.963911 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/49595b6e-3eb8-4a20-a992-2fcdf940fc28-host-var-lib-cni-multus\") pod \"multus-v8kl4\" (UID: \"49595b6e-3eb8-4a20-a992-2fcdf940fc28\") " pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.967985 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.963931 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49595b6e-3eb8-4a20-a992-2fcdf940fc28-etc-kubernetes\") pod \"multus-v8kl4\" (UID: \"49595b6e-3eb8-4a20-a992-2fcdf940fc28\") " pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.967985 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.963989 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49595b6e-3eb8-4a20-a992-2fcdf940fc28-host-var-lib-kubelet\") pod \"multus-v8kl4\" (UID: \"49595b6e-3eb8-4a20-a992-2fcdf940fc28\") " pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.967985 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.964153 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-run-openvswitch\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.967985 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.964327 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 14 21:33:21.967985 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.964336 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-etc-openvswitch\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.967985 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.964359 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-host-cni-bin\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.967985 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.963672 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-etc-openvswitch\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.967985 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.964377 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/49595b6e-3eb8-4a20-a992-2fcdf940fc28-host-var-lib-cni-bin\") pod \"multus-v8kl4\" (UID: \"49595b6e-3eb8-4a20-a992-2fcdf940fc28\") " pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.967985 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.964418 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2cd4f68b-6453-4fa4-a522-77a515ee960f-etc-sysctl-conf\") pod \"tuned-gc4zx\" (UID: \"2cd4f68b-6453-4fa4-a522-77a515ee960f\") " pod="openshift-cluster-node-tuning-operator/tuned-gc4zx" Jun 14 21:33:21.967985 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.964455 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e564eb22-98d2-4710-91ec-e8cbc19a5885-cni-binary-copy\") pod \"multus-additional-cni-plugins-tnc2v\" (UID: \"e564eb22-98d2-4710-91ec-e8cbc19a5885\") " pod="openshift-multus/multus-additional-cni-plugins-tnc2v" Jun 14 21:33:21.967985 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.964557 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/49595b6e-3eb8-4a20-a992-2fcdf940fc28-host-run-k8s-cni-cncf-io\") pod \"multus-v8kl4\" (UID: \"49595b6e-3eb8-4a20-a992-2fcdf940fc28\") " pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.967985 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.964641 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/49595b6e-3eb8-4a20-a992-2fcdf940fc28-os-release\") pod \"multus-v8kl4\" (UID: \"49595b6e-3eb8-4a20-a992-2fcdf940fc28\") " pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.967985 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.964669 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fab653ef-3379-4e6c-9efe-2a0994436f73-tmp-dir\") pod \"node-resolver-l7htv\" (UID: \"fab653ef-3379-4e6c-9efe-2a0994436f73\") " pod="openshift-dns/node-resolver-l7htv" Jun 14 21:33:21.967985 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.964676 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/49595b6e-3eb8-4a20-a992-2fcdf940fc28-multus-socket-dir-parent\") pod \"multus-v8kl4\" (UID: \"49595b6e-3eb8-4a20-a992-2fcdf940fc28\") " pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.968679 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.964688 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e564eb22-98d2-4710-91ec-e8cbc19a5885-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tnc2v\" (UID: \"e564eb22-98d2-4710-91ec-e8cbc19a5885\") " pod="openshift-multus/multus-additional-cni-plugins-tnc2v" Jun 14 21:33:21.968679 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.964774 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.968679 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.964776 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-host-cni-netd\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.968679 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.964842 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-node-log\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.968679 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.964853 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/49595b6e-3eb8-4a20-a992-2fcdf940fc28-host-run-multus-certs\") pod \"multus-v8kl4\" (UID: \"49595b6e-3eb8-4a20-a992-2fcdf940fc28\") " pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.968679 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.964893 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e564eb22-98d2-4710-91ec-e8cbc19a5885-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tnc2v\" (UID: \"e564eb22-98d2-4710-91ec-e8cbc19a5885\") " pod="openshift-multus/multus-additional-cni-plugins-tnc2v" Jun 14 21:33:21.968679 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.964935 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/49595b6e-3eb8-4a20-a992-2fcdf940fc28-multus-socket-dir-parent\") pod \"multus-v8kl4\" (UID: \"49595b6e-3eb8-4a20-a992-2fcdf940fc28\") " pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.968679 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.964946 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/49595b6e-3eb8-4a20-a992-2fcdf940fc28-multus-cni-dir\") pod \"multus-v8kl4\" (UID: \"49595b6e-3eb8-4a20-a992-2fcdf940fc28\") " pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.968679 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.965004 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/49595b6e-3eb8-4a20-a992-2fcdf940fc28-cni-binary-copy\") pod \"multus-v8kl4\" (UID: \"49595b6e-3eb8-4a20-a992-2fcdf940fc28\") " pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.968679 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.965045 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/49595b6e-3eb8-4a20-a992-2fcdf940fc28-host-run-k8s-cni-cncf-io\") pod \"multus-v8kl4\" (UID: \"49595b6e-3eb8-4a20-a992-2fcdf940fc28\") " pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.968679 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.965084 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2cd4f68b-6453-4fa4-a522-77a515ee960f-lib-modules\") pod \"tuned-gc4zx\" (UID: \"2cd4f68b-6453-4fa4-a522-77a515ee960f\") " pod="openshift-cluster-node-tuning-operator/tuned-gc4zx" Jun 14 21:33:21.968679 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.965507 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-env-overrides\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.968679 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.965577 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-node-log\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.968679 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.965582 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e564eb22-98d2-4710-91ec-e8cbc19a5885-os-release\") pod \"multus-additional-cni-plugins-tnc2v\" (UID: \"e564eb22-98d2-4710-91ec-e8cbc19a5885\") " pod="openshift-multus/multus-additional-cni-plugins-tnc2v" Jun 14 21:33:21.968679 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.965673 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/49595b6e-3eb8-4a20-a992-2fcdf940fc28-os-release\") pod \"multus-v8kl4\" (UID: \"49595b6e-3eb8-4a20-a992-2fcdf940fc28\") " pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.968679 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.965740 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/49595b6e-3eb8-4a20-a992-2fcdf940fc28-cni-binary-copy\") pod \"multus-v8kl4\" (UID: \"49595b6e-3eb8-4a20-a992-2fcdf940fc28\") " pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.968679 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.965999 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/49595b6e-3eb8-4a20-a992-2fcdf940fc28-multus-daemon-config\") pod \"multus-v8kl4\" (UID: \"49595b6e-3eb8-4a20-a992-2fcdf940fc28\") " pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.969127 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.966253 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e564eb22-98d2-4710-91ec-e8cbc19a5885-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tnc2v\" (UID: \"e564eb22-98d2-4710-91ec-e8cbc19a5885\") " pod="openshift-multus/multus-additional-cni-plugins-tnc2v" Jun 14 21:33:21.969127 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.967788 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-ovn-node-metrics-cert\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.969127 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.968276 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lz78h\" (UniqueName: \"kubernetes.io/projected/f03840e6-bb9f-46f3-ba9a-ab2a98d744fa-kube-api-access-lz78h\") pod \"ovnkube-node-bkzms\" (UID: \"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:21.969573 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.969557 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tb7nw\" (UniqueName: \"kubernetes.io/projected/49595b6e-3eb8-4a20-a992-2fcdf940fc28-kube-api-access-tb7nw\") pod \"multus-v8kl4\" (UID: \"49595b6e-3eb8-4a20-a992-2fcdf940fc28\") " pod="openshift-multus/multus-v8kl4" Jun 14 21:33:21.975603 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.975584 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lz44q\" (UniqueName: \"kubernetes.io/projected/fab653ef-3379-4e6c-9efe-2a0994436f73-kube-api-access-lz44q\") pod \"node-resolver-l7htv\" (UID: \"fab653ef-3379-4e6c-9efe-2a0994436f73\") " pod="openshift-dns/node-resolver-l7htv" Jun 14 21:33:21.975719 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.975699 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh4jm\" (UniqueName: \"kubernetes.io/projected/ab5e49aa-95ae-4957-8dca-5642fc6e0336-kube-api-access-jh4jm\") pod \"network-metrics-daemon-g5wz8\" (UID: \"ab5e49aa-95ae-4957-8dca-5642fc6e0336\") " pod="openshift-multus/network-metrics-daemon-g5wz8" Jun 14 21:33:21.975777 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:21.975748 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6p9k\" (UniqueName: \"kubernetes.io/projected/e564eb22-98d2-4710-91ec-e8cbc19a5885-kube-api-access-p6p9k\") pod \"multus-additional-cni-plugins-tnc2v\" (UID: \"e564eb22-98d2-4710-91ec-e8cbc19a5885\") " pod="openshift-multus/multus-additional-cni-plugins-tnc2v" Jun 14 21:33:22.065471 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.065431 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2cd4f68b-6453-4fa4-a522-77a515ee960f-lib-modules\") pod \"tuned-gc4zx\" (UID: \"2cd4f68b-6453-4fa4-a522-77a515ee960f\") " pod="openshift-cluster-node-tuning-operator/tuned-gc4zx" Jun 14 21:33:22.065647 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.065510 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2cd4f68b-6453-4fa4-a522-77a515ee960f-sys\") pod \"tuned-gc4zx\" (UID: \"2cd4f68b-6453-4fa4-a522-77a515ee960f\") " pod="openshift-cluster-node-tuning-operator/tuned-gc4zx" Jun 14 21:33:22.065647 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.065536 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2cd4f68b-6453-4fa4-a522-77a515ee960f-etc-tuned\") pod \"tuned-gc4zx\" (UID: \"2cd4f68b-6453-4fa4-a522-77a515ee960f\") " pod="openshift-cluster-node-tuning-operator/tuned-gc4zx" Jun 14 21:33:22.065647 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.065609 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2cd4f68b-6453-4fa4-a522-77a515ee960f-run\") pod \"tuned-gc4zx\" (UID: \"2cd4f68b-6453-4fa4-a522-77a515ee960f\") " pod="openshift-cluster-node-tuning-operator/tuned-gc4zx" Jun 14 21:33:22.065647 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.065639 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2cd4f68b-6453-4fa4-a522-77a515ee960f-sys\") pod \"tuned-gc4zx\" (UID: \"2cd4f68b-6453-4fa4-a522-77a515ee960f\") " pod="openshift-cluster-node-tuning-operator/tuned-gc4zx" Jun 14 21:33:22.065850 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.065657 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d9d9b760-032d-43e3-b5a5-f834f5060412-sys-fs\") pod \"aws-ebs-csi-driver-node-rfd5l\" (UID: \"d9d9b760-032d-43e3-b5a5-f834f5060412\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfd5l" Jun 14 21:33:22.065850 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.065572 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2cd4f68b-6453-4fa4-a522-77a515ee960f-lib-modules\") pod \"tuned-gc4zx\" (UID: \"2cd4f68b-6453-4fa4-a522-77a515ee960f\") " pod="openshift-cluster-node-tuning-operator/tuned-gc4zx" Jun 14 21:33:22.065850 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.065690 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cd4f68b-6453-4fa4-a522-77a515ee960f-var-lib-kubelet\") pod \"tuned-gc4zx\" (UID: \"2cd4f68b-6453-4fa4-a522-77a515ee960f\") " pod="openshift-cluster-node-tuning-operator/tuned-gc4zx" Jun 14 21:33:22.065850 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.065693 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2cd4f68b-6453-4fa4-a522-77a515ee960f-run\") pod \"tuned-gc4zx\" (UID: \"2cd4f68b-6453-4fa4-a522-77a515ee960f\") " pod="openshift-cluster-node-tuning-operator/tuned-gc4zx" Jun 14 21:33:22.065850 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.065732 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/82ba6948-a910-4e5e-8783-3c981623181c-agent-certs\") pod \"konnectivity-agent-r69lf\" (UID: \"82ba6948-a910-4e5e-8783-3c981623181c\") " pod="kube-system/konnectivity-agent-r69lf" Jun 14 21:33:22.065850 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.065740 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d9d9b760-032d-43e3-b5a5-f834f5060412-sys-fs\") pod \"aws-ebs-csi-driver-node-rfd5l\" (UID: \"d9d9b760-032d-43e3-b5a5-f834f5060412\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfd5l" Jun 14 21:33:22.065850 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.065757 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cd4f68b-6453-4fa4-a522-77a515ee960f-var-lib-kubelet\") pod \"tuned-gc4zx\" (UID: \"2cd4f68b-6453-4fa4-a522-77a515ee960f\") " pod="openshift-cluster-node-tuning-operator/tuned-gc4zx" Jun 14 21:33:22.065850 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.065765 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb-original-pull-secret\") pod \"global-pull-secret-syncer-snfcq\" (UID: \"95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb\") " pod="kube-system/global-pull-secret-syncer-snfcq" Jun 14 21:33:22.065850 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.065808 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2cd4f68b-6453-4fa4-a522-77a515ee960f-host\") pod \"tuned-gc4zx\" (UID: \"2cd4f68b-6453-4fa4-a522-77a515ee960f\") " pod="openshift-cluster-node-tuning-operator/tuned-gc4zx" Jun 14 21:33:22.065850 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.065835 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb-kubelet-config\") pod \"global-pull-secret-syncer-snfcq\" (UID: \"95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb\") " pod="kube-system/global-pull-secret-syncer-snfcq" Jun 14 21:33:22.066430 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.065860 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2cd4f68b-6453-4fa4-a522-77a515ee960f-etc-systemd\") pod \"tuned-gc4zx\" (UID: \"2cd4f68b-6453-4fa4-a522-77a515ee960f\") " pod="openshift-cluster-node-tuning-operator/tuned-gc4zx" Jun 14 21:33:22.066430 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.065884 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6c41cf46-cb82-49f4-8d57-d6ac4df58684-serviceca\") pod \"node-ca-dsmrq\" (UID: \"6c41cf46-cb82-49f4-8d57-d6ac4df58684\") " pod="openshift-image-registry/node-ca-dsmrq" Jun 14 21:33:22.066430 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.065906 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2cd4f68b-6453-4fa4-a522-77a515ee960f-host\") pod \"tuned-gc4zx\" (UID: \"2cd4f68b-6453-4fa4-a522-77a515ee960f\") " pod="openshift-cluster-node-tuning-operator/tuned-gc4zx" Jun 14 21:33:22.066430 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:22.065921 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 21:33:22.066430 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.065905 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2cd4f68b-6453-4fa4-a522-77a515ee960f-etc-sysconfig\") pod \"tuned-gc4zx\" (UID: \"2cd4f68b-6453-4fa4-a522-77a515ee960f\") " pod="openshift-cluster-node-tuning-operator/tuned-gc4zx" Jun 14 21:33:22.066430 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.065971 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2cd4f68b-6453-4fa4-a522-77a515ee960f-etc-systemd\") pod \"tuned-gc4zx\" (UID: \"2cd4f68b-6453-4fa4-a522-77a515ee960f\") " pod="openshift-cluster-node-tuning-operator/tuned-gc4zx" Jun 14 21:33:22.066430 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.065930 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb-kubelet-config\") pod \"global-pull-secret-syncer-snfcq\" (UID: \"95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb\") " pod="kube-system/global-pull-secret-syncer-snfcq" Jun 14 21:33:22.066430 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:22.065991 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb-original-pull-secret podName:95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb nodeName:}" failed. No retries permitted until 2026-06-14 21:33:22.565967294 +0000 UTC m=+3.030568034 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb-original-pull-secret") pod "global-pull-secret-syncer-snfcq" (UID: "95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb") : object "kube-system"/"original-pull-secret" not registered Jun 14 21:33:22.066430 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.066014 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9769\" (UniqueName: \"kubernetes.io/projected/0605cbd9-4413-4172-bb98-5122e21fd9cc-kube-api-access-p9769\") pod \"iptables-alerter-g9tbl\" (UID: \"0605cbd9-4413-4172-bb98-5122e21fd9cc\") " pod="openshift-network-operator/iptables-alerter-g9tbl" Jun 14 21:33:22.066430 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.066030 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2cd4f68b-6453-4fa4-a522-77a515ee960f-etc-sysconfig\") pod \"tuned-gc4zx\" (UID: \"2cd4f68b-6453-4fa4-a522-77a515ee960f\") " pod="openshift-cluster-node-tuning-operator/tuned-gc4zx" Jun 14 21:33:22.066430 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.066062 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d9d9b760-032d-43e3-b5a5-f834f5060412-socket-dir\") pod \"aws-ebs-csi-driver-node-rfd5l\" (UID: \"d9d9b760-032d-43e3-b5a5-f834f5060412\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfd5l" Jun 14 21:33:22.066430 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.066088 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d9d9b760-032d-43e3-b5a5-f834f5060412-device-dir\") pod \"aws-ebs-csi-driver-node-rfd5l\" (UID: \"d9d9b760-032d-43e3-b5a5-f834f5060412\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfd5l" Jun 14 21:33:22.066430 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.066162 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f4lt\" (UniqueName: \"kubernetes.io/projected/6c41cf46-cb82-49f4-8d57-d6ac4df58684-kube-api-access-9f4lt\") pod \"node-ca-dsmrq\" (UID: \"6c41cf46-cb82-49f4-8d57-d6ac4df58684\") " pod="openshift-image-registry/node-ca-dsmrq" Jun 14 21:33:22.066430 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.066176 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d9d9b760-032d-43e3-b5a5-f834f5060412-socket-dir\") pod \"aws-ebs-csi-driver-node-rfd5l\" (UID: \"d9d9b760-032d-43e3-b5a5-f834f5060412\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfd5l" Jun 14 21:33:22.066430 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.066185 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d9d9b760-032d-43e3-b5a5-f834f5060412-device-dir\") pod \"aws-ebs-csi-driver-node-rfd5l\" (UID: \"d9d9b760-032d-43e3-b5a5-f834f5060412\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfd5l" Jun 14 21:33:22.066430 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.066189 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb-dbus\") pod \"global-pull-secret-syncer-snfcq\" (UID: \"95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb\") " pod="kube-system/global-pull-secret-syncer-snfcq" Jun 14 21:33:22.066430 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.066242 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2cd4f68b-6453-4fa4-a522-77a515ee960f-etc-kubernetes\") pod \"tuned-gc4zx\" (UID: \"2cd4f68b-6453-4fa4-a522-77a515ee960f\") " pod="openshift-cluster-node-tuning-operator/tuned-gc4zx" Jun 14 21:33:22.067436 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.066263 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/82ba6948-a910-4e5e-8783-3c981623181c-konnectivity-ca\") pod \"konnectivity-agent-r69lf\" (UID: \"82ba6948-a910-4e5e-8783-3c981623181c\") " pod="kube-system/konnectivity-agent-r69lf" Jun 14 21:33:22.067436 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.066284 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2cd4f68b-6453-4fa4-a522-77a515ee960f-etc-sysctl-d\") pod \"tuned-gc4zx\" (UID: \"2cd4f68b-6453-4fa4-a522-77a515ee960f\") " pod="openshift-cluster-node-tuning-operator/tuned-gc4zx" Jun 14 21:33:22.067436 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.066302 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d9d9b760-032d-43e3-b5a5-f834f5060412-etc-selinux\") pod \"aws-ebs-csi-driver-node-rfd5l\" (UID: \"d9d9b760-032d-43e3-b5a5-f834f5060412\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfd5l" Jun 14 21:33:22.067436 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.066306 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2cd4f68b-6453-4fa4-a522-77a515ee960f-etc-kubernetes\") pod \"tuned-gc4zx\" (UID: \"2cd4f68b-6453-4fa4-a522-77a515ee960f\") " pod="openshift-cluster-node-tuning-operator/tuned-gc4zx" Jun 14 21:33:22.067436 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.066320 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6c41cf46-cb82-49f4-8d57-d6ac4df58684-host\") pod \"node-ca-dsmrq\" (UID: \"6c41cf46-cb82-49f4-8d57-d6ac4df58684\") " pod="openshift-image-registry/node-ca-dsmrq" Jun 14 21:33:22.067436 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.066343 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb-dbus\") pod \"global-pull-secret-syncer-snfcq\" (UID: \"95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb\") " pod="kube-system/global-pull-secret-syncer-snfcq" Jun 14 21:33:22.067436 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.066342 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0605cbd9-4413-4172-bb98-5122e21fd9cc-iptables-alerter-script\") pod \"iptables-alerter-g9tbl\" (UID: \"0605cbd9-4413-4172-bb98-5122e21fd9cc\") " pod="openshift-network-operator/iptables-alerter-g9tbl" Jun 14 21:33:22.067436 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.066394 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d9d9b760-032d-43e3-b5a5-f834f5060412-etc-selinux\") pod \"aws-ebs-csi-driver-node-rfd5l\" (UID: \"d9d9b760-032d-43e3-b5a5-f834f5060412\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfd5l" Jun 14 21:33:22.067436 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.066406 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0605cbd9-4413-4172-bb98-5122e21fd9cc-host-slash\") pod \"iptables-alerter-g9tbl\" (UID: \"0605cbd9-4413-4172-bb98-5122e21fd9cc\") " pod="openshift-network-operator/iptables-alerter-g9tbl" Jun 14 21:33:22.067436 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.066407 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6c41cf46-cb82-49f4-8d57-d6ac4df58684-host\") pod \"node-ca-dsmrq\" (UID: \"6c41cf46-cb82-49f4-8d57-d6ac4df58684\") " pod="openshift-image-registry/node-ca-dsmrq" Jun 14 21:33:22.067436 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.066343 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6c41cf46-cb82-49f4-8d57-d6ac4df58684-serviceca\") pod \"node-ca-dsmrq\" (UID: \"6c41cf46-cb82-49f4-8d57-d6ac4df58684\") " pod="openshift-image-registry/node-ca-dsmrq" Jun 14 21:33:22.067436 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.066433 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2cd4f68b-6453-4fa4-a522-77a515ee960f-etc-modprobe-d\") pod \"tuned-gc4zx\" (UID: \"2cd4f68b-6453-4fa4-a522-77a515ee960f\") " pod="openshift-cluster-node-tuning-operator/tuned-gc4zx" Jun 14 21:33:22.067436 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.066462 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0605cbd9-4413-4172-bb98-5122e21fd9cc-host-slash\") pod \"iptables-alerter-g9tbl\" (UID: \"0605cbd9-4413-4172-bb98-5122e21fd9cc\") " pod="openshift-network-operator/iptables-alerter-g9tbl" Jun 14 21:33:22.067436 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.066486 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2cd4f68b-6453-4fa4-a522-77a515ee960f-etc-sysctl-d\") pod \"tuned-gc4zx\" (UID: \"2cd4f68b-6453-4fa4-a522-77a515ee960f\") " pod="openshift-cluster-node-tuning-operator/tuned-gc4zx" Jun 14 21:33:22.067436 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.066497 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2cd4f68b-6453-4fa4-a522-77a515ee960f-tmp\") pod \"tuned-gc4zx\" (UID: \"2cd4f68b-6453-4fa4-a522-77a515ee960f\") " pod="openshift-cluster-node-tuning-operator/tuned-gc4zx" Jun 14 21:33:22.067436 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.066533 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2cd4f68b-6453-4fa4-a522-77a515ee960f-etc-modprobe-d\") pod \"tuned-gc4zx\" (UID: \"2cd4f68b-6453-4fa4-a522-77a515ee960f\") " pod="openshift-cluster-node-tuning-operator/tuned-gc4zx" Jun 14 21:33:22.067436 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.066656 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d9d9b760-032d-43e3-b5a5-f834f5060412-registration-dir\") pod \"aws-ebs-csi-driver-node-rfd5l\" (UID: \"d9d9b760-032d-43e3-b5a5-f834f5060412\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfd5l" Jun 14 21:33:22.067436 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.066690 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2x8n\" (UniqueName: \"kubernetes.io/projected/2cd4f68b-6453-4fa4-a522-77a515ee960f-kube-api-access-q2x8n\") pod \"tuned-gc4zx\" (UID: \"2cd4f68b-6453-4fa4-a522-77a515ee960f\") " pod="openshift-cluster-node-tuning-operator/tuned-gc4zx" Jun 14 21:33:22.068370 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.066716 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4s9c\" (UniqueName: \"kubernetes.io/projected/60997d9b-5a4e-4d38-8337-21cb8c551d0e-kube-api-access-h4s9c\") pod \"network-check-target-8dt84\" (UID: \"60997d9b-5a4e-4d38-8337-21cb8c551d0e\") " pod="openshift-network-diagnostics/network-check-target-8dt84" Jun 14 21:33:22.068370 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.066740 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d9d9b760-032d-43e3-b5a5-f834f5060412-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rfd5l\" (UID: \"d9d9b760-032d-43e3-b5a5-f834f5060412\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfd5l" Jun 14 21:33:22.068370 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.066747 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d9d9b760-032d-43e3-b5a5-f834f5060412-registration-dir\") pod \"aws-ebs-csi-driver-node-rfd5l\" (UID: \"d9d9b760-032d-43e3-b5a5-f834f5060412\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfd5l" Jun 14 21:33:22.068370 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.066767 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjtv4\" (UniqueName: \"kubernetes.io/projected/d9d9b760-032d-43e3-b5a5-f834f5060412-kube-api-access-cjtv4\") pod \"aws-ebs-csi-driver-node-rfd5l\" (UID: \"d9d9b760-032d-43e3-b5a5-f834f5060412\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfd5l" Jun 14 21:33:22.068370 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.066814 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2cd4f68b-6453-4fa4-a522-77a515ee960f-etc-sysctl-conf\") pod \"tuned-gc4zx\" (UID: \"2cd4f68b-6453-4fa4-a522-77a515ee960f\") " pod="openshift-cluster-node-tuning-operator/tuned-gc4zx" Jun 14 21:33:22.068370 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.066833 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0605cbd9-4413-4172-bb98-5122e21fd9cc-iptables-alerter-script\") pod \"iptables-alerter-g9tbl\" (UID: \"0605cbd9-4413-4172-bb98-5122e21fd9cc\") " pod="openshift-network-operator/iptables-alerter-g9tbl" Jun 14 21:33:22.068370 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.066833 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/82ba6948-a910-4e5e-8783-3c981623181c-konnectivity-ca\") pod \"konnectivity-agent-r69lf\" (UID: \"82ba6948-a910-4e5e-8783-3c981623181c\") " pod="kube-system/konnectivity-agent-r69lf" Jun 14 21:33:22.068370 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.066885 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d9d9b760-032d-43e3-b5a5-f834f5060412-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rfd5l\" (UID: \"d9d9b760-032d-43e3-b5a5-f834f5060412\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfd5l" Jun 14 21:33:22.068370 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.067005 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2cd4f68b-6453-4fa4-a522-77a515ee960f-etc-sysctl-conf\") pod \"tuned-gc4zx\" (UID: \"2cd4f68b-6453-4fa4-a522-77a515ee960f\") " pod="openshift-cluster-node-tuning-operator/tuned-gc4zx" Jun 14 21:33:22.068370 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.068269 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2cd4f68b-6453-4fa4-a522-77a515ee960f-etc-tuned\") pod \"tuned-gc4zx\" (UID: \"2cd4f68b-6453-4fa4-a522-77a515ee960f\") " pod="openshift-cluster-node-tuning-operator/tuned-gc4zx" Jun 14 21:33:22.068817 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.068598 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/82ba6948-a910-4e5e-8783-3c981623181c-agent-certs\") pod \"konnectivity-agent-r69lf\" (UID: \"82ba6948-a910-4e5e-8783-3c981623181c\") " pod="kube-system/konnectivity-agent-r69lf" Jun 14 21:33:22.068902 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.068878 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2cd4f68b-6453-4fa4-a522-77a515ee960f-tmp\") pod \"tuned-gc4zx\" (UID: \"2cd4f68b-6453-4fa4-a522-77a515ee960f\") " pod="openshift-cluster-node-tuning-operator/tuned-gc4zx" Jun 14 21:33:22.075420 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:22.075396 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 21:33:22.075420 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:22.075424 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 21:33:22.075555 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:22.075438 2563 projected.go:196] Error preparing data for projected volume kube-api-access-h4s9c for pod openshift-network-diagnostics/network-check-target-8dt84: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 21:33:22.075555 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:22.075505 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60997d9b-5a4e-4d38-8337-21cb8c551d0e-kube-api-access-h4s9c podName:60997d9b-5a4e-4d38-8337-21cb8c551d0e nodeName:}" failed. No retries permitted until 2026-06-14 21:33:22.575487075 +0000 UTC m=+3.040087816 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-h4s9c" (UniqueName: "kubernetes.io/projected/60997d9b-5a4e-4d38-8337-21cb8c551d0e-kube-api-access-h4s9c") pod "network-check-target-8dt84" (UID: "60997d9b-5a4e-4d38-8337-21cb8c551d0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 21:33:22.075786 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.075739 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9769\" (UniqueName: \"kubernetes.io/projected/0605cbd9-4413-4172-bb98-5122e21fd9cc-kube-api-access-p9769\") pod \"iptables-alerter-g9tbl\" (UID: \"0605cbd9-4413-4172-bb98-5122e21fd9cc\") " pod="openshift-network-operator/iptables-alerter-g9tbl" Jun 14 21:33:22.075867 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.075819 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f4lt\" (UniqueName: \"kubernetes.io/projected/6c41cf46-cb82-49f4-8d57-d6ac4df58684-kube-api-access-9f4lt\") pod \"node-ca-dsmrq\" (UID: \"6c41cf46-cb82-49f4-8d57-d6ac4df58684\") " pod="openshift-image-registry/node-ca-dsmrq" Jun 14 21:33:22.076558 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.076535 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjtv4\" (UniqueName: \"kubernetes.io/projected/d9d9b760-032d-43e3-b5a5-f834f5060412-kube-api-access-cjtv4\") pod \"aws-ebs-csi-driver-node-rfd5l\" (UID: \"d9d9b760-032d-43e3-b5a5-f834f5060412\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfd5l" Jun 14 21:33:22.077761 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.077744 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2x8n\" (UniqueName: \"kubernetes.io/projected/2cd4f68b-6453-4fa4-a522-77a515ee960f-kube-api-access-q2x8n\") pod \"tuned-gc4zx\" (UID: \"2cd4f68b-6453-4fa4-a522-77a515ee960f\") " pod="openshift-cluster-node-tuning-operator/tuned-gc4zx" Jun 14 21:33:22.149742 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.149714 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l7htv" Jun 14 21:33:22.158762 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.158743 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tnc2v" Jun 14 21:33:22.167557 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.167538 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v8kl4" Jun 14 21:33:22.174361 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.174345 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:22.181058 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.181037 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r69lf" Jun 14 21:33:22.186803 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.186786 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfd5l" Jun 14 21:33:22.192625 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.192608 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gc4zx" Jun 14 21:33:22.200422 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.200351 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dsmrq" Jun 14 21:33:22.207055 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.207036 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-g9tbl" Jun 14 21:33:22.469051 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.468980 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab5e49aa-95ae-4957-8dca-5642fc6e0336-metrics-certs\") pod \"network-metrics-daemon-g5wz8\" (UID: \"ab5e49aa-95ae-4957-8dca-5642fc6e0336\") " pod="openshift-multus/network-metrics-daemon-g5wz8" Jun 14 21:33:22.469181 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:22.469141 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 21:33:22.469249 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:22.469204 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab5e49aa-95ae-4957-8dca-5642fc6e0336-metrics-certs podName:ab5e49aa-95ae-4957-8dca-5642fc6e0336 nodeName:}" failed. No retries permitted until 2026-06-14 21:33:23.469189232 +0000 UTC m=+3.933789970 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab5e49aa-95ae-4957-8dca-5642fc6e0336-metrics-certs") pod "network-metrics-daemon-g5wz8" (UID: "ab5e49aa-95ae-4957-8dca-5642fc6e0336") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 21:33:22.569806 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.569768 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb-original-pull-secret\") pod \"global-pull-secret-syncer-snfcq\" (UID: \"95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb\") " pod="kube-system/global-pull-secret-syncer-snfcq" Jun 14 21:33:22.569958 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:22.569898 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 21:33:22.569958 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:22.569955 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb-original-pull-secret podName:95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb nodeName:}" failed. No retries permitted until 2026-06-14 21:33:23.569936697 +0000 UTC m=+4.034537424 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb-original-pull-secret") pod "global-pull-secret-syncer-snfcq" (UID: "95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb") : object "kube-system"/"original-pull-secret" not registered Jun 14 21:33:22.671013 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.670970 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4s9c\" (UniqueName: \"kubernetes.io/projected/60997d9b-5a4e-4d38-8337-21cb8c551d0e-kube-api-access-h4s9c\") pod \"network-check-target-8dt84\" (UID: \"60997d9b-5a4e-4d38-8337-21cb8c551d0e\") " pod="openshift-network-diagnostics/network-check-target-8dt84" Jun 14 21:33:22.671179 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:22.671161 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 21:33:22.671311 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:22.671185 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 21:33:22.671311 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:22.671197 2563 projected.go:196] Error preparing data for projected volume kube-api-access-h4s9c for pod openshift-network-diagnostics/network-check-target-8dt84: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 21:33:22.671311 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:22.671291 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60997d9b-5a4e-4d38-8337-21cb8c551d0e-kube-api-access-h4s9c podName:60997d9b-5a4e-4d38-8337-21cb8c551d0e nodeName:}" failed. No retries permitted until 2026-06-14 21:33:23.671265136 +0000 UTC m=+4.135865874 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-h4s9c" (UniqueName: "kubernetes.io/projected/60997d9b-5a4e-4d38-8337-21cb8c551d0e-kube-api-access-h4s9c") pod "network-check-target-8dt84" (UID: "60997d9b-5a4e-4d38-8337-21cb8c551d0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 21:33:22.673185 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:22.673105 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cd4f68b_6453_4fa4_a522_77a515ee960f.slice/crio-ade6f4af67f290d0d9e459ece0b18fc18f858e2ea28ca05b7eaf5cff558d7cac WatchSource:0}: Error finding container ade6f4af67f290d0d9e459ece0b18fc18f858e2ea28ca05b7eaf5cff558d7cac: Status 404 returned error can't find the container with id ade6f4af67f290d0d9e459ece0b18fc18f858e2ea28ca05b7eaf5cff558d7cac Jun 14 21:33:22.674762 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:22.674671 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0605cbd9_4413_4172_bb98_5122e21fd9cc.slice/crio-eb9a7b5252464ef1f3d082b844a05ae8d1a5ed1c22bacccebad9601c7aff24ac WatchSource:0}: Error finding container eb9a7b5252464ef1f3d082b844a05ae8d1a5ed1c22bacccebad9601c7aff24ac: Status 404 returned error can't find the container with id eb9a7b5252464ef1f3d082b844a05ae8d1a5ed1c22bacccebad9601c7aff24ac Jun 14 21:33:22.675285 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:22.675262 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf03840e6_bb9f_46f3_ba9a_ab2a98d744fa.slice/crio-c8a119d302661fc50606f9bc8ba530bdaa44367d151cae4c16d8a3864cfa0661 WatchSource:0}: Error finding container c8a119d302661fc50606f9bc8ba530bdaa44367d151cae4c16d8a3864cfa0661: Status 404 returned error can't find the container with id c8a119d302661fc50606f9bc8ba530bdaa44367d151cae4c16d8a3864cfa0661 Jun 14 21:33:22.677150 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:22.676035 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c41cf46_cb82_49f4_8d57_d6ac4df58684.slice/crio-4cfee40c2c36d855b5437cc227c54e8dcb67a7d6d15102beb45debe2c9f2c88d WatchSource:0}: Error finding container 4cfee40c2c36d855b5437cc227c54e8dcb67a7d6d15102beb45debe2c9f2c88d: Status 404 returned error can't find the container with id 4cfee40c2c36d855b5437cc227c54e8dcb67a7d6d15102beb45debe2c9f2c88d Jun 14 21:33:22.677665 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:22.677637 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfab653ef_3379_4e6c_9efe_2a0994436f73.slice/crio-51ec3aa2ccd1199cf3072f9ac3cc126511fa5ebd43e7da9cf79c366119dc9799 WatchSource:0}: Error finding container 51ec3aa2ccd1199cf3072f9ac3cc126511fa5ebd43e7da9cf79c366119dc9799: Status 404 returned error can't find the container with id 51ec3aa2ccd1199cf3072f9ac3cc126511fa5ebd43e7da9cf79c366119dc9799 Jun 14 21:33:22.898485 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.898440 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-13 21:28:21 +0000 UTC" deadline="2027-12-05 23:48:44.434334443 +0000 UTC" Jun 14 21:33:22.898485 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.898484 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12938h15m21.535853362s" Jun 14 21:33:22.924429 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.924402 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-95.ec2.internal" event={"ID":"f490b35b80d897116aecbebc7de818c1","Type":"ContainerStarted","Data":"f85f31cae28022b7f99496bbe8b6c8a6e059444fda073b3775d6e09b7fcd8068"} Jun 14 21:33:22.925872 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.925837 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-95.ec2.internal" event={"ID":"3c99a3657720963dc97fd6269d6795a7","Type":"ContainerStarted","Data":"6f00c6f4c03967b78b5f1fd1882c04a3d124a112ca92dc60b6ced0ee3e02a355"} Jun 14 21:33:22.926975 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.926955 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfd5l" event={"ID":"d9d9b760-032d-43e3-b5a5-f834f5060412","Type":"ContainerStarted","Data":"8d49ed9c89cfbd6ca93b3220fcc6df010e6c1214f02e2dbd700685df20617705"} Jun 14 21:33:22.927982 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.927964 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v8kl4" event={"ID":"49595b6e-3eb8-4a20-a992-2fcdf940fc28","Type":"ContainerStarted","Data":"95bc92019a9722c80075deb3396075233594f0e58c85b0b540c4fb817030db36"} Jun 14 21:33:22.928855 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.928837 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l7htv" event={"ID":"fab653ef-3379-4e6c-9efe-2a0994436f73","Type":"ContainerStarted","Data":"51ec3aa2ccd1199cf3072f9ac3cc126511fa5ebd43e7da9cf79c366119dc9799"} Jun 14 21:33:22.929942 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.929918 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-g9tbl" event={"ID":"0605cbd9-4413-4172-bb98-5122e21fd9cc","Type":"ContainerStarted","Data":"eb9a7b5252464ef1f3d082b844a05ae8d1a5ed1c22bacccebad9601c7aff24ac"} Jun 14 21:33:22.930921 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.930903 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r69lf" event={"ID":"82ba6948-a910-4e5e-8783-3c981623181c","Type":"ContainerStarted","Data":"680620a3754c07f0906b0b23aad3dd3a6505b87ac3d6df84f62ecad2d9bb8035"} Jun 14 21:33:22.931900 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.931884 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tnc2v" event={"ID":"e564eb22-98d2-4710-91ec-e8cbc19a5885","Type":"ContainerStarted","Data":"89da0d3df7bd9a3442038d27a53a194cd35b1d8f52e682f24e9ca21215965cec"} Jun 14 21:33:22.932923 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.932896 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" event={"ID":"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa","Type":"ContainerStarted","Data":"c8a119d302661fc50606f9bc8ba530bdaa44367d151cae4c16d8a3864cfa0661"} Jun 14 21:33:22.933976 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.933957 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dsmrq" event={"ID":"6c41cf46-cb82-49f4-8d57-d6ac4df58684","Type":"ContainerStarted","Data":"4cfee40c2c36d855b5437cc227c54e8dcb67a7d6d15102beb45debe2c9f2c88d"} Jun 14 21:33:22.934858 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.934841 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gc4zx" event={"ID":"2cd4f68b-6453-4fa4-a522-77a515ee960f","Type":"ContainerStarted","Data":"ade6f4af67f290d0d9e459ece0b18fc18f858e2ea28ca05b7eaf5cff558d7cac"} Jun 14 21:33:22.950147 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:22.950106 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-95.ec2.internal" podStartSLOduration=2.950095347 podStartE2EDuration="2.950095347s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 21:33:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:33:22.949950146 +0000 UTC m=+3.414550891" watchObservedRunningTime="2026-06-14 21:33:22.950095347 +0000 UTC m=+3.414696093" Jun 14 21:33:23.478435 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:23.478399 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab5e49aa-95ae-4957-8dca-5642fc6e0336-metrics-certs\") pod \"network-metrics-daemon-g5wz8\" (UID: \"ab5e49aa-95ae-4957-8dca-5642fc6e0336\") " pod="openshift-multus/network-metrics-daemon-g5wz8" Jun 14 21:33:23.478615 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:23.478584 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 21:33:23.478674 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:23.478645 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab5e49aa-95ae-4957-8dca-5642fc6e0336-metrics-certs podName:ab5e49aa-95ae-4957-8dca-5642fc6e0336 nodeName:}" failed. No retries permitted until 2026-06-14 21:33:25.478627585 +0000 UTC m=+5.943228311 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab5e49aa-95ae-4957-8dca-5642fc6e0336-metrics-certs") pod "network-metrics-daemon-g5wz8" (UID: "ab5e49aa-95ae-4957-8dca-5642fc6e0336") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 21:33:23.582256 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:23.579560 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb-original-pull-secret\") pod \"global-pull-secret-syncer-snfcq\" (UID: \"95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb\") " pod="kube-system/global-pull-secret-syncer-snfcq" Jun 14 21:33:23.582256 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:23.579717 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 21:33:23.582256 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:23.579791 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb-original-pull-secret podName:95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb nodeName:}" failed. No retries permitted until 2026-06-14 21:33:25.579771722 +0000 UTC m=+6.044372449 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb-original-pull-secret") pod "global-pull-secret-syncer-snfcq" (UID: "95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb") : object "kube-system"/"original-pull-secret" not registered Jun 14 21:33:23.681308 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:23.680689 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4s9c\" (UniqueName: \"kubernetes.io/projected/60997d9b-5a4e-4d38-8337-21cb8c551d0e-kube-api-access-h4s9c\") pod \"network-check-target-8dt84\" (UID: \"60997d9b-5a4e-4d38-8337-21cb8c551d0e\") " pod="openshift-network-diagnostics/network-check-target-8dt84" Jun 14 21:33:23.681308 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:23.680871 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 21:33:23.681308 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:23.680893 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 21:33:23.681308 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:23.680906 2563 projected.go:196] Error preparing data for projected volume kube-api-access-h4s9c for pod openshift-network-diagnostics/network-check-target-8dt84: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 21:33:23.681308 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:23.680964 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60997d9b-5a4e-4d38-8337-21cb8c551d0e-kube-api-access-h4s9c podName:60997d9b-5a4e-4d38-8337-21cb8c551d0e nodeName:}" failed. No retries permitted until 2026-06-14 21:33:25.680944535 +0000 UTC m=+6.145545268 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-h4s9c" (UniqueName: "kubernetes.io/projected/60997d9b-5a4e-4d38-8337-21cb8c551d0e-kube-api-access-h4s9c") pod "network-check-target-8dt84" (UID: "60997d9b-5a4e-4d38-8337-21cb8c551d0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 21:33:23.899118 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:23.899050 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-13 21:28:21 +0000 UTC" deadline="2028-01-21 19:10:06.309056713 +0000 UTC" Jun 14 21:33:23.899118 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:23.899088 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14061h36m42.409973012s" Jun 14 21:33:23.918250 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:23.916669 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dt84" Jun 14 21:33:23.918250 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:23.916775 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dt84" podUID="60997d9b-5a4e-4d38-8337-21cb8c551d0e" Jun 14 21:33:23.918250 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:23.917169 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5wz8" Jun 14 21:33:23.918250 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:23.917294 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5wz8" podUID="ab5e49aa-95ae-4957-8dca-5642fc6e0336" Jun 14 21:33:23.918250 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:23.917355 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-snfcq" Jun 14 21:33:23.918250 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:23.917423 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-snfcq" podUID="95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb" Jun 14 21:33:23.942518 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:23.942464 2563 generic.go:356] "Generic (PLEG): container finished" podID="f490b35b80d897116aecbebc7de818c1" containerID="f85f31cae28022b7f99496bbe8b6c8a6e059444fda073b3775d6e09b7fcd8068" exitCode=0 Jun 14 21:33:23.943393 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:23.943316 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-95.ec2.internal" event={"ID":"f490b35b80d897116aecbebc7de818c1","Type":"ContainerDied","Data":"f85f31cae28022b7f99496bbe8b6c8a6e059444fda073b3775d6e09b7fcd8068"} Jun 14 21:33:24.978019 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:24.977949 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-95.ec2.internal" event={"ID":"f490b35b80d897116aecbebc7de818c1","Type":"ContainerStarted","Data":"7b34ba7874a3017ddf00314169d4ab4a4665affa4e90ae0dec8da962ff21d80d"} Jun 14 21:33:25.496580 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:25.496543 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab5e49aa-95ae-4957-8dca-5642fc6e0336-metrics-certs\") pod \"network-metrics-daemon-g5wz8\" (UID: \"ab5e49aa-95ae-4957-8dca-5642fc6e0336\") " pod="openshift-multus/network-metrics-daemon-g5wz8" Jun 14 21:33:25.496757 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:25.496717 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 21:33:25.496837 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:25.496778 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab5e49aa-95ae-4957-8dca-5642fc6e0336-metrics-certs podName:ab5e49aa-95ae-4957-8dca-5642fc6e0336 nodeName:}" failed. No retries permitted until 2026-06-14 21:33:29.496760635 +0000 UTC m=+9.961361364 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab5e49aa-95ae-4957-8dca-5642fc6e0336-metrics-certs") pod "network-metrics-daemon-g5wz8" (UID: "ab5e49aa-95ae-4957-8dca-5642fc6e0336") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 21:33:25.597632 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:25.597598 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb-original-pull-secret\") pod \"global-pull-secret-syncer-snfcq\" (UID: \"95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb\") " pod="kube-system/global-pull-secret-syncer-snfcq" Jun 14 21:33:25.597786 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:25.597775 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 21:33:25.597863 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:25.597848 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb-original-pull-secret podName:95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb nodeName:}" failed. No retries permitted until 2026-06-14 21:33:29.597817298 +0000 UTC m=+10.062418033 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb-original-pull-secret") pod "global-pull-secret-syncer-snfcq" (UID: "95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb") : object "kube-system"/"original-pull-secret" not registered Jun 14 21:33:25.699149 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:25.699099 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4s9c\" (UniqueName: \"kubernetes.io/projected/60997d9b-5a4e-4d38-8337-21cb8c551d0e-kube-api-access-h4s9c\") pod \"network-check-target-8dt84\" (UID: \"60997d9b-5a4e-4d38-8337-21cb8c551d0e\") " pod="openshift-network-diagnostics/network-check-target-8dt84" Jun 14 21:33:25.710999 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:25.710418 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 21:33:25.710999 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:25.710444 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 21:33:25.710999 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:25.710459 2563 projected.go:196] Error preparing data for projected volume kube-api-access-h4s9c for pod openshift-network-diagnostics/network-check-target-8dt84: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 21:33:25.710999 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:25.710525 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60997d9b-5a4e-4d38-8337-21cb8c551d0e-kube-api-access-h4s9c podName:60997d9b-5a4e-4d38-8337-21cb8c551d0e nodeName:}" failed. No retries permitted until 2026-06-14 21:33:29.710505314 +0000 UTC m=+10.175106040 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-h4s9c" (UniqueName: "kubernetes.io/projected/60997d9b-5a4e-4d38-8337-21cb8c551d0e-kube-api-access-h4s9c") pod "network-check-target-8dt84" (UID: "60997d9b-5a4e-4d38-8337-21cb8c551d0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 21:33:25.918039 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:25.918007 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5wz8" Jun 14 21:33:25.918170 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:25.918125 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5wz8" podUID="ab5e49aa-95ae-4957-8dca-5642fc6e0336" Jun 14 21:33:25.918466 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:25.918350 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dt84" Jun 14 21:33:25.918466 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:25.918379 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-snfcq" Jun 14 21:33:25.918466 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:25.918460 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dt84" podUID="60997d9b-5a4e-4d38-8337-21cb8c551d0e" Jun 14 21:33:25.918699 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:25.918543 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-snfcq" podUID="95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb" Jun 14 21:33:27.916608 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:27.916105 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5wz8" Jun 14 21:33:27.916608 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:27.916110 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dt84" Jun 14 21:33:27.916608 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:27.916254 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5wz8" podUID="ab5e49aa-95ae-4957-8dca-5642fc6e0336" Jun 14 21:33:27.916608 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:27.916105 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-snfcq" Jun 14 21:33:27.916608 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:27.916332 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dt84" podUID="60997d9b-5a4e-4d38-8337-21cb8c551d0e" Jun 14 21:33:27.916608 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:27.916426 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-snfcq" podUID="95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb" Jun 14 21:33:29.532956 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:29.532257 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab5e49aa-95ae-4957-8dca-5642fc6e0336-metrics-certs\") pod \"network-metrics-daemon-g5wz8\" (UID: \"ab5e49aa-95ae-4957-8dca-5642fc6e0336\") " pod="openshift-multus/network-metrics-daemon-g5wz8" Jun 14 21:33:29.532956 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:29.532397 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 21:33:29.532956 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:29.532464 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab5e49aa-95ae-4957-8dca-5642fc6e0336-metrics-certs podName:ab5e49aa-95ae-4957-8dca-5642fc6e0336 nodeName:}" failed. No retries permitted until 2026-06-14 21:33:37.532445213 +0000 UTC m=+17.997045950 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab5e49aa-95ae-4957-8dca-5642fc6e0336-metrics-certs") pod "network-metrics-daemon-g5wz8" (UID: "ab5e49aa-95ae-4957-8dca-5642fc6e0336") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 21:33:29.633788 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:29.633178 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb-original-pull-secret\") pod \"global-pull-secret-syncer-snfcq\" (UID: \"95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb\") " pod="kube-system/global-pull-secret-syncer-snfcq" Jun 14 21:33:29.633788 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:29.633402 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 21:33:29.633788 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:29.633464 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb-original-pull-secret podName:95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb nodeName:}" failed. No retries permitted until 2026-06-14 21:33:37.633445691 +0000 UTC m=+18.098046432 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb-original-pull-secret") pod "global-pull-secret-syncer-snfcq" (UID: "95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb") : object "kube-system"/"original-pull-secret" not registered Jun 14 21:33:29.733767 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:29.733732 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4s9c\" (UniqueName: \"kubernetes.io/projected/60997d9b-5a4e-4d38-8337-21cb8c551d0e-kube-api-access-h4s9c\") pod \"network-check-target-8dt84\" (UID: \"60997d9b-5a4e-4d38-8337-21cb8c551d0e\") " pod="openshift-network-diagnostics/network-check-target-8dt84" Jun 14 21:33:29.733931 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:29.733892 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 21:33:29.733931 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:29.733919 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 21:33:29.734057 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:29.733933 2563 projected.go:196] Error preparing data for projected volume kube-api-access-h4s9c for pod openshift-network-diagnostics/network-check-target-8dt84: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 21:33:29.734057 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:29.734001 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60997d9b-5a4e-4d38-8337-21cb8c551d0e-kube-api-access-h4s9c podName:60997d9b-5a4e-4d38-8337-21cb8c551d0e nodeName:}" failed. No retries permitted until 2026-06-14 21:33:37.733980601 +0000 UTC m=+18.198581327 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-h4s9c" (UniqueName: "kubernetes.io/projected/60997d9b-5a4e-4d38-8337-21cb8c551d0e-kube-api-access-h4s9c") pod "network-check-target-8dt84" (UID: "60997d9b-5a4e-4d38-8337-21cb8c551d0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 21:33:29.916672 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:29.916630 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dt84" Jun 14 21:33:29.916832 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:29.916685 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5wz8" Jun 14 21:33:29.916832 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:29.916756 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dt84" podUID="60997d9b-5a4e-4d38-8337-21cb8c551d0e" Jun 14 21:33:29.916942 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:29.916840 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-snfcq" Jun 14 21:33:29.916942 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:29.916833 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5wz8" podUID="ab5e49aa-95ae-4957-8dca-5642fc6e0336" Jun 14 21:33:29.916942 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:29.916913 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-snfcq" podUID="95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb" Jun 14 21:33:31.916749 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:31.916716 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-snfcq" Jun 14 21:33:31.917189 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:31.916716 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5wz8" Jun 14 21:33:31.917189 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:31.916835 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-snfcq" podUID="95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb" Jun 14 21:33:31.917189 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:31.916864 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dt84" Jun 14 21:33:31.917189 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:31.916962 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5wz8" podUID="ab5e49aa-95ae-4957-8dca-5642fc6e0336" Jun 14 21:33:31.917189 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:31.917039 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dt84" podUID="60997d9b-5a4e-4d38-8337-21cb8c551d0e" Jun 14 21:33:33.915920 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:33.915888 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5wz8" Jun 14 21:33:33.915920 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:33.915894 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dt84" Jun 14 21:33:33.916448 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:33.915888 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-snfcq" Jun 14 21:33:33.916448 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:33.916022 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5wz8" podUID="ab5e49aa-95ae-4957-8dca-5642fc6e0336" Jun 14 21:33:33.916448 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:33.916136 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-snfcq" podUID="95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb" Jun 14 21:33:33.916448 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:33.916259 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dt84" podUID="60997d9b-5a4e-4d38-8337-21cb8c551d0e" Jun 14 21:33:35.915951 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:35.915918 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5wz8" Jun 14 21:33:35.916374 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:35.915918 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dt84" Jun 14 21:33:35.916374 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:35.916042 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5wz8" podUID="ab5e49aa-95ae-4957-8dca-5642fc6e0336" Jun 14 21:33:35.916374 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:35.916142 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dt84" podUID="60997d9b-5a4e-4d38-8337-21cb8c551d0e" Jun 14 21:33:35.916374 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:35.915918 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-snfcq" Jun 14 21:33:35.916374 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:35.916267 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-snfcq" podUID="95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb" Jun 14 21:33:37.600019 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:37.599992 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab5e49aa-95ae-4957-8dca-5642fc6e0336-metrics-certs\") pod \"network-metrics-daemon-g5wz8\" (UID: \"ab5e49aa-95ae-4957-8dca-5642fc6e0336\") " pod="openshift-multus/network-metrics-daemon-g5wz8" Jun 14 21:33:37.600444 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:37.600128 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 21:33:37.600444 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:37.600184 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab5e49aa-95ae-4957-8dca-5642fc6e0336-metrics-certs podName:ab5e49aa-95ae-4957-8dca-5642fc6e0336 nodeName:}" failed. No retries permitted until 2026-06-14 21:33:53.600169959 +0000 UTC m=+34.064770687 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab5e49aa-95ae-4957-8dca-5642fc6e0336-metrics-certs") pod "network-metrics-daemon-g5wz8" (UID: "ab5e49aa-95ae-4957-8dca-5642fc6e0336") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 21:33:37.700731 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:37.700700 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb-original-pull-secret\") pod \"global-pull-secret-syncer-snfcq\" (UID: \"95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb\") " pod="kube-system/global-pull-secret-syncer-snfcq" Jun 14 21:33:37.700867 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:37.700830 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 21:33:37.700913 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:37.700885 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb-original-pull-secret podName:95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb nodeName:}" failed. No retries permitted until 2026-06-14 21:33:53.700867271 +0000 UTC m=+34.165467997 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb-original-pull-secret") pod "global-pull-secret-syncer-snfcq" (UID: "95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb") : object "kube-system"/"original-pull-secret" not registered Jun 14 21:33:37.801943 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:37.801910 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4s9c\" (UniqueName: \"kubernetes.io/projected/60997d9b-5a4e-4d38-8337-21cb8c551d0e-kube-api-access-h4s9c\") pod \"network-check-target-8dt84\" (UID: \"60997d9b-5a4e-4d38-8337-21cb8c551d0e\") " pod="openshift-network-diagnostics/network-check-target-8dt84" Jun 14 21:33:37.802103 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:37.802056 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 21:33:37.802103 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:37.802076 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 21:33:37.802103 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:37.802086 2563 projected.go:196] Error preparing data for projected volume kube-api-access-h4s9c for pod openshift-network-diagnostics/network-check-target-8dt84: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 21:33:37.802286 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:37.802152 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60997d9b-5a4e-4d38-8337-21cb8c551d0e-kube-api-access-h4s9c podName:60997d9b-5a4e-4d38-8337-21cb8c551d0e nodeName:}" failed. No retries permitted until 2026-06-14 21:33:53.802123591 +0000 UTC m=+34.266724318 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-h4s9c" (UniqueName: "kubernetes.io/projected/60997d9b-5a4e-4d38-8337-21cb8c551d0e-kube-api-access-h4s9c") pod "network-check-target-8dt84" (UID: "60997d9b-5a4e-4d38-8337-21cb8c551d0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 21:33:37.916198 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:37.916132 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-snfcq" Jun 14 21:33:37.916198 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:37.916162 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dt84" Jun 14 21:33:37.916400 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:37.916134 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5wz8" Jun 14 21:33:37.916400 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:37.916278 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-snfcq" podUID="95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb" Jun 14 21:33:37.916470 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:37.916408 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5wz8" podUID="ab5e49aa-95ae-4957-8dca-5642fc6e0336" Jun 14 21:33:37.916528 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:37.916507 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dt84" podUID="60997d9b-5a4e-4d38-8337-21cb8c551d0e" Jun 14 21:33:39.916956 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:39.916928 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5wz8" Jun 14 21:33:39.917348 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:39.917035 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dt84" Jun 14 21:33:39.917348 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:39.917035 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5wz8" podUID="ab5e49aa-95ae-4957-8dca-5642fc6e0336" Jun 14 21:33:39.917348 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:39.917141 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-snfcq" Jun 14 21:33:39.917348 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:39.917144 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dt84" podUID="60997d9b-5a4e-4d38-8337-21cb8c551d0e" Jun 14 21:33:39.917348 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:39.917286 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-snfcq" podUID="95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb" Jun 14 21:33:41.915817 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:41.915640 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5wz8" Jun 14 21:33:41.916414 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:41.915663 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dt84" Jun 14 21:33:41.916414 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:41.915908 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5wz8" podUID="ab5e49aa-95ae-4957-8dca-5642fc6e0336" Jun 14 21:33:41.916414 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:41.915640 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-snfcq" Jun 14 21:33:41.916414 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:41.915998 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dt84" podUID="60997d9b-5a4e-4d38-8337-21cb8c551d0e" Jun 14 21:33:41.916414 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:41.916048 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-snfcq" podUID="95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb" Jun 14 21:33:42.012621 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:42.012592 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfd5l" event={"ID":"d9d9b760-032d-43e3-b5a5-f834f5060412","Type":"ContainerStarted","Data":"9ee24417524ab096e33d6a420b22b38def52bf2d1cb4d68fd6d938945b7729ca"} Jun 14 21:33:42.013985 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:42.013963 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v8kl4" event={"ID":"49595b6e-3eb8-4a20-a992-2fcdf940fc28","Type":"ContainerStarted","Data":"ffa23fdbca988047020ab1458e1329558147e5855afb7726b65f340edd296cbd"} Jun 14 21:33:42.015327 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:42.015306 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l7htv" event={"ID":"fab653ef-3379-4e6c-9efe-2a0994436f73","Type":"ContainerStarted","Data":"88a9a6e80453fcbcefa90e4a650bbfbdc1e902efb508fdbfbb06591101568739"} Jun 14 21:33:42.016703 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:42.016685 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r69lf" event={"ID":"82ba6948-a910-4e5e-8783-3c981623181c","Type":"ContainerStarted","Data":"ec5683bf3dae5e1ef35d34d1c638927eff1bd7184e4da28a036905d89555327b"} Jun 14 21:33:42.018617 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:42.018596 2563 generic.go:356] "Generic (PLEG): container finished" podID="e564eb22-98d2-4710-91ec-e8cbc19a5885" containerID="5891cbf7e06e5534b2fad17926dd9efc173dd1ae16f732e39a0a410291d7993e" exitCode=0 Jun 14 21:33:42.018766 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:42.018676 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tnc2v" event={"ID":"e564eb22-98d2-4710-91ec-e8cbc19a5885","Type":"ContainerDied","Data":"5891cbf7e06e5534b2fad17926dd9efc173dd1ae16f732e39a0a410291d7993e"} Jun 14 21:33:42.021640 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:42.021622 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bkzms_f03840e6-bb9f-46f3-ba9a-ab2a98d744fa/ovn-acl-logging/0.log" Jun 14 21:33:42.021938 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:42.021922 2563 generic.go:356] "Generic (PLEG): container finished" podID="f03840e6-bb9f-46f3-ba9a-ab2a98d744fa" containerID="91cdf68ae9e3c64f72cd2985294dc967f41a3dd833824073b9d40faeb111c5ed" exitCode=1 Jun 14 21:33:42.022006 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:42.021974 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" event={"ID":"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa","Type":"ContainerStarted","Data":"b04c313fb509835f7f78965e876813fae07044beae0c684255311a80e7f63509"} Jun 14 21:33:42.022062 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:42.022048 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" event={"ID":"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa","Type":"ContainerStarted","Data":"efc1f22db18c95c1852c2235fc3a52bb5f31521be8866e38fbc71d5d7186ef34"} Jun 14 21:33:42.022116 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:42.022077 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" event={"ID":"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa","Type":"ContainerDied","Data":"91cdf68ae9e3c64f72cd2985294dc967f41a3dd833824073b9d40faeb111c5ed"} Jun 14 21:33:42.022116 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:42.022107 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" event={"ID":"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa","Type":"ContainerStarted","Data":"c408cba8aaee80b0f749c1b3802cee5f2ce59a8b6ab9f4012f8c619da53cf31a"} Jun 14 21:33:42.023262 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:42.023241 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dsmrq" event={"ID":"6c41cf46-cb82-49f4-8d57-d6ac4df58684","Type":"ContainerStarted","Data":"9f23fb228d97226d505382b5b149025f829d6108ca5436dd1c63164a1a0aae0c"} Jun 14 21:33:42.024751 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:42.024729 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gc4zx" event={"ID":"2cd4f68b-6453-4fa4-a522-77a515ee960f","Type":"ContainerStarted","Data":"7287e12a6cb2eb0029557544bf8e12e9c546ce8ed5f32c71326619a8876f6f23"} Jun 14 21:33:42.031266 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:42.031230 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-95.ec2.internal" podStartSLOduration=22.031198811 podStartE2EDuration="22.031198811s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 21:33:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:33:24.993889243 +0000 UTC m=+5.458489986" watchObservedRunningTime="2026-06-14 21:33:42.031198811 +0000 UTC m=+22.495799557" Jun 14 21:33:42.031486 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:42.031463 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-v8kl4" podStartSLOduration=3.220907538 podStartE2EDuration="22.031458544s" totalImagesPullingTime="18.810551006s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 21:33:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:33:42.029901387 +0000 UTC m=+22.494502133" watchObservedRunningTime="2026-06-14 21:33:42.031458544 +0000 UTC m=+22.496059291" Jun 14 21:33:42.047493 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:42.045420 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-gc4zx" podStartSLOduration=3.231506837 podStartE2EDuration="22.045396106s" totalImagesPullingTime="18.813889269s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 21:33:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:33:42.045167127 +0000 UTC m=+22.509767889" watchObservedRunningTime="2026-06-14 21:33:42.045396106 +0000 UTC m=+22.509996843" Jun 14 21:33:42.060412 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:42.060376 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dsmrq" podStartSLOduration=3.25194785 podStartE2EDuration="22.060369965s" totalImagesPullingTime="18.808422115s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 21:33:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:33:42.059920066 +0000 UTC m=+22.524520815" watchObservedRunningTime="2026-06-14 21:33:42.060369965 +0000 UTC m=+22.524970711" Jun 14 21:33:42.073257 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:42.073202 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-l7htv" podStartSLOduration=3.295276818 podStartE2EDuration="22.073191458s" totalImagesPullingTime="18.77791464s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 21:33:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:33:42.072759629 +0000 UTC m=+22.537360377" watchObservedRunningTime="2026-06-14 21:33:42.073191458 +0000 UTC m=+22.537792203" Jun 14 21:33:42.111755 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:42.111257 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-r69lf" podStartSLOduration=8.087779347 podStartE2EDuration="22.111240476s" totalImagesPullingTime="14.023461129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:33:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:33:42.110805621 +0000 UTC m=+22.575406368" watchObservedRunningTime="2026-06-14 21:33:42.111240476 +0000 UTC m=+22.575841222" Jun 14 21:33:42.860190 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:42.860043 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 14 21:33:42.913382 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:42.913242 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-14T21:33:42.860188147Z","UUID":"ae9a7785-96ff-4f7c-bdd4-53ec57fe5297","Handler":null,"Name":"","Endpoint":""} Jun 14 21:33:42.914809 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:42.914786 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 14 21:33:42.914901 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:42.914829 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 14 21:33:43.029037 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:43.029009 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfd5l" event={"ID":"d9d9b760-032d-43e3-b5a5-f834f5060412","Type":"ContainerStarted","Data":"1a5e9ffc2db1a26f28c578201f5bd40b6f291717945221a6a8e39fd46271cad9"} Jun 14 21:33:43.032495 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:43.032473 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bkzms_f03840e6-bb9f-46f3-ba9a-ab2a98d744fa/ovn-acl-logging/0.log" Jun 14 21:33:43.033452 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:43.032978 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" event={"ID":"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa","Type":"ContainerStarted","Data":"5422a6528ffa5ec146772ab08c926276dbb8eaa5c4017287c1d3a442723a8ba0"} Jun 14 21:33:43.033452 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:43.033058 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" event={"ID":"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa","Type":"ContainerStarted","Data":"a074ba0cdfaec66706d2bf34fc71d88cf4d4f99ed23a0d38639fddae0054bf81"} Jun 14 21:33:43.233342 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:43.233264 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-r69lf" Jun 14 21:33:43.233940 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:43.233921 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-r69lf" Jun 14 21:33:43.916282 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:43.916254 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dt84" Jun 14 21:33:43.916282 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:43.916272 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-snfcq" Jun 14 21:33:43.916282 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:43.916268 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5wz8" Jun 14 21:33:43.916584 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:43.916391 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dt84" podUID="60997d9b-5a4e-4d38-8337-21cb8c551d0e" Jun 14 21:33:43.916584 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:43.916478 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5wz8" podUID="ab5e49aa-95ae-4957-8dca-5642fc6e0336" Jun 14 21:33:43.916707 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:43.916582 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-snfcq" podUID="95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb" Jun 14 21:33:44.043759 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:44.043319 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-g9tbl" event={"ID":"0605cbd9-4413-4172-bb98-5122e21fd9cc","Type":"ContainerStarted","Data":"8a614cdb80e6ae31f3c31703b2e1a55c80a1e0627d52147a27ccdad09233a1e1"} Jun 14 21:33:45.049071 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:45.049039 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bkzms_f03840e6-bb9f-46f3-ba9a-ab2a98d744fa/ovn-acl-logging/0.log" Jun 14 21:33:45.049610 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:45.049504 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" event={"ID":"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa","Type":"ContainerStarted","Data":"f9e1cd034dd51fff5947b925783681d927c1563837e00a53f2a044574e0a99f5"} Jun 14 21:33:45.051832 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:45.051805 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfd5l" event={"ID":"d9d9b760-032d-43e3-b5a5-f834f5060412","Type":"ContainerStarted","Data":"567e4c9651755397082066614b361540e0b1744377057c6b99bb79c39e796e5b"} Jun 14 21:33:45.051964 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:45.051853 2563 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 14 21:33:45.072174 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:45.072136 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfd5l" podStartSLOduration=4.233991746 podStartE2EDuration="25.072122449s" totalImagesPullingTime="20.838130703s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 21:33:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:33:45.072023762 +0000 UTC m=+25.536624507" watchObservedRunningTime="2026-06-14 21:33:45.072122449 +0000 UTC m=+25.536723194" Jun 14 21:33:45.072453 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:45.072418 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-g9tbl" podStartSLOduration=6.262450438 podStartE2EDuration="25.072409936s" totalImagesPullingTime="18.809959498s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 21:33:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:33:44.057415215 +0000 UTC m=+24.522015964" watchObservedRunningTime="2026-06-14 21:33:45.072409936 +0000 UTC m=+25.537010684" Jun 14 21:33:45.915987 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:45.915958 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5wz8" Jun 14 21:33:45.916147 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:45.915958 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dt84" Jun 14 21:33:45.916147 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:45.916086 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-snfcq" Jun 14 21:33:45.916147 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:45.916081 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5wz8" podUID="ab5e49aa-95ae-4957-8dca-5642fc6e0336" Jun 14 21:33:45.916336 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:45.916302 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-snfcq" podUID="95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb" Jun 14 21:33:45.916450 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:45.916416 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dt84" podUID="60997d9b-5a4e-4d38-8337-21cb8c551d0e" Jun 14 21:33:47.057852 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:47.057689 2563 generic.go:356] "Generic (PLEG): container finished" podID="e564eb22-98d2-4710-91ec-e8cbc19a5885" containerID="07660c638296e56b0a6e0103dad5b966d16c8cfe43b5eb595381276e35fc48c4" exitCode=0 Jun 14 21:33:47.058511 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:47.057765 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tnc2v" event={"ID":"e564eb22-98d2-4710-91ec-e8cbc19a5885","Type":"ContainerDied","Data":"07660c638296e56b0a6e0103dad5b966d16c8cfe43b5eb595381276e35fc48c4"} Jun 14 21:33:47.061867 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:47.061850 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bkzms_f03840e6-bb9f-46f3-ba9a-ab2a98d744fa/ovn-acl-logging/0.log" Jun 14 21:33:47.062196 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:47.062180 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" event={"ID":"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa","Type":"ContainerStarted","Data":"5db3ff104af7249e44251f856add11183153aee0d59b8389f21fa1cf6db78feb"} Jun 14 21:33:47.062460 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:47.062442 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:47.062562 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:47.062549 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:47.062662 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:47.062641 2563 scope.go:117] "RemoveContainer" containerID="91cdf68ae9e3c64f72cd2985294dc967f41a3dd833824073b9d40faeb111c5ed" Jun 14 21:33:47.079516 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:47.079498 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:47.915905 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:47.915879 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dt84" Jun 14 21:33:47.916050 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:47.915904 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-snfcq" Jun 14 21:33:47.916050 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:47.915879 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5wz8" Jun 14 21:33:47.916050 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:47.915997 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dt84" podUID="60997d9b-5a4e-4d38-8337-21cb8c551d0e" Jun 14 21:33:47.916196 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:47.916080 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5wz8" podUID="ab5e49aa-95ae-4957-8dca-5642fc6e0336" Jun 14 21:33:47.916196 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:47.916160 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-snfcq" podUID="95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb" Jun 14 21:33:48.067234 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:48.067174 2563 generic.go:356] "Generic (PLEG): container finished" podID="e564eb22-98d2-4710-91ec-e8cbc19a5885" containerID="fab61ad121f699b001b5b7c99a4012d6a0ffe1c5f9d28a0a3e1555e40b1b1b4e" exitCode=0 Jun 14 21:33:48.067632 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:48.067281 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tnc2v" event={"ID":"e564eb22-98d2-4710-91ec-e8cbc19a5885","Type":"ContainerDied","Data":"fab61ad121f699b001b5b7c99a4012d6a0ffe1c5f9d28a0a3e1555e40b1b1b4e"} Jun 14 21:33:48.071661 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:48.071644 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bkzms_f03840e6-bb9f-46f3-ba9a-ab2a98d744fa/ovn-acl-logging/0.log" Jun 14 21:33:48.072026 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:48.072006 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" event={"ID":"f03840e6-bb9f-46f3-ba9a-ab2a98d744fa","Type":"ContainerStarted","Data":"cc417a72a0a0ed9b930823ea3e139285fa82f05bdcb837a8b785922c6ead403c"} Jun 14 21:33:48.072315 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:48.072294 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:48.089134 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:48.089116 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:33:48.125876 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:48.125837 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" podStartSLOduration=9.26214161 podStartE2EDuration="28.125824193s" totalImagesPullingTime="18.863682583s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 21:33:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:33:48.123963015 +0000 UTC m=+28.588563771" watchObservedRunningTime="2026-06-14 21:33:48.125824193 +0000 UTC m=+28.590424964" Jun 14 21:33:48.321407 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:48.321341 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-snfcq"] Jun 14 21:33:48.321503 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:48.321418 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-snfcq" Jun 14 21:33:48.321550 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:48.321497 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-snfcq" podUID="95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb" Jun 14 21:33:48.324598 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:48.324574 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8dt84"] Jun 14 21:33:48.324703 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:48.324666 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dt84" Jun 14 21:33:48.324786 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:48.324762 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dt84" podUID="60997d9b-5a4e-4d38-8337-21cb8c551d0e" Jun 14 21:33:48.325191 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:48.325171 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g5wz8"] Jun 14 21:33:48.325287 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:48.325273 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5wz8" Jun 14 21:33:48.325389 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:48.325371 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5wz8" podUID="ab5e49aa-95ae-4957-8dca-5642fc6e0336" Jun 14 21:33:49.076231 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:49.076185 2563 generic.go:356] "Generic (PLEG): container finished" podID="e564eb22-98d2-4710-91ec-e8cbc19a5885" containerID="274c90e8cc8a4fb258101245214dfbb0383757123b1ef9be305ecf28fba493e1" exitCode=0 Jun 14 21:33:49.076755 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:49.076266 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tnc2v" event={"ID":"e564eb22-98d2-4710-91ec-e8cbc19a5885","Type":"ContainerDied","Data":"274c90e8cc8a4fb258101245214dfbb0383757123b1ef9be305ecf28fba493e1"} Jun 14 21:33:49.917460 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:49.917429 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5wz8" Jun 14 21:33:49.917625 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:49.917518 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-snfcq" Jun 14 21:33:49.917625 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:49.917556 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dt84" Jun 14 21:33:49.917625 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:49.917562 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5wz8" podUID="ab5e49aa-95ae-4957-8dca-5642fc6e0336" Jun 14 21:33:49.917777 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:49.917632 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dt84" podUID="60997d9b-5a4e-4d38-8337-21cb8c551d0e" Jun 14 21:33:49.917777 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:49.917717 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-snfcq" podUID="95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb" Jun 14 21:33:50.250402 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:50.250319 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-r69lf" Jun 14 21:33:50.250785 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:50.250446 2563 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 14 21:33:50.250891 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:50.250869 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-r69lf" Jun 14 21:33:51.916069 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:51.916036 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-snfcq" Jun 14 21:33:51.916749 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:51.916044 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5wz8" Jun 14 21:33:51.916749 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:51.916155 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-snfcq" podUID="95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb" Jun 14 21:33:51.916749 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:51.916189 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dt84" Jun 14 21:33:51.916749 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:51.916288 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5wz8" podUID="ab5e49aa-95ae-4957-8dca-5642fc6e0336" Jun 14 21:33:51.916749 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:51.916362 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dt84" podUID="60997d9b-5a4e-4d38-8337-21cb8c551d0e" Jun 14 21:33:52.270849 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:52.270773 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r69lf_82ba6948-a910-4e5e-8783-3c981623181c/konnectivity-agent/0.log" limit=1024 Jun 14 21:33:52.344900 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:52.344870 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r69lf_82ba6948-a910-4e5e-8783-3c981623181c/konnectivity-agent/0.log" limit=1024 Jun 14 21:33:53.629640 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:53.629608 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab5e49aa-95ae-4957-8dca-5642fc6e0336-metrics-certs\") pod \"network-metrics-daemon-g5wz8\" (UID: \"ab5e49aa-95ae-4957-8dca-5642fc6e0336\") " pod="openshift-multus/network-metrics-daemon-g5wz8" Jun 14 21:33:53.630195 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:53.629778 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 21:33:53.630195 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:53.629856 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab5e49aa-95ae-4957-8dca-5642fc6e0336-metrics-certs podName:ab5e49aa-95ae-4957-8dca-5642fc6e0336 nodeName:}" failed. No retries permitted until 2026-06-14 21:34:25.629835734 +0000 UTC m=+66.094436473 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab5e49aa-95ae-4957-8dca-5642fc6e0336-metrics-certs") pod "network-metrics-daemon-g5wz8" (UID: "ab5e49aa-95ae-4957-8dca-5642fc6e0336") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 21:33:53.730400 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:53.730364 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb-original-pull-secret\") pod \"global-pull-secret-syncer-snfcq\" (UID: \"95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb\") " pod="kube-system/global-pull-secret-syncer-snfcq" Jun 14 21:33:53.730555 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:53.730535 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 21:33:53.730619 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:53.730607 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb-original-pull-secret podName:95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb nodeName:}" failed. No retries permitted until 2026-06-14 21:34:25.730588237 +0000 UTC m=+66.195188965 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb-original-pull-secret") pod "global-pull-secret-syncer-snfcq" (UID: "95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb") : object "kube-system"/"original-pull-secret" not registered Jun 14 21:33:53.830835 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:53.830799 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4s9c\" (UniqueName: \"kubernetes.io/projected/60997d9b-5a4e-4d38-8337-21cb8c551d0e-kube-api-access-h4s9c\") pod \"network-check-target-8dt84\" (UID: \"60997d9b-5a4e-4d38-8337-21cb8c551d0e\") " pod="openshift-network-diagnostics/network-check-target-8dt84" Jun 14 21:33:53.830985 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:53.830954 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 21:33:53.830985 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:53.830976 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 21:33:53.830985 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:53.830985 2563 projected.go:196] Error preparing data for projected volume kube-api-access-h4s9c for pod openshift-network-diagnostics/network-check-target-8dt84: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 21:33:53.831103 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:53.831031 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60997d9b-5a4e-4d38-8337-21cb8c551d0e-kube-api-access-h4s9c podName:60997d9b-5a4e-4d38-8337-21cb8c551d0e nodeName:}" failed. No retries permitted until 2026-06-14 21:34:25.831018459 +0000 UTC m=+66.295619195 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-h4s9c" (UniqueName: "kubernetes.io/projected/60997d9b-5a4e-4d38-8337-21cb8c551d0e-kube-api-access-h4s9c") pod "network-check-target-8dt84" (UID: "60997d9b-5a4e-4d38-8337-21cb8c551d0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 21:33:53.915708 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:53.915650 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5wz8" Jun 14 21:33:53.915708 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:53.915678 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dt84" Jun 14 21:33:53.915847 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:53.915650 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-snfcq" Jun 14 21:33:53.915847 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:53.915754 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5wz8" podUID="ab5e49aa-95ae-4957-8dca-5642fc6e0336" Jun 14 21:33:53.915847 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:53.915823 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dt84" podUID="60997d9b-5a4e-4d38-8337-21cb8c551d0e" Jun 14 21:33:53.915953 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:53.915926 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-snfcq" podUID="95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb" Jun 14 21:33:54.423473 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:54.423445 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-95.ec2.internal" event="NodeReady" Jun 14 21:33:54.423609 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:54.423599 2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 14 21:33:54.464204 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:54.464153 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-r6tq6"] Jun 14 21:33:54.485300 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:54.485269 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-sw9gq"] Jun 14 21:33:54.485431 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:54.485412 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r6tq6" Jun 14 21:33:54.488166 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:54.488147 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dh44t\"" Jun 14 21:33:54.488166 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:54.488161 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 14 21:33:54.488297 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:54.488147 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 14 21:33:54.509604 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:54.509541 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-r6tq6"] Jun 14 21:33:54.509604 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:54.509572 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sw9gq"] Jun 14 21:33:54.509724 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:54.509645 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sw9gq" Jun 14 21:33:54.512081 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:54.512064 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 14 21:33:54.512259 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:54.512243 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 14 21:33:54.512335 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:54.512284 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 14 21:33:54.512452 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:54.512419 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dqfn9\"" Jun 14 21:33:54.535917 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:54.535898 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fb5528ef-9909-498c-b4f4-b02c05fe398e-config-volume\") pod \"dns-default-r6tq6\" (UID: \"fb5528ef-9909-498c-b4f4-b02c05fe398e\") " pod="openshift-dns/dns-default-r6tq6" Jun 14 21:33:54.535992 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:54.535922 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2782k\" (UniqueName: \"kubernetes.io/projected/35df5206-ea6b-4647-bd13-c3daf9c87884-kube-api-access-2782k\") pod \"ingress-canary-sw9gq\" (UID: \"35df5206-ea6b-4647-bd13-c3daf9c87884\") " pod="openshift-ingress-canary/ingress-canary-sw9gq" Jun 14 21:33:54.535992 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:54.535942 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/35df5206-ea6b-4647-bd13-c3daf9c87884-cert\") pod \"ingress-canary-sw9gq\" (UID: \"35df5206-ea6b-4647-bd13-c3daf9c87884\") " pod="openshift-ingress-canary/ingress-canary-sw9gq" Jun 14 21:33:54.535992 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:54.535968 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb5528ef-9909-498c-b4f4-b02c05fe398e-tmp-dir\") pod \"dns-default-r6tq6\" (UID: \"fb5528ef-9909-498c-b4f4-b02c05fe398e\") " pod="openshift-dns/dns-default-r6tq6" Jun 14 21:33:54.536159 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:54.536048 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wblr\" (UniqueName: \"kubernetes.io/projected/fb5528ef-9909-498c-b4f4-b02c05fe398e-kube-api-access-6wblr\") pod \"dns-default-r6tq6\" (UID: \"fb5528ef-9909-498c-b4f4-b02c05fe398e\") " pod="openshift-dns/dns-default-r6tq6" Jun 14 21:33:54.536159 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:54.536103 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb5528ef-9909-498c-b4f4-b02c05fe398e-metrics-tls\") pod \"dns-default-r6tq6\" (UID: \"fb5528ef-9909-498c-b4f4-b02c05fe398e\") " pod="openshift-dns/dns-default-r6tq6" Jun 14 21:33:54.637149 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:54.637129 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb5528ef-9909-498c-b4f4-b02c05fe398e-tmp-dir\") pod \"dns-default-r6tq6\" (UID: \"fb5528ef-9909-498c-b4f4-b02c05fe398e\") " pod="openshift-dns/dns-default-r6tq6" Jun 14 21:33:54.637494 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:54.637159 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wblr\" (UniqueName: \"kubernetes.io/projected/fb5528ef-9909-498c-b4f4-b02c05fe398e-kube-api-access-6wblr\") pod \"dns-default-r6tq6\" (UID: \"fb5528ef-9909-498c-b4f4-b02c05fe398e\") " pod="openshift-dns/dns-default-r6tq6" Jun 14 21:33:54.637494 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:54.637185 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb5528ef-9909-498c-b4f4-b02c05fe398e-metrics-tls\") pod \"dns-default-r6tq6\" (UID: \"fb5528ef-9909-498c-b4f4-b02c05fe398e\") " pod="openshift-dns/dns-default-r6tq6" Jun 14 21:33:54.637494 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:54.637243 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fb5528ef-9909-498c-b4f4-b02c05fe398e-config-volume\") pod \"dns-default-r6tq6\" (UID: \"fb5528ef-9909-498c-b4f4-b02c05fe398e\") " pod="openshift-dns/dns-default-r6tq6" Jun 14 21:33:54.637494 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:54.637262 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2782k\" (UniqueName: \"kubernetes.io/projected/35df5206-ea6b-4647-bd13-c3daf9c87884-kube-api-access-2782k\") pod \"ingress-canary-sw9gq\" (UID: \"35df5206-ea6b-4647-bd13-c3daf9c87884\") " pod="openshift-ingress-canary/ingress-canary-sw9gq" Jun 14 21:33:54.637494 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:54.637280 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/35df5206-ea6b-4647-bd13-c3daf9c87884-cert\") pod \"ingress-canary-sw9gq\" (UID: \"35df5206-ea6b-4647-bd13-c3daf9c87884\") " pod="openshift-ingress-canary/ingress-canary-sw9gq" Jun 14 21:33:54.637494 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:54.637412 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 21:33:54.637494 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:54.637470 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb5528ef-9909-498c-b4f4-b02c05fe398e-metrics-tls podName:fb5528ef-9909-498c-b4f4-b02c05fe398e nodeName:}" failed. No retries permitted until 2026-06-14 21:33:55.137450849 +0000 UTC m=+35.602051573 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fb5528ef-9909-498c-b4f4-b02c05fe398e-metrics-tls") pod "dns-default-r6tq6" (UID: "fb5528ef-9909-498c-b4f4-b02c05fe398e") : secret "dns-default-metrics-tls" not found Jun 14 21:33:54.637494 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:54.637477 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb5528ef-9909-498c-b4f4-b02c05fe398e-tmp-dir\") pod \"dns-default-r6tq6\" (UID: \"fb5528ef-9909-498c-b4f4-b02c05fe398e\") " pod="openshift-dns/dns-default-r6tq6" Jun 14 21:33:54.637830 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:54.637782 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fb5528ef-9909-498c-b4f4-b02c05fe398e-config-volume\") pod \"dns-default-r6tq6\" (UID: \"fb5528ef-9909-498c-b4f4-b02c05fe398e\") " pod="openshift-dns/dns-default-r6tq6" Jun 14 21:33:54.641197 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:54.641167 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/35df5206-ea6b-4647-bd13-c3daf9c87884-cert\") pod \"ingress-canary-sw9gq\" (UID: \"35df5206-ea6b-4647-bd13-c3daf9c87884\") " pod="openshift-ingress-canary/ingress-canary-sw9gq" Jun 14 21:33:54.650659 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:54.650631 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wblr\" (UniqueName: \"kubernetes.io/projected/fb5528ef-9909-498c-b4f4-b02c05fe398e-kube-api-access-6wblr\") pod \"dns-default-r6tq6\" (UID: \"fb5528ef-9909-498c-b4f4-b02c05fe398e\") " pod="openshift-dns/dns-default-r6tq6" Jun 14 21:33:54.650851 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:54.650831 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2782k\" (UniqueName: \"kubernetes.io/projected/35df5206-ea6b-4647-bd13-c3daf9c87884-kube-api-access-2782k\") pod \"ingress-canary-sw9gq\" (UID: \"35df5206-ea6b-4647-bd13-c3daf9c87884\") " pod="openshift-ingress-canary/ingress-canary-sw9gq" Jun 14 21:33:54.824193 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:54.824175 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sw9gq" Jun 14 21:33:55.034492 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:55.034463 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sw9gq"] Jun 14 21:33:55.037615 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:33:55.037592 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35df5206_ea6b_4647_bd13_c3daf9c87884.slice/crio-8f3bf09384d0ee1b633613ddccae98346278fee62d294cb7f0463870386effd5 WatchSource:0}: Error finding container 8f3bf09384d0ee1b633613ddccae98346278fee62d294cb7f0463870386effd5: Status 404 returned error can't find the container with id 8f3bf09384d0ee1b633613ddccae98346278fee62d294cb7f0463870386effd5 Jun 14 21:33:55.090167 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:55.090094 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sw9gq" event={"ID":"35df5206-ea6b-4647-bd13-c3daf9c87884","Type":"ContainerStarted","Data":"8f3bf09384d0ee1b633613ddccae98346278fee62d294cb7f0463870386effd5"} Jun 14 21:33:55.092785 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:55.092762 2563 generic.go:356] "Generic (PLEG): container finished" podID="e564eb22-98d2-4710-91ec-e8cbc19a5885" containerID="70730a29a124f2cac2790da70f36d088bceabe32a5e2b2dfe8ca22e1f8584e92" exitCode=0 Jun 14 21:33:55.092857 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:55.092803 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tnc2v" event={"ID":"e564eb22-98d2-4710-91ec-e8cbc19a5885","Type":"ContainerDied","Data":"70730a29a124f2cac2790da70f36d088bceabe32a5e2b2dfe8ca22e1f8584e92"} Jun 14 21:33:55.140582 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:55.140560 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb5528ef-9909-498c-b4f4-b02c05fe398e-metrics-tls\") pod \"dns-default-r6tq6\" (UID: \"fb5528ef-9909-498c-b4f4-b02c05fe398e\") " pod="openshift-dns/dns-default-r6tq6" Jun 14 21:33:55.140743 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:55.140724 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 21:33:55.140808 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:55.140786 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb5528ef-9909-498c-b4f4-b02c05fe398e-metrics-tls podName:fb5528ef-9909-498c-b4f4-b02c05fe398e nodeName:}" failed. No retries permitted until 2026-06-14 21:33:56.140766318 +0000 UTC m=+36.605367050 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fb5528ef-9909-498c-b4f4-b02c05fe398e-metrics-tls") pod "dns-default-r6tq6" (UID: "fb5528ef-9909-498c-b4f4-b02c05fe398e") : secret "dns-default-metrics-tls" not found Jun 14 21:33:55.916098 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:55.916064 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5wz8" Jun 14 21:33:55.916554 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:55.916077 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dt84" Jun 14 21:33:55.916554 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:55.916077 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-snfcq" Jun 14 21:33:55.919988 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:55.919948 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 14 21:33:55.920251 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:55.920232 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zzhb8\"" Jun 14 21:33:55.920332 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:55.920255 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 14 21:33:55.920332 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:55.920235 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 14 21:33:55.920332 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:55.920326 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-v2f84\"" Jun 14 21:33:55.920484 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:55.920235 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 14 21:33:56.100723 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:56.100689 2563 generic.go:356] "Generic (PLEG): container finished" podID="e564eb22-98d2-4710-91ec-e8cbc19a5885" containerID="bf910efdad6a12ebd78e3a282cd3638e232f892abaa7b0c3846fbdfd4aa16374" exitCode=0 Jun 14 21:33:56.100886 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:56.100752 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tnc2v" event={"ID":"e564eb22-98d2-4710-91ec-e8cbc19a5885","Type":"ContainerDied","Data":"bf910efdad6a12ebd78e3a282cd3638e232f892abaa7b0c3846fbdfd4aa16374"} Jun 14 21:33:56.147757 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:56.147731 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb5528ef-9909-498c-b4f4-b02c05fe398e-metrics-tls\") pod \"dns-default-r6tq6\" (UID: \"fb5528ef-9909-498c-b4f4-b02c05fe398e\") " pod="openshift-dns/dns-default-r6tq6" Jun 14 21:33:56.148706 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:56.148675 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 21:33:56.148914 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:56.148893 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb5528ef-9909-498c-b4f4-b02c05fe398e-metrics-tls podName:fb5528ef-9909-498c-b4f4-b02c05fe398e nodeName:}" failed. No retries permitted until 2026-06-14 21:33:58.148875002 +0000 UTC m=+38.613475737 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fb5528ef-9909-498c-b4f4-b02c05fe398e-metrics-tls") pod "dns-default-r6tq6" (UID: "fb5528ef-9909-498c-b4f4-b02c05fe398e") : secret "dns-default-metrics-tls" not found Jun 14 21:33:57.105748 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:57.105719 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tnc2v" event={"ID":"e564eb22-98d2-4710-91ec-e8cbc19a5885","Type":"ContainerStarted","Data":"cd4cc97d6001c17d287410bb15fbca2fe14c3cacaa8040ae987c211d2eef8f7f"} Jun 14 21:33:57.129919 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:57.129876 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tnc2v" podStartSLOduration=7.78755187 podStartE2EDuration="37.129862524s" totalImagesPullingTime="29.342310654s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 21:33:20 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:33:57.128150202 +0000 UTC m=+37.592750948" watchObservedRunningTime="2026-06-14 21:33:57.129862524 +0000 UTC m=+37.594463270" Jun 14 21:33:58.109416 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:58.109343 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sw9gq" event={"ID":"35df5206-ea6b-4647-bd13-c3daf9c87884","Type":"ContainerStarted","Data":"0d60eb6eb2eae36b98e7c03ec03f0124399cc768166eeabf13a0b3cbbaa81e41"} Jun 14 21:33:58.124551 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:58.124512 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-sw9gq" podStartSLOduration=2.174932547 podStartE2EDuration="4.124498027s" totalImagesPullingTime="1.94956548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:33:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:33:58.123971006 +0000 UTC m=+38.588571751" watchObservedRunningTime="2026-06-14 21:33:58.124498027 +0000 UTC m=+38.589098772" Jun 14 21:33:58.160264 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:33:58.160237 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb5528ef-9909-498c-b4f4-b02c05fe398e-metrics-tls\") pod \"dns-default-r6tq6\" (UID: \"fb5528ef-9909-498c-b4f4-b02c05fe398e\") " pod="openshift-dns/dns-default-r6tq6" Jun 14 21:33:58.160440 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:58.160416 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 21:33:58.160519 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:33:58.160505 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb5528ef-9909-498c-b4f4-b02c05fe398e-metrics-tls podName:fb5528ef-9909-498c-b4f4-b02c05fe398e nodeName:}" failed. No retries permitted until 2026-06-14 21:34:02.160485934 +0000 UTC m=+42.625086675 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fb5528ef-9909-498c-b4f4-b02c05fe398e-metrics-tls") pod "dns-default-r6tq6" (UID: "fb5528ef-9909-498c-b4f4-b02c05fe398e") : secret "dns-default-metrics-tls" not found Jun 14 21:34:02.188406 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:02.188374 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb5528ef-9909-498c-b4f4-b02c05fe398e-metrics-tls\") pod \"dns-default-r6tq6\" (UID: \"fb5528ef-9909-498c-b4f4-b02c05fe398e\") " pod="openshift-dns/dns-default-r6tq6" Jun 14 21:34:02.188836 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:34:02.188488 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 21:34:02.188836 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:34:02.188535 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb5528ef-9909-498c-b4f4-b02c05fe398e-metrics-tls podName:fb5528ef-9909-498c-b4f4-b02c05fe398e nodeName:}" failed. No retries permitted until 2026-06-14 21:34:10.18852386 +0000 UTC m=+50.653124584 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fb5528ef-9909-498c-b4f4-b02c05fe398e-metrics-tls") pod "dns-default-r6tq6" (UID: "fb5528ef-9909-498c-b4f4-b02c05fe398e") : secret "dns-default-metrics-tls" not found Jun 14 21:34:10.239971 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:10.239938 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb5528ef-9909-498c-b4f4-b02c05fe398e-metrics-tls\") pod \"dns-default-r6tq6\" (UID: \"fb5528ef-9909-498c-b4f4-b02c05fe398e\") " pod="openshift-dns/dns-default-r6tq6" Jun 14 21:34:10.240490 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:34:10.240098 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 21:34:10.240490 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:34:10.240158 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb5528ef-9909-498c-b4f4-b02c05fe398e-metrics-tls podName:fb5528ef-9909-498c-b4f4-b02c05fe398e nodeName:}" failed. No retries permitted until 2026-06-14 21:34:26.240141929 +0000 UTC m=+66.704742653 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fb5528ef-9909-498c-b4f4-b02c05fe398e-metrics-tls") pod "dns-default-r6tq6" (UID: "fb5528ef-9909-498c-b4f4-b02c05fe398e") : secret "dns-default-metrics-tls" not found Jun 14 21:34:20.089019 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:20.088993 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bkzms" Jun 14 21:34:25.638076 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:25.638040 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab5e49aa-95ae-4957-8dca-5642fc6e0336-metrics-certs\") pod \"network-metrics-daemon-g5wz8\" (UID: \"ab5e49aa-95ae-4957-8dca-5642fc6e0336\") " pod="openshift-multus/network-metrics-daemon-g5wz8" Jun 14 21:34:25.640984 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:25.640965 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 14 21:34:25.649176 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:34:25.649158 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 14 21:34:25.649277 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:34:25.649236 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab5e49aa-95ae-4957-8dca-5642fc6e0336-metrics-certs podName:ab5e49aa-95ae-4957-8dca-5642fc6e0336 nodeName:}" failed. No retries permitted until 2026-06-14 21:35:29.649197949 +0000 UTC m=+130.113798686 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab5e49aa-95ae-4957-8dca-5642fc6e0336-metrics-certs") pod "network-metrics-daemon-g5wz8" (UID: "ab5e49aa-95ae-4957-8dca-5642fc6e0336") : secret "metrics-daemon-secret" not found Jun 14 21:34:25.738955 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:25.738931 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb-original-pull-secret\") pod \"global-pull-secret-syncer-snfcq\" (UID: \"95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb\") " pod="kube-system/global-pull-secret-syncer-snfcq" Jun 14 21:34:25.742072 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:25.742057 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 14 21:34:25.752072 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:25.752054 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb-original-pull-secret\") pod \"global-pull-secret-syncer-snfcq\" (UID: \"95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb\") " pod="kube-system/global-pull-secret-syncer-snfcq" Jun 14 21:34:25.839653 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:25.839624 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4s9c\" (UniqueName: \"kubernetes.io/projected/60997d9b-5a4e-4d38-8337-21cb8c551d0e-kube-api-access-h4s9c\") pod \"network-check-target-8dt84\" (UID: \"60997d9b-5a4e-4d38-8337-21cb8c551d0e\") " pod="openshift-network-diagnostics/network-check-target-8dt84" Jun 14 21:34:25.842162 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:25.842148 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 14 21:34:25.852536 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:25.852512 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 14 21:34:25.862661 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:25.862639 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4s9c\" (UniqueName: \"kubernetes.io/projected/60997d9b-5a4e-4d38-8337-21cb8c551d0e-kube-api-access-h4s9c\") pod \"network-check-target-8dt84\" (UID: \"60997d9b-5a4e-4d38-8337-21cb8c551d0e\") " pod="openshift-network-diagnostics/network-check-target-8dt84" Jun 14 21:34:25.938147 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:25.938094 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zzhb8\"" Jun 14 21:34:25.940945 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:25.940931 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-snfcq" Jun 14 21:34:25.946242 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:25.946199 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dt84" Jun 14 21:34:26.071907 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:26.071739 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-snfcq"] Jun 14 21:34:26.074588 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:34:26.074560 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95f20b19_8b4b_4e5d_8b1c_fe16e8c48bdb.slice/crio-5274f4e866a188cb449489a1e22bcb647d05c4ac86ca64b0c3fb515f5433e893 WatchSource:0}: Error finding container 5274f4e866a188cb449489a1e22bcb647d05c4ac86ca64b0c3fb515f5433e893: Status 404 returned error can't find the container with id 5274f4e866a188cb449489a1e22bcb647d05c4ac86ca64b0c3fb515f5433e893 Jun 14 21:34:26.091413 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:26.091277 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8dt84"] Jun 14 21:34:26.095401 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:34:26.095379 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60997d9b_5a4e_4d38_8337_21cb8c551d0e.slice/crio-38f56005e23d22bc8f041725e0c4044f7aebbb089daf11c594caa7ae5d16a295 WatchSource:0}: Error finding container 38f56005e23d22bc8f041725e0c4044f7aebbb089daf11c594caa7ae5d16a295: Status 404 returned error can't find the container with id 38f56005e23d22bc8f041725e0c4044f7aebbb089daf11c594caa7ae5d16a295 Jun 14 21:34:26.172463 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:26.172436 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8dt84" event={"ID":"60997d9b-5a4e-4d38-8337-21cb8c551d0e","Type":"ContainerStarted","Data":"38f56005e23d22bc8f041725e0c4044f7aebbb089daf11c594caa7ae5d16a295"} Jun 14 21:34:26.173472 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:26.173453 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-snfcq" event={"ID":"95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb","Type":"ContainerStarted","Data":"5274f4e866a188cb449489a1e22bcb647d05c4ac86ca64b0c3fb515f5433e893"} Jun 14 21:34:26.242643 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:26.242588 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb5528ef-9909-498c-b4f4-b02c05fe398e-metrics-tls\") pod \"dns-default-r6tq6\" (UID: \"fb5528ef-9909-498c-b4f4-b02c05fe398e\") " pod="openshift-dns/dns-default-r6tq6" Jun 14 21:34:26.242736 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:34:26.242719 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 21:34:26.242775 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:34:26.242771 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb5528ef-9909-498c-b4f4-b02c05fe398e-metrics-tls podName:fb5528ef-9909-498c-b4f4-b02c05fe398e nodeName:}" failed. No retries permitted until 2026-06-14 21:34:58.242758028 +0000 UTC m=+98.707358757 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fb5528ef-9909-498c-b4f4-b02c05fe398e-metrics-tls") pod "dns-default-r6tq6" (UID: "fb5528ef-9909-498c-b4f4-b02c05fe398e") : secret "dns-default-metrics-tls" not found Jun 14 21:34:31.188865 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:31.188828 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8dt84" event={"ID":"60997d9b-5a4e-4d38-8337-21cb8c551d0e","Type":"ContainerStarted","Data":"1d5d78adbebca968b70ca0a2500785e2953343d3da9844c60d49628c2169cda4"} Jun 14 21:34:31.189317 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:31.188912 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8dt84" Jun 14 21:34:31.190258 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:31.190239 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-snfcq" event={"ID":"95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb","Type":"ContainerStarted","Data":"d830e8eef53833b71a3bc9301bbf6082e6551ad379320a079228f4456d73439e"} Jun 14 21:34:31.206558 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:31.206515 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8dt84" podStartSLOduration=66.884637059 podStartE2EDuration="1m11.206501582s" totalImagesPullingTime="4.321864523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:33:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:34:31.205775738 +0000 UTC m=+71.670376483" watchObservedRunningTime="2026-06-14 21:34:31.206501582 +0000 UTC m=+71.671102328" Jun 14 21:34:31.219619 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:31.219578 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-snfcq" podStartSLOduration=66.872379349 podStartE2EDuration="1m11.219565233s" totalImagesPullingTime="4.347185884s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 21:33:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:34:31.218873242 +0000 UTC m=+71.683473988" watchObservedRunningTime="2026-06-14 21:34:31.219565233 +0000 UTC m=+71.684166003" Jun 14 21:34:42.109475 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:42.109347 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-749c4774dd-xkkj8"] Jun 14 21:34:42.113564 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:42.113542 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749c4774dd-xkkj8" Jun 14 21:34:42.120962 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:42.120822 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 14 21:34:42.121102 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:42.121079 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 14 21:34:42.121307 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:42.120955 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 14 21:34:42.121538 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:42.121052 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 14 21:34:42.124066 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:42.124049 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5694485f96-2w9cz"] Jun 14 21:34:42.126729 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:42.126714 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5694485f96-2w9cz" Jun 14 21:34:42.130955 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:42.130936 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 14 21:34:42.136267 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:42.136248 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 14 21:34:42.136474 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:42.136459 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 14 21:34:42.136576 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:42.136560 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 14 21:34:42.146413 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:42.146392 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-749c4774dd-xkkj8"] Jun 14 21:34:42.151868 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:42.151849 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fea5a2db-dc5e-4fc2-bdae-c766747e2048-tmp\") pod \"klusterlet-addon-workmgr-749c4774dd-xkkj8\" (UID: \"fea5a2db-dc5e-4fc2-bdae-c766747e2048\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749c4774dd-xkkj8" Jun 14 21:34:42.151953 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:42.151877 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/fea5a2db-dc5e-4fc2-bdae-c766747e2048-klusterlet-config\") pod \"klusterlet-addon-workmgr-749c4774dd-xkkj8\" (UID: \"fea5a2db-dc5e-4fc2-bdae-c766747e2048\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749c4774dd-xkkj8" Jun 14 21:34:42.151953 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:42.151894 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6mz4\" (UniqueName: \"kubernetes.io/projected/fea5a2db-dc5e-4fc2-bdae-c766747e2048-kube-api-access-j6mz4\") pod \"klusterlet-addon-workmgr-749c4774dd-xkkj8\" (UID: \"fea5a2db-dc5e-4fc2-bdae-c766747e2048\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749c4774dd-xkkj8" Jun 14 21:34:42.155903 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:42.155884 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5694485f96-2w9cz"] Jun 14 21:34:42.253103 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:42.253078 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fea5a2db-dc5e-4fc2-bdae-c766747e2048-tmp\") pod \"klusterlet-addon-workmgr-749c4774dd-xkkj8\" (UID: \"fea5a2db-dc5e-4fc2-bdae-c766747e2048\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749c4774dd-xkkj8" Jun 14 21:34:42.253198 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:42.253105 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/fea5a2db-dc5e-4fc2-bdae-c766747e2048-klusterlet-config\") pod \"klusterlet-addon-workmgr-749c4774dd-xkkj8\" (UID: \"fea5a2db-dc5e-4fc2-bdae-c766747e2048\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749c4774dd-xkkj8" Jun 14 21:34:42.253198 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:42.253122 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6mz4\" (UniqueName: \"kubernetes.io/projected/fea5a2db-dc5e-4fc2-bdae-c766747e2048-kube-api-access-j6mz4\") pod \"klusterlet-addon-workmgr-749c4774dd-xkkj8\" (UID: \"fea5a2db-dc5e-4fc2-bdae-c766747e2048\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749c4774dd-xkkj8" Jun 14 21:34:42.253198 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:42.253139 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1c1e319f-0962-4a85-90d9-fcd7df06c8bd-hub\") pod \"cluster-proxy-proxy-agent-5694485f96-2w9cz\" (UID: \"1c1e319f-0962-4a85-90d9-fcd7df06c8bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5694485f96-2w9cz" Jun 14 21:34:42.253198 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:42.253158 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c1e319f-0962-4a85-90d9-fcd7df06c8bd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5694485f96-2w9cz\" (UID: \"1c1e319f-0962-4a85-90d9-fcd7df06c8bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5694485f96-2w9cz" Jun 14 21:34:42.253397 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:42.253198 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxlsd\" (UniqueName: \"kubernetes.io/projected/1c1e319f-0962-4a85-90d9-fcd7df06c8bd-kube-api-access-sxlsd\") pod \"cluster-proxy-proxy-agent-5694485f96-2w9cz\" (UID: \"1c1e319f-0962-4a85-90d9-fcd7df06c8bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5694485f96-2w9cz" Jun 14 21:34:42.253397 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:42.253286 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1c1e319f-0962-4a85-90d9-fcd7df06c8bd-ca\") pod \"cluster-proxy-proxy-agent-5694485f96-2w9cz\" (UID: \"1c1e319f-0962-4a85-90d9-fcd7df06c8bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5694485f96-2w9cz" Jun 14 21:34:42.253397 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:42.253363 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1c1e319f-0962-4a85-90d9-fcd7df06c8bd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5694485f96-2w9cz\" (UID: \"1c1e319f-0962-4a85-90d9-fcd7df06c8bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5694485f96-2w9cz" Jun 14 21:34:42.253501 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:42.253399 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1c1e319f-0962-4a85-90d9-fcd7df06c8bd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5694485f96-2w9cz\" (UID: \"1c1e319f-0962-4a85-90d9-fcd7df06c8bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5694485f96-2w9cz" Jun 14 21:34:42.253501 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:42.253448 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fea5a2db-dc5e-4fc2-bdae-c766747e2048-tmp\") pod \"klusterlet-addon-workmgr-749c4774dd-xkkj8\" (UID: \"fea5a2db-dc5e-4fc2-bdae-c766747e2048\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749c4774dd-xkkj8" Jun 14 21:34:42.255563 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:42.255548 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/fea5a2db-dc5e-4fc2-bdae-c766747e2048-klusterlet-config\") pod \"klusterlet-addon-workmgr-749c4774dd-xkkj8\" (UID: \"fea5a2db-dc5e-4fc2-bdae-c766747e2048\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749c4774dd-xkkj8" Jun 14 21:34:42.261828 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:42.261803 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6mz4\" (UniqueName: \"kubernetes.io/projected/fea5a2db-dc5e-4fc2-bdae-c766747e2048-kube-api-access-j6mz4\") pod \"klusterlet-addon-workmgr-749c4774dd-xkkj8\" (UID: \"fea5a2db-dc5e-4fc2-bdae-c766747e2048\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749c4774dd-xkkj8" Jun 14 21:34:42.353915 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:42.353893 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1c1e319f-0962-4a85-90d9-fcd7df06c8bd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5694485f96-2w9cz\" (UID: \"1c1e319f-0962-4a85-90d9-fcd7df06c8bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5694485f96-2w9cz" Jun 14 21:34:42.353997 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:42.353920 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1c1e319f-0962-4a85-90d9-fcd7df06c8bd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5694485f96-2w9cz\" (UID: \"1c1e319f-0962-4a85-90d9-fcd7df06c8bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5694485f96-2w9cz" Jun 14 21:34:42.353997 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:42.353958 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1c1e319f-0962-4a85-90d9-fcd7df06c8bd-hub\") pod \"cluster-proxy-proxy-agent-5694485f96-2w9cz\" (UID: \"1c1e319f-0962-4a85-90d9-fcd7df06c8bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5694485f96-2w9cz" Jun 14 21:34:42.353997 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:42.353984 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c1e319f-0962-4a85-90d9-fcd7df06c8bd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5694485f96-2w9cz\" (UID: \"1c1e319f-0962-4a85-90d9-fcd7df06c8bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5694485f96-2w9cz" Jun 14 21:34:42.354135 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:42.354023 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxlsd\" (UniqueName: \"kubernetes.io/projected/1c1e319f-0962-4a85-90d9-fcd7df06c8bd-kube-api-access-sxlsd\") pod \"cluster-proxy-proxy-agent-5694485f96-2w9cz\" (UID: \"1c1e319f-0962-4a85-90d9-fcd7df06c8bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5694485f96-2w9cz" Jun 14 21:34:42.354135 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:42.354048 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1c1e319f-0962-4a85-90d9-fcd7df06c8bd-ca\") pod \"cluster-proxy-proxy-agent-5694485f96-2w9cz\" (UID: \"1c1e319f-0962-4a85-90d9-fcd7df06c8bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5694485f96-2w9cz" Jun 14 21:34:42.354944 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:42.354918 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c1e319f-0962-4a85-90d9-fcd7df06c8bd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5694485f96-2w9cz\" (UID: \"1c1e319f-0962-4a85-90d9-fcd7df06c8bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5694485f96-2w9cz" Jun 14 21:34:42.356498 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:42.356471 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1c1e319f-0962-4a85-90d9-fcd7df06c8bd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5694485f96-2w9cz\" (UID: \"1c1e319f-0962-4a85-90d9-fcd7df06c8bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5694485f96-2w9cz" Jun 14 21:34:42.356590 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:42.356553 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1c1e319f-0962-4a85-90d9-fcd7df06c8bd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5694485f96-2w9cz\" (UID: \"1c1e319f-0962-4a85-90d9-fcd7df06c8bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5694485f96-2w9cz" Jun 14 21:34:42.356650 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:42.356559 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1c1e319f-0962-4a85-90d9-fcd7df06c8bd-ca\") pod \"cluster-proxy-proxy-agent-5694485f96-2w9cz\" (UID: \"1c1e319f-0962-4a85-90d9-fcd7df06c8bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5694485f96-2w9cz" Jun 14 21:34:42.356650 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:42.356638 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1c1e319f-0962-4a85-90d9-fcd7df06c8bd-hub\") pod \"cluster-proxy-proxy-agent-5694485f96-2w9cz\" (UID: \"1c1e319f-0962-4a85-90d9-fcd7df06c8bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5694485f96-2w9cz" Jun 14 21:34:42.366915 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:42.366864 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxlsd\" (UniqueName: \"kubernetes.io/projected/1c1e319f-0962-4a85-90d9-fcd7df06c8bd-kube-api-access-sxlsd\") pod \"cluster-proxy-proxy-agent-5694485f96-2w9cz\" (UID: \"1c1e319f-0962-4a85-90d9-fcd7df06c8bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5694485f96-2w9cz" Jun 14 21:34:42.423891 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:42.423869 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749c4774dd-xkkj8" Jun 14 21:34:42.444803 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:42.444785 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5694485f96-2w9cz" Jun 14 21:34:42.559455 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:42.559264 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-749c4774dd-xkkj8"] Jun 14 21:34:42.561399 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:34:42.561360 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfea5a2db_dc5e_4fc2_bdae_c766747e2048.slice/crio-f962265dd104cef3681221d5d8500e015c5d447c3aa81635bea653cf98b36982 WatchSource:0}: Error finding container f962265dd104cef3681221d5d8500e015c5d447c3aa81635bea653cf98b36982: Status 404 returned error can't find the container with id f962265dd104cef3681221d5d8500e015c5d447c3aa81635bea653cf98b36982 Jun 14 21:34:42.576982 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:42.576961 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5694485f96-2w9cz"] Jun 14 21:34:42.579472 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:34:42.579440 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1c1e319f_0962_4a85_90d9_fcd7df06c8bd.slice/crio-2e515a60c65e60b2742075df32d4552a6240074849afe76dc3b98bb1069c39ee WatchSource:0}: Error finding container 2e515a60c65e60b2742075df32d4552a6240074849afe76dc3b98bb1069c39ee: Status 404 returned error can't find the container with id 2e515a60c65e60b2742075df32d4552a6240074849afe76dc3b98bb1069c39ee Jun 14 21:34:43.219308 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:43.219268 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5694485f96-2w9cz" event={"ID":"1c1e319f-0962-4a85-90d9-fcd7df06c8bd","Type":"ContainerStarted","Data":"2e515a60c65e60b2742075df32d4552a6240074849afe76dc3b98bb1069c39ee"} Jun 14 21:34:43.220594 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:43.220550 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749c4774dd-xkkj8" event={"ID":"fea5a2db-dc5e-4fc2-bdae-c766747e2048","Type":"ContainerStarted","Data":"f962265dd104cef3681221d5d8500e015c5d447c3aa81635bea653cf98b36982"} Jun 14 21:34:49.241830 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:49.241794 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5694485f96-2w9cz" event={"ID":"1c1e319f-0962-4a85-90d9-fcd7df06c8bd","Type":"ContainerStarted","Data":"e47dc077842522a9d338b306a587bbdaba50f889493498899c191ae52b98a377"} Jun 14 21:34:49.242281 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:49.241838 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5694485f96-2w9cz" event={"ID":"1c1e319f-0962-4a85-90d9-fcd7df06c8bd","Type":"ContainerStarted","Data":"646900291b62caa9e48ca24b85efb9dab74f8cbb2af73e5abd45ca96701d580f"} Jun 14 21:34:49.242281 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:49.241850 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5694485f96-2w9cz" event={"ID":"1c1e319f-0962-4a85-90d9-fcd7df06c8bd","Type":"ContainerStarted","Data":"c937a3586c806a9b87b8fbe6f372ca8feebf7a63a01b3599811a386fa39489a5"} Jun 14 21:34:49.243242 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:49.243203 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749c4774dd-xkkj8" event={"ID":"fea5a2db-dc5e-4fc2-bdae-c766747e2048","Type":"ContainerStarted","Data":"3bad9eb3d5613d83e59338542934164e6740fdf359ec5209dcb64887f033abc6"} Jun 14 21:34:49.243423 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:49.243411 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749c4774dd-xkkj8" Jun 14 21:34:49.244857 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:49.244838 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749c4774dd-xkkj8" Jun 14 21:34:49.265557 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:49.265522 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5694485f96-2w9cz" podStartSLOduration=1.6128677790000001 podStartE2EDuration="7.265510285s" totalImagesPullingTime="5.652642506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:34:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:34:49.264401803 +0000 UTC m=+89.729002548" watchObservedRunningTime="2026-06-14 21:34:49.265510285 +0000 UTC m=+89.730111074" Jun 14 21:34:49.279225 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:49.279186 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749c4774dd-xkkj8" podStartSLOduration=1.606142975 podStartE2EDuration="7.279173288s" totalImagesPullingTime="5.673030313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:34:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:34:49.278865189 +0000 UTC m=+89.743465937" watchObservedRunningTime="2026-06-14 21:34:49.279173288 +0000 UTC m=+89.743774012" Jun 14 21:34:58.260270 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:34:58.260172 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb5528ef-9909-498c-b4f4-b02c05fe398e-metrics-tls\") pod \"dns-default-r6tq6\" (UID: \"fb5528ef-9909-498c-b4f4-b02c05fe398e\") " pod="openshift-dns/dns-default-r6tq6" Jun 14 21:34:58.260593 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:34:58.260305 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 21:34:58.260593 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:34:58.260374 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb5528ef-9909-498c-b4f4-b02c05fe398e-metrics-tls podName:fb5528ef-9909-498c-b4f4-b02c05fe398e nodeName:}" failed. No retries permitted until 2026-06-14 21:36:02.260358934 +0000 UTC m=+162.724959658 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fb5528ef-9909-498c-b4f4-b02c05fe398e-metrics-tls") pod "dns-default-r6tq6" (UID: "fb5528ef-9909-498c-b4f4-b02c05fe398e") : secret "dns-default-metrics-tls" not found Jun 14 21:35:02.195970 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:35:02.195938 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8dt84" Jun 14 21:35:29.661341 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:35:29.661290 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab5e49aa-95ae-4957-8dca-5642fc6e0336-metrics-certs\") pod \"network-metrics-daemon-g5wz8\" (UID: \"ab5e49aa-95ae-4957-8dca-5642fc6e0336\") " pod="openshift-multus/network-metrics-daemon-g5wz8" Jun 14 21:35:29.661825 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:35:29.661446 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 14 21:35:29.661825 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:35:29.661545 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab5e49aa-95ae-4957-8dca-5642fc6e0336-metrics-certs podName:ab5e49aa-95ae-4957-8dca-5642fc6e0336 nodeName:}" failed. No retries permitted until 2026-06-14 21:37:31.661507655 +0000 UTC m=+252.126108380 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab5e49aa-95ae-4957-8dca-5642fc6e0336-metrics-certs") pod "network-metrics-daemon-g5wz8" (UID: "ab5e49aa-95ae-4957-8dca-5642fc6e0336") : secret "metrics-daemon-secret" not found Jun 14 21:35:57.520001 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:35:57.519965 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-r6tq6" podUID="fb5528ef-9909-498c-b4f4-b02c05fe398e" Jun 14 21:35:58.433735 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:35:58.433707 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r6tq6" Jun 14 21:35:58.927924 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:35:58.927888 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-g5wz8" podUID="ab5e49aa-95ae-4957-8dca-5642fc6e0336" Jun 14 21:36:02.263704 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:36:02.263620 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb5528ef-9909-498c-b4f4-b02c05fe398e-metrics-tls\") pod \"dns-default-r6tq6\" (UID: \"fb5528ef-9909-498c-b4f4-b02c05fe398e\") " pod="openshift-dns/dns-default-r6tq6" Jun 14 21:36:02.264128 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:36:02.263775 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 21:36:02.264128 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:36:02.263855 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb5528ef-9909-498c-b4f4-b02c05fe398e-metrics-tls podName:fb5528ef-9909-498c-b4f4-b02c05fe398e nodeName:}" failed. No retries permitted until 2026-06-14 21:38:04.263836738 +0000 UTC m=+284.728437469 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fb5528ef-9909-498c-b4f4-b02c05fe398e-metrics-tls") pod "dns-default-r6tq6" (UID: "fb5528ef-9909-498c-b4f4-b02c05fe398e") : secret "dns-default-metrics-tls" not found Jun 14 21:36:12.915791 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:36:12.915757 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5wz8" Jun 14 21:36:48.569856 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:36:48.569824 2563 generic.go:356] "Generic (PLEG): container finished" podID="fea5a2db-dc5e-4fc2-bdae-c766747e2048" containerID="3bad9eb3d5613d83e59338542934164e6740fdf359ec5209dcb64887f033abc6" exitCode=1 Jun 14 21:36:48.570238 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:36:48.569869 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749c4774dd-xkkj8" event={"ID":"fea5a2db-dc5e-4fc2-bdae-c766747e2048","Type":"ContainerDied","Data":"3bad9eb3d5613d83e59338542934164e6740fdf359ec5209dcb64887f033abc6"} Jun 14 21:36:48.570238 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:36:48.570123 2563 scope.go:117] "RemoveContainer" containerID="3bad9eb3d5613d83e59338542934164e6740fdf359ec5209dcb64887f033abc6" Jun 14 21:36:49.244227 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:36:49.244178 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749c4774dd-xkkj8" Jun 14 21:36:49.573832 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:36:49.573802 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749c4774dd-xkkj8" event={"ID":"fea5a2db-dc5e-4fc2-bdae-c766747e2048","Type":"ContainerStarted","Data":"328575f6795815f2fc9baeb530b277e44b0396fcbe1bed50117d727c9fe56b6c"} Jun 14 21:36:49.574183 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:36:49.574005 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749c4774dd-xkkj8" Jun 14 21:36:49.574631 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:36:49.574615 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749c4774dd-xkkj8" Jun 14 21:37:11.790061 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:11.790027 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hzbll"] Jun 14 21:37:11.793102 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:11.793080 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hzbll" Jun 14 21:37:11.795362 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:11.795337 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 14 21:37:11.795487 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:11.795338 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 14 21:37:11.795487 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:11.795357 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 14 21:37:11.796505 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:11.796490 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tgr2l\"" Jun 14 21:37:11.796505 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:11.796497 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 14 21:37:11.807852 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:11.807832 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hzbll"] Jun 14 21:37:11.914953 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:11.914924 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9285c99f-4f0e-4452-b585-a2f596798de7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hzbll\" (UID: \"9285c99f-4f0e-4452-b585-a2f596798de7\") " pod="openshift-insights/insights-runtime-extractor-hzbll" Jun 14 21:37:11.915104 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:11.914968 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kvnr\" (UniqueName: \"kubernetes.io/projected/9285c99f-4f0e-4452-b585-a2f596798de7-kube-api-access-2kvnr\") pod \"insights-runtime-extractor-hzbll\" (UID: \"9285c99f-4f0e-4452-b585-a2f596798de7\") " pod="openshift-insights/insights-runtime-extractor-hzbll" Jun 14 21:37:11.915104 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:11.914994 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9285c99f-4f0e-4452-b585-a2f596798de7-data-volume\") pod \"insights-runtime-extractor-hzbll\" (UID: \"9285c99f-4f0e-4452-b585-a2f596798de7\") " pod="openshift-insights/insights-runtime-extractor-hzbll" Jun 14 21:37:11.915181 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:11.915096 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9285c99f-4f0e-4452-b585-a2f596798de7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hzbll\" (UID: \"9285c99f-4f0e-4452-b585-a2f596798de7\") " pod="openshift-insights/insights-runtime-extractor-hzbll" Jun 14 21:37:11.915181 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:11.915124 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9285c99f-4f0e-4452-b585-a2f596798de7-crio-socket\") pod \"insights-runtime-extractor-hzbll\" (UID: \"9285c99f-4f0e-4452-b585-a2f596798de7\") " pod="openshift-insights/insights-runtime-extractor-hzbll" Jun 14 21:37:12.015345 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:12.015320 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kvnr\" (UniqueName: \"kubernetes.io/projected/9285c99f-4f0e-4452-b585-a2f596798de7-kube-api-access-2kvnr\") pod \"insights-runtime-extractor-hzbll\" (UID: \"9285c99f-4f0e-4452-b585-a2f596798de7\") " pod="openshift-insights/insights-runtime-extractor-hzbll" Jun 14 21:37:12.015345 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:12.015348 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9285c99f-4f0e-4452-b585-a2f596798de7-data-volume\") pod \"insights-runtime-extractor-hzbll\" (UID: \"9285c99f-4f0e-4452-b585-a2f596798de7\") " pod="openshift-insights/insights-runtime-extractor-hzbll" Jun 14 21:37:12.015518 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:12.015497 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9285c99f-4f0e-4452-b585-a2f596798de7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hzbll\" (UID: \"9285c99f-4f0e-4452-b585-a2f596798de7\") " pod="openshift-insights/insights-runtime-extractor-hzbll" Jun 14 21:37:12.015564 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:12.015527 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9285c99f-4f0e-4452-b585-a2f596798de7-crio-socket\") pod \"insights-runtime-extractor-hzbll\" (UID: \"9285c99f-4f0e-4452-b585-a2f596798de7\") " pod="openshift-insights/insights-runtime-extractor-hzbll" Jun 14 21:37:12.015564 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:12.015547 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9285c99f-4f0e-4452-b585-a2f596798de7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hzbll\" (UID: \"9285c99f-4f0e-4452-b585-a2f596798de7\") " pod="openshift-insights/insights-runtime-extractor-hzbll" Jun 14 21:37:12.015670 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:37:12.015625 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 21:37:12.015670 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:37:12.015635 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 21:37:12.015670 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:12.015639 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9285c99f-4f0e-4452-b585-a2f596798de7-crio-socket\") pod \"insights-runtime-extractor-hzbll\" (UID: \"9285c99f-4f0e-4452-b585-a2f596798de7\") " pod="openshift-insights/insights-runtime-extractor-hzbll" Jun 14 21:37:12.015670 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:12.015643 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9285c99f-4f0e-4452-b585-a2f596798de7-data-volume\") pod \"insights-runtime-extractor-hzbll\" (UID: \"9285c99f-4f0e-4452-b585-a2f596798de7\") " pod="openshift-insights/insights-runtime-extractor-hzbll" Jun 14 21:37:12.015858 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:37:12.015678 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9285c99f-4f0e-4452-b585-a2f596798de7-insights-runtime-extractor-tls podName:9285c99f-4f0e-4452-b585-a2f596798de7 nodeName:}" failed. No retries permitted until 2026-06-14 21:37:12.515664401 +0000 UTC m=+232.980265126 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9285c99f-4f0e-4452-b585-a2f596798de7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hzbll" (UID: "9285c99f-4f0e-4452-b585-a2f596798de7") : secret "insights-runtime-extractor-tls" not found Jun 14 21:37:12.015858 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:37:12.015700 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9285c99f-4f0e-4452-b585-a2f596798de7-kube-rbac-proxy-cm podName:9285c99f-4f0e-4452-b585-a2f596798de7 nodeName:}" failed. No retries permitted until 2026-06-14 21:37:12.515685479 +0000 UTC m=+232.980286203 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9285c99f-4f0e-4452-b585-a2f596798de7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hzbll" (UID: "9285c99f-4f0e-4452-b585-a2f596798de7") : configmap "kube-rbac-proxy" not found Jun 14 21:37:12.023343 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:12.023320 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kvnr\" (UniqueName: \"kubernetes.io/projected/9285c99f-4f0e-4452-b585-a2f596798de7-kube-api-access-2kvnr\") pod \"insights-runtime-extractor-hzbll\" (UID: \"9285c99f-4f0e-4452-b585-a2f596798de7\") " pod="openshift-insights/insights-runtime-extractor-hzbll" Jun 14 21:37:12.518787 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:12.518745 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9285c99f-4f0e-4452-b585-a2f596798de7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hzbll\" (UID: \"9285c99f-4f0e-4452-b585-a2f596798de7\") " pod="openshift-insights/insights-runtime-extractor-hzbll" Jun 14 21:37:12.518787 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:12.518790 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9285c99f-4f0e-4452-b585-a2f596798de7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hzbll\" (UID: \"9285c99f-4f0e-4452-b585-a2f596798de7\") " pod="openshift-insights/insights-runtime-extractor-hzbll" Jun 14 21:37:12.518998 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:37:12.518860 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 21:37:12.518998 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:37:12.518898 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 21:37:12.518998 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:37:12.518930 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9285c99f-4f0e-4452-b585-a2f596798de7-kube-rbac-proxy-cm podName:9285c99f-4f0e-4452-b585-a2f596798de7 nodeName:}" failed. No retries permitted until 2026-06-14 21:37:13.518912772 +0000 UTC m=+233.983513496 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9285c99f-4f0e-4452-b585-a2f596798de7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hzbll" (UID: "9285c99f-4f0e-4452-b585-a2f596798de7") : configmap "kube-rbac-proxy" not found Jun 14 21:37:12.518998 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:37:12.518947 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9285c99f-4f0e-4452-b585-a2f596798de7-insights-runtime-extractor-tls podName:9285c99f-4f0e-4452-b585-a2f596798de7 nodeName:}" failed. No retries permitted until 2026-06-14 21:37:13.518937306 +0000 UTC m=+233.983538030 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9285c99f-4f0e-4452-b585-a2f596798de7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hzbll" (UID: "9285c99f-4f0e-4452-b585-a2f596798de7") : secret "insights-runtime-extractor-tls" not found Jun 14 21:37:13.526790 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:13.526761 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9285c99f-4f0e-4452-b585-a2f596798de7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hzbll\" (UID: \"9285c99f-4f0e-4452-b585-a2f596798de7\") " pod="openshift-insights/insights-runtime-extractor-hzbll" Jun 14 21:37:13.526790 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:13.526794 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9285c99f-4f0e-4452-b585-a2f596798de7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hzbll\" (UID: \"9285c99f-4f0e-4452-b585-a2f596798de7\") " pod="openshift-insights/insights-runtime-extractor-hzbll" Jun 14 21:37:13.527271 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:37:13.526885 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 21:37:13.527271 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:37:13.526889 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 21:37:13.527271 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:37:13.526939 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9285c99f-4f0e-4452-b585-a2f596798de7-insights-runtime-extractor-tls podName:9285c99f-4f0e-4452-b585-a2f596798de7 nodeName:}" failed. No retries permitted until 2026-06-14 21:37:15.526923471 +0000 UTC m=+235.991524215 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9285c99f-4f0e-4452-b585-a2f596798de7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hzbll" (UID: "9285c99f-4f0e-4452-b585-a2f596798de7") : secret "insights-runtime-extractor-tls" not found Jun 14 21:37:13.527271 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:37:13.526952 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9285c99f-4f0e-4452-b585-a2f596798de7-kube-rbac-proxy-cm podName:9285c99f-4f0e-4452-b585-a2f596798de7 nodeName:}" failed. No retries permitted until 2026-06-14 21:37:15.52694638 +0000 UTC m=+235.991547104 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9285c99f-4f0e-4452-b585-a2f596798de7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hzbll" (UID: "9285c99f-4f0e-4452-b585-a2f596798de7") : configmap "kube-rbac-proxy" not found Jun 14 21:37:14.791696 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:14.791671 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l7htv_fab653ef-3379-4e6c-9efe-2a0994436f73/dns-node-resolver/0.log" Jun 14 21:37:15.541120 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:15.541086 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9285c99f-4f0e-4452-b585-a2f596798de7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hzbll\" (UID: \"9285c99f-4f0e-4452-b585-a2f596798de7\") " pod="openshift-insights/insights-runtime-extractor-hzbll" Jun 14 21:37:15.541120 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:15.541127 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9285c99f-4f0e-4452-b585-a2f596798de7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hzbll\" (UID: \"9285c99f-4f0e-4452-b585-a2f596798de7\") " pod="openshift-insights/insights-runtime-extractor-hzbll" Jun 14 21:37:15.541361 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:37:15.541243 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 21:37:15.541361 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:37:15.541207 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 21:37:15.541361 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:37:15.541294 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9285c99f-4f0e-4452-b585-a2f596798de7-insights-runtime-extractor-tls podName:9285c99f-4f0e-4452-b585-a2f596798de7 nodeName:}" failed. No retries permitted until 2026-06-14 21:37:19.541279492 +0000 UTC m=+240.005880216 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9285c99f-4f0e-4452-b585-a2f596798de7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hzbll" (UID: "9285c99f-4f0e-4452-b585-a2f596798de7") : secret "insights-runtime-extractor-tls" not found Jun 14 21:37:15.541361 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:37:15.541307 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9285c99f-4f0e-4452-b585-a2f596798de7-kube-rbac-proxy-cm podName:9285c99f-4f0e-4452-b585-a2f596798de7 nodeName:}" failed. No retries permitted until 2026-06-14 21:37:19.541301204 +0000 UTC m=+240.005901928 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9285c99f-4f0e-4452-b585-a2f596798de7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hzbll" (UID: "9285c99f-4f0e-4452-b585-a2f596798de7") : configmap "kube-rbac-proxy" not found Jun 14 21:37:15.792010 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:15.791948 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dsmrq_6c41cf46-cb82-49f4-8d57-d6ac4df58684/node-ca/0.log" Jun 14 21:37:16.593303 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:16.593280 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sw9gq_35df5206-ea6b-4647-bd13-c3daf9c87884/serve-healthcheck-canary/0.log" Jun 14 21:37:19.569460 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:19.569430 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9285c99f-4f0e-4452-b585-a2f596798de7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hzbll\" (UID: \"9285c99f-4f0e-4452-b585-a2f596798de7\") " pod="openshift-insights/insights-runtime-extractor-hzbll" Jun 14 21:37:19.569927 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:19.569466 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9285c99f-4f0e-4452-b585-a2f596798de7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hzbll\" (UID: \"9285c99f-4f0e-4452-b585-a2f596798de7\") " pod="openshift-insights/insights-runtime-extractor-hzbll" Jun 14 21:37:19.569927 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:37:19.569544 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 21:37:19.569927 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:37:19.569563 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 21:37:19.569927 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:37:19.569611 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9285c99f-4f0e-4452-b585-a2f596798de7-kube-rbac-proxy-cm podName:9285c99f-4f0e-4452-b585-a2f596798de7 nodeName:}" failed. No retries permitted until 2026-06-14 21:37:27.569597968 +0000 UTC m=+248.034198693 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9285c99f-4f0e-4452-b585-a2f596798de7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hzbll" (UID: "9285c99f-4f0e-4452-b585-a2f596798de7") : configmap "kube-rbac-proxy" not found Jun 14 21:37:19.569927 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:37:19.569626 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9285c99f-4f0e-4452-b585-a2f596798de7-insights-runtime-extractor-tls podName:9285c99f-4f0e-4452-b585-a2f596798de7 nodeName:}" failed. No retries permitted until 2026-06-14 21:37:27.569620354 +0000 UTC m=+248.034221078 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9285c99f-4f0e-4452-b585-a2f596798de7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hzbll" (UID: "9285c99f-4f0e-4452-b585-a2f596798de7") : secret "insights-runtime-extractor-tls" not found Jun 14 21:37:27.627799 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:27.627753 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9285c99f-4f0e-4452-b585-a2f596798de7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hzbll\" (UID: \"9285c99f-4f0e-4452-b585-a2f596798de7\") " pod="openshift-insights/insights-runtime-extractor-hzbll" Jun 14 21:37:27.627799 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:27.627806 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9285c99f-4f0e-4452-b585-a2f596798de7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hzbll\" (UID: \"9285c99f-4f0e-4452-b585-a2f596798de7\") " pod="openshift-insights/insights-runtime-extractor-hzbll" Jun 14 21:37:27.628339 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:27.628262 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9285c99f-4f0e-4452-b585-a2f596798de7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hzbll\" (UID: \"9285c99f-4f0e-4452-b585-a2f596798de7\") " pod="openshift-insights/insights-runtime-extractor-hzbll" Jun 14 21:37:27.630226 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:27.630194 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9285c99f-4f0e-4452-b585-a2f596798de7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hzbll\" (UID: \"9285c99f-4f0e-4452-b585-a2f596798de7\") " pod="openshift-insights/insights-runtime-extractor-hzbll" Jun 14 21:37:27.704832 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:27.704808 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tgr2l\"" Jun 14 21:37:27.712813 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:27.712796 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hzbll" Jun 14 21:37:27.830471 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:27.830442 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hzbll"] Jun 14 21:37:27.833654 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:37:27.833629 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9285c99f_4f0e_4452_b585_a2f596798de7.slice/crio-1e2f71d229896bb45953e67a08742147fdf4630f839760007687d70902eb5efb WatchSource:0}: Error finding container 1e2f71d229896bb45953e67a08742147fdf4630f839760007687d70902eb5efb: Status 404 returned error can't find the container with id 1e2f71d229896bb45953e67a08742147fdf4630f839760007687d70902eb5efb Jun 14 21:37:28.685266 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:28.685205 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hzbll" event={"ID":"9285c99f-4f0e-4452-b585-a2f596798de7","Type":"ContainerStarted","Data":"1e2f71d229896bb45953e67a08742147fdf4630f839760007687d70902eb5efb"} Jun 14 21:37:31.694797 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:31.694767 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hzbll" event={"ID":"9285c99f-4f0e-4452-b585-a2f596798de7","Type":"ContainerStarted","Data":"bd336aef46783605999215c43182405833650f6d91a00131389ffca01f240c6b"} Jun 14 21:37:31.760257 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:31.760206 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab5e49aa-95ae-4957-8dca-5642fc6e0336-metrics-certs\") pod \"network-metrics-daemon-g5wz8\" (UID: \"ab5e49aa-95ae-4957-8dca-5642fc6e0336\") " pod="openshift-multus/network-metrics-daemon-g5wz8" Jun 14 21:37:31.763199 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:31.763176 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab5e49aa-95ae-4957-8dca-5642fc6e0336-metrics-certs\") pod \"network-metrics-daemon-g5wz8\" (UID: \"ab5e49aa-95ae-4957-8dca-5642fc6e0336\") " pod="openshift-multus/network-metrics-daemon-g5wz8" Jun 14 21:37:31.818880 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:31.818855 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-v2f84\"" Jun 14 21:37:31.827092 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:31.827071 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5wz8" Jun 14 21:37:31.984539 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:31.981039 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g5wz8"] Jun 14 21:37:32.699736 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:32.699688 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g5wz8" event={"ID":"ab5e49aa-95ae-4957-8dca-5642fc6e0336","Type":"ContainerStarted","Data":"b9fac6af60a9a58ce8c8b82f8f301cc4615546d31dcd31f0cdceef033b7d40eb"} Jun 14 21:37:32.701612 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:32.701588 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hzbll" event={"ID":"9285c99f-4f0e-4452-b585-a2f596798de7","Type":"ContainerStarted","Data":"ce57a1d27395aab1bdbd0da436491efa75b0f0245596ad3c5569f9ac8ec196aa"} Jun 14 21:37:33.038823 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:33.037956 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-79c58d45f-6pl24"] Jun 14 21:37:33.041166 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:33.041144 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79c58d45f-6pl24" Jun 14 21:37:33.043851 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:33.043817 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 14 21:37:33.043992 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:33.043920 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 14 21:37:33.044845 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:33.044826 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 14 21:37:33.044939 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:33.044855 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-n55vx\"" Jun 14 21:37:33.051511 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:33.051488 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 14 21:37:33.111500 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:33.111463 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-79c58d45f-6pl24"] Jun 14 21:37:33.169256 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:33.169202 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4413ff08-cd1b-4f37-b3cd-bbd878484a8f-registry-certificates\") pod \"image-registry-79c58d45f-6pl24\" (UID: \"4413ff08-cd1b-4f37-b3cd-bbd878484a8f\") " pod="openshift-image-registry/image-registry-79c58d45f-6pl24" Jun 14 21:37:33.169256 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:33.169252 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxxgs\" (UniqueName: \"kubernetes.io/projected/4413ff08-cd1b-4f37-b3cd-bbd878484a8f-kube-api-access-fxxgs\") pod \"image-registry-79c58d45f-6pl24\" (UID: \"4413ff08-cd1b-4f37-b3cd-bbd878484a8f\") " pod="openshift-image-registry/image-registry-79c58d45f-6pl24" Jun 14 21:37:33.169454 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:33.169288 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4413ff08-cd1b-4f37-b3cd-bbd878484a8f-trusted-ca\") pod \"image-registry-79c58d45f-6pl24\" (UID: \"4413ff08-cd1b-4f37-b3cd-bbd878484a8f\") " pod="openshift-image-registry/image-registry-79c58d45f-6pl24" Jun 14 21:37:33.169454 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:33.169352 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4413ff08-cd1b-4f37-b3cd-bbd878484a8f-image-registry-private-configuration\") pod \"image-registry-79c58d45f-6pl24\" (UID: \"4413ff08-cd1b-4f37-b3cd-bbd878484a8f\") " pod="openshift-image-registry/image-registry-79c58d45f-6pl24" Jun 14 21:37:33.169454 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:33.169398 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4413ff08-cd1b-4f37-b3cd-bbd878484a8f-installation-pull-secrets\") pod \"image-registry-79c58d45f-6pl24\" (UID: \"4413ff08-cd1b-4f37-b3cd-bbd878484a8f\") " pod="openshift-image-registry/image-registry-79c58d45f-6pl24" Jun 14 21:37:33.169454 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:33.169423 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4413ff08-cd1b-4f37-b3cd-bbd878484a8f-registry-tls\") pod \"image-registry-79c58d45f-6pl24\" (UID: \"4413ff08-cd1b-4f37-b3cd-bbd878484a8f\") " pod="openshift-image-registry/image-registry-79c58d45f-6pl24" Jun 14 21:37:33.169622 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:33.169527 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4413ff08-cd1b-4f37-b3cd-bbd878484a8f-ca-trust-extracted\") pod \"image-registry-79c58d45f-6pl24\" (UID: \"4413ff08-cd1b-4f37-b3cd-bbd878484a8f\") " pod="openshift-image-registry/image-registry-79c58d45f-6pl24" Jun 14 21:37:33.169622 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:33.169597 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4413ff08-cd1b-4f37-b3cd-bbd878484a8f-bound-sa-token\") pod \"image-registry-79c58d45f-6pl24\" (UID: \"4413ff08-cd1b-4f37-b3cd-bbd878484a8f\") " pod="openshift-image-registry/image-registry-79c58d45f-6pl24" Jun 14 21:37:33.270108 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:33.270042 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4413ff08-cd1b-4f37-b3cd-bbd878484a8f-registry-tls\") pod \"image-registry-79c58d45f-6pl24\" (UID: \"4413ff08-cd1b-4f37-b3cd-bbd878484a8f\") " pod="openshift-image-registry/image-registry-79c58d45f-6pl24" Jun 14 21:37:33.270108 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:33.270087 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4413ff08-cd1b-4f37-b3cd-bbd878484a8f-ca-trust-extracted\") pod \"image-registry-79c58d45f-6pl24\" (UID: \"4413ff08-cd1b-4f37-b3cd-bbd878484a8f\") " pod="openshift-image-registry/image-registry-79c58d45f-6pl24" Jun 14 21:37:33.270345 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:33.270113 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4413ff08-cd1b-4f37-b3cd-bbd878484a8f-bound-sa-token\") pod \"image-registry-79c58d45f-6pl24\" (UID: \"4413ff08-cd1b-4f37-b3cd-bbd878484a8f\") " pod="openshift-image-registry/image-registry-79c58d45f-6pl24" Jun 14 21:37:33.270345 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:33.270149 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4413ff08-cd1b-4f37-b3cd-bbd878484a8f-registry-certificates\") pod \"image-registry-79c58d45f-6pl24\" (UID: \"4413ff08-cd1b-4f37-b3cd-bbd878484a8f\") " pod="openshift-image-registry/image-registry-79c58d45f-6pl24" Jun 14 21:37:33.270345 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:33.270172 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxxgs\" (UniqueName: \"kubernetes.io/projected/4413ff08-cd1b-4f37-b3cd-bbd878484a8f-kube-api-access-fxxgs\") pod \"image-registry-79c58d45f-6pl24\" (UID: \"4413ff08-cd1b-4f37-b3cd-bbd878484a8f\") " pod="openshift-image-registry/image-registry-79c58d45f-6pl24" Jun 14 21:37:33.270345 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:33.270208 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4413ff08-cd1b-4f37-b3cd-bbd878484a8f-trusted-ca\") pod \"image-registry-79c58d45f-6pl24\" (UID: \"4413ff08-cd1b-4f37-b3cd-bbd878484a8f\") " pod="openshift-image-registry/image-registry-79c58d45f-6pl24" Jun 14 21:37:33.270345 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:33.270265 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4413ff08-cd1b-4f37-b3cd-bbd878484a8f-image-registry-private-configuration\") pod \"image-registry-79c58d45f-6pl24\" (UID: \"4413ff08-cd1b-4f37-b3cd-bbd878484a8f\") " pod="openshift-image-registry/image-registry-79c58d45f-6pl24" Jun 14 21:37:33.270595 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:33.270451 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4413ff08-cd1b-4f37-b3cd-bbd878484a8f-installation-pull-secrets\") pod \"image-registry-79c58d45f-6pl24\" (UID: \"4413ff08-cd1b-4f37-b3cd-bbd878484a8f\") " pod="openshift-image-registry/image-registry-79c58d45f-6pl24" Jun 14 21:37:33.270595 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:33.270546 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4413ff08-cd1b-4f37-b3cd-bbd878484a8f-ca-trust-extracted\") pod \"image-registry-79c58d45f-6pl24\" (UID: \"4413ff08-cd1b-4f37-b3cd-bbd878484a8f\") " pod="openshift-image-registry/image-registry-79c58d45f-6pl24" Jun 14 21:37:33.271154 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:33.271123 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4413ff08-cd1b-4f37-b3cd-bbd878484a8f-registry-certificates\") pod \"image-registry-79c58d45f-6pl24\" (UID: \"4413ff08-cd1b-4f37-b3cd-bbd878484a8f\") " pod="openshift-image-registry/image-registry-79c58d45f-6pl24" Jun 14 21:37:33.271480 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:33.271458 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4413ff08-cd1b-4f37-b3cd-bbd878484a8f-trusted-ca\") pod \"image-registry-79c58d45f-6pl24\" (UID: \"4413ff08-cd1b-4f37-b3cd-bbd878484a8f\") " pod="openshift-image-registry/image-registry-79c58d45f-6pl24" Jun 14 21:37:33.273451 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:33.273393 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4413ff08-cd1b-4f37-b3cd-bbd878484a8f-installation-pull-secrets\") pod \"image-registry-79c58d45f-6pl24\" (UID: \"4413ff08-cd1b-4f37-b3cd-bbd878484a8f\") " pod="openshift-image-registry/image-registry-79c58d45f-6pl24" Jun 14 21:37:33.273809 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:33.273790 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4413ff08-cd1b-4f37-b3cd-bbd878484a8f-image-registry-private-configuration\") pod \"image-registry-79c58d45f-6pl24\" (UID: \"4413ff08-cd1b-4f37-b3cd-bbd878484a8f\") " pod="openshift-image-registry/image-registry-79c58d45f-6pl24" Jun 14 21:37:33.273809 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:33.273801 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4413ff08-cd1b-4f37-b3cd-bbd878484a8f-registry-tls\") pod \"image-registry-79c58d45f-6pl24\" (UID: \"4413ff08-cd1b-4f37-b3cd-bbd878484a8f\") " pod="openshift-image-registry/image-registry-79c58d45f-6pl24" Jun 14 21:37:33.278042 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:33.278019 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxxgs\" (UniqueName: \"kubernetes.io/projected/4413ff08-cd1b-4f37-b3cd-bbd878484a8f-kube-api-access-fxxgs\") pod \"image-registry-79c58d45f-6pl24\" (UID: \"4413ff08-cd1b-4f37-b3cd-bbd878484a8f\") " pod="openshift-image-registry/image-registry-79c58d45f-6pl24" Jun 14 21:37:33.278306 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:33.278282 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4413ff08-cd1b-4f37-b3cd-bbd878484a8f-bound-sa-token\") pod \"image-registry-79c58d45f-6pl24\" (UID: \"4413ff08-cd1b-4f37-b3cd-bbd878484a8f\") " pod="openshift-image-registry/image-registry-79c58d45f-6pl24" Jun 14 21:37:33.351224 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:33.351187 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79c58d45f-6pl24" Jun 14 21:37:33.699954 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:33.699928 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-79c58d45f-6pl24"] Jun 14 21:37:33.702699 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:37:33.702670 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4413ff08_cd1b_4f37_b3cd_bbd878484a8f.slice/crio-6238be7f7fe3533cc53021417cbe714ce33f1fd7c134615c2f5de281503e8063 WatchSource:0}: Error finding container 6238be7f7fe3533cc53021417cbe714ce33f1fd7c134615c2f5de281503e8063: Status 404 returned error can't find the container with id 6238be7f7fe3533cc53021417cbe714ce33f1fd7c134615c2f5de281503e8063 Jun 14 21:37:33.706413 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:33.706392 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g5wz8" event={"ID":"ab5e49aa-95ae-4957-8dca-5642fc6e0336","Type":"ContainerStarted","Data":"b5a86c9eeeb5ff7e9d5b600fc57cd67fa43fab9332f68d797360f487b7fdfc6b"} Jun 14 21:37:33.706501 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:33.706444 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g5wz8" event={"ID":"ab5e49aa-95ae-4957-8dca-5642fc6e0336","Type":"ContainerStarted","Data":"09743cd7c0a03d64a9e8849da2c0a6d780a30cff18d5d2cb52d465ab0c32301e"} Jun 14 21:37:33.708484 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:33.708455 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hzbll" event={"ID":"9285c99f-4f0e-4452-b585-a2f596798de7","Type":"ContainerStarted","Data":"2fb3313809332b6515b429713a3d34e0099c5bac9c8330faeebb50716c7c5195"} Jun 14 21:37:33.722359 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:33.722321 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-g5wz8" podStartSLOduration=252.878322741 podStartE2EDuration="4m13.722307314s" totalImagesPullingTime="843.984573ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:33:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:37:33.721959487 +0000 UTC m=+254.186560235" watchObservedRunningTime="2026-06-14 21:37:33.722307314 +0000 UTC m=+254.186908060" Jun 14 21:37:33.742727 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:33.742691 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hzbll" podStartSLOduration=17.0611604 podStartE2EDuration="22.742672461s" totalImagesPullingTime="5.681512061s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 21:37:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:37:33.742271939 +0000 UTC m=+254.206872685" watchObservedRunningTime="2026-06-14 21:37:33.742672461 +0000 UTC m=+254.207273210" Jun 14 21:37:34.713342 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:34.713307 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79c58d45f-6pl24" event={"ID":"4413ff08-cd1b-4f37-b3cd-bbd878484a8f","Type":"ContainerStarted","Data":"12139c5bedbcb38c0577f716dc7a2a6f704de389de9a6c402472e22e71dbfae9"} Jun 14 21:37:34.713782 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:34.713641 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-79c58d45f-6pl24" Jun 14 21:37:34.713782 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:34.713671 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79c58d45f-6pl24" event={"ID":"4413ff08-cd1b-4f37-b3cd-bbd878484a8f","Type":"ContainerStarted","Data":"6238be7f7fe3533cc53021417cbe714ce33f1fd7c134615c2f5de281503e8063"} Jun 14 21:37:34.733302 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:34.733263 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-79c58d45f-6pl24" podStartSLOduration=1.733250232 podStartE2EDuration="1.733250232s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:37:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:37:34.731479698 +0000 UTC m=+255.196080444" watchObservedRunningTime="2026-06-14 21:37:34.733250232 +0000 UTC m=+255.197850977" Jun 14 21:37:53.356465 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:53.356429 2563 patch_prober.go:28] interesting pod/image-registry-79c58d45f-6pl24 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 14 21:37:53.356918 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:53.356497 2563 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-79c58d45f-6pl24" podUID="4413ff08-cd1b-4f37-b3cd-bbd878484a8f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 21:37:56.722682 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:56.722647 2563 patch_prober.go:28] interesting pod/image-registry-79c58d45f-6pl24 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 14 21:37:56.723042 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:37:56.722694 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-79c58d45f-6pl24" podUID="4413ff08-cd1b-4f37-b3cd-bbd878484a8f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 21:38:00.947961 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:00.947923 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-vmpdb"] Jun 14 21:38:00.962398 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:00.962361 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-b7rhn"] Jun 14 21:38:00.962540 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:00.962456 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-vmpdb" Jun 14 21:38:00.964397 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:00.964376 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-vmpdb"] Jun 14 21:38:00.964526 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:00.964456 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-b7rhn" Jun 14 21:38:00.966185 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:00.966156 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-bmxd6\"" Jun 14 21:38:00.966322 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:00.966307 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 14 21:38:00.966386 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:00.966347 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 14 21:38:00.966386 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:00.966359 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 14 21:38:00.966488 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:00.966397 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 14 21:38:00.966488 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:00.966354 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 14 21:38:00.966600 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:00.966579 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 14 21:38:00.966785 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:00.966765 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 14 21:38:00.966860 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:00.966801 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 14 21:38:00.966860 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:00.966770 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5qb4h\"" Jun 14 21:38:00.967010 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:00.966984 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 14 21:38:01.138531 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:01.138495 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cf818c0b-dd90-4f91-9620-4405f5dcd447-node-exporter-textfile\") pod \"node-exporter-b7rhn\" (UID: \"cf818c0b-dd90-4f91-9620-4405f5dcd447\") " pod="openshift-monitoring/node-exporter-b7rhn" Jun 14 21:38:01.138971 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:01.138535 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/636bebe8-1ca5-4643-afd1-9db48d2835e6-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-vmpdb\" (UID: \"636bebe8-1ca5-4643-afd1-9db48d2835e6\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-vmpdb" Jun 14 21:38:01.139086 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:01.139053 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/636bebe8-1ca5-4643-afd1-9db48d2835e6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-vmpdb\" (UID: \"636bebe8-1ca5-4643-afd1-9db48d2835e6\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-vmpdb" Jun 14 21:38:01.139147 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:01.139095 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rd2n2\" (UniqueName: \"kubernetes.io/projected/cf818c0b-dd90-4f91-9620-4405f5dcd447-kube-api-access-rd2n2\") pod \"node-exporter-b7rhn\" (UID: \"cf818c0b-dd90-4f91-9620-4405f5dcd447\") " pod="openshift-monitoring/node-exporter-b7rhn" Jun 14 21:38:01.139147 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:01.139125 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cf818c0b-dd90-4f91-9620-4405f5dcd447-node-exporter-tls\") pod \"node-exporter-b7rhn\" (UID: \"cf818c0b-dd90-4f91-9620-4405f5dcd447\") " pod="openshift-monitoring/node-exporter-b7rhn" Jun 14 21:38:01.139288 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:01.139159 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cf818c0b-dd90-4f91-9620-4405f5dcd447-node-exporter-wtmp\") pod \"node-exporter-b7rhn\" (UID: \"cf818c0b-dd90-4f91-9620-4405f5dcd447\") " pod="openshift-monitoring/node-exporter-b7rhn" Jun 14 21:38:01.139288 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:01.139202 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cf818c0b-dd90-4f91-9620-4405f5dcd447-root\") pod \"node-exporter-b7rhn\" (UID: \"cf818c0b-dd90-4f91-9620-4405f5dcd447\") " pod="openshift-monitoring/node-exporter-b7rhn" Jun 14 21:38:01.139288 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:01.139277 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf818c0b-dd90-4f91-9620-4405f5dcd447-sys\") pod \"node-exporter-b7rhn\" (UID: \"cf818c0b-dd90-4f91-9620-4405f5dcd447\") " pod="openshift-monitoring/node-exporter-b7rhn" Jun 14 21:38:01.139442 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:01.139311 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw4g5\" (UniqueName: \"kubernetes.io/projected/636bebe8-1ca5-4643-afd1-9db48d2835e6-kube-api-access-kw4g5\") pod \"kube-state-metrics-678bc549d7-vmpdb\" (UID: \"636bebe8-1ca5-4643-afd1-9db48d2835e6\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-vmpdb" Jun 14 21:38:01.139442 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:01.139339 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf818c0b-dd90-4f91-9620-4405f5dcd447-metrics-client-ca\") pod \"node-exporter-b7rhn\" (UID: \"cf818c0b-dd90-4f91-9620-4405f5dcd447\") " pod="openshift-monitoring/node-exporter-b7rhn" Jun 14 21:38:01.139442 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:01.139381 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/636bebe8-1ca5-4643-afd1-9db48d2835e6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-vmpdb\" (UID: \"636bebe8-1ca5-4643-afd1-9db48d2835e6\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-vmpdb" Jun 14 21:38:01.139442 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:01.139425 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cf818c0b-dd90-4f91-9620-4405f5dcd447-node-exporter-accelerators-collector-config\") pod \"node-exporter-b7rhn\" (UID: \"cf818c0b-dd90-4f91-9620-4405f5dcd447\") " pod="openshift-monitoring/node-exporter-b7rhn" Jun 14 21:38:01.139638 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:01.139458 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/636bebe8-1ca5-4643-afd1-9db48d2835e6-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-vmpdb\" (UID: \"636bebe8-1ca5-4643-afd1-9db48d2835e6\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-vmpdb" Jun 14 21:38:01.139638 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:01.139514 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf818c0b-dd90-4f91-9620-4405f5dcd447-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b7rhn\" (UID: \"cf818c0b-dd90-4f91-9620-4405f5dcd447\") " pod="openshift-monitoring/node-exporter-b7rhn" Jun 14 21:38:01.139638 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:01.139544 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/636bebe8-1ca5-4643-afd1-9db48d2835e6-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-vmpdb\" (UID: \"636bebe8-1ca5-4643-afd1-9db48d2835e6\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-vmpdb" Jun 14 21:38:01.240745 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:01.240660 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cf818c0b-dd90-4f91-9620-4405f5dcd447-node-exporter-textfile\") pod \"node-exporter-b7rhn\" (UID: \"cf818c0b-dd90-4f91-9620-4405f5dcd447\") " pod="openshift-monitoring/node-exporter-b7rhn" Jun 14 21:38:01.240745 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:01.240706 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/636bebe8-1ca5-4643-afd1-9db48d2835e6-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-vmpdb\" (UID: \"636bebe8-1ca5-4643-afd1-9db48d2835e6\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-vmpdb" Jun 14 21:38:01.240963 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:01.240857 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/636bebe8-1ca5-4643-afd1-9db48d2835e6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-vmpdb\" (UID: \"636bebe8-1ca5-4643-afd1-9db48d2835e6\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-vmpdb" Jun 14 21:38:01.240963 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:01.240890 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rd2n2\" (UniqueName: \"kubernetes.io/projected/cf818c0b-dd90-4f91-9620-4405f5dcd447-kube-api-access-rd2n2\") pod \"node-exporter-b7rhn\" (UID: \"cf818c0b-dd90-4f91-9620-4405f5dcd447\") " pod="openshift-monitoring/node-exporter-b7rhn" Jun 14 21:38:01.240963 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:01.240914 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cf818c0b-dd90-4f91-9620-4405f5dcd447-node-exporter-tls\") pod \"node-exporter-b7rhn\" (UID: \"cf818c0b-dd90-4f91-9620-4405f5dcd447\") " pod="openshift-monitoring/node-exporter-b7rhn" Jun 14 21:38:01.240963 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:01.240931 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cf818c0b-dd90-4f91-9620-4405f5dcd447-node-exporter-wtmp\") pod \"node-exporter-b7rhn\" (UID: \"cf818c0b-dd90-4f91-9620-4405f5dcd447\") " pod="openshift-monitoring/node-exporter-b7rhn" Jun 14 21:38:01.240963 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:01.240954 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cf818c0b-dd90-4f91-9620-4405f5dcd447-root\") pod \"node-exporter-b7rhn\" (UID: \"cf818c0b-dd90-4f91-9620-4405f5dcd447\") " pod="openshift-monitoring/node-exporter-b7rhn" Jun 14 21:38:01.241229 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:01.240990 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cf818c0b-dd90-4f91-9620-4405f5dcd447-node-exporter-textfile\") pod \"node-exporter-b7rhn\" (UID: \"cf818c0b-dd90-4f91-9620-4405f5dcd447\") " pod="openshift-monitoring/node-exporter-b7rhn" Jun 14 21:38:01.241229 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:01.241040 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cf818c0b-dd90-4f91-9620-4405f5dcd447-root\") pod \"node-exporter-b7rhn\" (UID: \"cf818c0b-dd90-4f91-9620-4405f5dcd447\") " pod="openshift-monitoring/node-exporter-b7rhn" Jun 14 21:38:01.241229 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:01.241051 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf818c0b-dd90-4f91-9620-4405f5dcd447-sys\") pod \"node-exporter-b7rhn\" (UID: \"cf818c0b-dd90-4f91-9620-4405f5dcd447\") " pod="openshift-monitoring/node-exporter-b7rhn" Jun 14 21:38:01.241229 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:38:01.241041 2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 14 21:38:01.241229 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:01.240996 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf818c0b-dd90-4f91-9620-4405f5dcd447-sys\") pod \"node-exporter-b7rhn\" (UID: \"cf818c0b-dd90-4f91-9620-4405f5dcd447\") " pod="openshift-monitoring/node-exporter-b7rhn" Jun 14 21:38:01.241229 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:01.241089 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw4g5\" (UniqueName: \"kubernetes.io/projected/636bebe8-1ca5-4643-afd1-9db48d2835e6-kube-api-access-kw4g5\") pod \"kube-state-metrics-678bc549d7-vmpdb\" (UID: \"636bebe8-1ca5-4643-afd1-9db48d2835e6\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-vmpdb" Jun 14 21:38:01.241229 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:01.241104 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cf818c0b-dd90-4f91-9620-4405f5dcd447-node-exporter-wtmp\") pod \"node-exporter-b7rhn\" (UID: \"cf818c0b-dd90-4f91-9620-4405f5dcd447\") " pod="openshift-monitoring/node-exporter-b7rhn" Jun 14 21:38:01.241229 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:38:01.241117 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf818c0b-dd90-4f91-9620-4405f5dcd447-node-exporter-tls podName:cf818c0b-dd90-4f91-9620-4405f5dcd447 nodeName:}" failed. No retries permitted until 2026-06-14 21:38:01.741096708 +0000 UTC m=+282.205697432 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/cf818c0b-dd90-4f91-9620-4405f5dcd447-node-exporter-tls") pod "node-exporter-b7rhn" (UID: "cf818c0b-dd90-4f91-9620-4405f5dcd447") : secret "node-exporter-tls" not found Jun 14 21:38:01.241229 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:01.241142 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf818c0b-dd90-4f91-9620-4405f5dcd447-metrics-client-ca\") pod \"node-exporter-b7rhn\" (UID: \"cf818c0b-dd90-4f91-9620-4405f5dcd447\") " pod="openshift-monitoring/node-exporter-b7rhn" Jun 14 21:38:01.241229 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:01.241174 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/636bebe8-1ca5-4643-afd1-9db48d2835e6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-vmpdb\" (UID: \"636bebe8-1ca5-4643-afd1-9db48d2835e6\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-vmpdb" Jun 14 21:38:01.241229 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:01.241228 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cf818c0b-dd90-4f91-9620-4405f5dcd447-node-exporter-accelerators-collector-config\") pod \"node-exporter-b7rhn\" (UID: \"cf818c0b-dd90-4f91-9620-4405f5dcd447\") " pod="openshift-monitoring/node-exporter-b7rhn" Jun 14 21:38:01.241935 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:01.241254 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/636bebe8-1ca5-4643-afd1-9db48d2835e6-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-vmpdb\" (UID: \"636bebe8-1ca5-4643-afd1-9db48d2835e6\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-vmpdb" Jun 14 21:38:01.241935 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:01.241298 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf818c0b-dd90-4f91-9620-4405f5dcd447-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b7rhn\" (UID: \"cf818c0b-dd90-4f91-9620-4405f5dcd447\") " pod="openshift-monitoring/node-exporter-b7rhn" Jun 14 21:38:01.241935 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:01.241327 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/636bebe8-1ca5-4643-afd1-9db48d2835e6-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-vmpdb\" (UID: \"636bebe8-1ca5-4643-afd1-9db48d2835e6\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-vmpdb" Jun 14 21:38:01.241935 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:01.241630 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/636bebe8-1ca5-4643-afd1-9db48d2835e6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-vmpdb\" (UID: \"636bebe8-1ca5-4643-afd1-9db48d2835e6\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-vmpdb" Jun 14 21:38:01.241935 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:01.241697 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/636bebe8-1ca5-4643-afd1-9db48d2835e6-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-vmpdb\" (UID: \"636bebe8-1ca5-4643-afd1-9db48d2835e6\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-vmpdb" Jun 14 21:38:01.241935 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:01.241851 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cf818c0b-dd90-4f91-9620-4405f5dcd447-node-exporter-accelerators-collector-config\") pod \"node-exporter-b7rhn\" (UID: \"cf818c0b-dd90-4f91-9620-4405f5dcd447\") " pod="openshift-monitoring/node-exporter-b7rhn" Jun 14 21:38:01.241935 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:01.241900 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/636bebe8-1ca5-4643-afd1-9db48d2835e6-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-vmpdb\" (UID: \"636bebe8-1ca5-4643-afd1-9db48d2835e6\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-vmpdb" Jun 14 21:38:01.242297 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:01.242240 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf818c0b-dd90-4f91-9620-4405f5dcd447-metrics-client-ca\") pod \"node-exporter-b7rhn\" (UID: \"cf818c0b-dd90-4f91-9620-4405f5dcd447\") " pod="openshift-monitoring/node-exporter-b7rhn" Jun 14 21:38:01.243463 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:01.243440 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/636bebe8-1ca5-4643-afd1-9db48d2835e6-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-vmpdb\" (UID: \"636bebe8-1ca5-4643-afd1-9db48d2835e6\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-vmpdb" Jun 14 21:38:01.243571 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:01.243529 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf818c0b-dd90-4f91-9620-4405f5dcd447-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b7rhn\" (UID: \"cf818c0b-dd90-4f91-9620-4405f5dcd447\") " pod="openshift-monitoring/node-exporter-b7rhn" Jun 14 21:38:01.243855 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:01.243837 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/636bebe8-1ca5-4643-afd1-9db48d2835e6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-vmpdb\" (UID: \"636bebe8-1ca5-4643-afd1-9db48d2835e6\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-vmpdb" Jun 14 21:38:01.251993 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:01.251968 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rd2n2\" (UniqueName: \"kubernetes.io/projected/cf818c0b-dd90-4f91-9620-4405f5dcd447-kube-api-access-rd2n2\") pod \"node-exporter-b7rhn\" (UID: \"cf818c0b-dd90-4f91-9620-4405f5dcd447\") " pod="openshift-monitoring/node-exporter-b7rhn" Jun 14 21:38:01.252874 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:01.252855 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw4g5\" (UniqueName: \"kubernetes.io/projected/636bebe8-1ca5-4643-afd1-9db48d2835e6-kube-api-access-kw4g5\") pod \"kube-state-metrics-678bc549d7-vmpdb\" (UID: \"636bebe8-1ca5-4643-afd1-9db48d2835e6\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-vmpdb" Jun 14 21:38:01.273755 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:01.273731 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-vmpdb" Jun 14 21:38:01.397899 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:01.397870 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-vmpdb"] Jun 14 21:38:01.400990 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:38:01.400968 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod636bebe8_1ca5_4643_afd1_9db48d2835e6.slice/crio-fdf42a018d1478772e999477fae12823ac49243d24d16914fd0bc1673f5c5bb1 WatchSource:0}: Error finding container fdf42a018d1478772e999477fae12823ac49243d24d16914fd0bc1673f5c5bb1: Status 404 returned error can't find the container with id fdf42a018d1478772e999477fae12823ac49243d24d16914fd0bc1673f5c5bb1 Jun 14 21:38:01.434858 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:38:01.434825 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-r6tq6" podUID="fb5528ef-9909-498c-b4f4-b02c05fe398e" Jun 14 21:38:01.746567 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:01.746532 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cf818c0b-dd90-4f91-9620-4405f5dcd447-node-exporter-tls\") pod \"node-exporter-b7rhn\" (UID: \"cf818c0b-dd90-4f91-9620-4405f5dcd447\") " pod="openshift-monitoring/node-exporter-b7rhn" Jun 14 21:38:01.748915 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:01.748891 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cf818c0b-dd90-4f91-9620-4405f5dcd447-node-exporter-tls\") pod \"node-exporter-b7rhn\" (UID: \"cf818c0b-dd90-4f91-9620-4405f5dcd447\") " pod="openshift-monitoring/node-exporter-b7rhn" Jun 14 21:38:01.790959 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:01.790937 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r6tq6" Jun 14 21:38:01.790959 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:01.790939 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-vmpdb" event={"ID":"636bebe8-1ca5-4643-afd1-9db48d2835e6","Type":"ContainerStarted","Data":"fdf42a018d1478772e999477fae12823ac49243d24d16914fd0bc1673f5c5bb1"} Jun 14 21:38:01.878807 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:01.878779 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-b7rhn" Jun 14 21:38:01.890379 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:38:01.890352 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf818c0b_dd90_4f91_9620_4405f5dcd447.slice/crio-eacbce4cecfd8bee340ea97ad4422d8feb3b670356e0106070097d97531e001f WatchSource:0}: Error finding container eacbce4cecfd8bee340ea97ad4422d8feb3b670356e0106070097d97531e001f: Status 404 returned error can't find the container with id eacbce4cecfd8bee340ea97ad4422d8feb3b670356e0106070097d97531e001f Jun 14 21:38:02.795263 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:02.795231 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b7rhn" event={"ID":"cf818c0b-dd90-4f91-9620-4405f5dcd447","Type":"ContainerStarted","Data":"eacbce4cecfd8bee340ea97ad4422d8feb3b670356e0106070097d97531e001f"} Jun 14 21:38:03.355964 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:03.355890 2563 patch_prober.go:28] interesting pod/image-registry-79c58d45f-6pl24 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 14 21:38:03.355964 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:03.355941 2563 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-79c58d45f-6pl24" podUID="4413ff08-cd1b-4f37-b3cd-bbd878484a8f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 21:38:03.800551 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:03.800455 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-vmpdb" event={"ID":"636bebe8-1ca5-4643-afd1-9db48d2835e6","Type":"ContainerStarted","Data":"201c13a90444cf9418eec4dcc2416fbdfd2ff0c2580739c70630cd97a4553d5d"} Jun 14 21:38:03.800551 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:03.800530 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-vmpdb" event={"ID":"636bebe8-1ca5-4643-afd1-9db48d2835e6","Type":"ContainerStarted","Data":"6d51fc3e3f8dfdb883640f8ba6d22d891a44a05cef02f51cab45f0381891cde2"} Jun 14 21:38:03.801012 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:03.800560 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-vmpdb" event={"ID":"636bebe8-1ca5-4643-afd1-9db48d2835e6","Type":"ContainerStarted","Data":"0d1d19c1f9da6d90b914a9b75e895e8ac1915227231eb41110a5dcb1b41ca9b9"} Jun 14 21:38:03.801970 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:03.801941 2563 generic.go:356] "Generic (PLEG): container finished" podID="cf818c0b-dd90-4f91-9620-4405f5dcd447" containerID="074fecb3bed02e868ef3be0591ff24de3e2f5c00316f9fd5e498316d5ceda35f" exitCode=0 Jun 14 21:38:03.802075 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:03.801983 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b7rhn" event={"ID":"cf818c0b-dd90-4f91-9620-4405f5dcd447","Type":"ContainerDied","Data":"074fecb3bed02e868ef3be0591ff24de3e2f5c00316f9fd5e498316d5ceda35f"} Jun 14 21:38:03.821940 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:03.821888 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-678bc549d7-vmpdb" podStartSLOduration=2.370817338 podStartE2EDuration="3.821869671s" totalImagesPullingTime="1.451052333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:38:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:38:03.821320625 +0000 UTC m=+284.285921370" watchObservedRunningTime="2026-06-14 21:38:03.821869671 +0000 UTC m=+284.286470418" Jun 14 21:38:04.268167 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:04.268131 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb5528ef-9909-498c-b4f4-b02c05fe398e-metrics-tls\") pod \"dns-default-r6tq6\" (UID: \"fb5528ef-9909-498c-b4f4-b02c05fe398e\") " pod="openshift-dns/dns-default-r6tq6" Jun 14 21:38:04.270484 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:04.270463 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb5528ef-9909-498c-b4f4-b02c05fe398e-metrics-tls\") pod \"dns-default-r6tq6\" (UID: \"fb5528ef-9909-498c-b4f4-b02c05fe398e\") " pod="openshift-dns/dns-default-r6tq6" Jun 14 21:38:04.493642 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:04.493613 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dh44t\"" Jun 14 21:38:04.501623 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:04.501606 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r6tq6" Jun 14 21:38:04.623141 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:04.623109 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-r6tq6"] Jun 14 21:38:04.627161 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:38:04.627136 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb5528ef_9909_498c_b4f4_b02c05fe398e.slice/crio-daff3a114fad54510e2a4ee34e5f4015a18914610d8cd3c979ba8ea950ce6500 WatchSource:0}: Error finding container daff3a114fad54510e2a4ee34e5f4015a18914610d8cd3c979ba8ea950ce6500: Status 404 returned error can't find the container with id daff3a114fad54510e2a4ee34e5f4015a18914610d8cd3c979ba8ea950ce6500 Jun 14 21:38:04.806804 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:04.806773 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b7rhn" event={"ID":"cf818c0b-dd90-4f91-9620-4405f5dcd447","Type":"ContainerStarted","Data":"229bb92baeeea113ea82aa4af81fe2dbef9e1842d94c9acbd581c3fa31131dd3"} Jun 14 21:38:04.807133 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:04.806824 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b7rhn" event={"ID":"cf818c0b-dd90-4f91-9620-4405f5dcd447","Type":"ContainerStarted","Data":"3a4c6c296579d843bf47e7fe470a14d41819811bd38bff658be6be2a26687740"} Jun 14 21:38:04.807968 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:04.807942 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r6tq6" event={"ID":"fb5528ef-9909-498c-b4f4-b02c05fe398e","Type":"ContainerStarted","Data":"daff3a114fad54510e2a4ee34e5f4015a18914610d8cd3c979ba8ea950ce6500"} Jun 14 21:38:04.825335 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:04.825286 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-b7rhn" podStartSLOduration=3.7693891 podStartE2EDuration="4.8252702s" totalImagesPullingTime="963.676212ms" totalInitContainerRuntime="92.204888ms" isStatefulPod=true podCreationTimestamp="2026-06-14 21:38:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:38:04.823872741 +0000 UTC m=+285.288473487" watchObservedRunningTime="2026-06-14 21:38:04.8252702 +0000 UTC m=+285.289870937" Jun 14 21:38:06.722850 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:06.722822 2563 patch_prober.go:28] interesting pod/image-registry-79c58d45f-6pl24 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 14 21:38:06.723185 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:06.722867 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-79c58d45f-6pl24" podUID="4413ff08-cd1b-4f37-b3cd-bbd878484a8f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 21:38:06.816297 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:06.816268 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r6tq6" event={"ID":"fb5528ef-9909-498c-b4f4-b02c05fe398e","Type":"ContainerStarted","Data":"4c6723cbbda938688d2e160b974923c3f6dc1d561c214c1218e077a99b1c91df"} Jun 14 21:38:06.816412 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:06.816316 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r6tq6" event={"ID":"fb5528ef-9909-498c-b4f4-b02c05fe398e","Type":"ContainerStarted","Data":"f4104faa6e6dd562c27e12800be5f58dd74448716152d0049a8973addccba04d"} Jun 14 21:38:06.816412 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:06.816382 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-r6tq6" Jun 14 21:38:06.833231 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:06.833178 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-r6tq6" podStartSLOduration=251.342485067 podStartE2EDuration="4m12.833165909s" totalImagesPullingTime="1.490680842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:33:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:38:06.831726062 +0000 UTC m=+287.296326821" watchObservedRunningTime="2026-06-14 21:38:06.833165909 +0000 UTC m=+287.297766655" Jun 14 21:38:13.355228 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:13.355175 2563 patch_prober.go:28] interesting pod/image-registry-79c58d45f-6pl24 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 14 21:38:13.355589 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:13.355249 2563 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-79c58d45f-6pl24" podUID="4413ff08-cd1b-4f37-b3cd-bbd878484a8f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 21:38:13.355589 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:13.355290 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-79c58d45f-6pl24" Jun 14 21:38:13.355679 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:13.355649 2563 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"12139c5bedbcb38c0577f716dc7a2a6f704de389de9a6c402472e22e71dbfae9"} pod="openshift-image-registry/image-registry-79c58d45f-6pl24" containerMessage="Container registry failed liveness probe, will be restarted" Jun 14 21:38:13.359336 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:13.359309 2563 patch_prober.go:28] interesting pod/image-registry-79c58d45f-6pl24 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 14 21:38:13.359459 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:13.359364 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-79c58d45f-6pl24" podUID="4413ff08-cd1b-4f37-b3cd-bbd878484a8f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 21:38:16.821712 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:16.821683 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-r6tq6" Jun 14 21:38:19.864860 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:19.864832 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bkzms_f03840e6-bb9f-46f3-ba9a-ab2a98d744fa/ovn-acl-logging/0.log" Jun 14 21:38:19.866007 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:19.865954 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bkzms_f03840e6-bb9f-46f3-ba9a-ab2a98d744fa/ovn-acl-logging/0.log" Jun 14 21:38:19.873291 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:19.873270 2563 kubelet.go:1648] "Image garbage collection succeeded" Jun 14 21:38:21.024656 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:21.024629 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-vmpdb_636bebe8-1ca5-4643-afd1-9db48d2835e6/kube-state-metrics/0.log" Jun 14 21:38:21.224529 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:21.224506 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-vmpdb_636bebe8-1ca5-4643-afd1-9db48d2835e6/kube-rbac-proxy-main/0.log" Jun 14 21:38:21.423638 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:21.423579 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-vmpdb_636bebe8-1ca5-4643-afd1-9db48d2835e6/kube-rbac-proxy-self/0.log" Jun 14 21:38:22.024572 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:22.024546 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b7rhn_cf818c0b-dd90-4f91-9620-4405f5dcd447/init-textfile/0.log" Jun 14 21:38:22.224832 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:22.224807 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b7rhn_cf818c0b-dd90-4f91-9620-4405f5dcd447/node-exporter/0.log" Jun 14 21:38:22.425182 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:22.425158 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b7rhn_cf818c0b-dd90-4f91-9620-4405f5dcd447/kube-rbac-proxy/0.log" Jun 14 21:38:23.359699 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:23.359672 2563 patch_prober.go:28] interesting pod/image-registry-79c58d45f-6pl24 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 14 21:38:23.360136 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:23.359715 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-79c58d45f-6pl24" podUID="4413ff08-cd1b-4f37-b3cd-bbd878484a8f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 21:38:29.829360 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:29.829332 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r6tq6_fb5528ef-9909-498c-b4f4-b02c05fe398e/dns/0.log" Jun 14 21:38:30.024169 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:30.024144 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r6tq6_fb5528ef-9909-498c-b4f4-b02c05fe398e/kube-rbac-proxy/0.log" Jun 14 21:38:30.624796 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:30.624772 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l7htv_fab653ef-3379-4e6c-9efe-2a0994436f73/dns-node-resolver/0.log" Jun 14 21:38:31.025927 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:31.025864 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-79c58d45f-6pl24_4413ff08-cd1b-4f37-b3cd-bbd878484a8f/registry/0.log" Jun 14 21:38:31.626125 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:31.626103 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dsmrq_6c41cf46-cb82-49f4-8d57-d6ac4df58684/node-ca/0.log" Jun 14 21:38:32.425331 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:32.425305 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sw9gq_35df5206-ea6b-4647-bd13-c3daf9c87884/serve-healthcheck-canary/0.log" Jun 14 21:38:32.446698 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:32.446669 2563 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5694485f96-2w9cz" podUID="1c1e319f-0962-4a85-90d9-fcd7df06c8bd" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 14 21:38:33.360150 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:33.360125 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-79c58d45f-6pl24" Jun 14 21:38:38.375019 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:38.374983 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-79c58d45f-6pl24" podUID="4413ff08-cd1b-4f37-b3cd-bbd878484a8f" containerName="registry" containerID="cri-o://12139c5bedbcb38c0577f716dc7a2a6f704de389de9a6c402472e22e71dbfae9" gracePeriod=30 Jun 14 21:38:38.919332 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:38.919299 2563 generic.go:356] "Generic (PLEG): container finished" podID="4413ff08-cd1b-4f37-b3cd-bbd878484a8f" containerID="12139c5bedbcb38c0577f716dc7a2a6f704de389de9a6c402472e22e71dbfae9" exitCode=0 Jun 14 21:38:38.919521 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:38.919392 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79c58d45f-6pl24" event={"ID":"4413ff08-cd1b-4f37-b3cd-bbd878484a8f","Type":"ContainerDied","Data":"12139c5bedbcb38c0577f716dc7a2a6f704de389de9a6c402472e22e71dbfae9"} Jun 14 21:38:38.919521 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:38.919446 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79c58d45f-6pl24" event={"ID":"4413ff08-cd1b-4f37-b3cd-bbd878484a8f","Type":"ContainerStarted","Data":"16f36179564c94d45c8dd5caefc492ccbbfde891230b2731bed5eb760e2cb046"} Jun 14 21:38:38.919633 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:38.919572 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-79c58d45f-6pl24" Jun 14 21:38:42.446579 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:42.446540 2563 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5694485f96-2w9cz" podUID="1c1e319f-0962-4a85-90d9-fcd7df06c8bd" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 14 21:38:52.446443 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:52.446402 2563 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5694485f96-2w9cz" podUID="1c1e319f-0962-4a85-90d9-fcd7df06c8bd" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 14 21:38:52.446806 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:52.446476 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5694485f96-2w9cz" Jun 14 21:38:52.446881 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:52.446865 2563 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"e47dc077842522a9d338b306a587bbdaba50f889493498899c191ae52b98a377"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5694485f96-2w9cz" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 14 21:38:52.446917 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:52.446900 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5694485f96-2w9cz" podUID="1c1e319f-0962-4a85-90d9-fcd7df06c8bd" containerName="service-proxy" containerID="cri-o://e47dc077842522a9d338b306a587bbdaba50f889493498899c191ae52b98a377" gracePeriod=30 Jun 14 21:38:52.965184 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:52.965159 2563 generic.go:356] "Generic (PLEG): container finished" podID="1c1e319f-0962-4a85-90d9-fcd7df06c8bd" containerID="e47dc077842522a9d338b306a587bbdaba50f889493498899c191ae52b98a377" exitCode=2 Jun 14 21:38:52.965338 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:52.965206 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5694485f96-2w9cz" event={"ID":"1c1e319f-0962-4a85-90d9-fcd7df06c8bd","Type":"ContainerDied","Data":"e47dc077842522a9d338b306a587bbdaba50f889493498899c191ae52b98a377"} Jun 14 21:38:52.965338 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:52.965258 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5694485f96-2w9cz" event={"ID":"1c1e319f-0962-4a85-90d9-fcd7df06c8bd","Type":"ContainerStarted","Data":"234c4e022367ef703bb2f99b146cb15ceb3059a5af2ef14c4ecaef26e272f6e2"} Jun 14 21:38:59.927885 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:38:59.927851 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-79c58d45f-6pl24" Jun 14 21:41:04.244380 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:04.244302 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-77v5n"] Jun 14 21:41:04.247327 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:04.247307 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-77v5n" Jun 14 21:41:04.250008 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:04.249990 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 14 21:41:04.251165 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:04.251147 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-mbc8l\"" Jun 14 21:41:04.251277 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:04.251162 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 14 21:41:04.254850 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:04.254817 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-77v5n"] Jun 14 21:41:04.316446 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:04.316419 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxjs4\" (UniqueName: \"kubernetes.io/projected/b9091747-7f3a-4531-8620-c3973d8d8759-kube-api-access-hxjs4\") pod \"openshift-lws-operator-fd8ccff4c-77v5n\" (UID: \"b9091747-7f3a-4531-8620-c3973d8d8759\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-77v5n" Jun 14 21:41:04.316572 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:04.316452 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b9091747-7f3a-4531-8620-c3973d8d8759-tmp\") pod \"openshift-lws-operator-fd8ccff4c-77v5n\" (UID: \"b9091747-7f3a-4531-8620-c3973d8d8759\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-77v5n" Jun 14 21:41:04.416918 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:04.416884 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b9091747-7f3a-4531-8620-c3973d8d8759-tmp\") pod \"openshift-lws-operator-fd8ccff4c-77v5n\" (UID: \"b9091747-7f3a-4531-8620-c3973d8d8759\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-77v5n" Jun 14 21:41:04.417086 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:04.416960 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxjs4\" (UniqueName: \"kubernetes.io/projected/b9091747-7f3a-4531-8620-c3973d8d8759-kube-api-access-hxjs4\") pod \"openshift-lws-operator-fd8ccff4c-77v5n\" (UID: \"b9091747-7f3a-4531-8620-c3973d8d8759\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-77v5n" Jun 14 21:41:04.417315 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:04.417294 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b9091747-7f3a-4531-8620-c3973d8d8759-tmp\") pod \"openshift-lws-operator-fd8ccff4c-77v5n\" (UID: \"b9091747-7f3a-4531-8620-c3973d8d8759\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-77v5n" Jun 14 21:41:04.424976 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:04.424957 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxjs4\" (UniqueName: \"kubernetes.io/projected/b9091747-7f3a-4531-8620-c3973d8d8759-kube-api-access-hxjs4\") pod \"openshift-lws-operator-fd8ccff4c-77v5n\" (UID: \"b9091747-7f3a-4531-8620-c3973d8d8759\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-77v5n" Jun 14 21:41:04.556046 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:04.556019 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-77v5n" Jun 14 21:41:04.680370 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:04.680339 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-77v5n"] Jun 14 21:41:04.683136 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:41:04.683111 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb9091747_7f3a_4531_8620_c3973d8d8759.slice/crio-dab2baffeb595a7dc5ce63f3cddd3b7e8aec6ea5731b1574b36b3047b61d1fcd WatchSource:0}: Error finding container dab2baffeb595a7dc5ce63f3cddd3b7e8aec6ea5731b1574b36b3047b61d1fcd: Status 404 returned error can't find the container with id dab2baffeb595a7dc5ce63f3cddd3b7e8aec6ea5731b1574b36b3047b61d1fcd Jun 14 21:41:04.684627 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:04.684607 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 21:41:05.387646 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:05.387609 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-77v5n" event={"ID":"b9091747-7f3a-4531-8620-c3973d8d8759","Type":"ContainerStarted","Data":"dab2baffeb595a7dc5ce63f3cddd3b7e8aec6ea5731b1574b36b3047b61d1fcd"} Jun 14 21:41:07.397418 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:07.397377 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-77v5n" event={"ID":"b9091747-7f3a-4531-8620-c3973d8d8759","Type":"ContainerStarted","Data":"ff768fa1211f780b460e8f4f8f1a690168238baefa67751baba8d5f0ab807386"} Jun 14 21:41:07.424249 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:07.424181 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-77v5n" podStartSLOduration=0.852315896 podStartE2EDuration="3.424167062s" totalImagesPullingTime="2.571851166s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:41:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:41:07.422508841 +0000 UTC m=+467.887109587" watchObservedRunningTime="2026-06-14 21:41:07.424167062 +0000 UTC m=+467.888767828" Jun 14 21:41:23.518280 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:23.518244 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-c88f8"] Jun 14 21:41:23.521447 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:23.521432 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-c88f8" Jun 14 21:41:23.525103 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:23.525078 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 14 21:41:23.525252 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:23.525081 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2s2vx\"" Jun 14 21:41:23.525343 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:23.525333 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 14 21:41:23.525396 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:23.525356 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 14 21:41:23.525640 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:23.525624 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 14 21:41:23.542069 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:23.542049 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-c88f8"] Jun 14 21:41:23.551111 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:23.551083 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a938e683-6d15-4169-bd61-5d56613a71d5-manifests\") pod \"opendatahub-operator-controller-manager-7c8557bfd5-c88f8\" (UID: \"a938e683-6d15-4169-bd61-5d56613a71d5\") " pod="opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-c88f8" Jun 14 21:41:23.551238 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:23.551123 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a938e683-6d15-4169-bd61-5d56613a71d5-tmp\") pod \"opendatahub-operator-controller-manager-7c8557bfd5-c88f8\" (UID: \"a938e683-6d15-4169-bd61-5d56613a71d5\") " pod="opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-c88f8" Jun 14 21:41:23.551238 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:23.551154 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a938e683-6d15-4169-bd61-5d56613a71d5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c8557bfd5-c88f8\" (UID: \"a938e683-6d15-4169-bd61-5d56613a71d5\") " pod="opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-c88f8" Jun 14 21:41:23.551238 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:23.551171 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a938e683-6d15-4169-bd61-5d56613a71d5-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c8557bfd5-c88f8\" (UID: \"a938e683-6d15-4169-bd61-5d56613a71d5\") " pod="opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-c88f8" Jun 14 21:41:23.551238 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:23.551199 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7ff6\" (UniqueName: \"kubernetes.io/projected/a938e683-6d15-4169-bd61-5d56613a71d5-kube-api-access-z7ff6\") pod \"opendatahub-operator-controller-manager-7c8557bfd5-c88f8\" (UID: \"a938e683-6d15-4169-bd61-5d56613a71d5\") " pod="opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-c88f8" Jun 14 21:41:23.652418 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:23.652389 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a938e683-6d15-4169-bd61-5d56613a71d5-manifests\") pod \"opendatahub-operator-controller-manager-7c8557bfd5-c88f8\" (UID: \"a938e683-6d15-4169-bd61-5d56613a71d5\") " pod="opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-c88f8" Jun 14 21:41:23.652523 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:23.652423 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a938e683-6d15-4169-bd61-5d56613a71d5-tmp\") pod \"opendatahub-operator-controller-manager-7c8557bfd5-c88f8\" (UID: \"a938e683-6d15-4169-bd61-5d56613a71d5\") " pod="opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-c88f8" Jun 14 21:41:23.652523 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:23.652446 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a938e683-6d15-4169-bd61-5d56613a71d5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c8557bfd5-c88f8\" (UID: \"a938e683-6d15-4169-bd61-5d56613a71d5\") " pod="opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-c88f8" Jun 14 21:41:23.652680 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:23.652660 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a938e683-6d15-4169-bd61-5d56613a71d5-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c8557bfd5-c88f8\" (UID: \"a938e683-6d15-4169-bd61-5d56613a71d5\") " pod="opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-c88f8" Jun 14 21:41:23.652720 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:23.652706 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7ff6\" (UniqueName: \"kubernetes.io/projected/a938e683-6d15-4169-bd61-5d56613a71d5-kube-api-access-z7ff6\") pod \"opendatahub-operator-controller-manager-7c8557bfd5-c88f8\" (UID: \"a938e683-6d15-4169-bd61-5d56613a71d5\") " pod="opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-c88f8" Jun 14 21:41:23.652897 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:23.652875 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a938e683-6d15-4169-bd61-5d56613a71d5-manifests\") pod \"opendatahub-operator-controller-manager-7c8557bfd5-c88f8\" (UID: \"a938e683-6d15-4169-bd61-5d56613a71d5\") " pod="opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-c88f8" Jun 14 21:41:23.654790 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:23.654770 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a938e683-6d15-4169-bd61-5d56613a71d5-tmp\") pod \"opendatahub-operator-controller-manager-7c8557bfd5-c88f8\" (UID: \"a938e683-6d15-4169-bd61-5d56613a71d5\") " pod="opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-c88f8" Jun 14 21:41:23.654878 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:23.654845 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a938e683-6d15-4169-bd61-5d56613a71d5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c8557bfd5-c88f8\" (UID: \"a938e683-6d15-4169-bd61-5d56613a71d5\") " pod="opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-c88f8" Jun 14 21:41:23.654939 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:23.654919 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a938e683-6d15-4169-bd61-5d56613a71d5-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c8557bfd5-c88f8\" (UID: \"a938e683-6d15-4169-bd61-5d56613a71d5\") " pod="opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-c88f8" Jun 14 21:41:23.661513 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:23.661492 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7ff6\" (UniqueName: \"kubernetes.io/projected/a938e683-6d15-4169-bd61-5d56613a71d5-kube-api-access-z7ff6\") pod \"opendatahub-operator-controller-manager-7c8557bfd5-c88f8\" (UID: \"a938e683-6d15-4169-bd61-5d56613a71d5\") " pod="opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-c88f8" Jun 14 21:41:23.831722 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:23.831695 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-c88f8" Jun 14 21:41:24.009812 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:24.009780 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-c88f8"] Jun 14 21:41:24.013079 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:41:24.013053 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda938e683_6d15_4169_bd61_5d56613a71d5.slice/crio-b3683e5a006157ff8f25ecca4ba4f713a5a652f1c991c07bd658f3bceb647ee7 WatchSource:0}: Error finding container b3683e5a006157ff8f25ecca4ba4f713a5a652f1c991c07bd658f3bceb647ee7: Status 404 returned error can't find the container with id b3683e5a006157ff8f25ecca4ba4f713a5a652f1c991c07bd658f3bceb647ee7 Jun 14 21:41:24.462151 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:24.462112 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-c88f8" event={"ID":"a938e683-6d15-4169-bd61-5d56613a71d5","Type":"ContainerStarted","Data":"b3683e5a006157ff8f25ecca4ba4f713a5a652f1c991c07bd658f3bceb647ee7"} Jun 14 21:41:27.475334 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:27.475288 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-c88f8" event={"ID":"a938e683-6d15-4169-bd61-5d56613a71d5","Type":"ContainerStarted","Data":"948c3f8de03ab47b7f29d2389e9f6e213cf25ab5592e6a2bd98fb36b01715e36"} Jun 14 21:41:28.480163 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:28.480130 2563 generic.go:356] "Generic (PLEG): container finished" podID="a938e683-6d15-4169-bd61-5d56613a71d5" containerID="948c3f8de03ab47b7f29d2389e9f6e213cf25ab5592e6a2bd98fb36b01715e36" exitCode=0 Jun 14 21:41:28.480535 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:28.480166 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-c88f8" event={"ID":"a938e683-6d15-4169-bd61-5d56613a71d5","Type":"ContainerDied","Data":"948c3f8de03ab47b7f29d2389e9f6e213cf25ab5592e6a2bd98fb36b01715e36"} Jun 14 21:41:29.484898 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:29.484862 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-c88f8" event={"ID":"a938e683-6d15-4169-bd61-5d56613a71d5","Type":"ContainerStarted","Data":"ba99f9cf3d183a77ec7f720b43c85e3697dac439ce90765167a51385fd52b5d6"} Jun 14 21:41:29.485256 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:29.485000 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-c88f8" Jun 14 21:41:29.516922 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:29.516880 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-c88f8" podStartSLOduration=2.66772617 podStartE2EDuration="6.516867725s" totalImagesPullingTime="2.945806988s" totalInitContainerRuntime="903.334567ms" isStatefulPod=false podCreationTimestamp="2026-06-14 21:41:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:41:29.515327078 +0000 UTC m=+489.979927833" watchObservedRunningTime="2026-06-14 21:41:29.516867725 +0000 UTC m=+489.981468470" Jun 14 21:41:40.490959 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:40.490931 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7c8557bfd5-c88f8" Jun 14 21:41:43.410781 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:43.410748 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-tgk9t"] Jun 14 21:41:43.418086 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:43.418058 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-tgk9t" Jun 14 21:41:43.421286 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:43.421268 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-vvtcx\"" Jun 14 21:41:43.425429 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:43.425414 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 14 21:41:43.441423 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:43.441397 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-tgk9t"] Jun 14 21:41:43.496073 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:43.496052 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54f5caad-dfe7-4150-ab78-833bf2f84702-cert\") pod \"odh-model-controller-6dc94f689f-tgk9t\" (UID: \"54f5caad-dfe7-4150-ab78-833bf2f84702\") " pod="opendatahub/odh-model-controller-6dc94f689f-tgk9t" Jun 14 21:41:43.496172 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:43.496100 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhmn4\" (UniqueName: \"kubernetes.io/projected/54f5caad-dfe7-4150-ab78-833bf2f84702-kube-api-access-rhmn4\") pod \"odh-model-controller-6dc94f689f-tgk9t\" (UID: \"54f5caad-dfe7-4150-ab78-833bf2f84702\") " pod="opendatahub/odh-model-controller-6dc94f689f-tgk9t" Jun 14 21:41:43.597376 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:43.597349 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54f5caad-dfe7-4150-ab78-833bf2f84702-cert\") pod \"odh-model-controller-6dc94f689f-tgk9t\" (UID: \"54f5caad-dfe7-4150-ab78-833bf2f84702\") " pod="opendatahub/odh-model-controller-6dc94f689f-tgk9t" Jun 14 21:41:43.597475 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:43.597395 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhmn4\" (UniqueName: \"kubernetes.io/projected/54f5caad-dfe7-4150-ab78-833bf2f84702-kube-api-access-rhmn4\") pod \"odh-model-controller-6dc94f689f-tgk9t\" (UID: \"54f5caad-dfe7-4150-ab78-833bf2f84702\") " pod="opendatahub/odh-model-controller-6dc94f689f-tgk9t" Jun 14 21:41:43.597515 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:41:43.597485 2563 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 14 21:41:43.597556 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:41:43.597547 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54f5caad-dfe7-4150-ab78-833bf2f84702-cert podName:54f5caad-dfe7-4150-ab78-833bf2f84702 nodeName:}" failed. No retries permitted until 2026-06-14 21:41:44.097525072 +0000 UTC m=+504.562125801 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/54f5caad-dfe7-4150-ab78-833bf2f84702-cert") pod "odh-model-controller-6dc94f689f-tgk9t" (UID: "54f5caad-dfe7-4150-ab78-833bf2f84702") : secret "odh-model-controller-webhook-cert" not found Jun 14 21:41:43.619854 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:43.619825 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhmn4\" (UniqueName: \"kubernetes.io/projected/54f5caad-dfe7-4150-ab78-833bf2f84702-kube-api-access-rhmn4\") pod \"odh-model-controller-6dc94f689f-tgk9t\" (UID: \"54f5caad-dfe7-4150-ab78-833bf2f84702\") " pod="opendatahub/odh-model-controller-6dc94f689f-tgk9t" Jun 14 21:41:44.100368 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:44.100340 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54f5caad-dfe7-4150-ab78-833bf2f84702-cert\") pod \"odh-model-controller-6dc94f689f-tgk9t\" (UID: \"54f5caad-dfe7-4150-ab78-833bf2f84702\") " pod="opendatahub/odh-model-controller-6dc94f689f-tgk9t" Jun 14 21:41:44.102822 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:44.102800 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54f5caad-dfe7-4150-ab78-833bf2f84702-cert\") pod \"odh-model-controller-6dc94f689f-tgk9t\" (UID: \"54f5caad-dfe7-4150-ab78-833bf2f84702\") " pod="opendatahub/odh-model-controller-6dc94f689f-tgk9t" Jun 14 21:41:44.327626 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:44.327599 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-tgk9t" Jun 14 21:41:44.447669 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:44.447637 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-hcjzh"] Jun 14 21:41:44.449585 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:44.449570 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-hcjzh" Jun 14 21:41:44.453017 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:44.452999 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 14 21:41:44.471636 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:44.471608 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-tgk9t"] Jun 14 21:41:44.472900 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:44.472877 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-hcjzh"] Jun 14 21:41:44.473315 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:41:44.473295 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54f5caad_dfe7_4150_ab78_833bf2f84702.slice/crio-2a0574697438318c334e6ca1db187f1b2a95915d40b21107756c49cf293e73d4 WatchSource:0}: Error finding container 2a0574697438318c334e6ca1db187f1b2a95915d40b21107756c49cf293e73d4: Status 404 returned error can't find the container with id 2a0574697438318c334e6ca1db187f1b2a95915d40b21107756c49cf293e73d4 Jun 14 21:41:44.537229 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:44.537176 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-tgk9t" event={"ID":"54f5caad-dfe7-4150-ab78-833bf2f84702","Type":"ContainerStarted","Data":"2a0574697438318c334e6ca1db187f1b2a95915d40b21107756c49cf293e73d4"} Jun 14 21:41:44.603702 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:44.603672 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/466f0add-93d2-4989-b4b9-a3209c80a7d5-tls-certs\") pod \"model-serving-api-5dd488fc48-hcjzh\" (UID: \"466f0add-93d2-4989-b4b9-a3209c80a7d5\") " pod="opendatahub/model-serving-api-5dd488fc48-hcjzh" Jun 14 21:41:44.603840 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:44.603710 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwxx5\" (UniqueName: \"kubernetes.io/projected/466f0add-93d2-4989-b4b9-a3209c80a7d5-kube-api-access-gwxx5\") pod \"model-serving-api-5dd488fc48-hcjzh\" (UID: \"466f0add-93d2-4989-b4b9-a3209c80a7d5\") " pod="opendatahub/model-serving-api-5dd488fc48-hcjzh" Jun 14 21:41:44.709190 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:44.705077 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/466f0add-93d2-4989-b4b9-a3209c80a7d5-tls-certs\") pod \"model-serving-api-5dd488fc48-hcjzh\" (UID: \"466f0add-93d2-4989-b4b9-a3209c80a7d5\") " pod="opendatahub/model-serving-api-5dd488fc48-hcjzh" Jun 14 21:41:44.709190 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:44.705140 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwxx5\" (UniqueName: \"kubernetes.io/projected/466f0add-93d2-4989-b4b9-a3209c80a7d5-kube-api-access-gwxx5\") pod \"model-serving-api-5dd488fc48-hcjzh\" (UID: \"466f0add-93d2-4989-b4b9-a3209c80a7d5\") " pod="opendatahub/model-serving-api-5dd488fc48-hcjzh" Jun 14 21:41:44.711880 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:44.711860 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/466f0add-93d2-4989-b4b9-a3209c80a7d5-tls-certs\") pod \"model-serving-api-5dd488fc48-hcjzh\" (UID: \"466f0add-93d2-4989-b4b9-a3209c80a7d5\") " pod="opendatahub/model-serving-api-5dd488fc48-hcjzh" Jun 14 21:41:44.718386 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:44.718364 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwxx5\" (UniqueName: \"kubernetes.io/projected/466f0add-93d2-4989-b4b9-a3209c80a7d5-kube-api-access-gwxx5\") pod \"model-serving-api-5dd488fc48-hcjzh\" (UID: \"466f0add-93d2-4989-b4b9-a3209c80a7d5\") " pod="opendatahub/model-serving-api-5dd488fc48-hcjzh" Jun 14 21:41:44.760277 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:44.760256 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-hcjzh" Jun 14 21:41:44.923556 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:44.923351 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-hcjzh"] Jun 14 21:41:44.926104 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:41:44.926074 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod466f0add_93d2_4989_b4b9_a3209c80a7d5.slice/crio-8995a3147f44e893c00ba98507f10bd1d843f603c0931c67c2d36ff2d446067e WatchSource:0}: Error finding container 8995a3147f44e893c00ba98507f10bd1d843f603c0931c67c2d36ff2d446067e: Status 404 returned error can't find the container with id 8995a3147f44e893c00ba98507f10bd1d843f603c0931c67c2d36ff2d446067e Jun 14 21:41:45.544634 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:45.544535 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-hcjzh" event={"ID":"466f0add-93d2-4989-b4b9-a3209c80a7d5","Type":"ContainerStarted","Data":"8995a3147f44e893c00ba98507f10bd1d843f603c0931c67c2d36ff2d446067e"} Jun 14 21:41:48.557571 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:48.557536 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-tgk9t" event={"ID":"54f5caad-dfe7-4150-ab78-833bf2f84702","Type":"ContainerStarted","Data":"519568a2ba586a6c469a92393eaf6b12840337e6f051de2be46607d12a788517"} Jun 14 21:41:48.558018 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:48.557656 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-tgk9t" Jun 14 21:41:48.559040 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:48.559017 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-hcjzh" event={"ID":"466f0add-93d2-4989-b4b9-a3209c80a7d5","Type":"ContainerStarted","Data":"afea48fc4c97faef0ba1f52f49ebef40592bc3de4ffc8499637951e928b83850"} Jun 14 21:41:48.559119 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:48.559060 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-hcjzh" Jun 14 21:41:48.576874 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:48.576832 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-tgk9t" podStartSLOduration=2.058396334 podStartE2EDuration="5.57681999s" totalImagesPullingTime="3.518423656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:41:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:41:48.574682246 +0000 UTC m=+509.039282991" watchObservedRunningTime="2026-06-14 21:41:48.57681999 +0000 UTC m=+509.041420769" Jun 14 21:41:48.594445 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:48.594403 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-hcjzh" podStartSLOduration=1.493286334 podStartE2EDuration="4.594390708s" totalImagesPullingTime="3.101104374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:41:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:41:48.593645204 +0000 UTC m=+509.058245952" watchObservedRunningTime="2026-06-14 21:41:48.594390708 +0000 UTC m=+509.058991454" Jun 14 21:41:48.818959 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:48.818888 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-ddf4d968b-v7lc2"] Jun 14 21:41:48.821963 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:48.821944 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-ddf4d968b-v7lc2" Jun 14 21:41:48.825605 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:48.825579 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 14 21:41:48.825702 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:48.825621 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 14 21:41:48.825842 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:48.825827 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-mh4fq\"" Jun 14 21:41:48.826272 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:48.826257 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 14 21:41:48.826544 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:48.826527 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 14 21:41:48.841949 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:48.841931 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-ddf4d968b-v7lc2"] Jun 14 21:41:48.940086 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:48.940064 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/439fd394-122c-48d7-8025-7b95554805bb-tmp\") pod \"kube-auth-proxy-ddf4d968b-v7lc2\" (UID: \"439fd394-122c-48d7-8025-7b95554805bb\") " pod="openshift-ingress/kube-auth-proxy-ddf4d968b-v7lc2" Jun 14 21:41:48.940200 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:48.940102 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htfm5\" (UniqueName: \"kubernetes.io/projected/439fd394-122c-48d7-8025-7b95554805bb-kube-api-access-htfm5\") pod \"kube-auth-proxy-ddf4d968b-v7lc2\" (UID: \"439fd394-122c-48d7-8025-7b95554805bb\") " pod="openshift-ingress/kube-auth-proxy-ddf4d968b-v7lc2" Jun 14 21:41:48.940200 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:48.940128 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/439fd394-122c-48d7-8025-7b95554805bb-tls-certs\") pod \"kube-auth-proxy-ddf4d968b-v7lc2\" (UID: \"439fd394-122c-48d7-8025-7b95554805bb\") " pod="openshift-ingress/kube-auth-proxy-ddf4d968b-v7lc2" Jun 14 21:41:49.041554 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:49.041527 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htfm5\" (UniqueName: \"kubernetes.io/projected/439fd394-122c-48d7-8025-7b95554805bb-kube-api-access-htfm5\") pod \"kube-auth-proxy-ddf4d968b-v7lc2\" (UID: \"439fd394-122c-48d7-8025-7b95554805bb\") " pod="openshift-ingress/kube-auth-proxy-ddf4d968b-v7lc2" Jun 14 21:41:49.041677 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:49.041560 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/439fd394-122c-48d7-8025-7b95554805bb-tls-certs\") pod \"kube-auth-proxy-ddf4d968b-v7lc2\" (UID: \"439fd394-122c-48d7-8025-7b95554805bb\") " pod="openshift-ingress/kube-auth-proxy-ddf4d968b-v7lc2" Jun 14 21:41:49.041677 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:49.041619 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/439fd394-122c-48d7-8025-7b95554805bb-tmp\") pod \"kube-auth-proxy-ddf4d968b-v7lc2\" (UID: \"439fd394-122c-48d7-8025-7b95554805bb\") " pod="openshift-ingress/kube-auth-proxy-ddf4d968b-v7lc2" Jun 14 21:41:49.043958 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:49.043937 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/439fd394-122c-48d7-8025-7b95554805bb-tmp\") pod \"kube-auth-proxy-ddf4d968b-v7lc2\" (UID: \"439fd394-122c-48d7-8025-7b95554805bb\") " pod="openshift-ingress/kube-auth-proxy-ddf4d968b-v7lc2" Jun 14 21:41:49.044190 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:49.044170 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/439fd394-122c-48d7-8025-7b95554805bb-tls-certs\") pod \"kube-auth-proxy-ddf4d968b-v7lc2\" (UID: \"439fd394-122c-48d7-8025-7b95554805bb\") " pod="openshift-ingress/kube-auth-proxy-ddf4d968b-v7lc2" Jun 14 21:41:49.050554 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:49.050532 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htfm5\" (UniqueName: \"kubernetes.io/projected/439fd394-122c-48d7-8025-7b95554805bb-kube-api-access-htfm5\") pod \"kube-auth-proxy-ddf4d968b-v7lc2\" (UID: \"439fd394-122c-48d7-8025-7b95554805bb\") " pod="openshift-ingress/kube-auth-proxy-ddf4d968b-v7lc2" Jun 14 21:41:49.130920 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:49.130853 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-ddf4d968b-v7lc2" Jun 14 21:41:49.266971 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:49.266940 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-ddf4d968b-v7lc2"] Jun 14 21:41:49.269484 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:41:49.269454 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod439fd394_122c_48d7_8025_7b95554805bb.slice/crio-8aa6a709898726fb7b45c3a85e119f10ce820d867e15b4a722cf640be0dcbfd9 WatchSource:0}: Error finding container 8aa6a709898726fb7b45c3a85e119f10ce820d867e15b4a722cf640be0dcbfd9: Status 404 returned error can't find the container with id 8aa6a709898726fb7b45c3a85e119f10ce820d867e15b4a722cf640be0dcbfd9 Jun 14 21:41:49.563771 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:49.563741 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-ddf4d968b-v7lc2" event={"ID":"439fd394-122c-48d7-8025-7b95554805bb","Type":"ContainerStarted","Data":"8aa6a709898726fb7b45c3a85e119f10ce820d867e15b4a722cf640be0dcbfd9"} Jun 14 21:41:51.582125 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:51.582080 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-ddf4d968b-v7lc2" event={"ID":"439fd394-122c-48d7-8025-7b95554805bb","Type":"ContainerStarted","Data":"7b0f1189cef63637feb7479b9c89cd5c0bc9f77817be5ffdf9cf87759fe3a7cb"} Jun 14 21:41:51.599186 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:51.599077 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-ddf4d968b-v7lc2" podStartSLOduration=1.52129543 podStartE2EDuration="3.599057876s" totalImagesPullingTime="2.077762446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:41:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:41:51.598593125 +0000 UTC m=+512.063193871" watchObservedRunningTime="2026-06-14 21:41:51.599057876 +0000 UTC m=+512.063658623" Jun 14 21:41:54.254384 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:54.254344 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-2lcdt"] Jun 14 21:41:54.257186 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:54.257163 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-2lcdt" Jun 14 21:41:54.260556 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:54.260534 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 14 21:41:54.261503 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:54.261481 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-6hksr\"" Jun 14 21:41:54.286828 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:54.286796 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-2lcdt"] Jun 14 21:41:54.291973 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:54.291953 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-r66ps"] Jun 14 21:41:54.295067 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:54.295048 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-r66ps" Jun 14 21:41:54.301384 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:54.301361 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 14 21:41:54.301525 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:54.301503 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-g8lgc\"" Jun 14 21:41:54.313998 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:54.313976 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-r66ps"] Jun 14 21:41:54.381995 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:54.381971 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90072ef0-9d3b-4d7b-93d5-4ab01e9df81d-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-r66ps\" (UID: \"90072ef0-9d3b-4d7b-93d5-4ab01e9df81d\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-r66ps" Jun 14 21:41:54.382161 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:54.382002 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvk64\" (UniqueName: \"kubernetes.io/projected/7df345b7-1956-487d-a724-a6860ab0a596-kube-api-access-qvk64\") pod \"kserve-controller-manager-69fc866d76-2lcdt\" (UID: \"7df345b7-1956-487d-a724-a6860ab0a596\") " pod="opendatahub/kserve-controller-manager-69fc866d76-2lcdt" Jun 14 21:41:54.382161 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:54.382038 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7kdr\" (UniqueName: \"kubernetes.io/projected/90072ef0-9d3b-4d7b-93d5-4ab01e9df81d-kube-api-access-v7kdr\") pod \"llmisvc-controller-manager-864bfd7bc9-r66ps\" (UID: \"90072ef0-9d3b-4d7b-93d5-4ab01e9df81d\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-r66ps" Jun 14 21:41:54.382161 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:54.382060 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7df345b7-1956-487d-a724-a6860ab0a596-cert\") pod \"kserve-controller-manager-69fc866d76-2lcdt\" (UID: \"7df345b7-1956-487d-a724-a6860ab0a596\") " pod="opendatahub/kserve-controller-manager-69fc866d76-2lcdt" Jun 14 21:41:54.482867 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:54.482845 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7kdr\" (UniqueName: \"kubernetes.io/projected/90072ef0-9d3b-4d7b-93d5-4ab01e9df81d-kube-api-access-v7kdr\") pod \"llmisvc-controller-manager-864bfd7bc9-r66ps\" (UID: \"90072ef0-9d3b-4d7b-93d5-4ab01e9df81d\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-r66ps" Jun 14 21:41:54.483004 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:54.482880 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7df345b7-1956-487d-a724-a6860ab0a596-cert\") pod \"kserve-controller-manager-69fc866d76-2lcdt\" (UID: \"7df345b7-1956-487d-a724-a6860ab0a596\") " pod="opendatahub/kserve-controller-manager-69fc866d76-2lcdt" Jun 14 21:41:54.483004 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:54.482922 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90072ef0-9d3b-4d7b-93d5-4ab01e9df81d-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-r66ps\" (UID: \"90072ef0-9d3b-4d7b-93d5-4ab01e9df81d\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-r66ps" Jun 14 21:41:54.483004 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:41:54.482999 2563 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 14 21:41:54.483158 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:54.483030 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvk64\" (UniqueName: \"kubernetes.io/projected/7df345b7-1956-487d-a724-a6860ab0a596-kube-api-access-qvk64\") pod \"kserve-controller-manager-69fc866d76-2lcdt\" (UID: \"7df345b7-1956-487d-a724-a6860ab0a596\") " pod="opendatahub/kserve-controller-manager-69fc866d76-2lcdt" Jun 14 21:41:54.483158 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:41:54.483043 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90072ef0-9d3b-4d7b-93d5-4ab01e9df81d-cert podName:90072ef0-9d3b-4d7b-93d5-4ab01e9df81d nodeName:}" failed. No retries permitted until 2026-06-14 21:41:54.983027578 +0000 UTC m=+515.447628302 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/90072ef0-9d3b-4d7b-93d5-4ab01e9df81d-cert") pod "llmisvc-controller-manager-864bfd7bc9-r66ps" (UID: "90072ef0-9d3b-4d7b-93d5-4ab01e9df81d") : secret "llmisvc-webhook-server-cert" not found Jun 14 21:41:54.485315 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:54.485296 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7df345b7-1956-487d-a724-a6860ab0a596-cert\") pod \"kserve-controller-manager-69fc866d76-2lcdt\" (UID: \"7df345b7-1956-487d-a724-a6860ab0a596\") " pod="opendatahub/kserve-controller-manager-69fc866d76-2lcdt" Jun 14 21:41:54.501404 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:54.501375 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7kdr\" (UniqueName: \"kubernetes.io/projected/90072ef0-9d3b-4d7b-93d5-4ab01e9df81d-kube-api-access-v7kdr\") pod \"llmisvc-controller-manager-864bfd7bc9-r66ps\" (UID: \"90072ef0-9d3b-4d7b-93d5-4ab01e9df81d\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-r66ps" Jun 14 21:41:54.502496 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:54.502473 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvk64\" (UniqueName: \"kubernetes.io/projected/7df345b7-1956-487d-a724-a6860ab0a596-kube-api-access-qvk64\") pod \"kserve-controller-manager-69fc866d76-2lcdt\" (UID: \"7df345b7-1956-487d-a724-a6860ab0a596\") " pod="opendatahub/kserve-controller-manager-69fc866d76-2lcdt" Jun 14 21:41:54.567738 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:54.567709 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-2lcdt" Jun 14 21:41:54.696206 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:54.696180 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-2lcdt"] Jun 14 21:41:54.698093 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:41:54.698068 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7df345b7_1956_487d_a724_a6860ab0a596.slice/crio-92fc4f3d59722178d1bf2339823b14a197f566fffe642d0e4a64a98f982d55c3 WatchSource:0}: Error finding container 92fc4f3d59722178d1bf2339823b14a197f566fffe642d0e4a64a98f982d55c3: Status 404 returned error can't find the container with id 92fc4f3d59722178d1bf2339823b14a197f566fffe642d0e4a64a98f982d55c3 Jun 14 21:41:54.986993 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:54.986924 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90072ef0-9d3b-4d7b-93d5-4ab01e9df81d-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-r66ps\" (UID: \"90072ef0-9d3b-4d7b-93d5-4ab01e9df81d\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-r66ps" Jun 14 21:41:54.989322 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:54.989299 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90072ef0-9d3b-4d7b-93d5-4ab01e9df81d-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-r66ps\" (UID: \"90072ef0-9d3b-4d7b-93d5-4ab01e9df81d\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-r66ps" Jun 14 21:41:55.205416 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:55.205383 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-r66ps" Jun 14 21:41:55.362781 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:55.362749 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-r66ps"] Jun 14 21:41:55.365986 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:41:55.365956 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod90072ef0_9d3b_4d7b_93d5_4ab01e9df81d.slice/crio-8606f1764c99bd4f0d5d863973c54ec676a7eea64c9b414ede123cad1ae73a91 WatchSource:0}: Error finding container 8606f1764c99bd4f0d5d863973c54ec676a7eea64c9b414ede123cad1ae73a91: Status 404 returned error can't find the container with id 8606f1764c99bd4f0d5d863973c54ec676a7eea64c9b414ede123cad1ae73a91 Jun 14 21:41:55.600959 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:55.600923 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-2lcdt" event={"ID":"7df345b7-1956-487d-a724-a6860ab0a596","Type":"ContainerStarted","Data":"92fc4f3d59722178d1bf2339823b14a197f566fffe642d0e4a64a98f982d55c3"} Jun 14 21:41:55.602175 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:55.602144 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-r66ps" event={"ID":"90072ef0-9d3b-4d7b-93d5-4ab01e9df81d","Type":"ContainerStarted","Data":"8606f1764c99bd4f0d5d863973c54ec676a7eea64c9b414ede123cad1ae73a91"} Jun 14 21:41:58.617514 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:58.617478 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-2lcdt" event={"ID":"7df345b7-1956-487d-a724-a6860ab0a596","Type":"ContainerStarted","Data":"1e421dfbff08e303e18552ff7cd63c71add7b56247906885cf6fb7ae0b7a3560"} Jun 14 21:41:58.617944 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:58.617562 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-2lcdt" Jun 14 21:41:58.618952 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:58.618927 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-r66ps" event={"ID":"90072ef0-9d3b-4d7b-93d5-4ab01e9df81d","Type":"ContainerStarted","Data":"5dfd4cb4ceff9c92f9a33c461e9b06e2589fd91b670880c3da791048bd278573"} Jun 14 21:41:58.619057 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:58.619042 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-r66ps" Jun 14 21:41:58.707751 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:58.707701 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-2lcdt" podStartSLOduration=2.277627526 podStartE2EDuration="4.707688816s" totalImagesPullingTime="2.43006129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:41:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:41:58.701421019 +0000 UTC m=+519.166021786" watchObservedRunningTime="2026-06-14 21:41:58.707688816 +0000 UTC m=+519.172289561" Jun 14 21:41:58.764000 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:58.763955 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-r66ps" podStartSLOduration=2.338499484 podStartE2EDuration="4.763941906s" totalImagesPullingTime="2.425442422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:41:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:41:58.763572823 +0000 UTC m=+519.228173570" watchObservedRunningTime="2026-06-14 21:41:58.763941906 +0000 UTC m=+519.228543003" Jun 14 21:41:59.568573 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:59.568538 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-hcjzh" Jun 14 21:41:59.608546 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:41:59.608522 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-tgk9t" Jun 14 21:42:00.746824 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:00.746788 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-85lbb"] Jun 14 21:42:00.750289 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:00.750259 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-85lbb" Jun 14 21:42:00.753628 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:00.753604 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 14 21:42:00.753807 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:00.753795 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-2278z\"" Jun 14 21:42:00.754015 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:00.753997 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 14 21:42:00.809316 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:00.809289 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-85lbb"] Jun 14 21:42:00.833895 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:00.833867 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lppd9\" (UniqueName: \"kubernetes.io/projected/56f5a8a0-babe-40e9-be44-cd544ab96a84-kube-api-access-lppd9\") pod \"servicemesh-operator3-57f65f65fb-85lbb\" (UID: \"56f5a8a0-babe-40e9-be44-cd544ab96a84\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-85lbb" Jun 14 21:42:00.833990 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:00.833900 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/56f5a8a0-babe-40e9-be44-cd544ab96a84-operator-config\") pod \"servicemesh-operator3-57f65f65fb-85lbb\" (UID: \"56f5a8a0-babe-40e9-be44-cd544ab96a84\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-85lbb" Jun 14 21:42:00.934433 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:00.934409 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lppd9\" (UniqueName: \"kubernetes.io/projected/56f5a8a0-babe-40e9-be44-cd544ab96a84-kube-api-access-lppd9\") pod \"servicemesh-operator3-57f65f65fb-85lbb\" (UID: \"56f5a8a0-babe-40e9-be44-cd544ab96a84\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-85lbb" Jun 14 21:42:00.934527 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:00.934440 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/56f5a8a0-babe-40e9-be44-cd544ab96a84-operator-config\") pod \"servicemesh-operator3-57f65f65fb-85lbb\" (UID: \"56f5a8a0-babe-40e9-be44-cd544ab96a84\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-85lbb" Jun 14 21:42:00.936993 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:00.936964 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/56f5a8a0-babe-40e9-be44-cd544ab96a84-operator-config\") pod \"servicemesh-operator3-57f65f65fb-85lbb\" (UID: \"56f5a8a0-babe-40e9-be44-cd544ab96a84\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-85lbb" Jun 14 21:42:00.944776 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:00.944759 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lppd9\" (UniqueName: \"kubernetes.io/projected/56f5a8a0-babe-40e9-be44-cd544ab96a84-kube-api-access-lppd9\") pod \"servicemesh-operator3-57f65f65fb-85lbb\" (UID: \"56f5a8a0-babe-40e9-be44-cd544ab96a84\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-85lbb" Jun 14 21:42:01.059295 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:01.059276 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-85lbb" Jun 14 21:42:01.203804 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:01.203773 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-85lbb"] Jun 14 21:42:01.206108 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:42:01.206084 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56f5a8a0_babe_40e9_be44_cd544ab96a84.slice/crio-a49f932729cebc858d3f3a470e4f447075bf96320fb399f9d2a876156c5d9d16 WatchSource:0}: Error finding container a49f932729cebc858d3f3a470e4f447075bf96320fb399f9d2a876156c5d9d16: Status 404 returned error can't find the container with id a49f932729cebc858d3f3a470e4f447075bf96320fb399f9d2a876156c5d9d16 Jun 14 21:42:01.631924 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:01.631895 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-85lbb" event={"ID":"56f5a8a0-babe-40e9-be44-cd544ab96a84","Type":"ContainerStarted","Data":"a49f932729cebc858d3f3a470e4f447075bf96320fb399f9d2a876156c5d9d16"} Jun 14 21:42:04.359783 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:04.359686 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-67768fd87d-888cx"] Jun 14 21:42:04.363130 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:04.363097 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-67768fd87d-888cx" Jun 14 21:42:04.367584 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:04.367553 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 14 21:42:04.367712 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:04.367583 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-2qcs4\"" Jun 14 21:42:04.382929 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:04.382902 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-67768fd87d-888cx"] Jun 14 21:42:04.464668 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:04.464636 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mt6sx\" (UniqueName: \"kubernetes.io/projected/17b0fbd6-dd44-4792-a622-4131de07af3e-kube-api-access-mt6sx\") pod \"dashboard-redirect-67768fd87d-888cx\" (UID: \"17b0fbd6-dd44-4792-a622-4131de07af3e\") " pod="opendatahub/dashboard-redirect-67768fd87d-888cx" Jun 14 21:42:04.464952 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:04.464933 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/17b0fbd6-dd44-4792-a622-4131de07af3e-redirect-config\") pod \"dashboard-redirect-67768fd87d-888cx\" (UID: \"17b0fbd6-dd44-4792-a622-4131de07af3e\") " pod="opendatahub/dashboard-redirect-67768fd87d-888cx" Jun 14 21:42:04.565608 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:04.565578 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/17b0fbd6-dd44-4792-a622-4131de07af3e-redirect-config\") pod \"dashboard-redirect-67768fd87d-888cx\" (UID: \"17b0fbd6-dd44-4792-a622-4131de07af3e\") " pod="opendatahub/dashboard-redirect-67768fd87d-888cx" Jun 14 21:42:04.565734 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:04.565662 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mt6sx\" (UniqueName: \"kubernetes.io/projected/17b0fbd6-dd44-4792-a622-4131de07af3e-kube-api-access-mt6sx\") pod \"dashboard-redirect-67768fd87d-888cx\" (UID: \"17b0fbd6-dd44-4792-a622-4131de07af3e\") " pod="opendatahub/dashboard-redirect-67768fd87d-888cx" Jun 14 21:42:04.566399 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:04.566381 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/17b0fbd6-dd44-4792-a622-4131de07af3e-redirect-config\") pod \"dashboard-redirect-67768fd87d-888cx\" (UID: \"17b0fbd6-dd44-4792-a622-4131de07af3e\") " pod="opendatahub/dashboard-redirect-67768fd87d-888cx" Jun 14 21:42:04.575992 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:04.575973 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mt6sx\" (UniqueName: \"kubernetes.io/projected/17b0fbd6-dd44-4792-a622-4131de07af3e-kube-api-access-mt6sx\") pod \"dashboard-redirect-67768fd87d-888cx\" (UID: \"17b0fbd6-dd44-4792-a622-4131de07af3e\") " pod="opendatahub/dashboard-redirect-67768fd87d-888cx" Jun 14 21:42:04.649693 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:04.649627 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-85lbb" event={"ID":"56f5a8a0-babe-40e9-be44-cd544ab96a84","Type":"ContainerStarted","Data":"e593597361417adf9251e922940536077aee869fd64835fca688fdf097c807d0"} Jun 14 21:42:04.649798 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:04.649737 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-85lbb" Jun 14 21:42:04.671445 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:04.671403 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-85lbb" podStartSLOduration=1.826067863 podStartE2EDuration="4.671389253s" totalImagesPullingTime="2.84532139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:42:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:42:04.669015413 +0000 UTC m=+525.133616162" watchObservedRunningTime="2026-06-14 21:42:04.671389253 +0000 UTC m=+525.135989998" Jun 14 21:42:04.675003 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:04.674987 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-67768fd87d-888cx" Jun 14 21:42:04.822921 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:04.822898 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-67768fd87d-888cx"] Jun 14 21:42:04.825945 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:42:04.825910 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17b0fbd6_dd44_4792_a622_4131de07af3e.slice/crio-4b667e9b72aeb6ca23811d1988ba113576586c1e6f3791b83b276702c2103686 WatchSource:0}: Error finding container 4b667e9b72aeb6ca23811d1988ba113576586c1e6f3791b83b276702c2103686: Status 404 returned error can't find the container with id 4b667e9b72aeb6ca23811d1988ba113576586c1e6f3791b83b276702c2103686 Jun 14 21:42:05.655542 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:05.655509 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-67768fd87d-888cx" event={"ID":"17b0fbd6-dd44-4792-a622-4131de07af3e","Type":"ContainerStarted","Data":"4b667e9b72aeb6ca23811d1988ba113576586c1e6f3791b83b276702c2103686"} Jun 14 21:42:06.660648 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:06.660618 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-67768fd87d-888cx" event={"ID":"17b0fbd6-dd44-4792-a622-4131de07af3e","Type":"ContainerStarted","Data":"d248378fed3bf876b882a8c6a552418bf631f325011169eac9d7333f17303b9e"} Jun 14 21:42:06.708479 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:06.708398 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-67768fd87d-888cx" podStartSLOduration=1.07762593 podStartE2EDuration="2.708381522s" totalImagesPullingTime="1.630755592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:42:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:42:06.707550614 +0000 UTC m=+527.172151361" watchObservedRunningTime="2026-06-14 21:42:06.708381522 +0000 UTC m=+527.172982309" Jun 14 21:42:15.657494 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:15.657461 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-85lbb" Jun 14 21:42:25.366661 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:25.366625 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-f4smf"] Jun 14 21:42:25.583271 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:25.583235 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-f4smf"] Jun 14 21:42:25.583456 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:25.583336 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f4smf" Jun 14 21:42:25.586016 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:25.585982 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 14 21:42:25.586162 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:25.586105 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-h6jgn\"" Jun 14 21:42:25.587054 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:25.587032 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 14 21:42:25.587153 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:25.587089 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 14 21:42:25.587153 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:25.587142 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 14 21:42:25.612735 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:25.612714 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4d21bb64-fe94-4af0-b15e-ffabdd23a430-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-f4smf\" (UID: \"4d21bb64-fe94-4af0-b15e-ffabdd23a430\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f4smf" Jun 14 21:42:25.612843 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:25.612748 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4d21bb64-fe94-4af0-b15e-ffabdd23a430-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-f4smf\" (UID: \"4d21bb64-fe94-4af0-b15e-ffabdd23a430\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f4smf" Jun 14 21:42:25.612843 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:25.612782 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4d21bb64-fe94-4af0-b15e-ffabdd23a430-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-f4smf\" (UID: \"4d21bb64-fe94-4af0-b15e-ffabdd23a430\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f4smf" Jun 14 21:42:25.612843 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:25.612829 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mtgj\" (UniqueName: \"kubernetes.io/projected/4d21bb64-fe94-4af0-b15e-ffabdd23a430-kube-api-access-7mtgj\") pod \"istiod-openshift-gateway-75c67f8887-f4smf\" (UID: \"4d21bb64-fe94-4af0-b15e-ffabdd23a430\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f4smf" Jun 14 21:42:25.612951 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:25.612865 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d21bb64-fe94-4af0-b15e-ffabdd23a430-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-f4smf\" (UID: \"4d21bb64-fe94-4af0-b15e-ffabdd23a430\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f4smf" Jun 14 21:42:25.612951 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:25.612882 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4d21bb64-fe94-4af0-b15e-ffabdd23a430-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-f4smf\" (UID: \"4d21bb64-fe94-4af0-b15e-ffabdd23a430\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f4smf" Jun 14 21:42:25.612951 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:25.612904 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d21bb64-fe94-4af0-b15e-ffabdd23a430-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-f4smf\" (UID: \"4d21bb64-fe94-4af0-b15e-ffabdd23a430\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f4smf" Jun 14 21:42:25.713408 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:25.713341 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4d21bb64-fe94-4af0-b15e-ffabdd23a430-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-f4smf\" (UID: \"4d21bb64-fe94-4af0-b15e-ffabdd23a430\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f4smf" Jun 14 21:42:25.713408 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:25.713383 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4d21bb64-fe94-4af0-b15e-ffabdd23a430-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-f4smf\" (UID: \"4d21bb64-fe94-4af0-b15e-ffabdd23a430\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f4smf" Jun 14 21:42:25.713559 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:25.713423 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4d21bb64-fe94-4af0-b15e-ffabdd23a430-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-f4smf\" (UID: \"4d21bb64-fe94-4af0-b15e-ffabdd23a430\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f4smf" Jun 14 21:42:25.713559 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:25.713455 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mtgj\" (UniqueName: \"kubernetes.io/projected/4d21bb64-fe94-4af0-b15e-ffabdd23a430-kube-api-access-7mtgj\") pod \"istiod-openshift-gateway-75c67f8887-f4smf\" (UID: \"4d21bb64-fe94-4af0-b15e-ffabdd23a430\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f4smf" Jun 14 21:42:25.713559 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:25.713499 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d21bb64-fe94-4af0-b15e-ffabdd23a430-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-f4smf\" (UID: \"4d21bb64-fe94-4af0-b15e-ffabdd23a430\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f4smf" Jun 14 21:42:25.713559 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:25.713520 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4d21bb64-fe94-4af0-b15e-ffabdd23a430-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-f4smf\" (UID: \"4d21bb64-fe94-4af0-b15e-ffabdd23a430\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f4smf" Jun 14 21:42:25.713559 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:25.713548 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d21bb64-fe94-4af0-b15e-ffabdd23a430-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-f4smf\" (UID: \"4d21bb64-fe94-4af0-b15e-ffabdd23a430\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f4smf" Jun 14 21:42:25.713932 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:25.713912 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4d21bb64-fe94-4af0-b15e-ffabdd23a430-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-f4smf\" (UID: \"4d21bb64-fe94-4af0-b15e-ffabdd23a430\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f4smf" Jun 14 21:42:25.715971 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:25.715949 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d21bb64-fe94-4af0-b15e-ffabdd23a430-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-f4smf\" (UID: \"4d21bb64-fe94-4af0-b15e-ffabdd23a430\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f4smf" Jun 14 21:42:25.716111 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:25.716092 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4d21bb64-fe94-4af0-b15e-ffabdd23a430-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-f4smf\" (UID: \"4d21bb64-fe94-4af0-b15e-ffabdd23a430\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f4smf" Jun 14 21:42:25.716205 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:25.716187 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4d21bb64-fe94-4af0-b15e-ffabdd23a430-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-f4smf\" (UID: \"4d21bb64-fe94-4af0-b15e-ffabdd23a430\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f4smf" Jun 14 21:42:25.716205 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:25.716206 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4d21bb64-fe94-4af0-b15e-ffabdd23a430-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-f4smf\" (UID: \"4d21bb64-fe94-4af0-b15e-ffabdd23a430\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f4smf" Jun 14 21:42:25.721741 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:25.721713 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d21bb64-fe94-4af0-b15e-ffabdd23a430-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-f4smf\" (UID: \"4d21bb64-fe94-4af0-b15e-ffabdd23a430\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f4smf" Jun 14 21:42:25.722506 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:25.722486 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mtgj\" (UniqueName: \"kubernetes.io/projected/4d21bb64-fe94-4af0-b15e-ffabdd23a430-kube-api-access-7mtgj\") pod \"istiod-openshift-gateway-75c67f8887-f4smf\" (UID: \"4d21bb64-fe94-4af0-b15e-ffabdd23a430\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f4smf" Jun 14 21:42:25.892929 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:25.892901 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f4smf" Jun 14 21:42:26.049645 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:26.049612 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-f4smf"] Jun 14 21:42:26.052115 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:42:26.052089 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d21bb64_fe94_4af0_b15e_ffabdd23a430.slice/crio-d8618813c0e7d75716941b97e254d995d300d2cc5bea8c67d95ee4b8a8b5c9c4 WatchSource:0}: Error finding container d8618813c0e7d75716941b97e254d995d300d2cc5bea8c67d95ee4b8a8b5c9c4: Status 404 returned error can't find the container with id d8618813c0e7d75716941b97e254d995d300d2cc5bea8c67d95ee4b8a8b5c9c4 Jun 14 21:42:26.745447 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:26.745415 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f4smf" event={"ID":"4d21bb64-fe94-4af0-b15e-ffabdd23a430","Type":"ContainerStarted","Data":"d8618813c0e7d75716941b97e254d995d300d2cc5bea8c67d95ee4b8a8b5c9c4"} Jun 14 21:42:29.439301 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:29.439262 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 14 21:42:29.439571 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:29.439358 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 14 21:42:29.624287 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:29.624254 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-r66ps" Jun 14 21:42:29.627317 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:29.627290 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-2lcdt" Jun 14 21:42:29.760675 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:29.760598 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f4smf" event={"ID":"4d21bb64-fe94-4af0-b15e-ffabdd23a430","Type":"ContainerStarted","Data":"edd7c65053ecc6dbd5fb0d283da0bb0e5c34037c54e07151d7e5c990f1e26e96"} Jun 14 21:42:29.760801 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:29.760720 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f4smf" Jun 14 21:42:29.779877 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:29.779832 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f4smf" podStartSLOduration=1.395064757 podStartE2EDuration="4.779817743s" totalImagesPullingTime="3.384752986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:42:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:42:29.777976763 +0000 UTC m=+550.242577532" watchObservedRunningTime="2026-06-14 21:42:29.779817743 +0000 UTC m=+550.244418488" Jun 14 21:42:30.766767 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:30.766730 2563 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-f4smf container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 14 21:42:30.767240 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:30.766798 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f4smf" podUID="4d21bb64-fe94-4af0-b15e-ffabdd23a430" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 21:42:33.766718 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:42:33.766689 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-f4smf" Jun 14 21:43:19.893040 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:43:19.893015 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bkzms_f03840e6-bb9f-46f3-ba9a-ab2a98d744fa/ovn-acl-logging/0.log" Jun 14 21:43:19.894274 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:43:19.894249 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bkzms_f03840e6-bb9f-46f3-ba9a-ab2a98d744fa/ovn-acl-logging/0.log" Jun 14 21:43:34.939574 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:43:34.939500 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gl8mh"] Jun 14 21:43:34.942721 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:43:34.942706 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gl8mh" Jun 14 21:43:34.945480 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:43:34.945462 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 14 21:43:34.946657 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:43:34.946640 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 14 21:43:34.946755 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:43:34.946653 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-bp945\"" Jun 14 21:43:34.954552 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:43:34.954522 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gl8mh"] Jun 14 21:43:35.101836 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:43:35.101807 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2lnv\" (UniqueName: \"kubernetes.io/projected/d8709f81-2135-4309-9a82-8bd507addbae-kube-api-access-h2lnv\") pod \"limitador-operator-controller-manager-859d7b78bd-gl8mh\" (UID: \"d8709f81-2135-4309-9a82-8bd507addbae\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gl8mh" Jun 14 21:43:35.203122 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:43:35.203067 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2lnv\" (UniqueName: \"kubernetes.io/projected/d8709f81-2135-4309-9a82-8bd507addbae-kube-api-access-h2lnv\") pod \"limitador-operator-controller-manager-859d7b78bd-gl8mh\" (UID: \"d8709f81-2135-4309-9a82-8bd507addbae\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gl8mh" Jun 14 21:43:35.212649 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:43:35.212621 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2lnv\" (UniqueName: \"kubernetes.io/projected/d8709f81-2135-4309-9a82-8bd507addbae-kube-api-access-h2lnv\") pod \"limitador-operator-controller-manager-859d7b78bd-gl8mh\" (UID: \"d8709f81-2135-4309-9a82-8bd507addbae\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gl8mh" Jun 14 21:43:35.252790 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:43:35.252764 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gl8mh" Jun 14 21:43:35.379714 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:43:35.379688 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gl8mh"] Jun 14 21:43:35.382132 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:43:35.382106 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8709f81_2135_4309_9a82_8bd507addbae.slice/crio-1fe338153188c6c06af39f6254758596a7a980d91dd6551866ed8601b4550e47 WatchSource:0}: Error finding container 1fe338153188c6c06af39f6254758596a7a980d91dd6551866ed8601b4550e47: Status 404 returned error can't find the container with id 1fe338153188c6c06af39f6254758596a7a980d91dd6551866ed8601b4550e47 Jun 14 21:43:36.038580 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:43:36.038549 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gl8mh" event={"ID":"d8709f81-2135-4309-9a82-8bd507addbae","Type":"ContainerStarted","Data":"1fe338153188c6c06af39f6254758596a7a980d91dd6551866ed8601b4550e47"} Jun 14 21:43:37.044207 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:43:37.044119 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gl8mh" event={"ID":"d8709f81-2135-4309-9a82-8bd507addbae","Type":"ContainerStarted","Data":"d88192572a2e69857a87180559d7da4d3fd762e242f51bcfe1ecb56143f4202f"} Jun 14 21:43:37.044577 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:43:37.044249 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gl8mh" Jun 14 21:43:37.077430 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:43:37.077375 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gl8mh" podStartSLOduration=1.673024094 podStartE2EDuration="3.077354471s" totalImagesPullingTime="1.404330377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:43:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:43:37.074255277 +0000 UTC m=+617.538856022" watchObservedRunningTime="2026-06-14 21:43:37.077354471 +0000 UTC m=+617.541955217" Jun 14 21:43:40.184819 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:43:40.184788 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gl8mh"] Jun 14 21:43:40.185253 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:43:40.184965 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gl8mh" podUID="d8709f81-2135-4309-9a82-8bd507addbae" containerName="manager" containerID="cri-o://d88192572a2e69857a87180559d7da4d3fd762e242f51bcfe1ecb56143f4202f" gracePeriod=2 Jun 14 21:43:40.191512 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:43:40.191486 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gl8mh"] Jun 14 21:43:40.227645 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:43:40.227619 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v7pc8"] Jun 14 21:43:40.227954 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:43:40.227939 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8709f81-2135-4309-9a82-8bd507addbae" containerName="manager" Jun 14 21:43:40.227954 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:43:40.227955 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8709f81-2135-4309-9a82-8bd507addbae" containerName="manager" Jun 14 21:43:40.228054 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:43:40.228010 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8709f81-2135-4309-9a82-8bd507addbae" containerName="manager" Jun 14 21:43:40.231053 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:43:40.231033 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v7pc8" Jun 14 21:43:40.265546 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:43:40.265524 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v7pc8"] Jun 14 21:43:40.295855 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:43:40.295827 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gl8mh\" is forbidden: User \"system:node:ip-10-0-142-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-95.ec2.internal' and this object" podUID="d8709f81-2135-4309-9a82-8bd507addbae" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gl8mh" Jun 14 21:43:40.342944 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:43:40.342915 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8kvg\" (UniqueName: \"kubernetes.io/projected/f7e8fff7-e906-4256-9e8d-f5502746bcb2-kube-api-access-n8kvg\") pod \"limitador-operator-controller-manager-859d7b78bd-v7pc8\" (UID: \"f7e8fff7-e906-4256-9e8d-f5502746bcb2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v7pc8" Jun 14 21:43:40.427175 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:43:40.427153 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gl8mh" Jun 14 21:43:40.429590 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:43:40.429567 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gl8mh\" is forbidden: User \"system:node:ip-10-0-142-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-95.ec2.internal' and this object" podUID="d8709f81-2135-4309-9a82-8bd507addbae" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gl8mh" Jun 14 21:43:40.444022 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:43:40.443959 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8kvg\" (UniqueName: \"kubernetes.io/projected/f7e8fff7-e906-4256-9e8d-f5502746bcb2-kube-api-access-n8kvg\") pod \"limitador-operator-controller-manager-859d7b78bd-v7pc8\" (UID: \"f7e8fff7-e906-4256-9e8d-f5502746bcb2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v7pc8" Jun 14 21:43:40.456343 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:43:40.456323 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8kvg\" (UniqueName: \"kubernetes.io/projected/f7e8fff7-e906-4256-9e8d-f5502746bcb2-kube-api-access-n8kvg\") pod \"limitador-operator-controller-manager-859d7b78bd-v7pc8\" (UID: \"f7e8fff7-e906-4256-9e8d-f5502746bcb2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v7pc8" Jun 14 21:43:40.545109 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:43:40.545073 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2lnv\" (UniqueName: \"kubernetes.io/projected/d8709f81-2135-4309-9a82-8bd507addbae-kube-api-access-h2lnv\") pod \"d8709f81-2135-4309-9a82-8bd507addbae\" (UID: \"d8709f81-2135-4309-9a82-8bd507addbae\") " Jun 14 21:43:40.547116 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:43:40.547095 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8709f81-2135-4309-9a82-8bd507addbae-kube-api-access-h2lnv" (OuterVolumeSpecName: "kube-api-access-h2lnv") pod "d8709f81-2135-4309-9a82-8bd507addbae" (UID: "d8709f81-2135-4309-9a82-8bd507addbae"). InnerVolumeSpecName "kube-api-access-h2lnv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 21:43:40.578415 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:43:40.578394 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v7pc8" Jun 14 21:43:40.646438 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:43:40.646411 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2lnv\" (UniqueName: \"kubernetes.io/projected/d8709f81-2135-4309-9a82-8bd507addbae-kube-api-access-h2lnv\") on node \"ip-10-0-142-95.ec2.internal\" DevicePath \"\"" Jun 14 21:43:40.714238 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:43:40.714196 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v7pc8"] Jun 14 21:43:40.716630 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:43:40.716599 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7e8fff7_e906_4256_9e8d_f5502746bcb2.slice/crio-9dad411e542b0aa271c1ef9c495894503497b20d6eafe89c5d57015a32df2a34 WatchSource:0}: Error finding container 9dad411e542b0aa271c1ef9c495894503497b20d6eafe89c5d57015a32df2a34: Status 404 returned error can't find the container with id 9dad411e542b0aa271c1ef9c495894503497b20d6eafe89c5d57015a32df2a34 Jun 14 21:43:41.062444 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:43:41.062416 2563 generic.go:356] "Generic (PLEG): container finished" podID="d8709f81-2135-4309-9a82-8bd507addbae" containerID="d88192572a2e69857a87180559d7da4d3fd762e242f51bcfe1ecb56143f4202f" exitCode=0 Jun 14 21:43:41.062604 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:43:41.062462 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gl8mh" Jun 14 21:43:41.062604 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:43:41.062523 2563 scope.go:117] "RemoveContainer" containerID="d88192572a2e69857a87180559d7da4d3fd762e242f51bcfe1ecb56143f4202f" Jun 14 21:43:41.064470 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:43:41.064438 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v7pc8" event={"ID":"f7e8fff7-e906-4256-9e8d-f5502746bcb2","Type":"ContainerStarted","Data":"540a5549b6e47750b512b8fcad1c07e860abad08eb884c00fbc0c5f30f662941"} Jun 14 21:43:41.064667 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:43:41.064487 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v7pc8" event={"ID":"f7e8fff7-e906-4256-9e8d-f5502746bcb2","Type":"ContainerStarted","Data":"9dad411e542b0aa271c1ef9c495894503497b20d6eafe89c5d57015a32df2a34"} Jun 14 21:43:41.064667 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:43:41.064521 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v7pc8" Jun 14 21:43:41.064828 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:43:41.064802 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gl8mh\" is forbidden: User \"system:node:ip-10-0-142-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-95.ec2.internal' and this object" podUID="d8709f81-2135-4309-9a82-8bd507addbae" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gl8mh" Jun 14 21:43:41.071555 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:43:41.071537 2563 scope.go:117] "RemoveContainer" containerID="d88192572a2e69857a87180559d7da4d3fd762e242f51bcfe1ecb56143f4202f" Jun 14 21:43:41.071795 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:43:41.071776 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d88192572a2e69857a87180559d7da4d3fd762e242f51bcfe1ecb56143f4202f\": container with ID starting with d88192572a2e69857a87180559d7da4d3fd762e242f51bcfe1ecb56143f4202f not found: ID does not exist" containerID="d88192572a2e69857a87180559d7da4d3fd762e242f51bcfe1ecb56143f4202f" Jun 14 21:43:41.071848 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:43:41.071804 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d88192572a2e69857a87180559d7da4d3fd762e242f51bcfe1ecb56143f4202f"} err="failed to get container status \"d88192572a2e69857a87180559d7da4d3fd762e242f51bcfe1ecb56143f4202f\": rpc error: code = NotFound desc = could not find container \"d88192572a2e69857a87180559d7da4d3fd762e242f51bcfe1ecb56143f4202f\": container with ID starting with d88192572a2e69857a87180559d7da4d3fd762e242f51bcfe1ecb56143f4202f not found: ID does not exist" Jun 14 21:43:41.092421 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:43:41.092376 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v7pc8" podStartSLOduration=1.092364348 podStartE2EDuration="1.092364348s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:43:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:43:41.091318944 +0000 UTC m=+621.555919684" watchObservedRunningTime="2026-06-14 21:43:41.092364348 +0000 UTC m=+621.556965095" Jun 14 21:43:41.093537 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:43:41.093518 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gl8mh\" is forbidden: User \"system:node:ip-10-0-142-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-95.ec2.internal' and this object" podUID="d8709f81-2135-4309-9a82-8bd507addbae" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gl8mh" Jun 14 21:43:41.095863 ip-10-0-142-95 kubenswrapper[2563]: E0614 21:43:41.095844 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gl8mh\" is forbidden: User \"system:node:ip-10-0-142-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-95.ec2.internal' and this object" podUID="d8709f81-2135-4309-9a82-8bd507addbae" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gl8mh" Jun 14 21:43:41.921687 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:43:41.921658 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8709f81-2135-4309-9a82-8bd507addbae" path="/var/lib/kubelet/pods/d8709f81-2135-4309-9a82-8bd507addbae/volumes" Jun 14 21:43:52.072117 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:43:52.072084 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v7pc8" Jun 14 21:44:24.967970 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:44:24.967938 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bcm22"] Jun 14 21:44:24.972884 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:44:24.972862 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-bcm22" Jun 14 21:44:24.975248 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:44:24.975207 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 14 21:44:24.975352 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:44:24.975276 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6cqvg\"" Jun 14 21:44:24.984282 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:44:24.984259 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bcm22"] Jun 14 21:44:25.009615 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:44:25.009588 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bcm22"] Jun 14 21:44:25.050672 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:44:25.050649 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1b44f3bd-cd1f-4e12-b766-7436acca91e9-config-file\") pod \"limitador-limitador-54d6d988d5-bcm22\" (UID: \"1b44f3bd-cd1f-4e12-b766-7436acca91e9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bcm22" Jun 14 21:44:25.050771 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:44:25.050678 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lg5q\" (UniqueName: \"kubernetes.io/projected/1b44f3bd-cd1f-4e12-b766-7436acca91e9-kube-api-access-2lg5q\") pod \"limitador-limitador-54d6d988d5-bcm22\" (UID: \"1b44f3bd-cd1f-4e12-b766-7436acca91e9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bcm22" Jun 14 21:44:25.151903 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:44:25.151877 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1b44f3bd-cd1f-4e12-b766-7436acca91e9-config-file\") pod \"limitador-limitador-54d6d988d5-bcm22\" (UID: \"1b44f3bd-cd1f-4e12-b766-7436acca91e9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bcm22" Jun 14 21:44:25.151995 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:44:25.151911 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lg5q\" (UniqueName: \"kubernetes.io/projected/1b44f3bd-cd1f-4e12-b766-7436acca91e9-kube-api-access-2lg5q\") pod \"limitador-limitador-54d6d988d5-bcm22\" (UID: \"1b44f3bd-cd1f-4e12-b766-7436acca91e9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bcm22" Jun 14 21:44:25.152528 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:44:25.152510 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1b44f3bd-cd1f-4e12-b766-7436acca91e9-config-file\") pod \"limitador-limitador-54d6d988d5-bcm22\" (UID: \"1b44f3bd-cd1f-4e12-b766-7436acca91e9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bcm22" Jun 14 21:44:25.159679 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:44:25.159658 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lg5q\" (UniqueName: \"kubernetes.io/projected/1b44f3bd-cd1f-4e12-b766-7436acca91e9-kube-api-access-2lg5q\") pod \"limitador-limitador-54d6d988d5-bcm22\" (UID: \"1b44f3bd-cd1f-4e12-b766-7436acca91e9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bcm22" Jun 14 21:44:25.282541 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:44:25.282479 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-bcm22" Jun 14 21:44:25.417177 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:44:25.417147 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bcm22"] Jun 14 21:44:25.420634 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:44:25.420596 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b44f3bd_cd1f_4e12_b766_7436acca91e9.slice/crio-7321830d102d2bd36ed67c610595e26dd3f69ad6a3ca4cd38f49c67982c41e9f WatchSource:0}: Error finding container 7321830d102d2bd36ed67c610595e26dd3f69ad6a3ca4cd38f49c67982c41e9f: Status 404 returned error can't find the container with id 7321830d102d2bd36ed67c610595e26dd3f69ad6a3ca4cd38f49c67982c41e9f Jun 14 21:44:26.254493 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:44:26.254457 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-bcm22" event={"ID":"1b44f3bd-cd1f-4e12-b766-7436acca91e9","Type":"ContainerStarted","Data":"7321830d102d2bd36ed67c610595e26dd3f69ad6a3ca4cd38f49c67982c41e9f"} Jun 14 21:44:28.265837 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:44:28.265745 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-bcm22" event={"ID":"1b44f3bd-cd1f-4e12-b766-7436acca91e9","Type":"ContainerStarted","Data":"318afde3116fdb4c945b2eaba7592ffe852742e03dba41769f0f6cba85200ddf"} Jun 14 21:44:28.265837 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:44:28.265833 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-bcm22" Jun 14 21:44:28.284002 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:44:28.283959 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-bcm22" podStartSLOduration=1.899929835 podStartE2EDuration="4.283942102s" totalImagesPullingTime="2.384012267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:44:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:44:28.283378509 +0000 UTC m=+668.747979282" watchObservedRunningTime="2026-06-14 21:44:28.283942102 +0000 UTC m=+668.748542851" Jun 14 21:44:39.271029 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:44:39.270996 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-bcm22" Jun 14 21:46:28.879887 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:46:28.879850 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bcm22"] Jun 14 21:46:28.902587 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:46:28.902551 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-r8c5d"] Jun 14 21:46:28.904770 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:46:28.904748 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-r8c5d" Jun 14 21:46:28.907467 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:46:28.907447 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 14 21:46:28.907569 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:46:28.907540 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-6wh7n\"" Jun 14 21:46:28.915440 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:46:28.915420 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-r8c5d"] Jun 14 21:46:28.943597 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:46:28.943575 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4r6b\" (UniqueName: \"kubernetes.io/projected/3a05cb8d-1444-47bf-ae98-f00c95f01cc2-kube-api-access-w4r6b\") pod \"payload-processing-699b6cd6c-r8c5d\" (UID: \"3a05cb8d-1444-47bf-ae98-f00c95f01cc2\") " pod="openshift-ingress/payload-processing-699b6cd6c-r8c5d" Jun 14 21:46:29.044573 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:46:29.044552 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4r6b\" (UniqueName: \"kubernetes.io/projected/3a05cb8d-1444-47bf-ae98-f00c95f01cc2-kube-api-access-w4r6b\") pod \"payload-processing-699b6cd6c-r8c5d\" (UID: \"3a05cb8d-1444-47bf-ae98-f00c95f01cc2\") " pod="openshift-ingress/payload-processing-699b6cd6c-r8c5d" Jun 14 21:46:29.054088 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:46:29.054057 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4r6b\" (UniqueName: \"kubernetes.io/projected/3a05cb8d-1444-47bf-ae98-f00c95f01cc2-kube-api-access-w4r6b\") pod \"payload-processing-699b6cd6c-r8c5d\" (UID: \"3a05cb8d-1444-47bf-ae98-f00c95f01cc2\") " pod="openshift-ingress/payload-processing-699b6cd6c-r8c5d" Jun 14 21:46:29.215167 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:46:29.215114 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-r8c5d" Jun 14 21:46:29.344958 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:46:29.344926 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-r8c5d"] Jun 14 21:46:29.347971 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:46:29.347946 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a05cb8d_1444_47bf_ae98_f00c95f01cc2.slice/crio-cc1449ab583419f6a430d120f1a4430afad91e869f993f87f6f8976b970de5d5 WatchSource:0}: Error finding container cc1449ab583419f6a430d120f1a4430afad91e869f993f87f6f8976b970de5d5: Status 404 returned error can't find the container with id cc1449ab583419f6a430d120f1a4430afad91e869f993f87f6f8976b970de5d5 Jun 14 21:46:29.350069 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:46:29.350052 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 21:46:29.800010 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:46:29.799941 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-r8c5d" event={"ID":"3a05cb8d-1444-47bf-ae98-f00c95f01cc2","Type":"ContainerStarted","Data":"cc1449ab583419f6a430d120f1a4430afad91e869f993f87f6f8976b970de5d5"} Jun 14 21:46:31.813652 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:46:31.813621 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-r8c5d" event={"ID":"3a05cb8d-1444-47bf-ae98-f00c95f01cc2","Type":"ContainerStarted","Data":"e86b74c764d91a23e82e08b91283e071ae9f0d0f8f662b6ffff5da1ccdf5d310"} Jun 14 21:46:31.814023 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:46:31.813742 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-r8c5d" Jun 14 21:46:31.830939 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:46:31.830888 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-r8c5d" podStartSLOduration=1.832166703 podStartE2EDuration="3.830869695s" totalImagesPullingTime="1.998702992s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:46:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:46:31.830189864 +0000 UTC m=+792.294790637" watchObservedRunningTime="2026-06-14 21:46:31.830869695 +0000 UTC m=+792.295470433" Jun 14 21:46:42.820294 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:46:42.820263 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-r8c5d" Jun 14 21:47:25.620100 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:47:25.620067 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bcm22"] Jun 14 21:47:34.268707 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:47:34.268668 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-4nxtn"] Jun 14 21:47:34.272339 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:47:34.272317 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4nxtn" Jun 14 21:47:34.275350 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:47:34.275330 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 14 21:47:34.275472 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:47:34.275373 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-b9vm5\"" Jun 14 21:47:34.275472 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:47:34.275373 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 14 21:47:34.276441 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:47:34.276422 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 14 21:47:34.283357 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:47:34.283338 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-4nxtn"] Jun 14 21:47:34.307423 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:47:34.307393 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/079d7112-842e-4c00-b10b-d4adac1b4ae2-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4nxtn\" (UID: \"079d7112-842e-4c00-b10b-d4adac1b4ae2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4nxtn" Jun 14 21:47:34.307539 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:47:34.307440 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bndqv\" (UniqueName: \"kubernetes.io/projected/079d7112-842e-4c00-b10b-d4adac1b4ae2-kube-api-access-bndqv\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4nxtn\" (UID: \"079d7112-842e-4c00-b10b-d4adac1b4ae2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4nxtn" Jun 14 21:47:34.307539 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:47:34.307472 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/079d7112-842e-4c00-b10b-d4adac1b4ae2-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4nxtn\" (UID: \"079d7112-842e-4c00-b10b-d4adac1b4ae2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4nxtn" Jun 14 21:47:34.307539 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:47:34.307531 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/079d7112-842e-4c00-b10b-d4adac1b4ae2-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4nxtn\" (UID: \"079d7112-842e-4c00-b10b-d4adac1b4ae2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4nxtn" Jun 14 21:47:34.307688 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:47:34.307573 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/079d7112-842e-4c00-b10b-d4adac1b4ae2-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4nxtn\" (UID: \"079d7112-842e-4c00-b10b-d4adac1b4ae2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4nxtn" Jun 14 21:47:34.307688 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:47:34.307614 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/079d7112-842e-4c00-b10b-d4adac1b4ae2-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4nxtn\" (UID: \"079d7112-842e-4c00-b10b-d4adac1b4ae2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4nxtn" Jun 14 21:47:34.408003 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:47:34.407976 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/079d7112-842e-4c00-b10b-d4adac1b4ae2-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4nxtn\" (UID: \"079d7112-842e-4c00-b10b-d4adac1b4ae2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4nxtn" Jun 14 21:47:34.408105 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:47:34.408007 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/079d7112-842e-4c00-b10b-d4adac1b4ae2-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4nxtn\" (UID: \"079d7112-842e-4c00-b10b-d4adac1b4ae2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4nxtn" Jun 14 21:47:34.408105 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:47:34.408036 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/079d7112-842e-4c00-b10b-d4adac1b4ae2-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4nxtn\" (UID: \"079d7112-842e-4c00-b10b-d4adac1b4ae2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4nxtn" Jun 14 21:47:34.408105 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:47:34.408070 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bndqv\" (UniqueName: \"kubernetes.io/projected/079d7112-842e-4c00-b10b-d4adac1b4ae2-kube-api-access-bndqv\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4nxtn\" (UID: \"079d7112-842e-4c00-b10b-d4adac1b4ae2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4nxtn" Jun 14 21:47:34.408105 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:47:34.408096 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/079d7112-842e-4c00-b10b-d4adac1b4ae2-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4nxtn\" (UID: \"079d7112-842e-4c00-b10b-d4adac1b4ae2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4nxtn" Jun 14 21:47:34.408344 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:47:34.408155 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/079d7112-842e-4c00-b10b-d4adac1b4ae2-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4nxtn\" (UID: \"079d7112-842e-4c00-b10b-d4adac1b4ae2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4nxtn" Jun 14 21:47:34.408530 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:47:34.408505 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/079d7112-842e-4c00-b10b-d4adac1b4ae2-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4nxtn\" (UID: \"079d7112-842e-4c00-b10b-d4adac1b4ae2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4nxtn" Jun 14 21:47:34.408693 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:47:34.408671 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/079d7112-842e-4c00-b10b-d4adac1b4ae2-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4nxtn\" (UID: \"079d7112-842e-4c00-b10b-d4adac1b4ae2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4nxtn" Jun 14 21:47:34.408765 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:47:34.408710 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/079d7112-842e-4c00-b10b-d4adac1b4ae2-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4nxtn\" (UID: \"079d7112-842e-4c00-b10b-d4adac1b4ae2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4nxtn" Jun 14 21:47:34.410353 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:47:34.410326 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/079d7112-842e-4c00-b10b-d4adac1b4ae2-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4nxtn\" (UID: \"079d7112-842e-4c00-b10b-d4adac1b4ae2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4nxtn" Jun 14 21:47:34.410734 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:47:34.410715 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/079d7112-842e-4c00-b10b-d4adac1b4ae2-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4nxtn\" (UID: \"079d7112-842e-4c00-b10b-d4adac1b4ae2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4nxtn" Jun 14 21:47:34.415988 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:47:34.415970 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bndqv\" (UniqueName: \"kubernetes.io/projected/079d7112-842e-4c00-b10b-d4adac1b4ae2-kube-api-access-bndqv\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4nxtn\" (UID: \"079d7112-842e-4c00-b10b-d4adac1b4ae2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4nxtn" Jun 14 21:47:34.583185 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:47:34.583159 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4nxtn" Jun 14 21:47:34.716795 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:47:34.716770 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-4nxtn"] Jun 14 21:47:34.718907 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:47:34.718880 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod079d7112_842e_4c00_b10b_d4adac1b4ae2.slice/crio-0c11cfda785186a2b7a95369743beece20e7894bd7b8fb7d53c0bd1f15120f51 WatchSource:0}: Error finding container 0c11cfda785186a2b7a95369743beece20e7894bd7b8fb7d53c0bd1f15120f51: Status 404 returned error can't find the container with id 0c11cfda785186a2b7a95369743beece20e7894bd7b8fb7d53c0bd1f15120f51 Jun 14 21:47:34.920929 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:47:34.920864 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bcm22"] Jun 14 21:47:35.077767 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:47:35.077734 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4nxtn" event={"ID":"079d7112-842e-4c00-b10b-d4adac1b4ae2","Type":"ContainerStarted","Data":"0c11cfda785186a2b7a95369743beece20e7894bd7b8fb7d53c0bd1f15120f51"} Jun 14 21:47:38.094846 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:47:38.094805 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4nxtn" event={"ID":"079d7112-842e-4c00-b10b-d4adac1b4ae2","Type":"ContainerStarted","Data":"25cd4537b6df5595b09b754128d05094f9e865dd61c4b7509f97ee05d18e5454"} Jun 14 21:47:42.407812 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:47:42.407778 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bcm22"] Jun 14 21:47:46.712142 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:47:46.712108 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bcm22"] Jun 14 21:48:08.189257 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:08.189159 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6"] Jun 14 21:48:08.194391 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:08.194369 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6" Jun 14 21:48:08.197573 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:08.197547 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 14 21:48:08.198265 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:08.198246 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6"] Jun 14 21:48:08.246332 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:08.246196 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0827b967-0854-43c3-a535-d1f5bb7323a1-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6\" (UID: \"0827b967-0854-43c3-a535-d1f5bb7323a1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6" Jun 14 21:48:08.246462 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:08.246360 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0827b967-0854-43c3-a535-d1f5bb7323a1-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6\" (UID: \"0827b967-0854-43c3-a535-d1f5bb7323a1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6" Jun 14 21:48:08.246462 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:08.246394 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0827b967-0854-43c3-a535-d1f5bb7323a1-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6\" (UID: \"0827b967-0854-43c3-a535-d1f5bb7323a1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6" Jun 14 21:48:08.246462 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:08.246411 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0827b967-0854-43c3-a535-d1f5bb7323a1-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6\" (UID: \"0827b967-0854-43c3-a535-d1f5bb7323a1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6" Jun 14 21:48:08.246462 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:08.246433 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dmcc\" (UniqueName: \"kubernetes.io/projected/0827b967-0854-43c3-a535-d1f5bb7323a1-kube-api-access-8dmcc\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6\" (UID: \"0827b967-0854-43c3-a535-d1f5bb7323a1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6" Jun 14 21:48:08.246462 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:08.246460 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0827b967-0854-43c3-a535-d1f5bb7323a1-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6\" (UID: \"0827b967-0854-43c3-a535-d1f5bb7323a1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6" Jun 14 21:48:08.347256 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:08.347205 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0827b967-0854-43c3-a535-d1f5bb7323a1-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6\" (UID: \"0827b967-0854-43c3-a535-d1f5bb7323a1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6" Jun 14 21:48:08.347384 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:08.347281 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0827b967-0854-43c3-a535-d1f5bb7323a1-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6\" (UID: \"0827b967-0854-43c3-a535-d1f5bb7323a1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6" Jun 14 21:48:08.347384 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:08.347314 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0827b967-0854-43c3-a535-d1f5bb7323a1-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6\" (UID: \"0827b967-0854-43c3-a535-d1f5bb7323a1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6" Jun 14 21:48:08.347384 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:08.347341 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0827b967-0854-43c3-a535-d1f5bb7323a1-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6\" (UID: \"0827b967-0854-43c3-a535-d1f5bb7323a1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6" Jun 14 21:48:08.347384 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:08.347371 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dmcc\" (UniqueName: \"kubernetes.io/projected/0827b967-0854-43c3-a535-d1f5bb7323a1-kube-api-access-8dmcc\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6\" (UID: \"0827b967-0854-43c3-a535-d1f5bb7323a1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6" Jun 14 21:48:08.347587 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:08.347401 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0827b967-0854-43c3-a535-d1f5bb7323a1-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6\" (UID: \"0827b967-0854-43c3-a535-d1f5bb7323a1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6" Jun 14 21:48:08.347647 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:08.347599 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0827b967-0854-43c3-a535-d1f5bb7323a1-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6\" (UID: \"0827b967-0854-43c3-a535-d1f5bb7323a1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6" Jun 14 21:48:08.347716 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:08.347696 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0827b967-0854-43c3-a535-d1f5bb7323a1-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6\" (UID: \"0827b967-0854-43c3-a535-d1f5bb7323a1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6" Jun 14 21:48:08.347797 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:08.347779 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0827b967-0854-43c3-a535-d1f5bb7323a1-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6\" (UID: \"0827b967-0854-43c3-a535-d1f5bb7323a1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6" Jun 14 21:48:08.349610 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:08.349588 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0827b967-0854-43c3-a535-d1f5bb7323a1-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6\" (UID: \"0827b967-0854-43c3-a535-d1f5bb7323a1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6" Jun 14 21:48:08.349794 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:08.349777 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0827b967-0854-43c3-a535-d1f5bb7323a1-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6\" (UID: \"0827b967-0854-43c3-a535-d1f5bb7323a1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6" Jun 14 21:48:08.355464 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:08.355445 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dmcc\" (UniqueName: \"kubernetes.io/projected/0827b967-0854-43c3-a535-d1f5bb7323a1-kube-api-access-8dmcc\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6\" (UID: \"0827b967-0854-43c3-a535-d1f5bb7323a1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6" Jun 14 21:48:08.518449 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:08.518396 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6" Jun 14 21:48:08.649172 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:08.649148 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6"] Jun 14 21:48:08.651343 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:48:08.651320 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0827b967_0854_43c3_a535_d1f5bb7323a1.slice/crio-d3af80cdffb8341cf911488c5d267c1e55936ff7a44c19a70b8f14f6ee4c2cfe WatchSource:0}: Error finding container d3af80cdffb8341cf911488c5d267c1e55936ff7a44c19a70b8f14f6ee4c2cfe: Status 404 returned error can't find the container with id d3af80cdffb8341cf911488c5d267c1e55936ff7a44c19a70b8f14f6ee4c2cfe Jun 14 21:48:09.231509 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:09.231472 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6" event={"ID":"0827b967-0854-43c3-a535-d1f5bb7323a1","Type":"ContainerStarted","Data":"0439236aac085e9fcbb72cdb9877e8ef29d3e07eef82748884c8e845f84f8172"} Jun 14 21:48:09.231840 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:09.231532 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6" event={"ID":"0827b967-0854-43c3-a535-d1f5bb7323a1","Type":"ContainerStarted","Data":"d3af80cdffb8341cf911488c5d267c1e55936ff7a44c19a70b8f14f6ee4c2cfe"} Jun 14 21:48:09.307919 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:09.307890 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bcm22"] Jun 14 21:48:10.236885 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:10.236804 2563 generic.go:356] "Generic (PLEG): container finished" podID="0827b967-0854-43c3-a535-d1f5bb7323a1" containerID="0439236aac085e9fcbb72cdb9877e8ef29d3e07eef82748884c8e845f84f8172" exitCode=0 Jun 14 21:48:10.237286 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:10.236897 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6" event={"ID":"0827b967-0854-43c3-a535-d1f5bb7323a1","Type":"ContainerDied","Data":"0439236aac085e9fcbb72cdb9877e8ef29d3e07eef82748884c8e845f84f8172"} Jun 14 21:48:12.246384 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:12.246353 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6" event={"ID":"0827b967-0854-43c3-a535-d1f5bb7323a1","Type":"ContainerStarted","Data":"544becfc0f405fe7c8ac83ea8180151b6846b64e75fb4af2de89882c2a878841"} Jun 14 21:48:12.264230 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:12.264178 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6" podStartSLOduration=2.063721834 podStartE2EDuration="4.264167048s" totalImagesPullingTime="1.018594999s" totalInitContainerRuntime="1.181850215s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:48:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:48:12.262966561 +0000 UTC m=+892.727567302" watchObservedRunningTime="2026-06-14 21:48:12.264167048 +0000 UTC m=+892.728767793" Jun 14 21:48:12.864829 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:12.864796 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-hsd9z"] Jun 14 21:48:12.868655 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:12.868635 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hsd9z" Jun 14 21:48:12.871286 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:12.871262 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 14 21:48:12.877759 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:12.877740 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-hsd9z"] Jun 14 21:48:12.987988 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:12.987957 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6c1d721-9619-4ba0-8f08-9a942bf05c3d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hsd9z\" (UID: \"b6c1d721-9619-4ba0-8f08-9a942bf05c3d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hsd9z" Jun 14 21:48:12.988130 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:12.987995 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b6c1d721-9619-4ba0-8f08-9a942bf05c3d-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hsd9z\" (UID: \"b6c1d721-9619-4ba0-8f08-9a942bf05c3d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hsd9z" Jun 14 21:48:12.988130 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:12.988094 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6c1d721-9619-4ba0-8f08-9a942bf05c3d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hsd9z\" (UID: \"b6c1d721-9619-4ba0-8f08-9a942bf05c3d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hsd9z" Jun 14 21:48:12.988130 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:12.988127 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fq66\" (UniqueName: \"kubernetes.io/projected/b6c1d721-9619-4ba0-8f08-9a942bf05c3d-kube-api-access-6fq66\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hsd9z\" (UID: \"b6c1d721-9619-4ba0-8f08-9a942bf05c3d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hsd9z" Jun 14 21:48:12.988283 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:12.988163 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b6c1d721-9619-4ba0-8f08-9a942bf05c3d-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hsd9z\" (UID: \"b6c1d721-9619-4ba0-8f08-9a942bf05c3d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hsd9z" Jun 14 21:48:12.988283 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:12.988183 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6c1d721-9619-4ba0-8f08-9a942bf05c3d-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hsd9z\" (UID: \"b6c1d721-9619-4ba0-8f08-9a942bf05c3d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hsd9z" Jun 14 21:48:13.088683 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:13.088653 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b6c1d721-9619-4ba0-8f08-9a942bf05c3d-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hsd9z\" (UID: \"b6c1d721-9619-4ba0-8f08-9a942bf05c3d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hsd9z" Jun 14 21:48:13.088683 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:13.088685 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6c1d721-9619-4ba0-8f08-9a942bf05c3d-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hsd9z\" (UID: \"b6c1d721-9619-4ba0-8f08-9a942bf05c3d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hsd9z" Jun 14 21:48:13.088829 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:13.088705 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6c1d721-9619-4ba0-8f08-9a942bf05c3d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hsd9z\" (UID: \"b6c1d721-9619-4ba0-8f08-9a942bf05c3d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hsd9z" Jun 14 21:48:13.088829 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:13.088729 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b6c1d721-9619-4ba0-8f08-9a942bf05c3d-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hsd9z\" (UID: \"b6c1d721-9619-4ba0-8f08-9a942bf05c3d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hsd9z" Jun 14 21:48:13.088829 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:13.088808 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6c1d721-9619-4ba0-8f08-9a942bf05c3d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hsd9z\" (UID: \"b6c1d721-9619-4ba0-8f08-9a942bf05c3d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hsd9z" Jun 14 21:48:13.088961 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:13.088831 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fq66\" (UniqueName: \"kubernetes.io/projected/b6c1d721-9619-4ba0-8f08-9a942bf05c3d-kube-api-access-6fq66\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hsd9z\" (UID: \"b6c1d721-9619-4ba0-8f08-9a942bf05c3d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hsd9z" Jun 14 21:48:13.089125 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:13.089100 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b6c1d721-9619-4ba0-8f08-9a942bf05c3d-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hsd9z\" (UID: \"b6c1d721-9619-4ba0-8f08-9a942bf05c3d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hsd9z" Jun 14 21:48:13.089125 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:13.089115 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6c1d721-9619-4ba0-8f08-9a942bf05c3d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hsd9z\" (UID: \"b6c1d721-9619-4ba0-8f08-9a942bf05c3d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hsd9z" Jun 14 21:48:13.089268 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:13.089238 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b6c1d721-9619-4ba0-8f08-9a942bf05c3d-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hsd9z\" (UID: \"b6c1d721-9619-4ba0-8f08-9a942bf05c3d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hsd9z" Jun 14 21:48:13.091043 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:13.091026 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6c1d721-9619-4ba0-8f08-9a942bf05c3d-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hsd9z\" (UID: \"b6c1d721-9619-4ba0-8f08-9a942bf05c3d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hsd9z" Jun 14 21:48:13.091402 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:13.091381 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6c1d721-9619-4ba0-8f08-9a942bf05c3d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hsd9z\" (UID: \"b6c1d721-9619-4ba0-8f08-9a942bf05c3d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hsd9z" Jun 14 21:48:13.096452 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:13.096431 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fq66\" (UniqueName: \"kubernetes.io/projected/b6c1d721-9619-4ba0-8f08-9a942bf05c3d-kube-api-access-6fq66\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hsd9z\" (UID: \"b6c1d721-9619-4ba0-8f08-9a942bf05c3d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hsd9z" Jun 14 21:48:13.177951 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:13.177896 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hsd9z" Jun 14 21:48:13.309441 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:13.309410 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-hsd9z"] Jun 14 21:48:13.311289 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:48:13.311261 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6c1d721_9619_4ba0_8f08_9a942bf05c3d.slice/crio-d0b8c6d8f22950f945aec80117e54ad802613f9d70ed43982106724b7833d5c6 WatchSource:0}: Error finding container d0b8c6d8f22950f945aec80117e54ad802613f9d70ed43982106724b7833d5c6: Status 404 returned error can't find the container with id d0b8c6d8f22950f945aec80117e54ad802613f9d70ed43982106724b7833d5c6 Jun 14 21:48:14.115182 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:14.115147 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bcm22"] Jun 14 21:48:14.256445 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:14.256412 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hsd9z" event={"ID":"b6c1d721-9619-4ba0-8f08-9a942bf05c3d","Type":"ContainerStarted","Data":"18c1e3a1f6f485a8da10a161baa1f22b423dda8267cdcd9e47ef9fb0ab58e1bd"} Jun 14 21:48:14.256589 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:14.256452 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hsd9z" event={"ID":"b6c1d721-9619-4ba0-8f08-9a942bf05c3d","Type":"ContainerStarted","Data":"d0b8c6d8f22950f945aec80117e54ad802613f9d70ed43982106724b7833d5c6"} Jun 14 21:48:18.519441 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:18.519405 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6" Jun 14 21:48:18.519824 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:18.519466 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6" Jun 14 21:48:18.531873 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:18.531841 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6" Jun 14 21:48:19.289402 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:19.289374 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6" Jun 14 21:48:19.919616 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:19.919589 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bkzms_f03840e6-bb9f-46f3-ba9a-ab2a98d744fa/ovn-acl-logging/0.log" Jun 14 21:48:19.921259 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:19.921237 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bkzms_f03840e6-bb9f-46f3-ba9a-ab2a98d744fa/ovn-acl-logging/0.log" Jun 14 21:48:31.331920 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:31.331885 2563 generic.go:356] "Generic (PLEG): container finished" podID="079d7112-842e-4c00-b10b-d4adac1b4ae2" containerID="25cd4537b6df5595b09b754128d05094f9e865dd61c4b7509f97ee05d18e5454" exitCode=0 Jun 14 21:48:31.332244 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:31.331959 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4nxtn" event={"ID":"079d7112-842e-4c00-b10b-d4adac1b4ae2","Type":"ContainerDied","Data":"25cd4537b6df5595b09b754128d05094f9e865dd61c4b7509f97ee05d18e5454"} Jun 14 21:48:32.337916 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:32.337885 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4nxtn" event={"ID":"079d7112-842e-4c00-b10b-d4adac1b4ae2","Type":"ContainerStarted","Data":"cf4f084f923141edf3e2a48c4c534c09b52b0dbda90c51c832870f34ba8087e6"} Jun 14 21:48:32.359357 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:32.359311 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4nxtn" podStartSLOduration=1.7490844920000002 podStartE2EDuration="58.359295669s" totalImagesPullingTime="2.96226272s" totalInitContainerRuntime="53.647948457s" isStatefulPod=false podCreationTimestamp="2026-06-14 21:47:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:48:32.356931361 +0000 UTC m=+912.821532134" watchObservedRunningTime="2026-06-14 21:48:32.359295669 +0000 UTC m=+912.823896414" Jun 14 21:48:34.583973 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:34.583942 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4nxtn" Jun 14 21:48:34.584454 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:34.584029 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4nxtn" Jun 14 21:48:34.596184 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:34.596165 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4nxtn" Jun 14 21:48:35.363669 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:48:35.363641 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4nxtn" Jun 14 21:53:19.948677 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:53:19.948647 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bkzms_f03840e6-bb9f-46f3-ba9a-ab2a98d744fa/ovn-acl-logging/0.log" Jun 14 21:53:19.950617 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:53:19.950594 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bkzms_f03840e6-bb9f-46f3-ba9a-ab2a98d744fa/ovn-acl-logging/0.log" Jun 14 21:53:41.333796 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:53:41.333760 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-hsd9z_b6c1d721-9619-4ba0-8f08-9a942bf05c3d/storage-initializer/0.log" Jun 14 21:53:46.815660 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:53:46.815628 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-67768fd87d-888cx_17b0fbd6-dd44-4792-a622-4131de07af3e/nginx/0.log" Jun 14 21:53:47.036703 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:53:47.036683 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-2lcdt_7df345b7-1956-487d-a724-a6860ab0a596/manager/0.log" Jun 14 21:53:47.148962 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:53:47.148892 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-r66ps_90072ef0-9d3b-4d7b-93d5-4ab01e9df81d/manager/0.log" Jun 14 21:53:47.541961 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:53:47.541898 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-hcjzh_466f0add-93d2-4989-b4b9-a3209c80a7d5/server/0.log" Jun 14 21:53:47.650597 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:53:47.650575 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-tgk9t_54f5caad-dfe7-4150-ab78-833bf2f84702/manager/0.log" Jun 14 21:53:47.761685 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:53:47.761661 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c8557bfd5-c88f8_a938e683-6d15-4169-bd61-5d56613a71d5/copy-manifests/0.log" Jun 14 21:53:47.768480 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:53:47.768462 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c8557bfd5-c88f8_a938e683-6d15-4169-bd61-5d56613a71d5/manager/0.log" Jun 14 21:53:50.070750 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:53:50.070719 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-bcm22_1b44f3bd-cd1f-4e12-b766-7436acca91e9/limitador/0.log" Jun 14 21:53:50.183027 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:53:50.182996 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-v7pc8_f7e8fff7-e906-4256-9e8d-f5502746bcb2/manager/0.log" Jun 14 21:53:50.640964 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:53:50.640941 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-f4smf_4d21bb64-fe94-4af0-b15e-ffabdd23a430/discovery/0.log" Jun 14 21:53:50.857068 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:53:50.857042 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-ddf4d968b-v7lc2_439fd394-122c-48d7-8025-7b95554805bb/kube-auth-proxy/0.log" Jun 14 21:53:51.193972 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:53:51.193953 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-r8c5d_3a05cb8d-1444-47bf-ae98-f00c95f01cc2/payload-processing/0.log" Jun 14 21:53:51.773634 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:53:51.773601 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-4nxtn_079d7112-842e-4c00-b10b-d4adac1b4ae2/storage-initializer/0.log" Jun 14 21:53:51.780382 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:53:51.780362 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-4nxtn_079d7112-842e-4c00-b10b-d4adac1b4ae2/main/0.log" Jun 14 21:53:52.122020 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:53:52.121993 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6_0827b967-0854-43c3-a535-d1f5bb7323a1/storage-initializer/0.log" Jun 14 21:53:52.129682 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:53:52.129655 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-q6sv6_0827b967-0854-43c3-a535-d1f5bb7323a1/main/0.log" Jun 14 21:53:52.242026 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:53:52.242007 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-hsd9z_b6c1d721-9619-4ba0-8f08-9a942bf05c3d/storage-initializer/0.log" Jun 14 21:53:59.545061 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:53:59.545033 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-snfcq_95f20b19-8b4b-4e5d-8b1c-fe16e8c48bdb/global-pull-secret-syncer/0.log" Jun 14 21:53:59.620942 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:53:59.620917 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-r69lf_82ba6948-a910-4e5e-8783-3c981623181c/konnectivity-agent/0.log" Jun 14 21:53:59.714634 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:53:59.714610 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-95.ec2.internal_3c99a3657720963dc97fd6269d6795a7/haproxy/0.log" Jun 14 21:54:03.817241 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:03.817146 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-85lbb_56f5a8a0-babe-40e9-be44-cd544ab96a84/sail-operator/0.log" Jun 14 21:54:04.549596 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:04.549566 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-bcm22_1b44f3bd-cd1f-4e12-b766-7436acca91e9/limitador/0.log" Jun 14 21:54:04.579500 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:04.579475 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-v7pc8_f7e8fff7-e906-4256-9e8d-f5502746bcb2/manager/0.log" Jun 14 21:54:06.377271 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:06.377241 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-vmpdb_636bebe8-1ca5-4643-afd1-9db48d2835e6/kube-state-metrics/0.log" Jun 14 21:54:06.395113 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:06.395089 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-vmpdb_636bebe8-1ca5-4643-afd1-9db48d2835e6/kube-rbac-proxy-main/0.log" Jun 14 21:54:06.415314 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:06.415294 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-vmpdb_636bebe8-1ca5-4643-afd1-9db48d2835e6/kube-rbac-proxy-self/0.log" Jun 14 21:54:06.500634 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:06.500614 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b7rhn_cf818c0b-dd90-4f91-9620-4405f5dcd447/node-exporter/0.log" Jun 14 21:54:06.521499 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:06.521477 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b7rhn_cf818c0b-dd90-4f91-9620-4405f5dcd447/kube-rbac-proxy/0.log" Jun 14 21:54:06.546206 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:06.546191 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b7rhn_cf818c0b-dd90-4f91-9620-4405f5dcd447/init-textfile/0.log" Jun 14 21:54:10.128384 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:10.128351 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tmwh7/perf-node-gather-daemonset-nm5fg"] Jun 14 21:54:10.131955 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:10.131933 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tmwh7/perf-node-gather-daemonset-nm5fg" Jun 14 21:54:10.134400 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:10.134377 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tmwh7\"/\"openshift-service-ca.crt\"" Jun 14 21:54:10.135505 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:10.135491 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tmwh7\"/\"default-dockercfg-rmv5q\"" Jun 14 21:54:10.135577 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:10.135495 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tmwh7\"/\"kube-root-ca.crt\"" Jun 14 21:54:10.138811 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:10.138481 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tmwh7/perf-node-gather-daemonset-nm5fg"] Jun 14 21:54:10.202941 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:10.202922 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf649fa0-2dfa-4df9-a899-bf7c31c518d8-sys\") pod \"perf-node-gather-daemonset-nm5fg\" (UID: \"cf649fa0-2dfa-4df9-a899-bf7c31c518d8\") " pod="openshift-must-gather-tmwh7/perf-node-gather-daemonset-nm5fg" Jun 14 21:54:10.203062 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:10.202947 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cf649fa0-2dfa-4df9-a899-bf7c31c518d8-podres\") pod \"perf-node-gather-daemonset-nm5fg\" (UID: \"cf649fa0-2dfa-4df9-a899-bf7c31c518d8\") " pod="openshift-must-gather-tmwh7/perf-node-gather-daemonset-nm5fg" Jun 14 21:54:10.203062 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:10.202969 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cf649fa0-2dfa-4df9-a899-bf7c31c518d8-proc\") pod \"perf-node-gather-daemonset-nm5fg\" (UID: \"cf649fa0-2dfa-4df9-a899-bf7c31c518d8\") " pod="openshift-must-gather-tmwh7/perf-node-gather-daemonset-nm5fg" Jun 14 21:54:10.203062 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:10.203009 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cf649fa0-2dfa-4df9-a899-bf7c31c518d8-lib-modules\") pod \"perf-node-gather-daemonset-nm5fg\" (UID: \"cf649fa0-2dfa-4df9-a899-bf7c31c518d8\") " pod="openshift-must-gather-tmwh7/perf-node-gather-daemonset-nm5fg" Jun 14 21:54:10.203187 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:10.203072 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vs88\" (UniqueName: \"kubernetes.io/projected/cf649fa0-2dfa-4df9-a899-bf7c31c518d8-kube-api-access-9vs88\") pod \"perf-node-gather-daemonset-nm5fg\" (UID: \"cf649fa0-2dfa-4df9-a899-bf7c31c518d8\") " pod="openshift-must-gather-tmwh7/perf-node-gather-daemonset-nm5fg" Jun 14 21:54:10.304370 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:10.304342 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vs88\" (UniqueName: \"kubernetes.io/projected/cf649fa0-2dfa-4df9-a899-bf7c31c518d8-kube-api-access-9vs88\") pod \"perf-node-gather-daemonset-nm5fg\" (UID: \"cf649fa0-2dfa-4df9-a899-bf7c31c518d8\") " pod="openshift-must-gather-tmwh7/perf-node-gather-daemonset-nm5fg" Jun 14 21:54:10.304461 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:10.304414 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf649fa0-2dfa-4df9-a899-bf7c31c518d8-sys\") pod \"perf-node-gather-daemonset-nm5fg\" (UID: \"cf649fa0-2dfa-4df9-a899-bf7c31c518d8\") " pod="openshift-must-gather-tmwh7/perf-node-gather-daemonset-nm5fg" Jun 14 21:54:10.304461 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:10.304441 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cf649fa0-2dfa-4df9-a899-bf7c31c518d8-podres\") pod \"perf-node-gather-daemonset-nm5fg\" (UID: \"cf649fa0-2dfa-4df9-a899-bf7c31c518d8\") " pod="openshift-must-gather-tmwh7/perf-node-gather-daemonset-nm5fg" Jun 14 21:54:10.304589 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:10.304474 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cf649fa0-2dfa-4df9-a899-bf7c31c518d8-proc\") pod \"perf-node-gather-daemonset-nm5fg\" (UID: \"cf649fa0-2dfa-4df9-a899-bf7c31c518d8\") " pod="openshift-must-gather-tmwh7/perf-node-gather-daemonset-nm5fg" Jun 14 21:54:10.304589 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:10.304512 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cf649fa0-2dfa-4df9-a899-bf7c31c518d8-lib-modules\") pod \"perf-node-gather-daemonset-nm5fg\" (UID: \"cf649fa0-2dfa-4df9-a899-bf7c31c518d8\") " pod="openshift-must-gather-tmwh7/perf-node-gather-daemonset-nm5fg" Jun 14 21:54:10.304589 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:10.304526 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf649fa0-2dfa-4df9-a899-bf7c31c518d8-sys\") pod \"perf-node-gather-daemonset-nm5fg\" (UID: \"cf649fa0-2dfa-4df9-a899-bf7c31c518d8\") " pod="openshift-must-gather-tmwh7/perf-node-gather-daemonset-nm5fg" Jun 14 21:54:10.304589 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:10.304576 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cf649fa0-2dfa-4df9-a899-bf7c31c518d8-podres\") pod \"perf-node-gather-daemonset-nm5fg\" (UID: \"cf649fa0-2dfa-4df9-a899-bf7c31c518d8\") " pod="openshift-must-gather-tmwh7/perf-node-gather-daemonset-nm5fg" Jun 14 21:54:10.304737 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:10.304610 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cf649fa0-2dfa-4df9-a899-bf7c31c518d8-proc\") pod \"perf-node-gather-daemonset-nm5fg\" (UID: \"cf649fa0-2dfa-4df9-a899-bf7c31c518d8\") " pod="openshift-must-gather-tmwh7/perf-node-gather-daemonset-nm5fg" Jun 14 21:54:10.304737 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:10.304635 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cf649fa0-2dfa-4df9-a899-bf7c31c518d8-lib-modules\") pod \"perf-node-gather-daemonset-nm5fg\" (UID: \"cf649fa0-2dfa-4df9-a899-bf7c31c518d8\") " pod="openshift-must-gather-tmwh7/perf-node-gather-daemonset-nm5fg" Jun 14 21:54:10.312525 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:10.312498 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vs88\" (UniqueName: \"kubernetes.io/projected/cf649fa0-2dfa-4df9-a899-bf7c31c518d8-kube-api-access-9vs88\") pod \"perf-node-gather-daemonset-nm5fg\" (UID: \"cf649fa0-2dfa-4df9-a899-bf7c31c518d8\") " pod="openshift-must-gather-tmwh7/perf-node-gather-daemonset-nm5fg" Jun 14 21:54:10.442644 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:10.442595 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tmwh7/perf-node-gather-daemonset-nm5fg" Jun 14 21:54:10.573521 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:10.573467 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tmwh7/perf-node-gather-daemonset-nm5fg"] Jun 14 21:54:10.576857 ip-10-0-142-95 kubenswrapper[2563]: W0614 21:54:10.576829 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcf649fa0_2dfa_4df9_a899_bf7c31c518d8.slice/crio-7f0327cb2167daef16e0c8b462a51b7c7843073bb12ff316f2b64ee7022946fe WatchSource:0}: Error finding container 7f0327cb2167daef16e0c8b462a51b7c7843073bb12ff316f2b64ee7022946fe: Status 404 returned error can't find the container with id 7f0327cb2167daef16e0c8b462a51b7c7843073bb12ff316f2b64ee7022946fe Jun 14 21:54:10.860184 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:10.860157 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tmwh7/perf-node-gather-daemonset-nm5fg" event={"ID":"cf649fa0-2dfa-4df9-a899-bf7c31c518d8","Type":"ContainerStarted","Data":"7006518e9d3a2e322d1a174e6ff2be66582e863de81a4d71137722008eeee3fe"} Jun 14 21:54:10.860322 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:10.860239 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tmwh7/perf-node-gather-daemonset-nm5fg" Jun 14 21:54:10.860322 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:10.860259 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tmwh7/perf-node-gather-daemonset-nm5fg" event={"ID":"cf649fa0-2dfa-4df9-a899-bf7c31c518d8","Type":"ContainerStarted","Data":"7f0327cb2167daef16e0c8b462a51b7c7843073bb12ff316f2b64ee7022946fe"} Jun 14 21:54:10.876538 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:10.876490 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tmwh7/perf-node-gather-daemonset-nm5fg" podStartSLOduration=0.876477694 podStartE2EDuration="876.477694ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 21:54:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 21:54:10.874466158 +0000 UTC m=+1251.339066910" watchObservedRunningTime="2026-06-14 21:54:10.876477694 +0000 UTC m=+1251.341078439" Jun 14 21:54:12.050353 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:12.050329 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r6tq6_fb5528ef-9909-498c-b4f4-b02c05fe398e/dns/0.log" Jun 14 21:54:12.070894 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:12.070874 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r6tq6_fb5528ef-9909-498c-b4f4-b02c05fe398e/kube-rbac-proxy/0.log" Jun 14 21:54:12.141691 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:12.141671 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l7htv_fab653ef-3379-4e6c-9efe-2a0994436f73/dns-node-resolver/0.log" Jun 14 21:54:12.671662 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:12.671635 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-79c58d45f-6pl24_4413ff08-cd1b-4f37-b3cd-bbd878484a8f/registry/0.log" Jun 14 21:54:12.675606 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:12.675585 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-79c58d45f-6pl24_4413ff08-cd1b-4f37-b3cd-bbd878484a8f/registry/1.log" Jun 14 21:54:12.748225 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:12.748200 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dsmrq_6c41cf46-cb82-49f4-8d57-d6ac4df58684/node-ca/0.log" Jun 14 21:54:13.729714 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:13.729681 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-f4smf_4d21bb64-fe94-4af0-b15e-ffabdd23a430/discovery/0.log" Jun 14 21:54:13.774612 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:13.774585 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-ddf4d968b-v7lc2_439fd394-122c-48d7-8025-7b95554805bb/kube-auth-proxy/0.log" Jun 14 21:54:13.842461 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:13.842437 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-r8c5d_3a05cb8d-1444-47bf-ae98-f00c95f01cc2/payload-processing/0.log" Jun 14 21:54:14.480858 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:14.480825 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sw9gq_35df5206-ea6b-4647-bd13-c3daf9c87884/serve-healthcheck-canary/0.log" Jun 14 21:54:14.999727 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:14.999697 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hzbll_9285c99f-4f0e-4452-b585-a2f596798de7/kube-rbac-proxy/0.log" Jun 14 21:54:15.020525 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:15.020503 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hzbll_9285c99f-4f0e-4452-b585-a2f596798de7/exporter/0.log" Jun 14 21:54:15.043252 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:15.043230 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hzbll_9285c99f-4f0e-4452-b585-a2f596798de7/extractor/0.log" Jun 14 21:54:16.874966 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:16.874946 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tmwh7/perf-node-gather-daemonset-nm5fg" Jun 14 21:54:17.373937 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:17.373915 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-67768fd87d-888cx_17b0fbd6-dd44-4792-a622-4131de07af3e/nginx/0.log" Jun 14 21:54:17.422475 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:17.422451 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-2lcdt_7df345b7-1956-487d-a724-a6860ab0a596/manager/0.log" Jun 14 21:54:17.456994 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:17.456969 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-r66ps_90072ef0-9d3b-4d7b-93d5-4ab01e9df81d/manager/0.log" Jun 14 21:54:17.530108 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:17.530087 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-hcjzh_466f0add-93d2-4989-b4b9-a3209c80a7d5/server/0.log" Jun 14 21:54:17.572274 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:17.572251 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-tgk9t_54f5caad-dfe7-4150-ab78-833bf2f84702/manager/0.log" Jun 14 21:54:17.598307 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:17.598286 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c8557bfd5-c88f8_a938e683-6d15-4169-bd61-5d56613a71d5/manager/0.log" Jun 14 21:54:17.618689 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:17.618670 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c8557bfd5-c88f8_a938e683-6d15-4169-bd61-5d56613a71d5/copy-manifests/0.log" Jun 14 21:54:19.498461 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:19.498399 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-77v5n_b9091747-7f3a-4531-8620-c3973d8d8759/openshift-lws-operator/0.log" Jun 14 21:54:24.479717 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:24.479688 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-f4smf_4d21bb64-fe94-4af0-b15e-ffabdd23a430/discovery/0.log" Jun 14 21:54:24.503590 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:24.503564 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-ddf4d968b-v7lc2_439fd394-122c-48d7-8025-7b95554805bb/kube-auth-proxy/0.log" Jun 14 21:54:24.547391 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:24.547359 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-r8c5d_3a05cb8d-1444-47bf-ae98-f00c95f01cc2/payload-processing/0.log" Jun 14 21:54:25.664140 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:25.664112 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-f4smf_4d21bb64-fe94-4af0-b15e-ffabdd23a430/discovery/0.log" Jun 14 21:54:25.694619 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:25.694596 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-ddf4d968b-v7lc2_439fd394-122c-48d7-8025-7b95554805bb/kube-auth-proxy/0.log" Jun 14 21:54:25.742563 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:25.742537 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-r8c5d_3a05cb8d-1444-47bf-ae98-f00c95f01cc2/payload-processing/0.log" Jun 14 21:54:26.906089 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:26.906061 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tnc2v_e564eb22-98d2-4710-91ec-e8cbc19a5885/kube-multus-additional-cni-plugins/0.log" Jun 14 21:54:26.927525 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:26.927497 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tnc2v_e564eb22-98d2-4710-91ec-e8cbc19a5885/egress-router-binary-copy/0.log" Jun 14 21:54:26.947913 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:26.947892 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tnc2v_e564eb22-98d2-4710-91ec-e8cbc19a5885/cni-plugins/0.log" Jun 14 21:54:26.968663 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:26.968639 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tnc2v_e564eb22-98d2-4710-91ec-e8cbc19a5885/bond-cni-plugin/0.log" Jun 14 21:54:26.989924 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:26.989903 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tnc2v_e564eb22-98d2-4710-91ec-e8cbc19a5885/routeoverride-cni/0.log" Jun 14 21:54:27.009959 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:27.009940 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tnc2v_e564eb22-98d2-4710-91ec-e8cbc19a5885/whereabouts-cni-bincopy/0.log" Jun 14 21:54:27.031978 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:27.031957 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tnc2v_e564eb22-98d2-4710-91ec-e8cbc19a5885/whereabouts-cni/0.log" Jun 14 21:54:27.091938 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:27.091919 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v8kl4_49595b6e-3eb8-4a20-a992-2fcdf940fc28/kube-multus/0.log" Jun 14 21:54:27.162722 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:27.162668 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-g5wz8_ab5e49aa-95ae-4957-8dca-5642fc6e0336/network-metrics-daemon/0.log" Jun 14 21:54:27.189842 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:27.189826 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-g5wz8_ab5e49aa-95ae-4957-8dca-5642fc6e0336/kube-rbac-proxy/0.log" Jun 14 21:54:27.413340 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:27.413287 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-f4smf_4d21bb64-fe94-4af0-b15e-ffabdd23a430/discovery/0.log" Jun 14 21:54:27.438646 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:27.438621 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-ddf4d968b-v7lc2_439fd394-122c-48d7-8025-7b95554805bb/kube-auth-proxy/0.log" Jun 14 21:54:27.484779 ip-10-0-142-95 kubenswrapper[2563]: I0614 21:54:27.484757 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-r8c5d_3a05cb8d-1444-47bf-ae98-f00c95f01cc2/payload-processing/0.log"