Jun 02 01:19:50.717860 ip-10-0-130-179 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 02 01:19:50.717874 ip-10-0-130-179 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 02 01:19:50.717883 ip-10-0-130-179 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 02 01:19:50.718188 ip-10-0-130-179 systemd[1]: Failed to start Kubernetes Kubelet. Jun 02 01:20:01.927008 ip-10-0-130-179 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 02 01:20:01.927027 ip-10-0-130-179 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 50fc8a5aa54a4aee814b5911f168e678 -- Jun 02 01:22:31.558160 ip-10-0-130-179 systemd[1]: Starting Kubernetes Kubelet... Jun 02 01:22:31.971011 ip-10-0-130-179 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 01:22:31.971011 ip-10-0-130-179 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 02 01:22:31.971011 ip-10-0-130-179 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 01:22:31.971011 ip-10-0-130-179 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 02 01:22:31.971011 ip-10-0-130-179 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 01:22:31.972816 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.972718 2559 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 02 01:22:31.977509 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977491 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 01:22:31.977509 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977509 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 01:22:31.977576 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977513 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 01:22:31.977576 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977517 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 01:22:31.977576 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977520 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 01:22:31.977576 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977523 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 01:22:31.977576 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977527 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 01:22:31.977576 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977530 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 01:22:31.977576 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977532 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 01:22:31.977576 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977535 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 01:22:31.977576 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977538 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 01:22:31.977576 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977542 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 01:22:31.977576 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977544 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 01:22:31.977576 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977547 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 01:22:31.977576 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977549 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 01:22:31.977576 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977553 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 01:22:31.977576 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977556 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 01:22:31.977576 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977558 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 01:22:31.977576 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977561 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 01:22:31.977576 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977563 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 01:22:31.977576 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977566 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 01:22:31.978051 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977569 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 01:22:31.978051 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977571 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 01:22:31.978051 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977574 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 01:22:31.978051 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977576 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 01:22:31.978051 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977579 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 01:22:31.978051 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977582 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 01:22:31.978051 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977586 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 01:22:31.978051 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977591 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 01:22:31.978051 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977595 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 01:22:31.978051 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977597 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 01:22:31.978051 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977600 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 01:22:31.978051 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977603 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 01:22:31.978051 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977606 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 01:22:31.978051 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977608 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 01:22:31.978051 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977611 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 01:22:31.978051 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977613 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 01:22:31.978051 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977616 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 01:22:31.978051 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977618 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 01:22:31.978051 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977621 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 01:22:31.978051 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977623 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 01:22:31.978529 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977626 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 01:22:31.978529 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977629 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 01:22:31.978529 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977631 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 01:22:31.978529 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977634 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 01:22:31.978529 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977636 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 01:22:31.978529 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977639 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 01:22:31.978529 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977641 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 01:22:31.978529 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977644 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 01:22:31.978529 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977646 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 01:22:31.978529 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977648 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 01:22:31.978529 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977651 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 01:22:31.978529 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977653 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 01:22:31.978529 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977656 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 01:22:31.978529 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977659 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 01:22:31.978529 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977662 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 01:22:31.978529 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977664 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 01:22:31.978529 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977667 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 02 01:22:31.978529 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977670 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 01:22:31.978529 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977673 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 01:22:31.978529 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977675 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 01:22:31.979029 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977678 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 01:22:31.979029 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977680 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 01:22:31.979029 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977683 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 01:22:31.979029 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977685 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 01:22:31.979029 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977688 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 01:22:31.979029 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977691 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 01:22:31.979029 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977693 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 01:22:31.979029 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977696 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 01:22:31.979029 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977698 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 01:22:31.979029 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977700 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 01:22:31.979029 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977703 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 01:22:31.979029 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977705 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 01:22:31.979029 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977707 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 01:22:31.979029 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977710 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 01:22:31.979029 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977712 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 01:22:31.979029 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977715 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 01:22:31.979029 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977717 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 01:22:31.979029 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977720 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 01:22:31.979029 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977725 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 01:22:31.979029 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977728 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 01:22:31.979515 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977730 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 01:22:31.979515 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977733 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 01:22:31.979515 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977735 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 01:22:31.979515 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977739 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 01:22:31.979515 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.977742 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 01:22:31.979515 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979126 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 01:22:31.979515 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979133 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 01:22:31.979515 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979137 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 01:22:31.979515 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979140 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 01:22:31.979515 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979143 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 01:22:31.979515 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979146 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 01:22:31.979515 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979149 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 01:22:31.979515 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979151 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 01:22:31.979515 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979154 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 01:22:31.979515 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979157 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 01:22:31.979515 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979160 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 01:22:31.979515 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979162 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 01:22:31.979515 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979165 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 01:22:31.979515 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979168 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 01:22:31.979515 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979171 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 01:22:31.980019 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979173 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 01:22:31.980019 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979176 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 01:22:31.980019 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979178 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 01:22:31.980019 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979180 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 01:22:31.980019 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979183 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 01:22:31.980019 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979185 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 01:22:31.980019 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979187 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 01:22:31.980019 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979190 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 01:22:31.980019 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979193 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 01:22:31.980019 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979195 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 01:22:31.980019 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979197 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 01:22:31.980019 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979200 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 01:22:31.980019 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979202 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 01:22:31.980019 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979206 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 01:22:31.980019 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979208 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 01:22:31.980019 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979211 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 01:22:31.980019 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979214 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 01:22:31.980019 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979216 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 01:22:31.980019 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979219 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 01:22:31.980019 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979221 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 01:22:31.980528 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979224 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 01:22:31.980528 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979227 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 01:22:31.980528 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979230 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 01:22:31.980528 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979232 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 01:22:31.980528 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979235 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 01:22:31.980528 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979237 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 01:22:31.980528 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979240 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 01:22:31.980528 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979242 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 01:22:31.980528 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979245 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 01:22:31.980528 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979247 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 01:22:31.980528 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979251 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 01:22:31.980528 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979255 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 01:22:31.980528 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979259 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 01:22:31.980528 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979262 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 01:22:31.980528 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979265 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 01:22:31.980528 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979268 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 01:22:31.980528 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979270 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 01:22:31.980528 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979273 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 01:22:31.980528 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979275 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 01:22:31.981005 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979278 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 01:22:31.981005 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979281 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 01:22:31.981005 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979284 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 01:22:31.981005 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979286 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 01:22:31.981005 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979289 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 01:22:31.981005 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979292 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 01:22:31.981005 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979295 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 01:22:31.981005 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979298 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 01:22:31.981005 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979302 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 01:22:31.981005 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979305 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 01:22:31.981005 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979307 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 01:22:31.981005 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979310 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 01:22:31.981005 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979312 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 01:22:31.981005 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979315 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 01:22:31.981005 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979317 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 01:22:31.981005 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979320 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 01:22:31.981005 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979322 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 01:22:31.981005 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979325 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 01:22:31.981005 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979327 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 01:22:31.981470 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979330 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 01:22:31.981470 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979332 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 01:22:31.981470 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979335 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 01:22:31.981470 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979337 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 01:22:31.981470 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979340 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 01:22:31.981470 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979343 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 01:22:31.981470 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979345 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 01:22:31.981470 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979347 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 01:22:31.981470 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979350 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 01:22:31.981470 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979352 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 02 01:22:31.981470 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979354 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 01:22:31.981470 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979357 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 01:22:31.981470 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.979359 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 01:22:31.981470 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979427 2559 flags.go:64] FLAG: --address="0.0.0.0" Jun 02 01:22:31.981470 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979434 2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 02 01:22:31.981470 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979441 2559 flags.go:64] FLAG: --anonymous-auth="true" Jun 02 01:22:31.981470 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979449 2559 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 02 01:22:31.981470 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979454 2559 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 02 01:22:31.981470 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979457 2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 02 01:22:31.981470 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979462 2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 02 01:22:31.981470 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979467 2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 02 01:22:31.982007 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979471 2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 02 01:22:31.982007 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979474 2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 02 01:22:31.982007 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979477 2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 02 01:22:31.982007 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979481 2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 02 01:22:31.982007 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979484 2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 02 01:22:31.982007 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979486 2559 flags.go:64] FLAG: --cgroup-root="" Jun 02 01:22:31.982007 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979489 2559 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 02 01:22:31.982007 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979492 2559 flags.go:64] FLAG: --client-ca-file="" Jun 02 01:22:31.982007 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979494 2559 flags.go:64] FLAG: --cloud-config="" Jun 02 01:22:31.982007 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979497 2559 flags.go:64] FLAG: --cloud-provider="external" Jun 02 01:22:31.982007 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979500 2559 flags.go:64] FLAG: --cluster-dns="[]" Jun 02 01:22:31.982007 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979503 2559 flags.go:64] FLAG: --cluster-domain="" Jun 02 01:22:31.982007 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979506 2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 02 01:22:31.982007 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979509 2559 flags.go:64] FLAG: --config-dir="" Jun 02 01:22:31.982007 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979512 2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 02 01:22:31.982007 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979515 2559 flags.go:64] FLAG: --container-log-max-files="5" Jun 02 01:22:31.982007 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979519 2559 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 02 01:22:31.982007 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979522 2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 02 01:22:31.982007 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979526 2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 02 01:22:31.982007 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979529 2559 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 02 01:22:31.982007 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979532 2559 flags.go:64] FLAG: --contention-profiling="false" Jun 02 01:22:31.982007 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979535 2559 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 02 01:22:31.982007 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979538 2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 02 01:22:31.982007 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979541 2559 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 02 01:22:31.982007 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979543 2559 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 02 01:22:31.982629 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979548 2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 02 01:22:31.982629 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979551 2559 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 02 01:22:31.982629 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979554 2559 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 02 01:22:31.982629 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979557 2559 flags.go:64] FLAG: --enable-load-reader="false" Jun 02 01:22:31.982629 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979560 2559 flags.go:64] FLAG: --enable-server="true" Jun 02 01:22:31.982629 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979563 2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 02 01:22:31.982629 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979568 2559 flags.go:64] FLAG: --event-burst="100" Jun 02 01:22:31.982629 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979571 2559 flags.go:64] FLAG: --event-qps="50" Jun 02 01:22:31.982629 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979574 2559 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 02 01:22:31.982629 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979577 2559 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 02 01:22:31.982629 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979580 2559 flags.go:64] FLAG: --eviction-hard="" Jun 02 01:22:31.982629 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979584 2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 02 01:22:31.982629 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979587 2559 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 02 01:22:31.982629 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979590 2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 02 01:22:31.982629 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979592 2559 flags.go:64] FLAG: --eviction-soft="" Jun 02 01:22:31.982629 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979595 2559 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 02 01:22:31.982629 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979598 2559 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 02 01:22:31.982629 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979601 2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 02 01:22:31.982629 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979604 2559 flags.go:64] FLAG: --experimental-mounter-path="" Jun 02 01:22:31.982629 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979606 2559 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 02 01:22:31.982629 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979609 2559 flags.go:64] FLAG: --fail-swap-on="true" Jun 02 01:22:31.982629 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979612 2559 flags.go:64] FLAG: --feature-gates="" Jun 02 01:22:31.982629 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979616 2559 flags.go:64] FLAG: --file-check-frequency="20s" Jun 02 01:22:31.982629 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979619 2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 02 01:22:31.982629 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979622 2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 02 01:22:31.983249 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979629 2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 02 01:22:31.983249 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979633 2559 flags.go:64] FLAG: --healthz-port="10248" Jun 02 01:22:31.983249 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979636 2559 flags.go:64] FLAG: --help="false" Jun 02 01:22:31.983249 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979639 2559 flags.go:64] FLAG: --hostname-override="ip-10-0-130-179.ec2.internal" Jun 02 01:22:31.983249 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979642 2559 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 02 01:22:31.983249 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979645 2559 flags.go:64] FLAG: --http-check-frequency="20s" Jun 02 01:22:31.983249 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979648 2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 02 01:22:31.983249 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979651 2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 02 01:22:31.983249 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979654 2559 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 02 01:22:31.983249 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979661 2559 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 02 01:22:31.983249 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979663 2559 flags.go:64] FLAG: --image-service-endpoint="" Jun 02 01:22:31.983249 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979666 2559 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 02 01:22:31.983249 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979669 2559 flags.go:64] FLAG: --kube-api-burst="100" Jun 02 01:22:31.983249 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979673 2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 02 01:22:31.983249 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979676 2559 flags.go:64] FLAG: --kube-api-qps="50" Jun 02 01:22:31.983249 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979679 2559 flags.go:64] FLAG: --kube-reserved="" Jun 02 01:22:31.983249 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979682 2559 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 02 01:22:31.983249 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979685 2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 02 01:22:31.983249 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979688 2559 flags.go:64] FLAG: --kubelet-cgroups="" Jun 02 01:22:31.983249 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979690 2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 02 01:22:31.983249 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979693 2559 flags.go:64] FLAG: --lock-file="" Jun 02 01:22:31.983249 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979696 2559 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 02 01:22:31.983249 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979699 2559 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 02 01:22:31.983249 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979702 2559 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 02 01:22:31.983957 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979707 2559 flags.go:64] FLAG: --log-json-split-stream="false" Jun 02 01:22:31.983957 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979710 2559 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 02 01:22:31.983957 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979712 2559 flags.go:64] FLAG: --log-text-split-stream="false" Jun 02 01:22:31.983957 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979715 2559 flags.go:64] FLAG: --logging-format="text" Jun 02 01:22:31.983957 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979718 2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 02 01:22:31.983957 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979721 2559 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 02 01:22:31.983957 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979723 2559 flags.go:64] FLAG: --manifest-url="" Jun 02 01:22:31.983957 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979726 2559 flags.go:64] FLAG: --manifest-url-header="" Jun 02 01:22:31.983957 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979730 2559 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 02 01:22:31.983957 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979734 2559 flags.go:64] FLAG: --max-open-files="1000000" Jun 02 01:22:31.983957 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979738 2559 flags.go:64] FLAG: --max-pods="110" Jun 02 01:22:31.983957 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979741 2559 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 02 01:22:31.983957 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979744 2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 02 01:22:31.983957 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979747 2559 flags.go:64] FLAG: --memory-manager-policy="None" Jun 02 01:22:31.983957 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979750 2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 02 01:22:31.983957 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979753 2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 02 01:22:31.983957 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979756 2559 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 02 01:22:31.983957 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979760 2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 02 01:22:31.983957 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979767 2559 flags.go:64] FLAG: --node-status-max-images="50" Jun 02 01:22:31.983957 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979770 2559 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 02 01:22:31.983957 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979773 2559 flags.go:64] FLAG: --oom-score-adj="-999" Jun 02 01:22:31.983957 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979775 2559 flags.go:64] FLAG: --pod-cidr="" Jun 02 01:22:31.983957 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979778 2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 02 01:22:31.984525 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979784 2559 flags.go:64] FLAG: --pod-manifest-path="" Jun 02 01:22:31.984525 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979787 2559 flags.go:64] FLAG: --pod-max-pids="-1" Jun 02 01:22:31.984525 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979790 2559 flags.go:64] FLAG: --pods-per-core="0" Jun 02 01:22:31.984525 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979793 2559 flags.go:64] FLAG: --port="10250" Jun 02 01:22:31.984525 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979796 2559 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 02 01:22:31.984525 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979798 2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c3d4955647266843" Jun 02 01:22:31.984525 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979801 2559 flags.go:64] FLAG: --qos-reserved="" Jun 02 01:22:31.984525 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979804 2559 flags.go:64] FLAG: --read-only-port="10255" Jun 02 01:22:31.984525 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979807 2559 flags.go:64] FLAG: --register-node="true" Jun 02 01:22:31.984525 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979810 2559 flags.go:64] FLAG: --register-schedulable="true" Jun 02 01:22:31.984525 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979813 2559 flags.go:64] FLAG: --register-with-taints="" Jun 02 01:22:31.984525 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979816 2559 flags.go:64] FLAG: --registry-burst="10" Jun 02 01:22:31.984525 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979819 2559 flags.go:64] FLAG: --registry-qps="5" Jun 02 01:22:31.984525 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979821 2559 flags.go:64] FLAG: --reserved-cpus="" Jun 02 01:22:31.984525 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979824 2559 flags.go:64] FLAG: --reserved-memory="" Jun 02 01:22:31.984525 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979828 2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 02 01:22:31.984525 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979843 2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 02 01:22:31.984525 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979847 2559 flags.go:64] FLAG: --rotate-certificates="false" Jun 02 01:22:31.984525 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979850 2559 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 02 01:22:31.984525 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979853 2559 flags.go:64] FLAG: --runonce="false" Jun 02 01:22:31.984525 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979856 2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 02 01:22:31.984525 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979859 2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 02 01:22:31.984525 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979862 2559 flags.go:64] FLAG: --seccomp-default="false" Jun 02 01:22:31.984525 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979865 2559 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 02 01:22:31.984525 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979868 2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 02 01:22:31.984525 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979871 2559 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 02 01:22:31.985155 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979874 2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 02 01:22:31.985155 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979878 2559 flags.go:64] FLAG: --storage-driver-password="root" Jun 02 01:22:31.985155 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979881 2559 flags.go:64] FLAG: --storage-driver-secure="false" Jun 02 01:22:31.985155 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979884 2559 flags.go:64] FLAG: --storage-driver-table="stats" Jun 02 01:22:31.985155 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979886 2559 flags.go:64] FLAG: --storage-driver-user="root" Jun 02 01:22:31.985155 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979889 2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 02 01:22:31.985155 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979892 2559 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 02 01:22:31.985155 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979895 2559 flags.go:64] FLAG: --system-cgroups="" Jun 02 01:22:31.985155 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979897 2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 02 01:22:31.985155 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979903 2559 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 02 01:22:31.985155 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979905 2559 flags.go:64] FLAG: --tls-cert-file="" Jun 02 01:22:31.985155 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979908 2559 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 02 01:22:31.985155 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979912 2559 flags.go:64] FLAG: --tls-min-version="" Jun 02 01:22:31.985155 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979914 2559 flags.go:64] FLAG: --tls-private-key-file="" Jun 02 01:22:31.985155 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979917 2559 flags.go:64] FLAG: --topology-manager-policy="none" Jun 02 01:22:31.985155 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979920 2559 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 02 01:22:31.985155 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979923 2559 flags.go:64] FLAG: --topology-manager-scope="container" Jun 02 01:22:31.985155 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979925 2559 flags.go:64] FLAG: --v="2" Jun 02 01:22:31.985155 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979929 2559 flags.go:64] FLAG: --version="false" Jun 02 01:22:31.985155 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979933 2559 flags.go:64] FLAG: --vmodule="" Jun 02 01:22:31.985155 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979937 2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 02 01:22:31.985155 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.979942 2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 02 01:22:31.985155 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980032 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 01:22:31.985155 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980036 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 01:22:31.985155 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980039 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 01:22:31.985787 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980042 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 01:22:31.985787 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980048 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 01:22:31.985787 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980051 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 01:22:31.985787 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980053 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 01:22:31.985787 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980056 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 01:22:31.985787 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980058 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 01:22:31.985787 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980061 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 01:22:31.985787 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980064 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 01:22:31.985787 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980067 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 01:22:31.985787 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980069 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 01:22:31.985787 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980071 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 01:22:31.985787 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980074 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 01:22:31.985787 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980077 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 01:22:31.985787 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980079 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 01:22:31.985787 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980081 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 01:22:31.985787 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980084 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 01:22:31.985787 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980086 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 01:22:31.985787 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980089 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 01:22:31.985787 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980091 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 01:22:31.985787 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980094 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 01:22:31.986307 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980096 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 01:22:31.986307 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980099 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 01:22:31.986307 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980101 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 01:22:31.986307 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980103 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 01:22:31.986307 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980106 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 01:22:31.986307 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980108 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 01:22:31.986307 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980111 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 01:22:31.986307 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980113 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 01:22:31.986307 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980116 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 01:22:31.986307 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980119 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 01:22:31.986307 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980121 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 01:22:31.986307 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980123 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 01:22:31.986307 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980126 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 01:22:31.986307 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980128 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 01:22:31.986307 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980131 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 01:22:31.986307 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980133 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 01:22:31.986307 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980135 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 01:22:31.986307 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980138 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 01:22:31.986307 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980141 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 01:22:31.986771 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980143 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 01:22:31.986771 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980146 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 01:22:31.986771 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980148 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 01:22:31.986771 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980150 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 01:22:31.986771 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980153 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 01:22:31.986771 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980155 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 01:22:31.986771 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980158 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 01:22:31.986771 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980160 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 01:22:31.986771 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980162 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 01:22:31.986771 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980165 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 01:22:31.986771 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980167 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 01:22:31.986771 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980171 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 01:22:31.986771 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980174 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 01:22:31.986771 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980178 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 01:22:31.986771 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980181 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 02 01:22:31.986771 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980183 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 01:22:31.986771 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980187 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 01:22:31.986771 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980190 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 01:22:31.986771 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980193 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 01:22:31.987236 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980195 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 01:22:31.987236 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980198 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 01:22:31.987236 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980200 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 01:22:31.987236 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980203 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 01:22:31.987236 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980205 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 01:22:31.987236 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980208 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 01:22:31.987236 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980210 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 01:22:31.987236 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980213 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 01:22:31.987236 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980215 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 01:22:31.987236 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980218 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 01:22:31.987236 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980220 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 01:22:31.987236 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980223 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 01:22:31.987236 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980225 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 01:22:31.987236 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980228 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 01:22:31.987236 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980231 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 01:22:31.987236 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980233 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 01:22:31.987236 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980235 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 01:22:31.987236 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980238 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 01:22:31.987236 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980240 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 01:22:31.987236 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980242 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 01:22:31.987743 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980244 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 01:22:31.987743 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980247 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 01:22:31.987743 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980250 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 01:22:31.987743 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980252 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 01:22:31.987743 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.980255 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 01:22:31.987743 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.980261 2559 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 01:22:31.987743 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.987502 2559 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 02 01:22:31.987743 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.987519 2559 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 02 01:22:31.987743 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987603 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 01:22:31.987743 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987608 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 01:22:31.987743 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987612 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 01:22:31.987743 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987614 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 01:22:31.987743 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987618 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 01:22:31.987743 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987620 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 01:22:31.987743 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987623 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 01:22:31.988152 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987626 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 01:22:31.988152 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987629 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 01:22:31.988152 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987631 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 01:22:31.988152 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987634 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 01:22:31.988152 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987636 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 02 01:22:31.988152 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987639 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 01:22:31.988152 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987641 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 01:22:31.988152 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987643 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 01:22:31.988152 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987646 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 01:22:31.988152 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987649 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 01:22:31.988152 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987652 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 01:22:31.988152 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987656 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 01:22:31.988152 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987659 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 01:22:31.988152 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987661 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 01:22:31.988152 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987664 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 01:22:31.988152 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987667 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 01:22:31.988152 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987669 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 01:22:31.988152 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987671 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 01:22:31.988152 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987674 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 01:22:31.988152 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987676 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 01:22:31.988653 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987679 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 01:22:31.988653 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987682 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 01:22:31.988653 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987684 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 01:22:31.988653 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987687 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 01:22:31.988653 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987691 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 01:22:31.988653 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987693 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 01:22:31.988653 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987696 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 01:22:31.988653 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987698 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 01:22:31.988653 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987701 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 01:22:31.988653 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987703 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 01:22:31.988653 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987706 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 01:22:31.988653 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987708 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 01:22:31.988653 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987710 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 01:22:31.988653 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987713 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 01:22:31.988653 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987715 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 01:22:31.988653 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987718 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 01:22:31.988653 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987720 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 01:22:31.988653 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987724 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 01:22:31.988653 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987729 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 01:22:31.989143 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987732 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 01:22:31.989143 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987735 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 01:22:31.989143 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987738 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 01:22:31.989143 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987741 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 01:22:31.989143 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987744 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 01:22:31.989143 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987747 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 01:22:31.989143 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987750 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 01:22:31.989143 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987753 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 01:22:31.989143 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987755 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 01:22:31.989143 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987758 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 01:22:31.989143 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987760 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 01:22:31.989143 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987763 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 01:22:31.989143 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987765 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 01:22:31.989143 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987768 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 01:22:31.989143 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987770 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 01:22:31.989143 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987773 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 01:22:31.989143 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987775 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 01:22:31.989143 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987778 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 01:22:31.989143 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987781 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 01:22:31.989143 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987784 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 01:22:31.989630 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987786 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 01:22:31.989630 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987789 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 01:22:31.989630 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987791 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 01:22:31.989630 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987793 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 01:22:31.989630 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987796 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 01:22:31.989630 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987798 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 01:22:31.989630 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987801 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 01:22:31.989630 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987804 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 01:22:31.989630 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987806 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 01:22:31.989630 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987808 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 01:22:31.989630 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987810 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 01:22:31.989630 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987813 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 01:22:31.989630 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987816 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 01:22:31.989630 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987818 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 01:22:31.989630 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987820 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 01:22:31.989630 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987823 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 01:22:31.989630 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987825 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 01:22:31.989630 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987827 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 01:22:31.989630 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987845 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 01:22:31.989630 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987850 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 01:22:31.990130 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.987855 2559 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 01:22:31.990130 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987947 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 01:22:31.990130 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987952 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 01:22:31.990130 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987955 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 01:22:31.990130 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987958 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 01:22:31.990130 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987960 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 01:22:31.990130 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987963 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 01:22:31.990130 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987966 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 01:22:31.990130 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987969 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 01:22:31.990130 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987972 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 01:22:31.990130 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987974 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 01:22:31.990130 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987978 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 01:22:31.990130 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987981 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 01:22:31.990130 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987983 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 01:22:31.990130 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987986 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 01:22:31.990491 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987988 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 01:22:31.990491 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987990 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 01:22:31.990491 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987993 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 01:22:31.990491 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987995 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 01:22:31.990491 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.987998 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 01:22:31.990491 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988000 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 01:22:31.990491 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988003 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 01:22:31.990491 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988005 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 01:22:31.990491 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988008 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 01:22:31.990491 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988010 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 01:22:31.990491 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988013 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 01:22:31.990491 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988015 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 01:22:31.990491 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988018 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 01:22:31.990491 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988020 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 01:22:31.990491 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988023 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 01:22:31.990491 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988025 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 02 01:22:31.990491 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988028 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 01:22:31.990491 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988030 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 01:22:31.990491 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988033 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 01:22:31.990491 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988035 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 01:22:31.990981 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988038 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 01:22:31.990981 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988040 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 01:22:31.990981 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988043 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 01:22:31.990981 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988045 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 01:22:31.990981 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988047 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 01:22:31.990981 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988050 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 01:22:31.990981 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988052 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 01:22:31.990981 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988055 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 01:22:31.990981 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988057 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 01:22:31.990981 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988059 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 01:22:31.990981 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988062 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 01:22:31.990981 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988064 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 01:22:31.990981 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988067 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 01:22:31.990981 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988069 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 01:22:31.990981 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988071 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 01:22:31.990981 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988074 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 01:22:31.990981 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988076 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 01:22:31.990981 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988078 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 01:22:31.990981 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988081 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 01:22:31.990981 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988083 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 01:22:31.991458 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988085 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 01:22:31.991458 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988088 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 01:22:31.991458 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988090 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 01:22:31.991458 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988092 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 01:22:31.991458 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988094 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 01:22:31.991458 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988097 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 01:22:31.991458 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988099 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 01:22:31.991458 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988102 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 01:22:31.991458 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988104 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 01:22:31.991458 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988107 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 01:22:31.991458 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988109 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 01:22:31.991458 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988112 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 01:22:31.991458 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988114 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 01:22:31.991458 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988118 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 01:22:31.991458 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988122 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 01:22:31.991458 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988124 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 01:22:31.991458 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988127 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 01:22:31.991458 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988129 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 01:22:31.991458 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988132 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 01:22:31.991932 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988149 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 01:22:31.991932 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988153 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 01:22:31.991932 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988156 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 01:22:31.991932 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988160 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 01:22:31.991932 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988164 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 01:22:31.991932 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988167 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 01:22:31.991932 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988170 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 01:22:31.991932 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988173 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 01:22:31.991932 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988176 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 01:22:31.991932 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988178 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 01:22:31.991932 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988180 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 01:22:31.991932 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988183 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 01:22:31.991932 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:31.988185 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 01:22:31.991932 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.988189 2559 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 01:22:31.991932 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.988780 2559 server.go:962] "Client rotation is on, will bootstrap in background" Jun 02 01:22:31.992379 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.990582 2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 02 01:22:31.992379 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.991367 2559 server.go:1019] "Starting client certificate rotation" Jun 02 01:22:31.992379 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.991464 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 01:22:31.992379 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:31.991506 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 01:22:32.018641 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.018611 2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 01:22:32.022909 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.022890 2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 01:22:32.040350 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.040321 2559 log.go:25] "Validated CRI v1 runtime API" Jun 02 01:22:32.045710 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.045692 2559 log.go:25] "Validated CRI v1 image API" Jun 02 01:22:32.046978 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.046964 2559 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 02 01:22:32.051497 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.051467 2559 fs.go:135] Filesystem UUIDs: map[2f496f4f-d92c-4e80-bc25-cabda3e27ad4:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 e5f52025-2b9f-4e2b-85a0-7a9c687ac1fd:/dev/nvme0n1p3] Jun 02 01:22:32.051573 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.051495 2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 02 01:22:32.055785 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.055669 2559 manager.go:217] Machine: {Timestamp:2026-06-02 01:22:32.055140749 +0000 UTC m=+0.384775658 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3110841 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e54f7f60f83e75bfc98d547f95cc5 SystemUUID:ec2e54f7-f60f-83e7-5bfc-98d547f95cc5 BootID:50fc8a5a-a54a-4aee-814b-5911f168e678 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a5:a9:d1:a8:a1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a5:a9:d1:a8:a1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ea:19:5d:74:0b:0f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 02 01:22:32.056189 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.056174 2559 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 01:22:32.057381 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.057368 2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 02 01:22:32.057496 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.057478 2559 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 02 01:22:32.059482 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.059462 2559 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 02 01:22:32.059612 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.059484 2559 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-179.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 02 01:22:32.059661 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.059621 2559 topology_manager.go:138] "Creating topology manager with none policy" Jun 02 01:22:32.059661 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.059628 2559 container_manager_linux.go:306] "Creating device plugin manager" Jun 02 01:22:32.059661 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.059635 2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 01:22:32.060508 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.060496 2559 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 01:22:32.061755 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.061745 2559 state_mem.go:36] "Initialized new in-memory state store" Jun 02 01:22:32.061973 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.061962 2559 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 02 01:22:32.066249 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.066233 2559 kubelet.go:491] "Attempting to sync node with API server" Jun 02 01:22:32.066314 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.066269 2559 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 02 01:22:32.066314 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.066281 2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 02 01:22:32.066314 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.066296 2559 kubelet.go:397] "Adding apiserver pod source" Jun 02 01:22:32.066314 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.066308 2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 02 01:22:32.067570 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.067556 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 01:22:32.067633 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.067577 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 01:22:32.070353 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.070332 2559 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 02 01:22:32.072076 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.072061 2559 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 02 01:22:32.074049 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.074035 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 02 01:22:32.074049 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.074052 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 02 01:22:32.074151 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.074058 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 02 01:22:32.074151 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.074064 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 02 01:22:32.074151 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.074072 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 02 01:22:32.074151 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.074078 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 02 01:22:32.074151 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.074083 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 02 01:22:32.074151 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.074089 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 02 01:22:32.074151 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.074095 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 02 01:22:32.074151 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.074101 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 02 01:22:32.074151 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.074108 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 02 01:22:32.074151 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.074114 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 02 01:22:32.075578 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.075568 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 02 01:22:32.075578 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.075579 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 02 01:22:32.076896 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:32.076862 2559 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 02 01:22:32.076963 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:32.076914 2559 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-179.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 02 01:22:32.078675 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.078658 2559 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-179.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 02 01:22:32.078894 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.078881 2559 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 02 01:22:32.078938 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.078916 2559 server.go:1295] "Started kubelet" Jun 02 01:22:32.079263 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.079240 2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 02 01:22:32.079607 ip-10-0-130-179 systemd[1]: Started Kubernetes Kubelet. Jun 02 01:22:32.080644 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.080595 2559 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 02 01:22:32.080779 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.080760 2559 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 02 01:22:32.081184 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.081170 2559 server.go:317] "Adding debug handlers to kubelet server" Jun 02 01:22:32.083282 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.083268 2559 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 02 01:22:32.086433 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.086180 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 02 01:22:32.086433 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.086159 2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 02 01:22:32.086571 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.086483 2559 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 02 01:22:32.086571 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.086501 2559 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 02 01:22:32.086664 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.086644 2559 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 02 01:22:32.086733 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.086715 2559 reconstruct.go:97] "Volume reconstruction finished" Jun 02 01:22:32.086733 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.086731 2559 reconciler.go:26] "Reconciler: start to sync state" Jun 02 01:22:32.088568 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:32.087102 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-179.ec2.internal\" not found" Jun 02 01:22:32.090276 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.090167 2559 factory.go:55] Registering systemd factory Jun 02 01:22:32.090365 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.090306 2559 factory.go:223] Registration of the systemd container factory successfully Jun 02 01:22:32.090571 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.090549 2559 factory.go:153] Registering CRI-O factory Jun 02 01:22:32.090571 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.090560 2559 factory.go:223] Registration of the crio container factory successfully Jun 02 01:22:32.090666 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.090614 2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 02 01:22:32.090666 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.090639 2559 factory.go:103] Registering Raw factory Jun 02 01:22:32.090666 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.090655 2559 manager.go:1196] Started watching for new ooms in manager Jun 02 01:22:32.091183 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.091168 2559 manager.go:319] Starting recovery of all containers Jun 02 01:22:32.092090 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:32.091963 2559 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 02 01:22:32.092180 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:32.092132 2559 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 02 01:22:32.095358 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:32.095329 2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-179.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 02 01:22:32.095473 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:32.091986 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-179.ec2.internal.18b51f0933c944fe default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-179.ec2.internal,UID:ip-10-0-130-179.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-179.ec2.internal,},FirstTimestamp:2026-06-02 01:22:32.078894334 +0000 UTC m=+0.408529244,LastTimestamp:2026-06-02 01:22:32.078894334 +0000 UTC m=+0.408529244,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-179.ec2.internal,}" Jun 02 01:22:32.105067 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.104939 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-k2ldw" Jun 02 01:22:32.105326 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.105308 2559 manager.go:324] Recovery completed Jun 02 01:22:32.109172 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.109158 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:22:32.110592 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.110576 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-k2ldw" Jun 02 01:22:32.111128 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.111114 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-179.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:22:32.111191 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.111142 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-179.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:22:32.111191 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.111152 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-179.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:22:32.111649 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.111634 2559 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 02 01:22:32.111649 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.111646 2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 02 01:22:32.111760 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.111661 2559 state_mem.go:36] "Initialized new in-memory state store" Jun 02 01:22:32.112976 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:32.112908 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-179.ec2.internal.18b51f0935b521c8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-179.ec2.internal,UID:ip-10-0-130-179.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-179.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-179.ec2.internal,},FirstTimestamp:2026-06-02 01:22:32.111129032 +0000 UTC m=+0.440763941,LastTimestamp:2026-06-02 01:22:32.111129032 +0000 UTC m=+0.440763941,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-179.ec2.internal,}" Jun 02 01:22:32.113751 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.113739 2559 policy_none.go:49] "None policy: Start" Jun 02 01:22:32.113851 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.113755 2559 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 02 01:22:32.113851 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.113766 2559 state_mem.go:35] "Initializing new in-memory state store" Jun 02 01:22:32.155504 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.155485 2559 manager.go:341] "Starting Device Plugin manager" Jun 02 01:22:32.163450 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:32.155526 2559 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 02 01:22:32.163450 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.155536 2559 server.go:85] "Starting device plugin registration server" Jun 02 01:22:32.163450 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.155796 2559 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 02 01:22:32.163450 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.155809 2559 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 02 01:22:32.163450 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.155908 2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 02 01:22:32.163450 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.155974 2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 02 01:22:32.163450 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.155980 2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 02 01:22:32.163450 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:32.156552 2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 02 01:22:32.163450 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:32.156594 2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-179.ec2.internal\" not found" Jun 02 01:22:32.226208 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.226126 2559 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 02 01:22:32.227538 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.227525 2559 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 02 01:22:32.227594 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.227550 2559 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 02 01:22:32.227594 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.227570 2559 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 02 01:22:32.227594 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.227580 2559 kubelet.go:2451] "Starting kubelet main sync loop" Jun 02 01:22:32.227728 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:32.227625 2559 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 02 01:22:32.230024 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.230004 2559 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:22:32.256750 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.256715 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:22:32.257828 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.257802 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-179.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:22:32.257949 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.257851 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-179.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:22:32.257949 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.257862 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-179.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:22:32.257949 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.257887 2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-179.ec2.internal" Jun 02 01:22:32.267087 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.267068 2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-179.ec2.internal" Jun 02 01:22:32.267164 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:32.267091 2559 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-179.ec2.internal\": node \"ip-10-0-130-179.ec2.internal\" not found" Jun 02 01:22:32.292552 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:32.292527 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-179.ec2.internal\" not found" Jun 02 01:22:32.328403 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.328365 2559 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-130-179.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-179.ec2.internal"] Jun 02 01:22:32.328572 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.328454 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:22:32.329496 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.329478 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-179.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:22:32.329593 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.329507 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-179.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:22:32.329593 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.329518 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-179.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:22:32.330646 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.330616 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:22:32.330776 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.330762 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-179.ec2.internal" Jun 02 01:22:32.330813 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.330792 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:22:32.331389 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.331372 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-179.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:22:32.331488 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.331373 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-179.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:22:32.331488 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.331424 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-179.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:22:32.331488 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.331435 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-179.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:22:32.331488 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.331405 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-179.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:22:32.331488 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.331478 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-179.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:22:32.332571 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.332557 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-179.ec2.internal" Jun 02 01:22:32.332661 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.332582 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:22:32.333216 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.333199 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-179.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:22:32.333216 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.333225 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-179.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:22:32.333354 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.333235 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-179.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:22:32.368823 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:32.368788 2559 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-179.ec2.internal\" not found" node="ip-10-0-130-179.ec2.internal" Jun 02 01:22:32.372297 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:32.372275 2559 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-179.ec2.internal\" not found" node="ip-10-0-130-179.ec2.internal" Jun 02 01:22:32.388356 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.388325 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8c8b5362a872b75803160058f4454c9c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-179.ec2.internal\" (UID: \"8c8b5362a872b75803160058f4454c9c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-179.ec2.internal" Jun 02 01:22:32.388356 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.388361 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c8b5362a872b75803160058f4454c9c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-179.ec2.internal\" (UID: \"8c8b5362a872b75803160058f4454c9c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-179.ec2.internal" Jun 02 01:22:32.388525 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.388378 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d4741659fb407ec36ac08d8abc23301e-config\") pod \"kube-apiserver-proxy-ip-10-0-130-179.ec2.internal\" (UID: \"d4741659fb407ec36ac08d8abc23301e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-179.ec2.internal" Jun 02 01:22:32.393417 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:32.393393 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-179.ec2.internal\" not found" Jun 02 01:22:32.489558 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.489459 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d4741659fb407ec36ac08d8abc23301e-config\") pod \"kube-apiserver-proxy-ip-10-0-130-179.ec2.internal\" (UID: \"d4741659fb407ec36ac08d8abc23301e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-179.ec2.internal" Jun 02 01:22:32.489558 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.489494 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8c8b5362a872b75803160058f4454c9c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-179.ec2.internal\" (UID: \"8c8b5362a872b75803160058f4454c9c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-179.ec2.internal" Jun 02 01:22:32.489558 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.489510 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c8b5362a872b75803160058f4454c9c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-179.ec2.internal\" (UID: \"8c8b5362a872b75803160058f4454c9c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-179.ec2.internal" Jun 02 01:22:32.489558 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.489538 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c8b5362a872b75803160058f4454c9c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-179.ec2.internal\" (UID: \"8c8b5362a872b75803160058f4454c9c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-179.ec2.internal" Jun 02 01:22:32.489809 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.489571 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8c8b5362a872b75803160058f4454c9c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-179.ec2.internal\" (UID: \"8c8b5362a872b75803160058f4454c9c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-179.ec2.internal" Jun 02 01:22:32.489809 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.489570 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d4741659fb407ec36ac08d8abc23301e-config\") pod \"kube-apiserver-proxy-ip-10-0-130-179.ec2.internal\" (UID: \"d4741659fb407ec36ac08d8abc23301e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-179.ec2.internal" Jun 02 01:22:32.493480 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:32.493456 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-179.ec2.internal\" not found" Jun 02 01:22:32.594249 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:32.594207 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-179.ec2.internal\" not found" Jun 02 01:22:32.672460 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.672427 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-179.ec2.internal" Jun 02 01:22:32.674966 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.674935 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-179.ec2.internal" Jun 02 01:22:32.695181 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:32.695154 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-179.ec2.internal\" not found" Jun 02 01:22:32.795758 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:32.795656 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-179.ec2.internal\" not found" Jun 02 01:22:32.896167 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:32.896141 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-179.ec2.internal\" not found" Jun 02 01:22:32.955206 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.953947 2559 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:22:32.991518 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.991471 2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 02 01:22:32.992116 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.991668 2559 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 01:22:32.992116 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:32.991690 2559 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 01:22:32.996685 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:32.996668 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-179.ec2.internal\" not found" Jun 02 01:22:33.086696 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:33.086619 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 02 01:22:33.096903 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:33.096868 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-179.ec2.internal\" not found" Jun 02 01:22:33.097052 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:33.096968 2559 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 01:22:33.112822 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:33.112788 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-01 01:17:32 +0000 UTC" deadline="2028-01-15 02:05:02.871952239 +0000 UTC" Jun 02 01:22:33.112822 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:33.112812 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14208h42m29.759142421s" Jun 02 01:22:33.156370 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:33.156342 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gdmkp" Jun 02 01:22:33.164119 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:33.164102 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gdmkp" Jun 02 01:22:33.197749 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:33.197721 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-179.ec2.internal\" not found" Jun 02 01:22:33.198112 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:33.198099 2559 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:22:33.251113 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:33.251078 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c8b5362a872b75803160058f4454c9c.slice/crio-29ef3a746f67837348fdb2772a9b60e02d4c47b259d9ea02b002b0b7578eca28 WatchSource:0}: Error finding container 29ef3a746f67837348fdb2772a9b60e02d4c47b259d9ea02b002b0b7578eca28: Status 404 returned error can't find the container with id 29ef3a746f67837348fdb2772a9b60e02d4c47b259d9ea02b002b0b7578eca28 Jun 02 01:22:33.251335 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:33.251317 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4741659fb407ec36ac08d8abc23301e.slice/crio-a8ff9e0ef2bd4cc2889aaa8ce43c93be419787b8d3ff5a2de9740dc059586527 WatchSource:0}: Error finding container a8ff9e0ef2bd4cc2889aaa8ce43c93be419787b8d3ff5a2de9740dc059586527: Status 404 returned error can't find the container with id a8ff9e0ef2bd4cc2889aaa8ce43c93be419787b8d3ff5a2de9740dc059586527 Jun 02 01:22:33.255306 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:33.255292 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 01:22:33.298249 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:33.298198 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-179.ec2.internal\" not found" Jun 02 01:22:33.320883 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:33.320862 2559 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:22:33.386980 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:33.386901 2559 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-179.ec2.internal" Jun 02 01:22:33.401338 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:33.401320 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 01:22:33.402388 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:33.402377 2559 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-179.ec2.internal" Jun 02 01:22:33.416528 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:33.416514 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 01:22:33.797323 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:33.797186 2559 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:22:34.067676 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.067598 2559 apiserver.go:52] "Watching apiserver" Jun 02 01:22:34.073620 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.073594 2559 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 02 01:22:34.074003 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.073981 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-5tkrg","openshift-multus/multus-additional-cni-plugins-nqdhn","openshift-multus/multus-n22l6","openshift-network-operator/iptables-alerter-rgnz6","kube-system/konnectivity-agent-lgtvp","openshift-cluster-node-tuning-operator/tuned-42rnv","openshift-image-registry/node-ca-7xkdt","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-179.ec2.internal","openshift-multus/network-metrics-daemon-96l4l","openshift-network-diagnostics/network-check-target-gcs7z","openshift-ovn-kubernetes/ovnkube-node-9jfrv","kube-system/kube-apiserver-proxy-ip-10-0-130-179.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42bwv"] Jun 02 01:22:34.075536 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.075513 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7xkdt" Jun 02 01:22:34.077587 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.077568 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nqdhn" Jun 02 01:22:34.077723 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.077702 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.078384 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.078361 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 02 01:22:34.078485 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.078398 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 02 01:22:34.078485 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.078436 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 02 01:22:34.078485 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.078463 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ttvn6\"" Jun 02 01:22:34.079906 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.079885 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lgtvp" Jun 02 01:22:34.080249 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.080235 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 02 01:22:34.080388 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.080377 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 02 01:22:34.080533 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.080520 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-j86jz\"" Jun 02 01:22:34.080644 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.080633 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 02 01:22:34.081166 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.080933 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 02 01:22:34.081166 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.080939 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 02 01:22:34.081166 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.081018 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-b4hl4\"" Jun 02 01:22:34.081166 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.081088 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 02 01:22:34.081673 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.081545 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rgnz6" Jun 02 01:22:34.081673 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.081563 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-42rnv" Jun 02 01:22:34.085412 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.083118 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 02 01:22:34.085412 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.083272 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 02 01:22:34.085412 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.083677 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5tkrg" Jun 02 01:22:34.085412 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.083790 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-l2s2w\"" Jun 02 01:22:34.085412 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.084028 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 02 01:22:34.085412 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.084325 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 02 01:22:34.085412 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.084530 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 02 01:22:34.085412 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.084740 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 02 01:22:34.085790 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.085589 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-96l4l" Jun 02 01:22:34.085790 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.085638 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-72fck\"" Jun 02 01:22:34.085790 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:34.085676 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-96l4l" podUID="564c53f1-521a-42b2-8353-80c10ff44bb2" Jun 02 01:22:34.085790 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.085768 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kknss\"" Jun 02 01:22:34.086862 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.086481 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 02 01:22:34.086862 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.086661 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ncvtd\"" Jun 02 01:22:34.086862 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.086716 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 02 01:22:34.086862 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.086828 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 02 01:22:34.087097 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.087079 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gcs7z" Jun 02 01:22:34.087180 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:34.087159 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gcs7z" podUID="ea44904f-42c9-44c6-84d2-06d8daf3412c" Jun 02 01:22:34.088993 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.088392 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.089542 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.089521 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42bwv" Jun 02 01:22:34.090767 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.090733 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 02 01:22:34.091186 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.090850 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mncp4\"" Jun 02 01:22:34.091186 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.091011 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 02 01:22:34.091324 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.091009 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 02 01:22:34.091324 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.091037 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 02 01:22:34.091430 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.091325 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mvfc4\"" Jun 02 01:22:34.091430 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.091071 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 02 01:22:34.091522 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.091131 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 02 01:22:34.091601 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.091582 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 02 01:22:34.091699 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.091589 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 02 01:22:34.091961 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.091942 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 02 01:22:34.098757 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.098737 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/585b1860-a049-4dc9-9dae-78a15997c822-host-run-k8s-cni-cncf-io\") pod \"multus-n22l6\" (UID: \"585b1860-a049-4dc9-9dae-78a15997c822\") " pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.098886 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.098769 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/585b1860-a049-4dc9-9dae-78a15997c822-host-run-netns\") pod \"multus-n22l6\" (UID: \"585b1860-a049-4dc9-9dae-78a15997c822\") " pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.098886 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.098791 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/585b1860-a049-4dc9-9dae-78a15997c822-host-var-lib-kubelet\") pod \"multus-n22l6\" (UID: \"585b1860-a049-4dc9-9dae-78a15997c822\") " pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.098886 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.098812 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/585b1860-a049-4dc9-9dae-78a15997c822-etc-kubernetes\") pod \"multus-n22l6\" (UID: \"585b1860-a049-4dc9-9dae-78a15997c822\") " pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.099132 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.098905 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/764af020-fd61-4df1-85d0-0e7d749a686a-iptables-alerter-script\") pod \"iptables-alerter-rgnz6\" (UID: \"764af020-fd61-4df1-85d0-0e7d749a686a\") " pod="openshift-network-operator/iptables-alerter-rgnz6" Jun 02 01:22:34.099132 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.098940 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d108b630-1a3c-42cf-83bc-0ebf39e40d89-var-lib-kubelet\") pod \"tuned-42rnv\" (UID: \"d108b630-1a3c-42cf-83bc-0ebf39e40d89\") " pod="openshift-cluster-node-tuning-operator/tuned-42rnv" Jun 02 01:22:34.099132 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.098994 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/864222f2-b558-4380-b095-b1f285e5b91c-cnibin\") pod \"multus-additional-cni-plugins-nqdhn\" (UID: \"864222f2-b558-4380-b095-b1f285e5b91c\") " pod="openshift-multus/multus-additional-cni-plugins-nqdhn" Jun 02 01:22:34.099132 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.099042 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/864222f2-b558-4380-b095-b1f285e5b91c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nqdhn\" (UID: \"864222f2-b558-4380-b095-b1f285e5b91c\") " pod="openshift-multus/multus-additional-cni-plugins-nqdhn" Jun 02 01:22:34.099132 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.099071 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/585b1860-a049-4dc9-9dae-78a15997c822-multus-conf-dir\") pod \"multus-n22l6\" (UID: \"585b1860-a049-4dc9-9dae-78a15997c822\") " pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.099132 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.099092 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d108b630-1a3c-42cf-83bc-0ebf39e40d89-host\") pod \"tuned-42rnv\" (UID: \"d108b630-1a3c-42cf-83bc-0ebf39e40d89\") " pod="openshift-cluster-node-tuning-operator/tuned-42rnv" Jun 02 01:22:34.099132 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.099116 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/585b1860-a049-4dc9-9dae-78a15997c822-cnibin\") pod \"multus-n22l6\" (UID: \"585b1860-a049-4dc9-9dae-78a15997c822\") " pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.099452 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.099138 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/585b1860-a049-4dc9-9dae-78a15997c822-cni-binary-copy\") pod \"multus-n22l6\" (UID: \"585b1860-a049-4dc9-9dae-78a15997c822\") " pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.099452 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.099162 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/564c53f1-521a-42b2-8353-80c10ff44bb2-metrics-certs\") pod \"network-metrics-daemon-96l4l\" (UID: \"564c53f1-521a-42b2-8353-80c10ff44bb2\") " pod="openshift-multus/network-metrics-daemon-96l4l" Jun 02 01:22:34.099452 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.099185 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d108b630-1a3c-42cf-83bc-0ebf39e40d89-etc-tuned\") pod \"tuned-42rnv\" (UID: \"d108b630-1a3c-42cf-83bc-0ebf39e40d89\") " pod="openshift-cluster-node-tuning-operator/tuned-42rnv" Jun 02 01:22:34.099452 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.099207 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d108b630-1a3c-42cf-83bc-0ebf39e40d89-tmp\") pod \"tuned-42rnv\" (UID: \"d108b630-1a3c-42cf-83bc-0ebf39e40d89\") " pod="openshift-cluster-node-tuning-operator/tuned-42rnv" Jun 02 01:22:34.099452 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.099231 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nw5nf\" (UniqueName: \"kubernetes.io/projected/d108b630-1a3c-42cf-83bc-0ebf39e40d89-kube-api-access-nw5nf\") pod \"tuned-42rnv\" (UID: \"d108b630-1a3c-42cf-83bc-0ebf39e40d89\") " pod="openshift-cluster-node-tuning-operator/tuned-42rnv" Jun 02 01:22:34.099452 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.099255 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/585b1860-a049-4dc9-9dae-78a15997c822-host-var-lib-cni-bin\") pod \"multus-n22l6\" (UID: \"585b1860-a049-4dc9-9dae-78a15997c822\") " pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.099452 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.099283 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/585b1860-a049-4dc9-9dae-78a15997c822-host-run-multus-certs\") pod \"multus-n22l6\" (UID: \"585b1860-a049-4dc9-9dae-78a15997c822\") " pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.099452 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.099306 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d108b630-1a3c-42cf-83bc-0ebf39e40d89-etc-kubernetes\") pod \"tuned-42rnv\" (UID: \"d108b630-1a3c-42cf-83bc-0ebf39e40d89\") " pod="openshift-cluster-node-tuning-operator/tuned-42rnv" Jun 02 01:22:34.099452 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.099329 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d108b630-1a3c-42cf-83bc-0ebf39e40d89-etc-sysctl-d\") pod \"tuned-42rnv\" (UID: \"d108b630-1a3c-42cf-83bc-0ebf39e40d89\") " pod="openshift-cluster-node-tuning-operator/tuned-42rnv" Jun 02 01:22:34.099452 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.099350 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d108b630-1a3c-42cf-83bc-0ebf39e40d89-run\") pod \"tuned-42rnv\" (UID: \"d108b630-1a3c-42cf-83bc-0ebf39e40d89\") " pod="openshift-cluster-node-tuning-operator/tuned-42rnv" Jun 02 01:22:34.099452 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.099371 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4449e4e0-b633-4914-a364-3a22b3408589-serviceca\") pod \"node-ca-7xkdt\" (UID: \"4449e4e0-b633-4914-a364-3a22b3408589\") " pod="openshift-image-registry/node-ca-7xkdt" Jun 02 01:22:34.099452 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.099395 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce15d2ed-5b70-4ef5-bc2c-bdd6c25be7d5-tmp-dir\") pod \"node-resolver-5tkrg\" (UID: \"ce15d2ed-5b70-4ef5-bc2c-bdd6c25be7d5\") " pod="openshift-dns/node-resolver-5tkrg" Jun 02 01:22:34.099452 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.099424 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxzpv\" (UniqueName: \"kubernetes.io/projected/ce15d2ed-5b70-4ef5-bc2c-bdd6c25be7d5-kube-api-access-qxzpv\") pod \"node-resolver-5tkrg\" (UID: \"ce15d2ed-5b70-4ef5-bc2c-bdd6c25be7d5\") " pod="openshift-dns/node-resolver-5tkrg" Jun 02 01:22:34.099452 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.099453 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/585b1860-a049-4dc9-9dae-78a15997c822-system-cni-dir\") pod \"multus-n22l6\" (UID: \"585b1860-a049-4dc9-9dae-78a15997c822\") " pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.100115 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.099474 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/585b1860-a049-4dc9-9dae-78a15997c822-multus-cni-dir\") pod \"multus-n22l6\" (UID: \"585b1860-a049-4dc9-9dae-78a15997c822\") " pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.100115 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.099497 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/585b1860-a049-4dc9-9dae-78a15997c822-os-release\") pod \"multus-n22l6\" (UID: \"585b1860-a049-4dc9-9dae-78a15997c822\") " pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.100115 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.099526 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/585b1860-a049-4dc9-9dae-78a15997c822-host-var-lib-cni-multus\") pod \"multus-n22l6\" (UID: \"585b1860-a049-4dc9-9dae-78a15997c822\") " pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.100115 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.099549 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/585b1860-a049-4dc9-9dae-78a15997c822-multus-daemon-config\") pod \"multus-n22l6\" (UID: \"585b1860-a049-4dc9-9dae-78a15997c822\") " pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.100115 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.099578 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4z28\" (UniqueName: \"kubernetes.io/projected/4449e4e0-b633-4914-a364-3a22b3408589-kube-api-access-b4z28\") pod \"node-ca-7xkdt\" (UID: \"4449e4e0-b633-4914-a364-3a22b3408589\") " pod="openshift-image-registry/node-ca-7xkdt" Jun 02 01:22:34.100115 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.099601 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8vbt\" (UniqueName: \"kubernetes.io/projected/564c53f1-521a-42b2-8353-80c10ff44bb2-kube-api-access-w8vbt\") pod \"network-metrics-daemon-96l4l\" (UID: \"564c53f1-521a-42b2-8353-80c10ff44bb2\") " pod="openshift-multus/network-metrics-daemon-96l4l" Jun 02 01:22:34.100115 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.099625 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/764af020-fd61-4df1-85d0-0e7d749a686a-host-slash\") pod \"iptables-alerter-rgnz6\" (UID: \"764af020-fd61-4df1-85d0-0e7d749a686a\") " pod="openshift-network-operator/iptables-alerter-rgnz6" Jun 02 01:22:34.100115 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.099647 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvbgd\" (UniqueName: \"kubernetes.io/projected/764af020-fd61-4df1-85d0-0e7d749a686a-kube-api-access-lvbgd\") pod \"iptables-alerter-rgnz6\" (UID: \"764af020-fd61-4df1-85d0-0e7d749a686a\") " pod="openshift-network-operator/iptables-alerter-rgnz6" Jun 02 01:22:34.100115 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.099682 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f410a064-878f-4457-ad8e-f4456e889346-konnectivity-ca\") pod \"konnectivity-agent-lgtvp\" (UID: \"f410a064-878f-4457-ad8e-f4456e889346\") " pod="kube-system/konnectivity-agent-lgtvp" Jun 02 01:22:34.100115 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.099709 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d108b630-1a3c-42cf-83bc-0ebf39e40d89-etc-sysctl-conf\") pod \"tuned-42rnv\" (UID: \"d108b630-1a3c-42cf-83bc-0ebf39e40d89\") " pod="openshift-cluster-node-tuning-operator/tuned-42rnv" Jun 02 01:22:34.100115 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.099734 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4tgk\" (UniqueName: \"kubernetes.io/projected/ea44904f-42c9-44c6-84d2-06d8daf3412c-kube-api-access-d4tgk\") pod \"network-check-target-gcs7z\" (UID: \"ea44904f-42c9-44c6-84d2-06d8daf3412c\") " pod="openshift-network-diagnostics/network-check-target-gcs7z" Jun 02 01:22:34.100115 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.099759 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4449e4e0-b633-4914-a364-3a22b3408589-host\") pod \"node-ca-7xkdt\" (UID: \"4449e4e0-b633-4914-a364-3a22b3408589\") " pod="openshift-image-registry/node-ca-7xkdt" Jun 02 01:22:34.100115 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.099782 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/864222f2-b558-4380-b095-b1f285e5b91c-system-cni-dir\") pod \"multus-additional-cni-plugins-nqdhn\" (UID: \"864222f2-b558-4380-b095-b1f285e5b91c\") " pod="openshift-multus/multus-additional-cni-plugins-nqdhn" Jun 02 01:22:34.100115 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.099813 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/864222f2-b558-4380-b095-b1f285e5b91c-os-release\") pod \"multus-additional-cni-plugins-nqdhn\" (UID: \"864222f2-b558-4380-b095-b1f285e5b91c\") " pod="openshift-multus/multus-additional-cni-plugins-nqdhn" Jun 02 01:22:34.100115 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.099856 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/864222f2-b558-4380-b095-b1f285e5b91c-cni-binary-copy\") pod \"multus-additional-cni-plugins-nqdhn\" (UID: \"864222f2-b558-4380-b095-b1f285e5b91c\") " pod="openshift-multus/multus-additional-cni-plugins-nqdhn" Jun 02 01:22:34.100115 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.099881 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/864222f2-b558-4380-b095-b1f285e5b91c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nqdhn\" (UID: \"864222f2-b558-4380-b095-b1f285e5b91c\") " pod="openshift-multus/multus-additional-cni-plugins-nqdhn" Jun 02 01:22:34.100933 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.099906 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/864222f2-b558-4380-b095-b1f285e5b91c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nqdhn\" (UID: \"864222f2-b558-4380-b095-b1f285e5b91c\") " pod="openshift-multus/multus-additional-cni-plugins-nqdhn" Jun 02 01:22:34.100933 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.099940 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55zxd\" (UniqueName: \"kubernetes.io/projected/585b1860-a049-4dc9-9dae-78a15997c822-kube-api-access-55zxd\") pod \"multus-n22l6\" (UID: \"585b1860-a049-4dc9-9dae-78a15997c822\") " pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.100933 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.099967 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d108b630-1a3c-42cf-83bc-0ebf39e40d89-etc-systemd\") pod \"tuned-42rnv\" (UID: \"d108b630-1a3c-42cf-83bc-0ebf39e40d89\") " pod="openshift-cluster-node-tuning-operator/tuned-42rnv" Jun 02 01:22:34.100933 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.099991 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hms8\" (UniqueName: \"kubernetes.io/projected/864222f2-b558-4380-b095-b1f285e5b91c-kube-api-access-7hms8\") pod \"multus-additional-cni-plugins-nqdhn\" (UID: \"864222f2-b558-4380-b095-b1f285e5b91c\") " pod="openshift-multus/multus-additional-cni-plugins-nqdhn" Jun 02 01:22:34.100933 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.100015 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/585b1860-a049-4dc9-9dae-78a15997c822-hostroot\") pod \"multus-n22l6\" (UID: \"585b1860-a049-4dc9-9dae-78a15997c822\") " pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.100933 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.100038 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f410a064-878f-4457-ad8e-f4456e889346-agent-certs\") pod \"konnectivity-agent-lgtvp\" (UID: \"f410a064-878f-4457-ad8e-f4456e889346\") " pod="kube-system/konnectivity-agent-lgtvp" Jun 02 01:22:34.100933 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.100061 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d108b630-1a3c-42cf-83bc-0ebf39e40d89-etc-modprobe-d\") pod \"tuned-42rnv\" (UID: \"d108b630-1a3c-42cf-83bc-0ebf39e40d89\") " pod="openshift-cluster-node-tuning-operator/tuned-42rnv" Jun 02 01:22:34.100933 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.100084 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d108b630-1a3c-42cf-83bc-0ebf39e40d89-etc-sysconfig\") pod \"tuned-42rnv\" (UID: \"d108b630-1a3c-42cf-83bc-0ebf39e40d89\") " pod="openshift-cluster-node-tuning-operator/tuned-42rnv" Jun 02 01:22:34.100933 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.100107 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d108b630-1a3c-42cf-83bc-0ebf39e40d89-sys\") pod \"tuned-42rnv\" (UID: \"d108b630-1a3c-42cf-83bc-0ebf39e40d89\") " pod="openshift-cluster-node-tuning-operator/tuned-42rnv" Jun 02 01:22:34.100933 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.100130 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d108b630-1a3c-42cf-83bc-0ebf39e40d89-lib-modules\") pod \"tuned-42rnv\" (UID: \"d108b630-1a3c-42cf-83bc-0ebf39e40d89\") " pod="openshift-cluster-node-tuning-operator/tuned-42rnv" Jun 02 01:22:34.100933 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.100154 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ce15d2ed-5b70-4ef5-bc2c-bdd6c25be7d5-hosts-file\") pod \"node-resolver-5tkrg\" (UID: \"ce15d2ed-5b70-4ef5-bc2c-bdd6c25be7d5\") " pod="openshift-dns/node-resolver-5tkrg" Jun 02 01:22:34.100933 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.100177 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/585b1860-a049-4dc9-9dae-78a15997c822-multus-socket-dir-parent\") pod \"multus-n22l6\" (UID: \"585b1860-a049-4dc9-9dae-78a15997c822\") " pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.164916 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.164885 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 01:17:33 +0000 UTC" deadline="2027-11-30 01:11:48.99998829 +0000 UTC" Jun 02 01:22:34.164916 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.164912 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13103h49m14.83507814s" Jun 02 01:22:34.188071 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.188045 2559 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 02 01:22:34.201011 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.200975 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/864222f2-b558-4380-b095-b1f285e5b91c-system-cni-dir\") pod \"multus-additional-cni-plugins-nqdhn\" (UID: \"864222f2-b558-4380-b095-b1f285e5b91c\") " pod="openshift-multus/multus-additional-cni-plugins-nqdhn" Jun 02 01:22:34.201145 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.201020 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/864222f2-b558-4380-b095-b1f285e5b91c-os-release\") pod \"multus-additional-cni-plugins-nqdhn\" (UID: \"864222f2-b558-4380-b095-b1f285e5b91c\") " pod="openshift-multus/multus-additional-cni-plugins-nqdhn" Jun 02 01:22:34.201145 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.201046 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/864222f2-b558-4380-b095-b1f285e5b91c-cni-binary-copy\") pod \"multus-additional-cni-plugins-nqdhn\" (UID: \"864222f2-b558-4380-b095-b1f285e5b91c\") " pod="openshift-multus/multus-additional-cni-plugins-nqdhn" Jun 02 01:22:34.201145 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.201071 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/864222f2-b558-4380-b095-b1f285e5b91c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nqdhn\" (UID: \"864222f2-b558-4380-b095-b1f285e5b91c\") " pod="openshift-multus/multus-additional-cni-plugins-nqdhn" Jun 02 01:22:34.201145 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.201088 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/864222f2-b558-4380-b095-b1f285e5b91c-system-cni-dir\") pod \"multus-additional-cni-plugins-nqdhn\" (UID: \"864222f2-b558-4380-b095-b1f285e5b91c\") " pod="openshift-multus/multus-additional-cni-plugins-nqdhn" Jun 02 01:22:34.201145 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.201100 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d108b630-1a3c-42cf-83bc-0ebf39e40d89-etc-systemd\") pod \"tuned-42rnv\" (UID: \"d108b630-1a3c-42cf-83bc-0ebf39e40d89\") " pod="openshift-cluster-node-tuning-operator/tuned-42rnv" Jun 02 01:22:34.201145 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.201131 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/864222f2-b558-4380-b095-b1f285e5b91c-os-release\") pod \"multus-additional-cni-plugins-nqdhn\" (UID: \"864222f2-b558-4380-b095-b1f285e5b91c\") " pod="openshift-multus/multus-additional-cni-plugins-nqdhn" Jun 02 01:22:34.201145 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.201142 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/83e1fd53-fa87-472e-91cc-c15dfac10b11-host-kubelet\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.201483 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.201162 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d108b630-1a3c-42cf-83bc-0ebf39e40d89-etc-systemd\") pod \"tuned-42rnv\" (UID: \"d108b630-1a3c-42cf-83bc-0ebf39e40d89\") " pod="openshift-cluster-node-tuning-operator/tuned-42rnv" Jun 02 01:22:34.201483 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.201169 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/83e1fd53-fa87-472e-91cc-c15dfac10b11-host-run-netns\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.201483 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.201282 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83e1fd53-fa87-472e-91cc-c15dfac10b11-run-openvswitch\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.201483 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.201316 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7hms8\" (UniqueName: \"kubernetes.io/projected/864222f2-b558-4380-b095-b1f285e5b91c-kube-api-access-7hms8\") pod \"multus-additional-cni-plugins-nqdhn\" (UID: \"864222f2-b558-4380-b095-b1f285e5b91c\") " pod="openshift-multus/multus-additional-cni-plugins-nqdhn" Jun 02 01:22:34.201483 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.201342 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/585b1860-a049-4dc9-9dae-78a15997c822-hostroot\") pod \"multus-n22l6\" (UID: \"585b1860-a049-4dc9-9dae-78a15997c822\") " pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.201483 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.201357 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f410a064-878f-4457-ad8e-f4456e889346-agent-certs\") pod \"konnectivity-agent-lgtvp\" (UID: \"f410a064-878f-4457-ad8e-f4456e889346\") " pod="kube-system/konnectivity-agent-lgtvp" Jun 02 01:22:34.201483 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.201387 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d108b630-1a3c-42cf-83bc-0ebf39e40d89-etc-tuned\") pod \"tuned-42rnv\" (UID: \"d108b630-1a3c-42cf-83bc-0ebf39e40d89\") " pod="openshift-cluster-node-tuning-operator/tuned-42rnv" Jun 02 01:22:34.201483 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.201430 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/83e1fd53-fa87-472e-91cc-c15dfac10b11-ovn-node-metrics-cert\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.201483 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.201447 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/83e1fd53-fa87-472e-91cc-c15dfac10b11-ovnkube-script-lib\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.201483 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.201468 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/acb4caa8-8c43-4415-a21b-7c7a6d530fbf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-42bwv\" (UID: \"acb4caa8-8c43-4415-a21b-7c7a6d530fbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42bwv" Jun 02 01:22:34.201779 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.201554 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/585b1860-a049-4dc9-9dae-78a15997c822-multus-socket-dir-parent\") pod \"multus-n22l6\" (UID: \"585b1860-a049-4dc9-9dae-78a15997c822\") " pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.201779 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.201577 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/585b1860-a049-4dc9-9dae-78a15997c822-host-run-netns\") pod \"multus-n22l6\" (UID: \"585b1860-a049-4dc9-9dae-78a15997c822\") " pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.201779 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.201598 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/585b1860-a049-4dc9-9dae-78a15997c822-host-var-lib-kubelet\") pod \"multus-n22l6\" (UID: \"585b1860-a049-4dc9-9dae-78a15997c822\") " pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.201779 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.201613 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/764af020-fd61-4df1-85d0-0e7d749a686a-iptables-alerter-script\") pod \"iptables-alerter-rgnz6\" (UID: \"764af020-fd61-4df1-85d0-0e7d749a686a\") " pod="openshift-network-operator/iptables-alerter-rgnz6" Jun 02 01:22:34.201779 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.201629 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/83e1fd53-fa87-472e-91cc-c15dfac10b11-run-ovn\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.201779 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.201645 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/acb4caa8-8c43-4415-a21b-7c7a6d530fbf-socket-dir\") pod \"aws-ebs-csi-driver-node-42bwv\" (UID: \"acb4caa8-8c43-4415-a21b-7c7a6d530fbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42bwv" Jun 02 01:22:34.201779 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.201700 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/864222f2-b558-4380-b095-b1f285e5b91c-cni-binary-copy\") pod \"multus-additional-cni-plugins-nqdhn\" (UID: \"864222f2-b558-4380-b095-b1f285e5b91c\") " pod="openshift-multus/multus-additional-cni-plugins-nqdhn" Jun 02 01:22:34.201779 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.201745 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/585b1860-a049-4dc9-9dae-78a15997c822-hostroot\") pod \"multus-n22l6\" (UID: \"585b1860-a049-4dc9-9dae-78a15997c822\") " pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.202047 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.201780 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/585b1860-a049-4dc9-9dae-78a15997c822-host-run-netns\") pod \"multus-n22l6\" (UID: \"585b1860-a049-4dc9-9dae-78a15997c822\") " pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.202047 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.201805 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/585b1860-a049-4dc9-9dae-78a15997c822-multus-socket-dir-parent\") pod \"multus-n22l6\" (UID: \"585b1860-a049-4dc9-9dae-78a15997c822\") " pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.202047 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.201883 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/585b1860-a049-4dc9-9dae-78a15997c822-host-var-lib-kubelet\") pod \"multus-n22l6\" (UID: \"585b1860-a049-4dc9-9dae-78a15997c822\") " pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.202047 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.201913 2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 02 01:22:34.202047 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.201700 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/864222f2-b558-4380-b095-b1f285e5b91c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nqdhn\" (UID: \"864222f2-b558-4380-b095-b1f285e5b91c\") " pod="openshift-multus/multus-additional-cni-plugins-nqdhn" Jun 02 01:22:34.202222 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.202203 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/864222f2-b558-4380-b095-b1f285e5b91c-cnibin\") pod \"multus-additional-cni-plugins-nqdhn\" (UID: \"864222f2-b558-4380-b095-b1f285e5b91c\") " pod="openshift-multus/multus-additional-cni-plugins-nqdhn" Jun 02 01:22:34.202268 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.202251 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/864222f2-b558-4380-b095-b1f285e5b91c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nqdhn\" (UID: \"864222f2-b558-4380-b095-b1f285e5b91c\") " pod="openshift-multus/multus-additional-cni-plugins-nqdhn" Jun 02 01:22:34.202305 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.202282 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d108b630-1a3c-42cf-83bc-0ebf39e40d89-host\") pod \"tuned-42rnv\" (UID: \"d108b630-1a3c-42cf-83bc-0ebf39e40d89\") " pod="openshift-cluster-node-tuning-operator/tuned-42rnv" Jun 02 01:22:34.202337 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.202325 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/83e1fd53-fa87-472e-91cc-c15dfac10b11-node-log\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.202379 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.202341 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/764af020-fd61-4df1-85d0-0e7d749a686a-iptables-alerter-script\") pod \"iptables-alerter-rgnz6\" (UID: \"764af020-fd61-4df1-85d0-0e7d749a686a\") " pod="openshift-network-operator/iptables-alerter-rgnz6" Jun 02 01:22:34.202379 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.202355 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83e1fd53-fa87-472e-91cc-c15dfac10b11-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.202457 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.202381 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/585b1860-a049-4dc9-9dae-78a15997c822-cnibin\") pod \"multus-n22l6\" (UID: \"585b1860-a049-4dc9-9dae-78a15997c822\") " pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.202457 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.202394 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/864222f2-b558-4380-b095-b1f285e5b91c-cnibin\") pod \"multus-additional-cni-plugins-nqdhn\" (UID: \"864222f2-b558-4380-b095-b1f285e5b91c\") " pod="openshift-multus/multus-additional-cni-plugins-nqdhn" Jun 02 01:22:34.202457 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.202435 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/564c53f1-521a-42b2-8353-80c10ff44bb2-metrics-certs\") pod \"network-metrics-daemon-96l4l\" (UID: \"564c53f1-521a-42b2-8353-80c10ff44bb2\") " pod="openshift-multus/network-metrics-daemon-96l4l" Jun 02 01:22:34.202588 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.202444 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d108b630-1a3c-42cf-83bc-0ebf39e40d89-host\") pod \"tuned-42rnv\" (UID: \"d108b630-1a3c-42cf-83bc-0ebf39e40d89\") " pod="openshift-cluster-node-tuning-operator/tuned-42rnv" Jun 02 01:22:34.202588 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.202483 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/585b1860-a049-4dc9-9dae-78a15997c822-cnibin\") pod \"multus-n22l6\" (UID: \"585b1860-a049-4dc9-9dae-78a15997c822\") " pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.202588 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.202462 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/585b1860-a049-4dc9-9dae-78a15997c822-host-var-lib-cni-bin\") pod \"multus-n22l6\" (UID: \"585b1860-a049-4dc9-9dae-78a15997c822\") " pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.202588 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.202494 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/585b1860-a049-4dc9-9dae-78a15997c822-host-var-lib-cni-bin\") pod \"multus-n22l6\" (UID: \"585b1860-a049-4dc9-9dae-78a15997c822\") " pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.202774 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.202590 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/585b1860-a049-4dc9-9dae-78a15997c822-host-run-multus-certs\") pod \"multus-n22l6\" (UID: \"585b1860-a049-4dc9-9dae-78a15997c822\") " pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.202774 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:34.202613 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:22:34.202774 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.202628 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d108b630-1a3c-42cf-83bc-0ebf39e40d89-etc-kubernetes\") pod \"tuned-42rnv\" (UID: \"d108b630-1a3c-42cf-83bc-0ebf39e40d89\") " pod="openshift-cluster-node-tuning-operator/tuned-42rnv" Jun 02 01:22:34.202774 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:34.202680 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/564c53f1-521a-42b2-8353-80c10ff44bb2-metrics-certs podName:564c53f1-521a-42b2-8353-80c10ff44bb2 nodeName:}" failed. No retries permitted until 2026-06-02 01:22:34.702644379 +0000 UTC m=+3.032279276 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/564c53f1-521a-42b2-8353-80c10ff44bb2-metrics-certs") pod "network-metrics-daemon-96l4l" (UID: "564c53f1-521a-42b2-8353-80c10ff44bb2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:22:34.202774 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.202684 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d108b630-1a3c-42cf-83bc-0ebf39e40d89-etc-kubernetes\") pod \"tuned-42rnv\" (UID: \"d108b630-1a3c-42cf-83bc-0ebf39e40d89\") " pod="openshift-cluster-node-tuning-operator/tuned-42rnv" Jun 02 01:22:34.202774 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.202695 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d108b630-1a3c-42cf-83bc-0ebf39e40d89-etc-sysctl-d\") pod \"tuned-42rnv\" (UID: \"d108b630-1a3c-42cf-83bc-0ebf39e40d89\") " pod="openshift-cluster-node-tuning-operator/tuned-42rnv" Jun 02 01:22:34.202774 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.202719 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/585b1860-a049-4dc9-9dae-78a15997c822-host-run-multus-certs\") pod \"multus-n22l6\" (UID: \"585b1860-a049-4dc9-9dae-78a15997c822\") " pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.202774 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.202758 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/acb4caa8-8c43-4415-a21b-7c7a6d530fbf-sys-fs\") pod \"aws-ebs-csi-driver-node-42bwv\" (UID: \"acb4caa8-8c43-4415-a21b-7c7a6d530fbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42bwv" Jun 02 01:22:34.203179 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.202922 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d108b630-1a3c-42cf-83bc-0ebf39e40d89-etc-sysctl-d\") pod \"tuned-42rnv\" (UID: \"d108b630-1a3c-42cf-83bc-0ebf39e40d89\") " pod="openshift-cluster-node-tuning-operator/tuned-42rnv" Jun 02 01:22:34.203179 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.202900 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4449e4e0-b633-4914-a364-3a22b3408589-serviceca\") pod \"node-ca-7xkdt\" (UID: \"4449e4e0-b633-4914-a364-3a22b3408589\") " pod="openshift-image-registry/node-ca-7xkdt" Jun 02 01:22:34.203179 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.202994 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qxzpv\" (UniqueName: \"kubernetes.io/projected/ce15d2ed-5b70-4ef5-bc2c-bdd6c25be7d5-kube-api-access-qxzpv\") pod \"node-resolver-5tkrg\" (UID: \"ce15d2ed-5b70-4ef5-bc2c-bdd6c25be7d5\") " pod="openshift-dns/node-resolver-5tkrg" Jun 02 01:22:34.203179 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.203004 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/864222f2-b558-4380-b095-b1f285e5b91c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nqdhn\" (UID: \"864222f2-b558-4380-b095-b1f285e5b91c\") " pod="openshift-multus/multus-additional-cni-plugins-nqdhn" Jun 02 01:22:34.203179 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.203017 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/585b1860-a049-4dc9-9dae-78a15997c822-multus-cni-dir\") pod \"multus-n22l6\" (UID: \"585b1860-a049-4dc9-9dae-78a15997c822\") " pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.203179 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.203042 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/585b1860-a049-4dc9-9dae-78a15997c822-multus-daemon-config\") pod \"multus-n22l6\" (UID: \"585b1860-a049-4dc9-9dae-78a15997c822\") " pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.203179 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.203066 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/764af020-fd61-4df1-85d0-0e7d749a686a-host-slash\") pod \"iptables-alerter-rgnz6\" (UID: \"764af020-fd61-4df1-85d0-0e7d749a686a\") " pod="openshift-network-operator/iptables-alerter-rgnz6" Jun 02 01:22:34.203179 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.203091 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/83e1fd53-fa87-472e-91cc-c15dfac10b11-run-systemd\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.203179 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.203127 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/acb4caa8-8c43-4415-a21b-7c7a6d530fbf-registration-dir\") pod \"aws-ebs-csi-driver-node-42bwv\" (UID: \"acb4caa8-8c43-4415-a21b-7c7a6d530fbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42bwv" Jun 02 01:22:34.203179 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.203151 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/acb4caa8-8c43-4415-a21b-7c7a6d530fbf-device-dir\") pod \"aws-ebs-csi-driver-node-42bwv\" (UID: \"acb4caa8-8c43-4415-a21b-7c7a6d530fbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42bwv" Jun 02 01:22:34.203629 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.203178 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b4z28\" (UniqueName: \"kubernetes.io/projected/4449e4e0-b633-4914-a364-3a22b3408589-kube-api-access-b4z28\") pod \"node-ca-7xkdt\" (UID: \"4449e4e0-b633-4914-a364-3a22b3408589\") " pod="openshift-image-registry/node-ca-7xkdt" Jun 02 01:22:34.203629 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.203213 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w8vbt\" (UniqueName: \"kubernetes.io/projected/564c53f1-521a-42b2-8353-80c10ff44bb2-kube-api-access-w8vbt\") pod \"network-metrics-daemon-96l4l\" (UID: \"564c53f1-521a-42b2-8353-80c10ff44bb2\") " pod="openshift-multus/network-metrics-daemon-96l4l" Jun 02 01:22:34.203629 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.203243 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/83e1fd53-fa87-472e-91cc-c15dfac10b11-systemd-units\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.203629 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.203267 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4449e4e0-b633-4914-a364-3a22b3408589-serviceca\") pod \"node-ca-7xkdt\" (UID: \"4449e4e0-b633-4914-a364-3a22b3408589\") " pod="openshift-image-registry/node-ca-7xkdt" Jun 02 01:22:34.203629 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.203308 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/585b1860-a049-4dc9-9dae-78a15997c822-multus-cni-dir\") pod \"multus-n22l6\" (UID: \"585b1860-a049-4dc9-9dae-78a15997c822\") " pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.203629 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.203347 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/83e1fd53-fa87-472e-91cc-c15dfac10b11-log-socket\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.203629 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.203378 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4449e4e0-b633-4914-a364-3a22b3408589-host\") pod \"node-ca-7xkdt\" (UID: \"4449e4e0-b633-4914-a364-3a22b3408589\") " pod="openshift-image-registry/node-ca-7xkdt" Jun 02 01:22:34.203629 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.203405 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/864222f2-b558-4380-b095-b1f285e5b91c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nqdhn\" (UID: \"864222f2-b558-4380-b095-b1f285e5b91c\") " pod="openshift-multus/multus-additional-cni-plugins-nqdhn" Jun 02 01:22:34.203629 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.203431 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-55zxd\" (UniqueName: \"kubernetes.io/projected/585b1860-a049-4dc9-9dae-78a15997c822-kube-api-access-55zxd\") pod \"multus-n22l6\" (UID: \"585b1860-a049-4dc9-9dae-78a15997c822\") " pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.203629 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.203455 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d108b630-1a3c-42cf-83bc-0ebf39e40d89-sys\") pod \"tuned-42rnv\" (UID: \"d108b630-1a3c-42cf-83bc-0ebf39e40d89\") " pod="openshift-cluster-node-tuning-operator/tuned-42rnv" Jun 02 01:22:34.203629 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.203479 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d108b630-1a3c-42cf-83bc-0ebf39e40d89-lib-modules\") pod \"tuned-42rnv\" (UID: \"d108b630-1a3c-42cf-83bc-0ebf39e40d89\") " pod="openshift-cluster-node-tuning-operator/tuned-42rnv" Jun 02 01:22:34.203629 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.203502 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d108b630-1a3c-42cf-83bc-0ebf39e40d89-etc-modprobe-d\") pod \"tuned-42rnv\" (UID: \"d108b630-1a3c-42cf-83bc-0ebf39e40d89\") " pod="openshift-cluster-node-tuning-operator/tuned-42rnv" Jun 02 01:22:34.203629 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.203527 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d108b630-1a3c-42cf-83bc-0ebf39e40d89-etc-sysconfig\") pod \"tuned-42rnv\" (UID: \"d108b630-1a3c-42cf-83bc-0ebf39e40d89\") " pod="openshift-cluster-node-tuning-operator/tuned-42rnv" Jun 02 01:22:34.203629 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.203547 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/764af020-fd61-4df1-85d0-0e7d749a686a-host-slash\") pod \"iptables-alerter-rgnz6\" (UID: \"764af020-fd61-4df1-85d0-0e7d749a686a\") " pod="openshift-network-operator/iptables-alerter-rgnz6" Jun 02 01:22:34.203629 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.203551 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d108b630-1a3c-42cf-83bc-0ebf39e40d89-var-lib-kubelet\") pod \"tuned-42rnv\" (UID: \"d108b630-1a3c-42cf-83bc-0ebf39e40d89\") " pod="openshift-cluster-node-tuning-operator/tuned-42rnv" Jun 02 01:22:34.203629 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.203581 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d108b630-1a3c-42cf-83bc-0ebf39e40d89-tmp\") pod \"tuned-42rnv\" (UID: \"d108b630-1a3c-42cf-83bc-0ebf39e40d89\") " pod="openshift-cluster-node-tuning-operator/tuned-42rnv" Jun 02 01:22:34.203629 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.203606 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d108b630-1a3c-42cf-83bc-0ebf39e40d89-etc-sysconfig\") pod \"tuned-42rnv\" (UID: \"d108b630-1a3c-42cf-83bc-0ebf39e40d89\") " pod="openshift-cluster-node-tuning-operator/tuned-42rnv" Jun 02 01:22:34.204429 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.203616 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nw5nf\" (UniqueName: \"kubernetes.io/projected/d108b630-1a3c-42cf-83bc-0ebf39e40d89-kube-api-access-nw5nf\") pod \"tuned-42rnv\" (UID: \"d108b630-1a3c-42cf-83bc-0ebf39e40d89\") " pod="openshift-cluster-node-tuning-operator/tuned-42rnv" Jun 02 01:22:34.204429 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.203647 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55lq5\" (UniqueName: \"kubernetes.io/projected/83e1fd53-fa87-472e-91cc-c15dfac10b11-kube-api-access-55lq5\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.204429 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.203666 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/acb4caa8-8c43-4415-a21b-7c7a6d530fbf-etc-selinux\") pod \"aws-ebs-csi-driver-node-42bwv\" (UID: \"acb4caa8-8c43-4415-a21b-7c7a6d530fbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42bwv" Jun 02 01:22:34.204429 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.203686 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ce15d2ed-5b70-4ef5-bc2c-bdd6c25be7d5-hosts-file\") pod \"node-resolver-5tkrg\" (UID: \"ce15d2ed-5b70-4ef5-bc2c-bdd6c25be7d5\") " pod="openshift-dns/node-resolver-5tkrg" Jun 02 01:22:34.204429 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.203709 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d108b630-1a3c-42cf-83bc-0ebf39e40d89-lib-modules\") pod \"tuned-42rnv\" (UID: \"d108b630-1a3c-42cf-83bc-0ebf39e40d89\") " pod="openshift-cluster-node-tuning-operator/tuned-42rnv" Jun 02 01:22:34.204429 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.203752 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d108b630-1a3c-42cf-83bc-0ebf39e40d89-sys\") pod \"tuned-42rnv\" (UID: \"d108b630-1a3c-42cf-83bc-0ebf39e40d89\") " pod="openshift-cluster-node-tuning-operator/tuned-42rnv" Jun 02 01:22:34.204429 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.203749 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/585b1860-a049-4dc9-9dae-78a15997c822-host-run-k8s-cni-cncf-io\") pod \"multus-n22l6\" (UID: \"585b1860-a049-4dc9-9dae-78a15997c822\") " pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.204429 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.203777 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4449e4e0-b633-4914-a364-3a22b3408589-host\") pod \"node-ca-7xkdt\" (UID: \"4449e4e0-b633-4914-a364-3a22b3408589\") " pod="openshift-image-registry/node-ca-7xkdt" Jun 02 01:22:34.204429 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.203786 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d108b630-1a3c-42cf-83bc-0ebf39e40d89-var-lib-kubelet\") pod \"tuned-42rnv\" (UID: \"d108b630-1a3c-42cf-83bc-0ebf39e40d89\") " pod="openshift-cluster-node-tuning-operator/tuned-42rnv" Jun 02 01:22:34.204429 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.203811 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d108b630-1a3c-42cf-83bc-0ebf39e40d89-etc-modprobe-d\") pod \"tuned-42rnv\" (UID: \"d108b630-1a3c-42cf-83bc-0ebf39e40d89\") " pod="openshift-cluster-node-tuning-operator/tuned-42rnv" Jun 02 01:22:34.204429 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.203714 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/585b1860-a049-4dc9-9dae-78a15997c822-host-run-k8s-cni-cncf-io\") pod \"multus-n22l6\" (UID: \"585b1860-a049-4dc9-9dae-78a15997c822\") " pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.204429 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.203872 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/585b1860-a049-4dc9-9dae-78a15997c822-etc-kubernetes\") pod \"multus-n22l6\" (UID: \"585b1860-a049-4dc9-9dae-78a15997c822\") " pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.204429 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.203898 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/585b1860-a049-4dc9-9dae-78a15997c822-multus-conf-dir\") pod \"multus-n22l6\" (UID: \"585b1860-a049-4dc9-9dae-78a15997c822\") " pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.204429 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.203925 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83e1fd53-fa87-472e-91cc-c15dfac10b11-var-lib-openvswitch\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.204429 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.203937 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/864222f2-b558-4380-b095-b1f285e5b91c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nqdhn\" (UID: \"864222f2-b558-4380-b095-b1f285e5b91c\") " pod="openshift-multus/multus-additional-cni-plugins-nqdhn" Jun 02 01:22:34.204429 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.203951 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/83e1fd53-fa87-472e-91cc-c15dfac10b11-host-cni-netd\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.204429 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.203939 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/585b1860-a049-4dc9-9dae-78a15997c822-multus-daemon-config\") pod \"multus-n22l6\" (UID: \"585b1860-a049-4dc9-9dae-78a15997c822\") " pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.205272 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.203979 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/585b1860-a049-4dc9-9dae-78a15997c822-cni-binary-copy\") pod \"multus-n22l6\" (UID: \"585b1860-a049-4dc9-9dae-78a15997c822\") " pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.205272 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.204001 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/585b1860-a049-4dc9-9dae-78a15997c822-etc-kubernetes\") pod \"multus-n22l6\" (UID: \"585b1860-a049-4dc9-9dae-78a15997c822\") " pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.205272 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.204007 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83e1fd53-fa87-472e-91cc-c15dfac10b11-etc-openvswitch\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.205272 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.204021 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ce15d2ed-5b70-4ef5-bc2c-bdd6c25be7d5-hosts-file\") pod \"node-resolver-5tkrg\" (UID: \"ce15d2ed-5b70-4ef5-bc2c-bdd6c25be7d5\") " pod="openshift-dns/node-resolver-5tkrg" Jun 02 01:22:34.205272 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.204031 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/585b1860-a049-4dc9-9dae-78a15997c822-multus-conf-dir\") pod \"multus-n22l6\" (UID: \"585b1860-a049-4dc9-9dae-78a15997c822\") " pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.205272 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.204033 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d108b630-1a3c-42cf-83bc-0ebf39e40d89-run\") pod \"tuned-42rnv\" (UID: \"d108b630-1a3c-42cf-83bc-0ebf39e40d89\") " pod="openshift-cluster-node-tuning-operator/tuned-42rnv" Jun 02 01:22:34.205272 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.204075 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d108b630-1a3c-42cf-83bc-0ebf39e40d89-run\") pod \"tuned-42rnv\" (UID: \"d108b630-1a3c-42cf-83bc-0ebf39e40d89\") " pod="openshift-cluster-node-tuning-operator/tuned-42rnv" Jun 02 01:22:34.205272 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.204154 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83e1fd53-fa87-472e-91cc-c15dfac10b11-host-run-ovn-kubernetes\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.205272 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.204182 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce15d2ed-5b70-4ef5-bc2c-bdd6c25be7d5-tmp-dir\") pod \"node-resolver-5tkrg\" (UID: \"ce15d2ed-5b70-4ef5-bc2c-bdd6c25be7d5\") " pod="openshift-dns/node-resolver-5tkrg" Jun 02 01:22:34.205272 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.204223 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/585b1860-a049-4dc9-9dae-78a15997c822-system-cni-dir\") pod \"multus-n22l6\" (UID: \"585b1860-a049-4dc9-9dae-78a15997c822\") " pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.205272 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.204247 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/585b1860-a049-4dc9-9dae-78a15997c822-os-release\") pod \"multus-n22l6\" (UID: \"585b1860-a049-4dc9-9dae-78a15997c822\") " pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.205272 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.204271 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/585b1860-a049-4dc9-9dae-78a15997c822-host-var-lib-cni-multus\") pod \"multus-n22l6\" (UID: \"585b1860-a049-4dc9-9dae-78a15997c822\") " pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.205272 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.204296 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lvbgd\" (UniqueName: \"kubernetes.io/projected/764af020-fd61-4df1-85d0-0e7d749a686a-kube-api-access-lvbgd\") pod \"iptables-alerter-rgnz6\" (UID: \"764af020-fd61-4df1-85d0-0e7d749a686a\") " pod="openshift-network-operator/iptables-alerter-rgnz6" Jun 02 01:22:34.205272 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.204330 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f410a064-878f-4457-ad8e-f4456e889346-konnectivity-ca\") pod \"konnectivity-agent-lgtvp\" (UID: \"f410a064-878f-4457-ad8e-f4456e889346\") " pod="kube-system/konnectivity-agent-lgtvp" Jun 02 01:22:34.205272 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.204358 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/83e1fd53-fa87-472e-91cc-c15dfac10b11-ovnkube-config\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.205272 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.204382 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/83e1fd53-fa87-472e-91cc-c15dfac10b11-env-overrides\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.205272 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.204407 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d108b630-1a3c-42cf-83bc-0ebf39e40d89-etc-sysctl-conf\") pod \"tuned-42rnv\" (UID: \"d108b630-1a3c-42cf-83bc-0ebf39e40d89\") " pod="openshift-cluster-node-tuning-operator/tuned-42rnv" Jun 02 01:22:34.205272 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.204432 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d4tgk\" (UniqueName: \"kubernetes.io/projected/ea44904f-42c9-44c6-84d2-06d8daf3412c-kube-api-access-d4tgk\") pod \"network-check-target-gcs7z\" (UID: \"ea44904f-42c9-44c6-84d2-06d8daf3412c\") " pod="openshift-network-diagnostics/network-check-target-gcs7z" Jun 02 01:22:34.206095 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.204457 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/83e1fd53-fa87-472e-91cc-c15dfac10b11-host-slash\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.206095 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.204481 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/83e1fd53-fa87-472e-91cc-c15dfac10b11-host-cni-bin\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.206095 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.204507 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sfhn\" (UniqueName: \"kubernetes.io/projected/acb4caa8-8c43-4415-a21b-7c7a6d530fbf-kube-api-access-5sfhn\") pod \"aws-ebs-csi-driver-node-42bwv\" (UID: \"acb4caa8-8c43-4415-a21b-7c7a6d530fbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42bwv" Jun 02 01:22:34.206095 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.204547 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/585b1860-a049-4dc9-9dae-78a15997c822-cni-binary-copy\") pod \"multus-n22l6\" (UID: \"585b1860-a049-4dc9-9dae-78a15997c822\") " pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.206095 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.204553 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce15d2ed-5b70-4ef5-bc2c-bdd6c25be7d5-tmp-dir\") pod \"node-resolver-5tkrg\" (UID: \"ce15d2ed-5b70-4ef5-bc2c-bdd6c25be7d5\") " pod="openshift-dns/node-resolver-5tkrg" Jun 02 01:22:34.206095 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.204611 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/585b1860-a049-4dc9-9dae-78a15997c822-system-cni-dir\") pod \"multus-n22l6\" (UID: \"585b1860-a049-4dc9-9dae-78a15997c822\") " pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.206095 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.204644 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/585b1860-a049-4dc9-9dae-78a15997c822-os-release\") pod \"multus-n22l6\" (UID: \"585b1860-a049-4dc9-9dae-78a15997c822\") " pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.206095 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.204737 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d108b630-1a3c-42cf-83bc-0ebf39e40d89-etc-sysctl-conf\") pod \"tuned-42rnv\" (UID: \"d108b630-1a3c-42cf-83bc-0ebf39e40d89\") " pod="openshift-cluster-node-tuning-operator/tuned-42rnv" Jun 02 01:22:34.206095 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.204824 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/585b1860-a049-4dc9-9dae-78a15997c822-host-var-lib-cni-multus\") pod \"multus-n22l6\" (UID: \"585b1860-a049-4dc9-9dae-78a15997c822\") " pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.206095 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.205149 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f410a064-878f-4457-ad8e-f4456e889346-konnectivity-ca\") pod \"konnectivity-agent-lgtvp\" (UID: \"f410a064-878f-4457-ad8e-f4456e889346\") " pod="kube-system/konnectivity-agent-lgtvp" Jun 02 01:22:34.206095 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.205615 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f410a064-878f-4457-ad8e-f4456e889346-agent-certs\") pod \"konnectivity-agent-lgtvp\" (UID: \"f410a064-878f-4457-ad8e-f4456e889346\") " pod="kube-system/konnectivity-agent-lgtvp" Jun 02 01:22:34.206556 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.206538 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d108b630-1a3c-42cf-83bc-0ebf39e40d89-etc-tuned\") pod \"tuned-42rnv\" (UID: \"d108b630-1a3c-42cf-83bc-0ebf39e40d89\") " pod="openshift-cluster-node-tuning-operator/tuned-42rnv" Jun 02 01:22:34.206972 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.206950 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d108b630-1a3c-42cf-83bc-0ebf39e40d89-tmp\") pod \"tuned-42rnv\" (UID: \"d108b630-1a3c-42cf-83bc-0ebf39e40d89\") " pod="openshift-cluster-node-tuning-operator/tuned-42rnv" Jun 02 01:22:34.214186 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:34.214085 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:22:34.214186 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:34.214107 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:22:34.214186 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:34.214120 2559 projected.go:194] Error preparing data for projected volume kube-api-access-d4tgk for pod openshift-network-diagnostics/network-check-target-gcs7z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:22:34.214366 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:34.214197 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea44904f-42c9-44c6-84d2-06d8daf3412c-kube-api-access-d4tgk podName:ea44904f-42c9-44c6-84d2-06d8daf3412c nodeName:}" failed. No retries permitted until 2026-06-02 01:22:34.714178993 +0000 UTC m=+3.043813894 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-d4tgk" (UniqueName: "kubernetes.io/projected/ea44904f-42c9-44c6-84d2-06d8daf3412c-kube-api-access-d4tgk") pod "network-check-target-gcs7z" (UID: "ea44904f-42c9-44c6-84d2-06d8daf3412c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:22:34.215366 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.215338 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hms8\" (UniqueName: \"kubernetes.io/projected/864222f2-b558-4380-b095-b1f285e5b91c-kube-api-access-7hms8\") pod \"multus-additional-cni-plugins-nqdhn\" (UID: \"864222f2-b558-4380-b095-b1f285e5b91c\") " pod="openshift-multus/multus-additional-cni-plugins-nqdhn" Jun 02 01:22:34.217096 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.217076 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8vbt\" (UniqueName: \"kubernetes.io/projected/564c53f1-521a-42b2-8353-80c10ff44bb2-kube-api-access-w8vbt\") pod \"network-metrics-daemon-96l4l\" (UID: \"564c53f1-521a-42b2-8353-80c10ff44bb2\") " pod="openshift-multus/network-metrics-daemon-96l4l" Jun 02 01:22:34.217353 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.217301 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxzpv\" (UniqueName: \"kubernetes.io/projected/ce15d2ed-5b70-4ef5-bc2c-bdd6c25be7d5-kube-api-access-qxzpv\") pod \"node-resolver-5tkrg\" (UID: \"ce15d2ed-5b70-4ef5-bc2c-bdd6c25be7d5\") " pod="openshift-dns/node-resolver-5tkrg" Jun 02 01:22:34.217420 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.217385 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nw5nf\" (UniqueName: \"kubernetes.io/projected/d108b630-1a3c-42cf-83bc-0ebf39e40d89-kube-api-access-nw5nf\") pod \"tuned-42rnv\" (UID: \"d108b630-1a3c-42cf-83bc-0ebf39e40d89\") " pod="openshift-cluster-node-tuning-operator/tuned-42rnv" Jun 02 01:22:34.218297 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.218271 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55zxd\" (UniqueName: \"kubernetes.io/projected/585b1860-a049-4dc9-9dae-78a15997c822-kube-api-access-55zxd\") pod \"multus-n22l6\" (UID: \"585b1860-a049-4dc9-9dae-78a15997c822\") " pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.218849 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.218808 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvbgd\" (UniqueName: \"kubernetes.io/projected/764af020-fd61-4df1-85d0-0e7d749a686a-kube-api-access-lvbgd\") pod \"iptables-alerter-rgnz6\" (UID: \"764af020-fd61-4df1-85d0-0e7d749a686a\") " pod="openshift-network-operator/iptables-alerter-rgnz6" Jun 02 01:22:34.219288 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.219272 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4z28\" (UniqueName: \"kubernetes.io/projected/4449e4e0-b633-4914-a364-3a22b3408589-kube-api-access-b4z28\") pod \"node-ca-7xkdt\" (UID: \"4449e4e0-b633-4914-a364-3a22b3408589\") " pod="openshift-image-registry/node-ca-7xkdt" Jun 02 01:22:34.233326 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.233261 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-179.ec2.internal" event={"ID":"8c8b5362a872b75803160058f4454c9c","Type":"ContainerStarted","Data":"29ef3a746f67837348fdb2772a9b60e02d4c47b259d9ea02b002b0b7578eca28"} Jun 02 01:22:34.234732 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.234695 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-179.ec2.internal" event={"ID":"d4741659fb407ec36ac08d8abc23301e","Type":"ContainerStarted","Data":"a8ff9e0ef2bd4cc2889aaa8ce43c93be419787b8d3ff5a2de9740dc059586527"} Jun 02 01:22:34.305638 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.305604 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/acb4caa8-8c43-4415-a21b-7c7a6d530fbf-sys-fs\") pod \"aws-ebs-csi-driver-node-42bwv\" (UID: \"acb4caa8-8c43-4415-a21b-7c7a6d530fbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42bwv" Jun 02 01:22:34.305638 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.305643 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/83e1fd53-fa87-472e-91cc-c15dfac10b11-run-systemd\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.305638 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.305661 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/acb4caa8-8c43-4415-a21b-7c7a6d530fbf-registration-dir\") pod \"aws-ebs-csi-driver-node-42bwv\" (UID: \"acb4caa8-8c43-4415-a21b-7c7a6d530fbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42bwv" Jun 02 01:22:34.305950 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.305676 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/acb4caa8-8c43-4415-a21b-7c7a6d530fbf-device-dir\") pod \"aws-ebs-csi-driver-node-42bwv\" (UID: \"acb4caa8-8c43-4415-a21b-7c7a6d530fbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42bwv" Jun 02 01:22:34.305950 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.305693 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/83e1fd53-fa87-472e-91cc-c15dfac10b11-systemd-units\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.305950 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.305714 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/83e1fd53-fa87-472e-91cc-c15dfac10b11-log-socket\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.305950 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.305745 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-55lq5\" (UniqueName: \"kubernetes.io/projected/83e1fd53-fa87-472e-91cc-c15dfac10b11-kube-api-access-55lq5\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.305950 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.305745 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/83e1fd53-fa87-472e-91cc-c15dfac10b11-run-systemd\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.305950 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.305760 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/acb4caa8-8c43-4415-a21b-7c7a6d530fbf-device-dir\") pod \"aws-ebs-csi-driver-node-42bwv\" (UID: \"acb4caa8-8c43-4415-a21b-7c7a6d530fbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42bwv" Jun 02 01:22:34.305950 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.305770 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/acb4caa8-8c43-4415-a21b-7c7a6d530fbf-etc-selinux\") pod \"aws-ebs-csi-driver-node-42bwv\" (UID: \"acb4caa8-8c43-4415-a21b-7c7a6d530fbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42bwv" Jun 02 01:22:34.305950 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.305753 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/acb4caa8-8c43-4415-a21b-7c7a6d530fbf-registration-dir\") pod \"aws-ebs-csi-driver-node-42bwv\" (UID: \"acb4caa8-8c43-4415-a21b-7c7a6d530fbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42bwv" Jun 02 01:22:34.305950 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.305785 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/83e1fd53-fa87-472e-91cc-c15dfac10b11-systemd-units\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.305950 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.305787 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/83e1fd53-fa87-472e-91cc-c15dfac10b11-log-socket\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.305950 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.305749 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/acb4caa8-8c43-4415-a21b-7c7a6d530fbf-sys-fs\") pod \"aws-ebs-csi-driver-node-42bwv\" (UID: \"acb4caa8-8c43-4415-a21b-7c7a6d530fbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42bwv" Jun 02 01:22:34.305950 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.305822 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83e1fd53-fa87-472e-91cc-c15dfac10b11-var-lib-openvswitch\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.305950 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.305863 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/83e1fd53-fa87-472e-91cc-c15dfac10b11-host-cni-netd\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.305950 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.305870 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83e1fd53-fa87-472e-91cc-c15dfac10b11-var-lib-openvswitch\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.305950 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.305891 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83e1fd53-fa87-472e-91cc-c15dfac10b11-etc-openvswitch\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.305950 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.305896 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/acb4caa8-8c43-4415-a21b-7c7a6d530fbf-etc-selinux\") pod \"aws-ebs-csi-driver-node-42bwv\" (UID: \"acb4caa8-8c43-4415-a21b-7c7a6d530fbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42bwv" Jun 02 01:22:34.305950 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.305910 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/83e1fd53-fa87-472e-91cc-c15dfac10b11-host-cni-netd\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.306820 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.305916 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83e1fd53-fa87-472e-91cc-c15dfac10b11-host-run-ovn-kubernetes\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.306820 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.305937 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83e1fd53-fa87-472e-91cc-c15dfac10b11-etc-openvswitch\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.306820 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.305950 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/83e1fd53-fa87-472e-91cc-c15dfac10b11-ovnkube-config\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.306820 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.305971 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/83e1fd53-fa87-472e-91cc-c15dfac10b11-env-overrides\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.306820 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.305974 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83e1fd53-fa87-472e-91cc-c15dfac10b11-host-run-ovn-kubernetes\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.306820 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.306001 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/83e1fd53-fa87-472e-91cc-c15dfac10b11-host-slash\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.306820 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.306022 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/83e1fd53-fa87-472e-91cc-c15dfac10b11-host-cni-bin\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.306820 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.306058 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/83e1fd53-fa87-472e-91cc-c15dfac10b11-host-slash\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.306820 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.306305 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5sfhn\" (UniqueName: \"kubernetes.io/projected/acb4caa8-8c43-4415-a21b-7c7a6d530fbf-kube-api-access-5sfhn\") pod \"aws-ebs-csi-driver-node-42bwv\" (UID: \"acb4caa8-8c43-4415-a21b-7c7a6d530fbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42bwv" Jun 02 01:22:34.306820 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.306402 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/83e1fd53-fa87-472e-91cc-c15dfac10b11-host-kubelet\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.306820 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.306435 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/83e1fd53-fa87-472e-91cc-c15dfac10b11-host-run-netns\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.306820 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.306468 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83e1fd53-fa87-472e-91cc-c15dfac10b11-run-openvswitch\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.306820 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.306498 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/83e1fd53-fa87-472e-91cc-c15dfac10b11-ovn-node-metrics-cert\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.306820 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.306530 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/83e1fd53-fa87-472e-91cc-c15dfac10b11-ovnkube-script-lib\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.306820 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.306564 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/acb4caa8-8c43-4415-a21b-7c7a6d530fbf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-42bwv\" (UID: \"acb4caa8-8c43-4415-a21b-7c7a6d530fbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42bwv" Jun 02 01:22:34.306820 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.306601 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/83e1fd53-fa87-472e-91cc-c15dfac10b11-run-ovn\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.306820 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.306632 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/acb4caa8-8c43-4415-a21b-7c7a6d530fbf-socket-dir\") pod \"aws-ebs-csi-driver-node-42bwv\" (UID: \"acb4caa8-8c43-4415-a21b-7c7a6d530fbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42bwv" Jun 02 01:22:34.307773 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.306662 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/83e1fd53-fa87-472e-91cc-c15dfac10b11-node-log\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.307773 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.306694 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83e1fd53-fa87-472e-91cc-c15dfac10b11-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.307773 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.306781 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/83e1fd53-fa87-472e-91cc-c15dfac10b11-env-overrides\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.307773 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.306796 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83e1fd53-fa87-472e-91cc-c15dfac10b11-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.307773 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.306801 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/83e1fd53-fa87-472e-91cc-c15dfac10b11-ovnkube-config\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.307773 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.307066 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/83e1fd53-fa87-472e-91cc-c15dfac10b11-host-kubelet\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.307773 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.307463 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/83e1fd53-fa87-472e-91cc-c15dfac10b11-run-ovn\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.307773 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.307548 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/83e1fd53-fa87-472e-91cc-c15dfac10b11-host-cni-bin\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.307773 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.307567 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/acb4caa8-8c43-4415-a21b-7c7a6d530fbf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-42bwv\" (UID: \"acb4caa8-8c43-4415-a21b-7c7a6d530fbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42bwv" Jun 02 01:22:34.307773 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.307605 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/83e1fd53-fa87-472e-91cc-c15dfac10b11-node-log\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.307773 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.307607 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/83e1fd53-fa87-472e-91cc-c15dfac10b11-host-run-netns\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.307773 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.307706 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/acb4caa8-8c43-4415-a21b-7c7a6d530fbf-socket-dir\") pod \"aws-ebs-csi-driver-node-42bwv\" (UID: \"acb4caa8-8c43-4415-a21b-7c7a6d530fbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42bwv" Jun 02 01:22:34.310144 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.307820 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83e1fd53-fa87-472e-91cc-c15dfac10b11-run-openvswitch\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.310144 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.308032 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/83e1fd53-fa87-472e-91cc-c15dfac10b11-ovnkube-script-lib\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.311361 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.311338 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/83e1fd53-fa87-472e-91cc-c15dfac10b11-ovn-node-metrics-cert\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.313294 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.313271 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55lq5\" (UniqueName: \"kubernetes.io/projected/83e1fd53-fa87-472e-91cc-c15dfac10b11-kube-api-access-55lq5\") pod \"ovnkube-node-9jfrv\" (UID: \"83e1fd53-fa87-472e-91cc-c15dfac10b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.314703 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.314683 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sfhn\" (UniqueName: \"kubernetes.io/projected/acb4caa8-8c43-4415-a21b-7c7a6d530fbf-kube-api-access-5sfhn\") pod \"aws-ebs-csi-driver-node-42bwv\" (UID: \"acb4caa8-8c43-4415-a21b-7c7a6d530fbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42bwv" Jun 02 01:22:34.388336 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.388246 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7xkdt" Jun 02 01:22:34.396150 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.396116 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nqdhn" Jun 02 01:22:34.405624 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.405592 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n22l6" Jun 02 01:22:34.413428 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.413406 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lgtvp" Jun 02 01:22:34.426864 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.426828 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rgnz6" Jun 02 01:22:34.432464 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.432446 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-42rnv" Jun 02 01:22:34.439978 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.439958 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5tkrg" Jun 02 01:22:34.447596 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.447579 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:22:34.463267 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.463243 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42bwv" Jun 02 01:22:34.710163 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.710078 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/564c53f1-521a-42b2-8353-80c10ff44bb2-metrics-certs\") pod \"network-metrics-daemon-96l4l\" (UID: \"564c53f1-521a-42b2-8353-80c10ff44bb2\") " pod="openshift-multus/network-metrics-daemon-96l4l" Jun 02 01:22:34.710303 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:34.710224 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:22:34.710303 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:34.710298 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/564c53f1-521a-42b2-8353-80c10ff44bb2-metrics-certs podName:564c53f1-521a-42b2-8353-80c10ff44bb2 nodeName:}" failed. No retries permitted until 2026-06-02 01:22:35.71027912 +0000 UTC m=+4.039914026 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/564c53f1-521a-42b2-8353-80c10ff44bb2-metrics-certs") pod "network-metrics-daemon-96l4l" (UID: "564c53f1-521a-42b2-8353-80c10ff44bb2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:22:34.778730 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:34.778698 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacb4caa8_8c43_4415_a21b_7c7a6d530fbf.slice/crio-e468bf7b348d473de09d3935a77f78b372c163006072e671f1222c791f042ca4 WatchSource:0}: Error finding container e468bf7b348d473de09d3935a77f78b372c163006072e671f1222c791f042ca4: Status 404 returned error can't find the container with id e468bf7b348d473de09d3935a77f78b372c163006072e671f1222c791f042ca4 Jun 02 01:22:34.783078 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:34.783012 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod585b1860_a049_4dc9_9dae_78a15997c822.slice/crio-628ba2549902b9e2329071156cd3cdd90c59722bdb3c70112bea67cb07e164ae WatchSource:0}: Error finding container 628ba2549902b9e2329071156cd3cdd90c59722bdb3c70112bea67cb07e164ae: Status 404 returned error can't find the container with id 628ba2549902b9e2329071156cd3cdd90c59722bdb3c70112bea67cb07e164ae Jun 02 01:22:34.785350 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:34.785321 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod864222f2_b558_4380_b095_b1f285e5b91c.slice/crio-45111b2f784ac162962cd2b87a21007aed89c874875d964136488736935923e5 WatchSource:0}: Error finding container 45111b2f784ac162962cd2b87a21007aed89c874875d964136488736935923e5: Status 404 returned error can't find the container with id 45111b2f784ac162962cd2b87a21007aed89c874875d964136488736935923e5 Jun 02 01:22:34.786249 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:34.786229 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf410a064_878f_4457_ad8e_f4456e889346.slice/crio-3d011d07daac173e918750d84bb09652d41dae967b187961a2640d78e8d6d6da WatchSource:0}: Error finding container 3d011d07daac173e918750d84bb09652d41dae967b187961a2640d78e8d6d6da: Status 404 returned error can't find the container with id 3d011d07daac173e918750d84bb09652d41dae967b187961a2640d78e8d6d6da Jun 02 01:22:34.786826 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:34.786795 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4449e4e0_b633_4914_a364_3a22b3408589.slice/crio-44ad2376b7b13b41d29173f0c00abff36d3c1f42e7ec8e3d957f88bba47f2ec5 WatchSource:0}: Error finding container 44ad2376b7b13b41d29173f0c00abff36d3c1f42e7ec8e3d957f88bba47f2ec5: Status 404 returned error can't find the container with id 44ad2376b7b13b41d29173f0c00abff36d3c1f42e7ec8e3d957f88bba47f2ec5 Jun 02 01:22:34.787766 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:34.787745 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83e1fd53_fa87_472e_91cc_c15dfac10b11.slice/crio-3076107b06315b29c8277f183728325414aa3416098ead49de7cf95964b27f52 WatchSource:0}: Error finding container 3076107b06315b29c8277f183728325414aa3416098ead49de7cf95964b27f52: Status 404 returned error can't find the container with id 3076107b06315b29c8277f183728325414aa3416098ead49de7cf95964b27f52 Jun 02 01:22:34.789143 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:34.789024 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce15d2ed_5b70_4ef5_bc2c_bdd6c25be7d5.slice/crio-1c994b5c2a10e84706b239e7c43a5358f4afcb1119ed373bb6a0e2145d938d0c WatchSource:0}: Error finding container 1c994b5c2a10e84706b239e7c43a5358f4afcb1119ed373bb6a0e2145d938d0c: Status 404 returned error can't find the container with id 1c994b5c2a10e84706b239e7c43a5358f4afcb1119ed373bb6a0e2145d938d0c Jun 02 01:22:34.790058 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:22:34.790037 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod764af020_fd61_4df1_85d0_0e7d749a686a.slice/crio-f5070b3d527542bd02b520efa779d27dcc36a445458c832082c1a913ac5bd741 WatchSource:0}: Error finding container f5070b3d527542bd02b520efa779d27dcc36a445458c832082c1a913ac5bd741: Status 404 returned error can't find the container with id f5070b3d527542bd02b520efa779d27dcc36a445458c832082c1a913ac5bd741 Jun 02 01:22:34.810699 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:34.810677 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d4tgk\" (UniqueName: \"kubernetes.io/projected/ea44904f-42c9-44c6-84d2-06d8daf3412c-kube-api-access-d4tgk\") pod \"network-check-target-gcs7z\" (UID: \"ea44904f-42c9-44c6-84d2-06d8daf3412c\") " pod="openshift-network-diagnostics/network-check-target-gcs7z" Jun 02 01:22:34.810824 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:34.810810 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:22:34.810914 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:34.810849 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:22:34.810914 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:34.810863 2559 projected.go:194] Error preparing data for projected volume kube-api-access-d4tgk for pod openshift-network-diagnostics/network-check-target-gcs7z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:22:34.810914 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:34.810909 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea44904f-42c9-44c6-84d2-06d8daf3412c-kube-api-access-d4tgk podName:ea44904f-42c9-44c6-84d2-06d8daf3412c nodeName:}" failed. No retries permitted until 2026-06-02 01:22:35.81089494 +0000 UTC m=+4.140529837 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-d4tgk" (UniqueName: "kubernetes.io/projected/ea44904f-42c9-44c6-84d2-06d8daf3412c-kube-api-access-d4tgk") pod "network-check-target-gcs7z" (UID: "ea44904f-42c9-44c6-84d2-06d8daf3412c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:22:35.165552 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:35.165218 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 01:17:33 +0000 UTC" deadline="2027-12-08 21:49:30.079880794 +0000 UTC" Jun 02 01:22:35.165552 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:35.165466 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13316h26m54.914420749s" Jun 02 01:22:35.243270 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:35.243230 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-179.ec2.internal" event={"ID":"d4741659fb407ec36ac08d8abc23301e","Type":"ContainerStarted","Data":"4a57390dcc3b7e610bd9aa17fd182fffffa36d58708937d0789a05d875b02304"} Jun 02 01:22:35.244239 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:35.244213 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" event={"ID":"83e1fd53-fa87-472e-91cc-c15dfac10b11","Type":"ContainerStarted","Data":"3076107b06315b29c8277f183728325414aa3416098ead49de7cf95964b27f52"} Jun 02 01:22:35.245332 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:35.245310 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nqdhn" event={"ID":"864222f2-b558-4380-b095-b1f285e5b91c","Type":"ContainerStarted","Data":"45111b2f784ac162962cd2b87a21007aed89c874875d964136488736935923e5"} Jun 02 01:22:35.246315 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:35.246279 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n22l6" event={"ID":"585b1860-a049-4dc9-9dae-78a15997c822","Type":"ContainerStarted","Data":"628ba2549902b9e2329071156cd3cdd90c59722bdb3c70112bea67cb07e164ae"} Jun 02 01:22:35.247289 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:35.247272 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-42rnv" event={"ID":"d108b630-1a3c-42cf-83bc-0ebf39e40d89","Type":"ContainerStarted","Data":"3d0109607b5811a14f20fbb19e57c0b75af7c0be331729b96805df6060077c0c"} Jun 02 01:22:35.248224 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:35.248206 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rgnz6" event={"ID":"764af020-fd61-4df1-85d0-0e7d749a686a","Type":"ContainerStarted","Data":"f5070b3d527542bd02b520efa779d27dcc36a445458c832082c1a913ac5bd741"} Jun 02 01:22:35.249135 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:35.249116 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5tkrg" event={"ID":"ce15d2ed-5b70-4ef5-bc2c-bdd6c25be7d5","Type":"ContainerStarted","Data":"1c994b5c2a10e84706b239e7c43a5358f4afcb1119ed373bb6a0e2145d938d0c"} Jun 02 01:22:35.249993 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:35.249975 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7xkdt" event={"ID":"4449e4e0-b633-4914-a364-3a22b3408589","Type":"ContainerStarted","Data":"44ad2376b7b13b41d29173f0c00abff36d3c1f42e7ec8e3d957f88bba47f2ec5"} Jun 02 01:22:35.251002 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:35.250973 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lgtvp" event={"ID":"f410a064-878f-4457-ad8e-f4456e889346","Type":"ContainerStarted","Data":"3d011d07daac173e918750d84bb09652d41dae967b187961a2640d78e8d6d6da"} Jun 02 01:22:35.251859 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:35.251819 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42bwv" event={"ID":"acb4caa8-8c43-4415-a21b-7c7a6d530fbf","Type":"ContainerStarted","Data":"e468bf7b348d473de09d3935a77f78b372c163006072e671f1222c791f042ca4"} Jun 02 01:22:35.717750 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:35.717708 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/564c53f1-521a-42b2-8353-80c10ff44bb2-metrics-certs\") pod \"network-metrics-daemon-96l4l\" (UID: \"564c53f1-521a-42b2-8353-80c10ff44bb2\") " pod="openshift-multus/network-metrics-daemon-96l4l" Jun 02 01:22:35.717967 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:35.717946 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:22:35.718031 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:35.718019 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/564c53f1-521a-42b2-8353-80c10ff44bb2-metrics-certs podName:564c53f1-521a-42b2-8353-80c10ff44bb2 nodeName:}" failed. No retries permitted until 2026-06-02 01:22:37.718000933 +0000 UTC m=+6.047635849 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/564c53f1-521a-42b2-8353-80c10ff44bb2-metrics-certs") pod "network-metrics-daemon-96l4l" (UID: "564c53f1-521a-42b2-8353-80c10ff44bb2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:22:35.759167 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:35.758825 2559 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:22:35.818945 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:35.818640 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d4tgk\" (UniqueName: \"kubernetes.io/projected/ea44904f-42c9-44c6-84d2-06d8daf3412c-kube-api-access-d4tgk\") pod \"network-check-target-gcs7z\" (UID: \"ea44904f-42c9-44c6-84d2-06d8daf3412c\") " pod="openshift-network-diagnostics/network-check-target-gcs7z" Jun 02 01:22:35.818945 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:35.818797 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:22:35.818945 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:35.818817 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:22:35.818945 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:35.818848 2559 projected.go:194] Error preparing data for projected volume kube-api-access-d4tgk for pod openshift-network-diagnostics/network-check-target-gcs7z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:22:35.818945 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:35.818905 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea44904f-42c9-44c6-84d2-06d8daf3412c-kube-api-access-d4tgk podName:ea44904f-42c9-44c6-84d2-06d8daf3412c nodeName:}" failed. No retries permitted until 2026-06-02 01:22:37.818887689 +0000 UTC m=+6.148522586 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-d4tgk" (UniqueName: "kubernetes.io/projected/ea44904f-42c9-44c6-84d2-06d8daf3412c-kube-api-access-d4tgk") pod "network-check-target-gcs7z" (UID: "ea44904f-42c9-44c6-84d2-06d8daf3412c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:22:36.228821 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:36.228736 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-96l4l" Jun 02 01:22:36.229287 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:36.228906 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-96l4l" podUID="564c53f1-521a-42b2-8353-80c10ff44bb2" Jun 02 01:22:36.231575 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:36.231543 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gcs7z" Jun 02 01:22:36.231692 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:36.231648 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gcs7z" podUID="ea44904f-42c9-44c6-84d2-06d8daf3412c" Jun 02 01:22:36.270725 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:36.270594 2559 generic.go:358] "Generic (PLEG): container finished" podID="8c8b5362a872b75803160058f4454c9c" containerID="f06b368bce469fa5473ad30e09f51b51c26834797e23e8a686d31ee21c2b3c67" exitCode=0 Jun 02 01:22:36.270725 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:36.270737 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-179.ec2.internal" event={"ID":"8c8b5362a872b75803160058f4454c9c","Type":"ContainerDied","Data":"f06b368bce469fa5473ad30e09f51b51c26834797e23e8a686d31ee21c2b3c67"} Jun 02 01:22:36.289214 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:36.288372 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-179.ec2.internal" podStartSLOduration=3.288353379 podStartE2EDuration="3.288353379s" podCreationTimestamp="2026-06-02 01:22:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:22:35.25551699 +0000 UTC m=+3.585151921" watchObservedRunningTime="2026-06-02 01:22:36.288353379 +0000 UTC m=+4.617988298" Jun 02 01:22:37.313810 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:37.313748 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-179.ec2.internal" event={"ID":"8c8b5362a872b75803160058f4454c9c","Type":"ContainerStarted","Data":"61b69e084d4d6178d420e7a6a9d82c933d4e37631c443ad7ed69ebb62cdca8e9"} Jun 02 01:22:37.328416 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:37.328361 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-179.ec2.internal" podStartSLOduration=4.328342863 podStartE2EDuration="4.328342863s" podCreationTimestamp="2026-06-02 01:22:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:22:37.327984485 +0000 UTC m=+5.657619405" watchObservedRunningTime="2026-06-02 01:22:37.328342863 +0000 UTC m=+5.657977784" Jun 02 01:22:37.733698 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:37.733611 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/564c53f1-521a-42b2-8353-80c10ff44bb2-metrics-certs\") pod \"network-metrics-daemon-96l4l\" (UID: \"564c53f1-521a-42b2-8353-80c10ff44bb2\") " pod="openshift-multus/network-metrics-daemon-96l4l" Jun 02 01:22:37.733894 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:37.733770 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:22:37.733894 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:37.733853 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/564c53f1-521a-42b2-8353-80c10ff44bb2-metrics-certs podName:564c53f1-521a-42b2-8353-80c10ff44bb2 nodeName:}" failed. No retries permitted until 2026-06-02 01:22:41.733817381 +0000 UTC m=+10.063452292 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/564c53f1-521a-42b2-8353-80c10ff44bb2-metrics-certs") pod "network-metrics-daemon-96l4l" (UID: "564c53f1-521a-42b2-8353-80c10ff44bb2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:22:37.835315 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:37.834628 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d4tgk\" (UniqueName: \"kubernetes.io/projected/ea44904f-42c9-44c6-84d2-06d8daf3412c-kube-api-access-d4tgk\") pod \"network-check-target-gcs7z\" (UID: \"ea44904f-42c9-44c6-84d2-06d8daf3412c\") " pod="openshift-network-diagnostics/network-check-target-gcs7z" Jun 02 01:22:37.835315 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:37.834859 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:22:37.835315 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:37.834879 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:22:37.835315 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:37.834892 2559 projected.go:194] Error preparing data for projected volume kube-api-access-d4tgk for pod openshift-network-diagnostics/network-check-target-gcs7z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:22:37.835315 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:37.834952 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea44904f-42c9-44c6-84d2-06d8daf3412c-kube-api-access-d4tgk podName:ea44904f-42c9-44c6-84d2-06d8daf3412c nodeName:}" failed. No retries permitted until 2026-06-02 01:22:41.834932648 +0000 UTC m=+10.164567564 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-d4tgk" (UniqueName: "kubernetes.io/projected/ea44904f-42c9-44c6-84d2-06d8daf3412c-kube-api-access-d4tgk") pod "network-check-target-gcs7z" (UID: "ea44904f-42c9-44c6-84d2-06d8daf3412c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:22:38.228006 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:38.227929 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gcs7z" Jun 02 01:22:38.228172 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:38.228067 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gcs7z" podUID="ea44904f-42c9-44c6-84d2-06d8daf3412c" Jun 02 01:22:38.231384 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:38.231185 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-96l4l" Jun 02 01:22:38.231384 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:38.231313 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-96l4l" podUID="564c53f1-521a-42b2-8353-80c10ff44bb2" Jun 02 01:22:40.229058 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:40.229020 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gcs7z" Jun 02 01:22:40.229528 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:40.229150 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gcs7z" podUID="ea44904f-42c9-44c6-84d2-06d8daf3412c" Jun 02 01:22:40.229597 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:40.229565 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-96l4l" Jun 02 01:22:40.229687 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:40.229666 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-96l4l" podUID="564c53f1-521a-42b2-8353-80c10ff44bb2" Jun 02 01:22:41.767326 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:41.767280 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/564c53f1-521a-42b2-8353-80c10ff44bb2-metrics-certs\") pod \"network-metrics-daemon-96l4l\" (UID: \"564c53f1-521a-42b2-8353-80c10ff44bb2\") " pod="openshift-multus/network-metrics-daemon-96l4l" Jun 02 01:22:41.767768 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:41.767434 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:22:41.767768 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:41.767493 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/564c53f1-521a-42b2-8353-80c10ff44bb2-metrics-certs podName:564c53f1-521a-42b2-8353-80c10ff44bb2 nodeName:}" failed. No retries permitted until 2026-06-02 01:22:49.767479621 +0000 UTC m=+18.097114519 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/564c53f1-521a-42b2-8353-80c10ff44bb2-metrics-certs") pod "network-metrics-daemon-96l4l" (UID: "564c53f1-521a-42b2-8353-80c10ff44bb2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:22:41.868162 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:41.868108 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d4tgk\" (UniqueName: \"kubernetes.io/projected/ea44904f-42c9-44c6-84d2-06d8daf3412c-kube-api-access-d4tgk\") pod \"network-check-target-gcs7z\" (UID: \"ea44904f-42c9-44c6-84d2-06d8daf3412c\") " pod="openshift-network-diagnostics/network-check-target-gcs7z" Jun 02 01:22:41.868348 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:41.868277 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:22:41.868348 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:41.868298 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:22:41.868348 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:41.868310 2559 projected.go:194] Error preparing data for projected volume kube-api-access-d4tgk for pod openshift-network-diagnostics/network-check-target-gcs7z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:22:41.868481 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:41.868374 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea44904f-42c9-44c6-84d2-06d8daf3412c-kube-api-access-d4tgk podName:ea44904f-42c9-44c6-84d2-06d8daf3412c nodeName:}" failed. No retries permitted until 2026-06-02 01:22:49.868359171 +0000 UTC m=+18.197994072 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-d4tgk" (UniqueName: "kubernetes.io/projected/ea44904f-42c9-44c6-84d2-06d8daf3412c-kube-api-access-d4tgk") pod "network-check-target-gcs7z" (UID: "ea44904f-42c9-44c6-84d2-06d8daf3412c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:22:42.229378 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:42.229260 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-96l4l" Jun 02 01:22:42.229535 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:42.229386 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-96l4l" podUID="564c53f1-521a-42b2-8353-80c10ff44bb2" Jun 02 01:22:42.229535 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:42.229448 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gcs7z" Jun 02 01:22:42.229828 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:42.229611 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gcs7z" podUID="ea44904f-42c9-44c6-84d2-06d8daf3412c" Jun 02 01:22:44.228563 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:44.228529 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gcs7z" Jun 02 01:22:44.229028 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:44.228535 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-96l4l" Jun 02 01:22:44.229028 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:44.228663 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gcs7z" podUID="ea44904f-42c9-44c6-84d2-06d8daf3412c" Jun 02 01:22:44.229028 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:44.228768 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-96l4l" podUID="564c53f1-521a-42b2-8353-80c10ff44bb2" Jun 02 01:22:45.333276 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:45.333107 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42bwv" event={"ID":"acb4caa8-8c43-4415-a21b-7c7a6d530fbf","Type":"ContainerStarted","Data":"300a549882442637bda60eff557aa898801f884b59fea85a1d526f8f98e9383d"} Jun 02 01:22:45.334870 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:45.334822 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nqdhn" event={"ID":"864222f2-b558-4380-b095-b1f285e5b91c","Type":"ContainerStarted","Data":"35043cbcc280574aaa09556ff0898bf991db40cf3a7af5ae1bb30087a5d0dd2d"} Jun 02 01:22:45.336761 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:45.336739 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-42rnv" event={"ID":"d108b630-1a3c-42cf-83bc-0ebf39e40d89","Type":"ContainerStarted","Data":"210fcb2b92959f23031f16f358bc89dee0a29f8537aebe481583ba97bc5d22e2"} Jun 02 01:22:45.338777 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:45.338752 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5tkrg" event={"ID":"ce15d2ed-5b70-4ef5-bc2c-bdd6c25be7d5","Type":"ContainerStarted","Data":"22aa8c2686ef2c5b42d01d71c5643edcf423ece0a7112794147d5768f9a47866"} Jun 02 01:22:45.340950 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:45.340553 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7xkdt" event={"ID":"4449e4e0-b633-4914-a364-3a22b3408589","Type":"ContainerStarted","Data":"7450986c39ed9414da4f718e72d1129cd4fcd0f1fa4019416060af9fd991407d"} Jun 02 01:22:45.342273 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:45.342096 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lgtvp" event={"ID":"f410a064-878f-4457-ad8e-f4456e889346","Type":"ContainerStarted","Data":"eabd352cd0e964dcccd278d02758f31cd5be3cb5b7b28015a736431767a4a375"} Jun 02 01:22:45.374888 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:45.374451 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-5tkrg" podStartSLOduration=3.128715977 podStartE2EDuration="13.374437887s" podCreationTimestamp="2026-06-02 01:22:32 +0000 UTC" firstStartedPulling="2026-06-02 01:22:34.791020486 +0000 UTC m=+3.120655386" lastFinishedPulling="2026-06-02 01:22:45.036742396 +0000 UTC m=+13.366377296" observedRunningTime="2026-06-02 01:22:45.37424317 +0000 UTC m=+13.703878164" watchObservedRunningTime="2026-06-02 01:22:45.374437887 +0000 UTC m=+13.704072805" Jun 02 01:22:45.374888 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:45.374699 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-42rnv" podStartSLOduration=3.066336888 podStartE2EDuration="13.374694027s" podCreationTimestamp="2026-06-02 01:22:32 +0000 UTC" firstStartedPulling="2026-06-02 01:22:34.782634061 +0000 UTC m=+3.112268975" lastFinishedPulling="2026-06-02 01:22:45.09099121 +0000 UTC m=+13.420626114" observedRunningTime="2026-06-02 01:22:45.363141635 +0000 UTC m=+13.692776557" watchObservedRunningTime="2026-06-02 01:22:45.374694027 +0000 UTC m=+13.704328957" Jun 02 01:22:45.391483 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:45.391435 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7xkdt" podStartSLOduration=3.149328081 podStartE2EDuration="13.391420789s" podCreationTimestamp="2026-06-02 01:22:32 +0000 UTC" firstStartedPulling="2026-06-02 01:22:34.789227022 +0000 UTC m=+3.118861928" lastFinishedPulling="2026-06-02 01:22:45.031319733 +0000 UTC m=+13.360954636" observedRunningTime="2026-06-02 01:22:45.391090382 +0000 UTC m=+13.720725303" watchObservedRunningTime="2026-06-02 01:22:45.391420789 +0000 UTC m=+13.721055718" Jun 02 01:22:45.411496 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:45.411436 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lgtvp" podStartSLOduration=3.173267105 podStartE2EDuration="13.411418301s" podCreationTimestamp="2026-06-02 01:22:32 +0000 UTC" firstStartedPulling="2026-06-02 01:22:34.788015874 +0000 UTC m=+3.117650772" lastFinishedPulling="2026-06-02 01:22:45.02616705 +0000 UTC m=+13.355801968" observedRunningTime="2026-06-02 01:22:45.41059409 +0000 UTC m=+13.740229009" watchObservedRunningTime="2026-06-02 01:22:45.411418301 +0000 UTC m=+13.741053238" Jun 02 01:22:46.228497 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:46.228401 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gcs7z" Jun 02 01:22:46.228637 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:46.228401 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-96l4l" Jun 02 01:22:46.228637 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:46.228547 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gcs7z" podUID="ea44904f-42c9-44c6-84d2-06d8daf3412c" Jun 02 01:22:46.228637 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:46.228617 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-96l4l" podUID="564c53f1-521a-42b2-8353-80c10ff44bb2" Jun 02 01:22:46.345183 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:46.345142 2559 generic.go:358] "Generic (PLEG): container finished" podID="864222f2-b558-4380-b095-b1f285e5b91c" containerID="35043cbcc280574aaa09556ff0898bf991db40cf3a7af5ae1bb30087a5d0dd2d" exitCode=0 Jun 02 01:22:46.345750 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:46.345282 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nqdhn" event={"ID":"864222f2-b558-4380-b095-b1f285e5b91c","Type":"ContainerDied","Data":"35043cbcc280574aaa09556ff0898bf991db40cf3a7af5ae1bb30087a5d0dd2d"} Jun 02 01:22:47.042680 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:47.042646 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lgtvp" Jun 02 01:22:47.043141 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:47.043121 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lgtvp" Jun 02 01:22:47.349065 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:47.348977 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rgnz6" event={"ID":"764af020-fd61-4df1-85d0-0e7d749a686a","Type":"ContainerStarted","Data":"1dc795855cd3ba14d48386d76abe62fbb0dce0f2a5031bd283d1850d4f443515"} Jun 02 01:22:47.362515 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:47.362456 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rgnz6" podStartSLOduration=5.125178805 podStartE2EDuration="15.362437321s" podCreationTimestamp="2026-06-02 01:22:32 +0000 UTC" firstStartedPulling="2026-06-02 01:22:34.792143802 +0000 UTC m=+3.121778699" lastFinishedPulling="2026-06-02 01:22:45.029402315 +0000 UTC m=+13.359037215" observedRunningTime="2026-06-02 01:22:47.361536098 +0000 UTC m=+15.691171017" watchObservedRunningTime="2026-06-02 01:22:47.362437321 +0000 UTC m=+15.692072242" Jun 02 01:22:48.227896 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:48.227847 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gcs7z" Jun 02 01:22:48.228078 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:48.227965 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gcs7z" podUID="ea44904f-42c9-44c6-84d2-06d8daf3412c" Jun 02 01:22:48.228194 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:48.227846 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-96l4l" Jun 02 01:22:48.228327 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:48.228275 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-96l4l" podUID="564c53f1-521a-42b2-8353-80c10ff44bb2" Jun 02 01:22:48.351109 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:48.351082 2559 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 02 01:22:49.830566 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:49.830523 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/564c53f1-521a-42b2-8353-80c10ff44bb2-metrics-certs\") pod \"network-metrics-daemon-96l4l\" (UID: \"564c53f1-521a-42b2-8353-80c10ff44bb2\") " pod="openshift-multus/network-metrics-daemon-96l4l" Jun 02 01:22:49.831280 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:49.830633 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:22:49.831280 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:49.830688 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/564c53f1-521a-42b2-8353-80c10ff44bb2-metrics-certs podName:564c53f1-521a-42b2-8353-80c10ff44bb2 nodeName:}" failed. No retries permitted until 2026-06-02 01:23:05.830673307 +0000 UTC m=+34.160308203 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/564c53f1-521a-42b2-8353-80c10ff44bb2-metrics-certs") pod "network-metrics-daemon-96l4l" (UID: "564c53f1-521a-42b2-8353-80c10ff44bb2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:22:49.931853 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:49.931802 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d4tgk\" (UniqueName: \"kubernetes.io/projected/ea44904f-42c9-44c6-84d2-06d8daf3412c-kube-api-access-d4tgk\") pod \"network-check-target-gcs7z\" (UID: \"ea44904f-42c9-44c6-84d2-06d8daf3412c\") " pod="openshift-network-diagnostics/network-check-target-gcs7z" Jun 02 01:22:49.932054 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:49.931971 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:22:49.932054 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:49.931995 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:22:49.932054 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:49.932008 2559 projected.go:194] Error preparing data for projected volume kube-api-access-d4tgk for pod openshift-network-diagnostics/network-check-target-gcs7z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:22:49.932216 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:49.932070 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea44904f-42c9-44c6-84d2-06d8daf3412c-kube-api-access-d4tgk podName:ea44904f-42c9-44c6-84d2-06d8daf3412c nodeName:}" failed. No retries permitted until 2026-06-02 01:23:05.932051006 +0000 UTC m=+34.261685904 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-d4tgk" (UniqueName: "kubernetes.io/projected/ea44904f-42c9-44c6-84d2-06d8daf3412c-kube-api-access-d4tgk") pod "network-check-target-gcs7z" (UID: "ea44904f-42c9-44c6-84d2-06d8daf3412c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:22:50.228111 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:50.228040 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-96l4l" Jun 02 01:22:50.228111 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:50.228089 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gcs7z" Jun 02 01:22:50.228305 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:50.228206 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-96l4l" podUID="564c53f1-521a-42b2-8353-80c10ff44bb2" Jun 02 01:22:50.228376 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:50.228348 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gcs7z" podUID="ea44904f-42c9-44c6-84d2-06d8daf3412c" Jun 02 01:22:52.228854 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:52.228620 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-96l4l" Jun 02 01:22:52.229316 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:52.228697 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gcs7z" Jun 02 01:22:52.229316 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:52.228954 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-96l4l" podUID="564c53f1-521a-42b2-8353-80c10ff44bb2" Jun 02 01:22:52.229316 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:52.229026 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gcs7z" podUID="ea44904f-42c9-44c6-84d2-06d8daf3412c" Jun 02 01:22:52.640937 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:52.640897 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-9slcd"] Jun 02 01:22:52.744418 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:52.744387 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9slcd" Jun 02 01:22:52.744569 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:52.744468 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9slcd" podUID="a69176c4-7342-45a1-87c5-7a25614b5f02" Jun 02 01:22:52.853714 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:52.853665 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a69176c4-7342-45a1-87c5-7a25614b5f02-dbus\") pod \"global-pull-secret-syncer-9slcd\" (UID: \"a69176c4-7342-45a1-87c5-7a25614b5f02\") " pod="kube-system/global-pull-secret-syncer-9slcd" Jun 02 01:22:52.853899 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:52.853806 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a69176c4-7342-45a1-87c5-7a25614b5f02-kubelet-config\") pod \"global-pull-secret-syncer-9slcd\" (UID: \"a69176c4-7342-45a1-87c5-7a25614b5f02\") " pod="kube-system/global-pull-secret-syncer-9slcd" Jun 02 01:22:52.853899 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:52.853858 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a69176c4-7342-45a1-87c5-7a25614b5f02-original-pull-secret\") pod \"global-pull-secret-syncer-9slcd\" (UID: \"a69176c4-7342-45a1-87c5-7a25614b5f02\") " pod="kube-system/global-pull-secret-syncer-9slcd" Jun 02 01:22:52.955424 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:52.955176 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a69176c4-7342-45a1-87c5-7a25614b5f02-kubelet-config\") pod \"global-pull-secret-syncer-9slcd\" (UID: \"a69176c4-7342-45a1-87c5-7a25614b5f02\") " pod="kube-system/global-pull-secret-syncer-9slcd" Jun 02 01:22:52.955424 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:52.955236 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a69176c4-7342-45a1-87c5-7a25614b5f02-original-pull-secret\") pod \"global-pull-secret-syncer-9slcd\" (UID: \"a69176c4-7342-45a1-87c5-7a25614b5f02\") " pod="kube-system/global-pull-secret-syncer-9slcd" Jun 02 01:22:52.955424 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:52.955270 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a69176c4-7342-45a1-87c5-7a25614b5f02-dbus\") pod \"global-pull-secret-syncer-9slcd\" (UID: \"a69176c4-7342-45a1-87c5-7a25614b5f02\") " pod="kube-system/global-pull-secret-syncer-9slcd" Jun 02 01:22:52.955424 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:52.955280 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a69176c4-7342-45a1-87c5-7a25614b5f02-kubelet-config\") pod \"global-pull-secret-syncer-9slcd\" (UID: \"a69176c4-7342-45a1-87c5-7a25614b5f02\") " pod="kube-system/global-pull-secret-syncer-9slcd" Jun 02 01:22:52.955424 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:52.955405 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 01:22:52.955799 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:52.955482 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a69176c4-7342-45a1-87c5-7a25614b5f02-original-pull-secret podName:a69176c4-7342-45a1-87c5-7a25614b5f02 nodeName:}" failed. No retries permitted until 2026-06-02 01:22:53.455462813 +0000 UTC m=+21.785097725 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a69176c4-7342-45a1-87c5-7a25614b5f02-original-pull-secret") pod "global-pull-secret-syncer-9slcd" (UID: "a69176c4-7342-45a1-87c5-7a25614b5f02") : object "kube-system"/"original-pull-secret" not registered Jun 02 01:22:52.955799 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:52.955526 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a69176c4-7342-45a1-87c5-7a25614b5f02-dbus\") pod \"global-pull-secret-syncer-9slcd\" (UID: \"a69176c4-7342-45a1-87c5-7a25614b5f02\") " pod="kube-system/global-pull-secret-syncer-9slcd" Jun 02 01:22:53.459226 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:53.459176 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a69176c4-7342-45a1-87c5-7a25614b5f02-original-pull-secret\") pod \"global-pull-secret-syncer-9slcd\" (UID: \"a69176c4-7342-45a1-87c5-7a25614b5f02\") " pod="kube-system/global-pull-secret-syncer-9slcd" Jun 02 01:22:53.459600 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:53.459333 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 01:22:53.459600 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:53.459410 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a69176c4-7342-45a1-87c5-7a25614b5f02-original-pull-secret podName:a69176c4-7342-45a1-87c5-7a25614b5f02 nodeName:}" failed. No retries permitted until 2026-06-02 01:22:54.459395182 +0000 UTC m=+22.789030082 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a69176c4-7342-45a1-87c5-7a25614b5f02-original-pull-secret") pod "global-pull-secret-syncer-9slcd" (UID: "a69176c4-7342-45a1-87c5-7a25614b5f02") : object "kube-system"/"original-pull-secret" not registered Jun 02 01:22:53.917218 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:53.916997 2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 02 01:22:54.168423 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:54.168302 2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-02T01:22:53.917199448Z","UUID":"d5b94d16-ec90-4af1-b268-d6792e90fa33","Handler":null,"Name":"","Endpoint":""} Jun 02 01:22:54.170468 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:54.170225 2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 02 01:22:54.170468 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:54.170258 2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 02 01:22:54.228789 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:54.228669 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-96l4l" Jun 02 01:22:54.228789 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:54.228704 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gcs7z" Jun 02 01:22:54.228789 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:54.228684 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9slcd" Jun 02 01:22:54.229066 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:54.228799 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-96l4l" podUID="564c53f1-521a-42b2-8353-80c10ff44bb2" Jun 02 01:22:54.229066 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:54.228911 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9slcd" podUID="a69176c4-7342-45a1-87c5-7a25614b5f02" Jun 02 01:22:54.229066 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:54.229003 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gcs7z" podUID="ea44904f-42c9-44c6-84d2-06d8daf3412c" Jun 02 01:22:54.370218 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:54.370160 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42bwv" event={"ID":"acb4caa8-8c43-4415-a21b-7c7a6d530fbf","Type":"ContainerStarted","Data":"0b0345a6dee739eb9d57677374a6e82f3548913fa554cfaa6ff720f3b8d6bfb2"} Jun 02 01:22:54.373142 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:54.373112 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" event={"ID":"83e1fd53-fa87-472e-91cc-c15dfac10b11","Type":"ContainerStarted","Data":"a330731e47e96c193e46e790782f9249f25751fa0e98c7649abd82973f708c67"} Jun 02 01:22:54.373270 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:54.373158 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" event={"ID":"83e1fd53-fa87-472e-91cc-c15dfac10b11","Type":"ContainerStarted","Data":"087ba7c27d5447388c2d6a9332076957c7a46fce06e4d7f2d2e998c618f205f9"} Jun 02 01:22:54.373270 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:54.373172 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" event={"ID":"83e1fd53-fa87-472e-91cc-c15dfac10b11","Type":"ContainerStarted","Data":"0b039e1d8f48502a8c319944d2367657b2c514f21010f952d47f23c53ec84415"} Jun 02 01:22:54.373270 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:54.373187 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" event={"ID":"83e1fd53-fa87-472e-91cc-c15dfac10b11","Type":"ContainerStarted","Data":"bb74f1672e6d62143a04df61ac9b87008c7639f836eea1ccfba16e06459aa0fa"} Jun 02 01:22:54.373270 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:54.373200 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" event={"ID":"83e1fd53-fa87-472e-91cc-c15dfac10b11","Type":"ContainerStarted","Data":"0f9b98bad754ad0a07ceef97aeefd35357bb693ae3ab5faaa591c38baf944fcc"} Jun 02 01:22:54.373270 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:54.373212 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" event={"ID":"83e1fd53-fa87-472e-91cc-c15dfac10b11","Type":"ContainerStarted","Data":"b393f3f90e37dd0bbda152d2317c42de2b4e3170f325c3e5cf8aa676a9c67840"} Jun 02 01:22:54.374960 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:54.374934 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n22l6" event={"ID":"585b1860-a049-4dc9-9dae-78a15997c822","Type":"ContainerStarted","Data":"b4352fb55805e28e164e324f0e7b62619bf83e27036cdb87708817fb20d3a104"} Jun 02 01:22:54.392160 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:54.392079 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-n22l6" podStartSLOduration=3.550001289 podStartE2EDuration="22.392061542s" podCreationTimestamp="2026-06-02 01:22:32 +0000 UTC" firstStartedPulling="2026-06-02 01:22:34.784559967 +0000 UTC m=+3.114194863" lastFinishedPulling="2026-06-02 01:22:53.626620212 +0000 UTC m=+21.956255116" observedRunningTime="2026-06-02 01:22:54.390965853 +0000 UTC m=+22.720600774" watchObservedRunningTime="2026-06-02 01:22:54.392061542 +0000 UTC m=+22.721696458" Jun 02 01:22:54.466656 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:54.466615 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a69176c4-7342-45a1-87c5-7a25614b5f02-original-pull-secret\") pod \"global-pull-secret-syncer-9slcd\" (UID: \"a69176c4-7342-45a1-87c5-7a25614b5f02\") " pod="kube-system/global-pull-secret-syncer-9slcd" Jun 02 01:22:54.467233 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:54.466711 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 01:22:54.467233 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:54.466779 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a69176c4-7342-45a1-87c5-7a25614b5f02-original-pull-secret podName:a69176c4-7342-45a1-87c5-7a25614b5f02 nodeName:}" failed. No retries permitted until 2026-06-02 01:22:56.466761139 +0000 UTC m=+24.796396050 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a69176c4-7342-45a1-87c5-7a25614b5f02-original-pull-secret") pod "global-pull-secret-syncer-9slcd" (UID: "a69176c4-7342-45a1-87c5-7a25614b5f02") : object "kube-system"/"original-pull-secret" not registered Jun 02 01:22:55.378335 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:55.378299 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42bwv" event={"ID":"acb4caa8-8c43-4415-a21b-7c7a6d530fbf","Type":"ContainerStarted","Data":"7fae41d57db81ac4c5fdb7ae41f81ec17904c3b86297c3daaf430bcb0491da07"} Jun 02 01:22:55.395605 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:55.395567 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42bwv" podStartSLOduration=3.355924073 podStartE2EDuration="23.395554788s" podCreationTimestamp="2026-06-02 01:22:32 +0000 UTC" firstStartedPulling="2026-06-02 01:22:34.78176867 +0000 UTC m=+3.111403574" lastFinishedPulling="2026-06-02 01:22:54.821399375 +0000 UTC m=+23.151034289" observedRunningTime="2026-06-02 01:22:55.395227603 +0000 UTC m=+23.724862523" watchObservedRunningTime="2026-06-02 01:22:55.395554788 +0000 UTC m=+23.725189707" Jun 02 01:22:56.228667 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:56.228607 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gcs7z" Jun 02 01:22:56.228667 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:56.228626 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-96l4l" Jun 02 01:22:56.229235 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:56.228622 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9slcd" Jun 02 01:22:56.229235 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:56.228729 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gcs7z" podUID="ea44904f-42c9-44c6-84d2-06d8daf3412c" Jun 02 01:22:56.229235 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:56.228805 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9slcd" podUID="a69176c4-7342-45a1-87c5-7a25614b5f02" Jun 02 01:22:56.229235 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:56.228898 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-96l4l" podUID="564c53f1-521a-42b2-8353-80c10ff44bb2" Jun 02 01:22:56.382973 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:56.382886 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" event={"ID":"83e1fd53-fa87-472e-91cc-c15dfac10b11","Type":"ContainerStarted","Data":"6d1967f94fe2de8fd6a39c795437b74c4537586e341bd5bbb15397dfcb637443"} Jun 02 01:22:56.482683 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:56.482645 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a69176c4-7342-45a1-87c5-7a25614b5f02-original-pull-secret\") pod \"global-pull-secret-syncer-9slcd\" (UID: \"a69176c4-7342-45a1-87c5-7a25614b5f02\") " pod="kube-system/global-pull-secret-syncer-9slcd" Jun 02 01:22:56.482870 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:56.482762 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 01:22:56.482870 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:56.482828 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a69176c4-7342-45a1-87c5-7a25614b5f02-original-pull-secret podName:a69176c4-7342-45a1-87c5-7a25614b5f02 nodeName:}" failed. No retries permitted until 2026-06-02 01:23:00.482810615 +0000 UTC m=+28.812445511 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a69176c4-7342-45a1-87c5-7a25614b5f02-original-pull-secret") pod "global-pull-secret-syncer-9slcd" (UID: "a69176c4-7342-45a1-87c5-7a25614b5f02") : object "kube-system"/"original-pull-secret" not registered Jun 02 01:22:57.143227 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:57.143186 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lgtvp" Jun 02 01:22:57.143392 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:57.143329 2559 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 02 01:22:57.143891 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:57.143868 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lgtvp" Jun 02 01:22:58.228102 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:58.228055 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-96l4l" Jun 02 01:22:58.228102 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:58.228076 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9slcd" Jun 02 01:22:58.228102 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:22:58.228056 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gcs7z" Jun 02 01:22:58.228683 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:58.228197 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9slcd" podUID="a69176c4-7342-45a1-87c5-7a25614b5f02" Jun 02 01:22:58.228683 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:58.228249 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gcs7z" podUID="ea44904f-42c9-44c6-84d2-06d8daf3412c" Jun 02 01:22:58.228683 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:22:58.228346 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-96l4l" podUID="564c53f1-521a-42b2-8353-80c10ff44bb2" Jun 02 01:23:00.228442 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:00.228134 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-96l4l" Jun 02 01:23:00.228985 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:00.228134 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9slcd" Jun 02 01:23:00.228985 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:00.228144 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gcs7z" Jun 02 01:23:00.228985 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:00.228509 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-96l4l" podUID="564c53f1-521a-42b2-8353-80c10ff44bb2" Jun 02 01:23:00.228985 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:00.228627 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gcs7z" podUID="ea44904f-42c9-44c6-84d2-06d8daf3412c" Jun 02 01:23:00.228985 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:00.228714 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9slcd" podUID="a69176c4-7342-45a1-87c5-7a25614b5f02" Jun 02 01:23:00.393984 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:00.393950 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" event={"ID":"83e1fd53-fa87-472e-91cc-c15dfac10b11","Type":"ContainerStarted","Data":"3a95a32f4c9d1b34da2d5e353d1fc07258348b3343c2e3218df22ca900016650"} Jun 02 01:23:00.394249 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:00.394203 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:23:00.395733 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:00.395705 2559 generic.go:358] "Generic (PLEG): container finished" podID="864222f2-b558-4380-b095-b1f285e5b91c" containerID="e510a8b3f29b7c9aa4ed317876ced597cc1f68dfb8d2a6a2c9eb4feac5b1440b" exitCode=0 Jun 02 01:23:00.395882 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:00.395743 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nqdhn" event={"ID":"864222f2-b558-4380-b095-b1f285e5b91c","Type":"ContainerDied","Data":"e510a8b3f29b7c9aa4ed317876ced597cc1f68dfb8d2a6a2c9eb4feac5b1440b"} Jun 02 01:23:00.411545 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:00.411523 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:23:00.422429 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:00.422381 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" podStartSLOduration=9.535847352 podStartE2EDuration="28.422368678s" podCreationTimestamp="2026-06-02 01:22:32 +0000 UTC" firstStartedPulling="2026-06-02 01:22:34.790227074 +0000 UTC m=+3.119861975" lastFinishedPulling="2026-06-02 01:22:53.67674839 +0000 UTC m=+22.006383301" observedRunningTime="2026-06-02 01:23:00.422064691 +0000 UTC m=+28.751699611" watchObservedRunningTime="2026-06-02 01:23:00.422368678 +0000 UTC m=+28.752003597" Jun 02 01:23:00.518905 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:00.518800 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a69176c4-7342-45a1-87c5-7a25614b5f02-original-pull-secret\") pod \"global-pull-secret-syncer-9slcd\" (UID: \"a69176c4-7342-45a1-87c5-7a25614b5f02\") " pod="kube-system/global-pull-secret-syncer-9slcd" Jun 02 01:23:00.519090 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:00.518968 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 01:23:00.519090 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:00.519048 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a69176c4-7342-45a1-87c5-7a25614b5f02-original-pull-secret podName:a69176c4-7342-45a1-87c5-7a25614b5f02 nodeName:}" failed. No retries permitted until 2026-06-02 01:23:08.519029152 +0000 UTC m=+36.848664052 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a69176c4-7342-45a1-87c5-7a25614b5f02-original-pull-secret") pod "global-pull-secret-syncer-9slcd" (UID: "a69176c4-7342-45a1-87c5-7a25614b5f02") : object "kube-system"/"original-pull-secret" not registered Jun 02 01:23:01.398005 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:01.397975 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:23:01.398400 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:01.398014 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:23:01.417546 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:01.417516 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:23:01.842712 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:01.842677 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gcs7z"] Jun 02 01:23:01.842913 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:01.842797 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gcs7z" Jun 02 01:23:01.842913 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:01.842898 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gcs7z" podUID="ea44904f-42c9-44c6-84d2-06d8daf3412c" Jun 02 01:23:01.845078 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:01.845047 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9slcd"] Jun 02 01:23:01.845206 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:01.845177 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9slcd" Jun 02 01:23:01.845308 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:01.845278 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9slcd" podUID="a69176c4-7342-45a1-87c5-7a25614b5f02" Jun 02 01:23:01.845667 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:01.845648 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-96l4l"] Jun 02 01:23:01.845772 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:01.845759 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-96l4l" Jun 02 01:23:01.845900 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:01.845880 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-96l4l" podUID="564c53f1-521a-42b2-8353-80c10ff44bb2" Jun 02 01:23:02.401693 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:02.401654 2559 generic.go:358] "Generic (PLEG): container finished" podID="864222f2-b558-4380-b095-b1f285e5b91c" containerID="9dbb4f1187fe580219af90c5966f95dc18a31a824b9897c663120710108d9079" exitCode=0 Jun 02 01:23:02.402277 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:02.401747 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nqdhn" event={"ID":"864222f2-b558-4380-b095-b1f285e5b91c","Type":"ContainerDied","Data":"9dbb4f1187fe580219af90c5966f95dc18a31a824b9897c663120710108d9079"} Jun 02 01:23:03.228808 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:03.228581 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gcs7z" Jun 02 01:23:03.228972 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:03.228640 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-96l4l" Jun 02 01:23:03.228972 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:03.228859 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gcs7z" podUID="ea44904f-42c9-44c6-84d2-06d8daf3412c" Jun 02 01:23:03.228972 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:03.228657 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9slcd" Jun 02 01:23:03.228972 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:03.228927 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-96l4l" podUID="564c53f1-521a-42b2-8353-80c10ff44bb2" Jun 02 01:23:03.229172 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:03.229021 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9slcd" podUID="a69176c4-7342-45a1-87c5-7a25614b5f02" Jun 02 01:23:04.407665 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:04.407630 2559 generic.go:358] "Generic (PLEG): container finished" podID="864222f2-b558-4380-b095-b1f285e5b91c" containerID="42e0f7e349fa139fe771ed64185729c3c2e44fc9693d87301767f0d4271ce99e" exitCode=0 Jun 02 01:23:04.408127 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:04.407687 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nqdhn" event={"ID":"864222f2-b558-4380-b095-b1f285e5b91c","Type":"ContainerDied","Data":"42e0f7e349fa139fe771ed64185729c3c2e44fc9693d87301767f0d4271ce99e"} Jun 02 01:23:05.228119 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:05.228030 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9slcd" Jun 02 01:23:05.228287 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:05.228154 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gcs7z" Jun 02 01:23:05.228287 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:05.228160 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9slcd" podUID="a69176c4-7342-45a1-87c5-7a25614b5f02" Jun 02 01:23:05.228287 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:05.228187 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-96l4l" Jun 02 01:23:05.228287 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:05.228228 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gcs7z" podUID="ea44904f-42c9-44c6-84d2-06d8daf3412c" Jun 02 01:23:05.228578 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:05.228322 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-96l4l" podUID="564c53f1-521a-42b2-8353-80c10ff44bb2" Jun 02 01:23:05.857213 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:05.857165 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/564c53f1-521a-42b2-8353-80c10ff44bb2-metrics-certs\") pod \"network-metrics-daemon-96l4l\" (UID: \"564c53f1-521a-42b2-8353-80c10ff44bb2\") " pod="openshift-multus/network-metrics-daemon-96l4l" Jun 02 01:23:05.857587 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:05.857324 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:23:05.857587 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:05.857407 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/564c53f1-521a-42b2-8353-80c10ff44bb2-metrics-certs podName:564c53f1-521a-42b2-8353-80c10ff44bb2 nodeName:}" failed. No retries permitted until 2026-06-02 01:23:37.857384352 +0000 UTC m=+66.187019249 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/564c53f1-521a-42b2-8353-80c10ff44bb2-metrics-certs") pod "network-metrics-daemon-96l4l" (UID: "564c53f1-521a-42b2-8353-80c10ff44bb2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:23:05.957903 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:05.957862 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d4tgk\" (UniqueName: \"kubernetes.io/projected/ea44904f-42c9-44c6-84d2-06d8daf3412c-kube-api-access-d4tgk\") pod \"network-check-target-gcs7z\" (UID: \"ea44904f-42c9-44c6-84d2-06d8daf3412c\") " pod="openshift-network-diagnostics/network-check-target-gcs7z" Jun 02 01:23:05.958079 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:05.958052 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:23:05.958079 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:05.958079 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:23:05.958187 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:05.958092 2559 projected.go:194] Error preparing data for projected volume kube-api-access-d4tgk for pod openshift-network-diagnostics/network-check-target-gcs7z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:23:05.958187 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:05.958161 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea44904f-42c9-44c6-84d2-06d8daf3412c-kube-api-access-d4tgk podName:ea44904f-42c9-44c6-84d2-06d8daf3412c nodeName:}" failed. No retries permitted until 2026-06-02 01:23:37.958142384 +0000 UTC m=+66.287777287 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-d4tgk" (UniqueName: "kubernetes.io/projected/ea44904f-42c9-44c6-84d2-06d8daf3412c-kube-api-access-d4tgk") pod "network-check-target-gcs7z" (UID: "ea44904f-42c9-44c6-84d2-06d8daf3412c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:23:06.470349 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.470320 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-179.ec2.internal" event="NodeReady" Jun 02 01:23:06.470510 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.470437 2559 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 02 01:23:06.501816 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.501777 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6486bbbddc-s644j"] Jun 02 01:23:06.521136 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.521103 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6486bbbddc-s644j"] Jun 02 01:23:06.521136 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.521132 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-m96w4"] Jun 02 01:23:06.521352 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.521265 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6486bbbddc-s644j" Jun 02 01:23:06.523751 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.523728 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 02 01:23:06.523997 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.523982 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 02 01:23:06.524090 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.524022 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 02 01:23:06.524090 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.524050 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-95blv\"" Jun 02 01:23:06.533967 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.532228 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 02 01:23:06.542128 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.542105 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-nj4t5"] Jun 02 01:23:06.542260 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.542238 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m96w4" Jun 02 01:23:06.544856 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.544816 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 02 01:23:06.544977 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.544878 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 02 01:23:06.545040 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.544993 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xz25b\"" Jun 02 01:23:06.545094 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.545080 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 02 01:23:06.566419 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.566392 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nj4t5"] Jun 02 01:23:06.566419 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.566425 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-m96w4"] Jun 02 01:23:06.566618 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.566532 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nj4t5" Jun 02 01:23:06.568992 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.568967 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 02 01:23:06.569124 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.568989 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 02 01:23:06.569124 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.568970 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8tqnd\"" Jun 02 01:23:06.661640 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.661603 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0c798c74-1434-4c07-86ab-2a20929dbb66-registry-certificates\") pod \"image-registry-6486bbbddc-s644j\" (UID: \"0c798c74-1434-4c07-86ab-2a20929dbb66\") " pod="openshift-image-registry/image-registry-6486bbbddc-s644j" Jun 02 01:23:06.661818 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.661645 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0c798c74-1434-4c07-86ab-2a20929dbb66-bound-sa-token\") pod \"image-registry-6486bbbddc-s644j\" (UID: \"0c798c74-1434-4c07-86ab-2a20929dbb66\") " pod="openshift-image-registry/image-registry-6486bbbddc-s644j" Jun 02 01:23:06.661818 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.661681 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/895ec876-825f-4148-b184-bd690c4203aa-metrics-tls\") pod \"dns-default-nj4t5\" (UID: \"895ec876-825f-4148-b184-bd690c4203aa\") " pod="openshift-dns/dns-default-nj4t5" Jun 02 01:23:06.661818 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.661710 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c798c74-1434-4c07-86ab-2a20929dbb66-registry-tls\") pod \"image-registry-6486bbbddc-s644j\" (UID: \"0c798c74-1434-4c07-86ab-2a20929dbb66\") " pod="openshift-image-registry/image-registry-6486bbbddc-s644j" Jun 02 01:23:06.661818 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.661734 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0c798c74-1434-4c07-86ab-2a20929dbb66-installation-pull-secrets\") pod \"image-registry-6486bbbddc-s644j\" (UID: \"0c798c74-1434-4c07-86ab-2a20929dbb66\") " pod="openshift-image-registry/image-registry-6486bbbddc-s644j" Jun 02 01:23:06.661818 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.661784 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnzdc\" (UniqueName: \"kubernetes.io/projected/0c798c74-1434-4c07-86ab-2a20929dbb66-kube-api-access-fnzdc\") pod \"image-registry-6486bbbddc-s644j\" (UID: \"0c798c74-1434-4c07-86ab-2a20929dbb66\") " pod="openshift-image-registry/image-registry-6486bbbddc-s644j" Jun 02 01:23:06.662110 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.661819 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbhxf\" (UniqueName: \"kubernetes.io/projected/895ec876-825f-4148-b184-bd690c4203aa-kube-api-access-pbhxf\") pod \"dns-default-nj4t5\" (UID: \"895ec876-825f-4148-b184-bd690c4203aa\") " pod="openshift-dns/dns-default-nj4t5" Jun 02 01:23:06.662110 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.661904 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/895ec876-825f-4148-b184-bd690c4203aa-config-volume\") pod \"dns-default-nj4t5\" (UID: \"895ec876-825f-4148-b184-bd690c4203aa\") " pod="openshift-dns/dns-default-nj4t5" Jun 02 01:23:06.662110 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.661930 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/895ec876-825f-4148-b184-bd690c4203aa-tmp-dir\") pod \"dns-default-nj4t5\" (UID: \"895ec876-825f-4148-b184-bd690c4203aa\") " pod="openshift-dns/dns-default-nj4t5" Jun 02 01:23:06.662110 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.661976 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0c798c74-1434-4c07-86ab-2a20929dbb66-image-registry-private-configuration\") pod \"image-registry-6486bbbddc-s644j\" (UID: \"0c798c74-1434-4c07-86ab-2a20929dbb66\") " pod="openshift-image-registry/image-registry-6486bbbddc-s644j" Jun 02 01:23:06.662110 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.662004 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0c798c74-1434-4c07-86ab-2a20929dbb66-trusted-ca\") pod \"image-registry-6486bbbddc-s644j\" (UID: \"0c798c74-1434-4c07-86ab-2a20929dbb66\") " pod="openshift-image-registry/image-registry-6486bbbddc-s644j" Jun 02 01:23:06.662110 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.662043 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czmw4\" (UniqueName: \"kubernetes.io/projected/3b09f852-0fa3-468e-b22e-8d25a143efc8-kube-api-access-czmw4\") pod \"ingress-canary-m96w4\" (UID: \"3b09f852-0fa3-468e-b22e-8d25a143efc8\") " pod="openshift-ingress-canary/ingress-canary-m96w4" Jun 02 01:23:06.662110 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.662071 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0c798c74-1434-4c07-86ab-2a20929dbb66-ca-trust-extracted\") pod \"image-registry-6486bbbddc-s644j\" (UID: \"0c798c74-1434-4c07-86ab-2a20929dbb66\") " pod="openshift-image-registry/image-registry-6486bbbddc-s644j" Jun 02 01:23:06.662110 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.662094 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b09f852-0fa3-468e-b22e-8d25a143efc8-cert\") pod \"ingress-canary-m96w4\" (UID: \"3b09f852-0fa3-468e-b22e-8d25a143efc8\") " pod="openshift-ingress-canary/ingress-canary-m96w4" Jun 02 01:23:06.762448 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.762363 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/895ec876-825f-4148-b184-bd690c4203aa-tmp-dir\") pod \"dns-default-nj4t5\" (UID: \"895ec876-825f-4148-b184-bd690c4203aa\") " pod="openshift-dns/dns-default-nj4t5" Jun 02 01:23:06.762448 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.762426 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0c798c74-1434-4c07-86ab-2a20929dbb66-image-registry-private-configuration\") pod \"image-registry-6486bbbddc-s644j\" (UID: \"0c798c74-1434-4c07-86ab-2a20929dbb66\") " pod="openshift-image-registry/image-registry-6486bbbddc-s644j" Jun 02 01:23:06.762651 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.762453 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0c798c74-1434-4c07-86ab-2a20929dbb66-trusted-ca\") pod \"image-registry-6486bbbddc-s644j\" (UID: \"0c798c74-1434-4c07-86ab-2a20929dbb66\") " pod="openshift-image-registry/image-registry-6486bbbddc-s644j" Jun 02 01:23:06.762651 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.762495 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-czmw4\" (UniqueName: \"kubernetes.io/projected/3b09f852-0fa3-468e-b22e-8d25a143efc8-kube-api-access-czmw4\") pod \"ingress-canary-m96w4\" (UID: \"3b09f852-0fa3-468e-b22e-8d25a143efc8\") " pod="openshift-ingress-canary/ingress-canary-m96w4" Jun 02 01:23:06.762651 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.762530 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0c798c74-1434-4c07-86ab-2a20929dbb66-ca-trust-extracted\") pod \"image-registry-6486bbbddc-s644j\" (UID: \"0c798c74-1434-4c07-86ab-2a20929dbb66\") " pod="openshift-image-registry/image-registry-6486bbbddc-s644j" Jun 02 01:23:06.762651 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.762545 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b09f852-0fa3-468e-b22e-8d25a143efc8-cert\") pod \"ingress-canary-m96w4\" (UID: \"3b09f852-0fa3-468e-b22e-8d25a143efc8\") " pod="openshift-ingress-canary/ingress-canary-m96w4" Jun 02 01:23:06.762651 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.762585 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0c798c74-1434-4c07-86ab-2a20929dbb66-registry-certificates\") pod \"image-registry-6486bbbddc-s644j\" (UID: \"0c798c74-1434-4c07-86ab-2a20929dbb66\") " pod="openshift-image-registry/image-registry-6486bbbddc-s644j" Jun 02 01:23:06.762651 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.762604 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0c798c74-1434-4c07-86ab-2a20929dbb66-bound-sa-token\") pod \"image-registry-6486bbbddc-s644j\" (UID: \"0c798c74-1434-4c07-86ab-2a20929dbb66\") " pod="openshift-image-registry/image-registry-6486bbbddc-s644j" Jun 02 01:23:06.762850 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.762799 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/895ec876-825f-4148-b184-bd690c4203aa-tmp-dir\") pod \"dns-default-nj4t5\" (UID: \"895ec876-825f-4148-b184-bd690c4203aa\") " pod="openshift-dns/dns-default-nj4t5" Jun 02 01:23:06.762935 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:06.762910 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:23:06.763000 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:06.762974 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b09f852-0fa3-468e-b22e-8d25a143efc8-cert podName:3b09f852-0fa3-468e-b22e-8d25a143efc8 nodeName:}" failed. No retries permitted until 2026-06-02 01:23:07.262955772 +0000 UTC m=+35.592590685 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3b09f852-0fa3-468e-b22e-8d25a143efc8-cert") pod "ingress-canary-m96w4" (UID: "3b09f852-0fa3-468e-b22e-8d25a143efc8") : secret "canary-serving-cert" not found Jun 02 01:23:06.763301 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.763275 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0c798c74-1434-4c07-86ab-2a20929dbb66-ca-trust-extracted\") pod \"image-registry-6486bbbddc-s644j\" (UID: \"0c798c74-1434-4c07-86ab-2a20929dbb66\") " pod="openshift-image-registry/image-registry-6486bbbddc-s644j" Jun 02 01:23:06.763412 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.763366 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/895ec876-825f-4148-b184-bd690c4203aa-metrics-tls\") pod \"dns-default-nj4t5\" (UID: \"895ec876-825f-4148-b184-bd690c4203aa\") " pod="openshift-dns/dns-default-nj4t5" Jun 02 01:23:06.763471 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.763421 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0c798c74-1434-4c07-86ab-2a20929dbb66-registry-certificates\") pod \"image-registry-6486bbbddc-s644j\" (UID: \"0c798c74-1434-4c07-86ab-2a20929dbb66\") " pod="openshift-image-registry/image-registry-6486bbbddc-s644j" Jun 02 01:23:06.763471 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.763419 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c798c74-1434-4c07-86ab-2a20929dbb66-registry-tls\") pod \"image-registry-6486bbbddc-s644j\" (UID: \"0c798c74-1434-4c07-86ab-2a20929dbb66\") " pod="openshift-image-registry/image-registry-6486bbbddc-s644j" Jun 02 01:23:06.763577 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.763472 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0c798c74-1434-4c07-86ab-2a20929dbb66-installation-pull-secrets\") pod \"image-registry-6486bbbddc-s644j\" (UID: \"0c798c74-1434-4c07-86ab-2a20929dbb66\") " pod="openshift-image-registry/image-registry-6486bbbddc-s644j" Jun 02 01:23:06.763577 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:06.763488 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:23:06.763577 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.763497 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fnzdc\" (UniqueName: \"kubernetes.io/projected/0c798c74-1434-4c07-86ab-2a20929dbb66-kube-api-access-fnzdc\") pod \"image-registry-6486bbbddc-s644j\" (UID: \"0c798c74-1434-4c07-86ab-2a20929dbb66\") " pod="openshift-image-registry/image-registry-6486bbbddc-s644j" Jun 02 01:23:06.763577 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:06.763527 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/895ec876-825f-4148-b184-bd690c4203aa-metrics-tls podName:895ec876-825f-4148-b184-bd690c4203aa nodeName:}" failed. No retries permitted until 2026-06-02 01:23:07.263510231 +0000 UTC m=+35.593145143 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/895ec876-825f-4148-b184-bd690c4203aa-metrics-tls") pod "dns-default-nj4t5" (UID: "895ec876-825f-4148-b184-bd690c4203aa") : secret "dns-default-metrics-tls" not found Jun 02 01:23:06.763577 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:06.763532 2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 01:23:06.763577 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:06.763543 2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6486bbbddc-s644j: secret "image-registry-tls" not found Jun 02 01:23:06.763577 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.763545 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pbhxf\" (UniqueName: \"kubernetes.io/projected/895ec876-825f-4148-b184-bd690c4203aa-kube-api-access-pbhxf\") pod \"dns-default-nj4t5\" (UID: \"895ec876-825f-4148-b184-bd690c4203aa\") " pod="openshift-dns/dns-default-nj4t5" Jun 02 01:23:06.763577 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:06.763575 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0c798c74-1434-4c07-86ab-2a20929dbb66-registry-tls podName:0c798c74-1434-4c07-86ab-2a20929dbb66 nodeName:}" failed. No retries permitted until 2026-06-02 01:23:07.263563149 +0000 UTC m=+35.593198046 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0c798c74-1434-4c07-86ab-2a20929dbb66-registry-tls") pod "image-registry-6486bbbddc-s644j" (UID: "0c798c74-1434-4c07-86ab-2a20929dbb66") : secret "image-registry-tls" not found Jun 02 01:23:06.764011 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.763601 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/895ec876-825f-4148-b184-bd690c4203aa-config-volume\") pod \"dns-default-nj4t5\" (UID: \"895ec876-825f-4148-b184-bd690c4203aa\") " pod="openshift-dns/dns-default-nj4t5" Jun 02 01:23:06.764011 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.763978 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0c798c74-1434-4c07-86ab-2a20929dbb66-trusted-ca\") pod \"image-registry-6486bbbddc-s644j\" (UID: \"0c798c74-1434-4c07-86ab-2a20929dbb66\") " pod="openshift-image-registry/image-registry-6486bbbddc-s644j" Jun 02 01:23:06.764011 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.763999 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/895ec876-825f-4148-b184-bd690c4203aa-config-volume\") pod \"dns-default-nj4t5\" (UID: \"895ec876-825f-4148-b184-bd690c4203aa\") " pod="openshift-dns/dns-default-nj4t5" Jun 02 01:23:06.767698 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.767673 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0c798c74-1434-4c07-86ab-2a20929dbb66-image-registry-private-configuration\") pod \"image-registry-6486bbbddc-s644j\" (UID: \"0c798c74-1434-4c07-86ab-2a20929dbb66\") " pod="openshift-image-registry/image-registry-6486bbbddc-s644j" Jun 02 01:23:06.767810 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.767680 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0c798c74-1434-4c07-86ab-2a20929dbb66-installation-pull-secrets\") pod \"image-registry-6486bbbddc-s644j\" (UID: \"0c798c74-1434-4c07-86ab-2a20929dbb66\") " pod="openshift-image-registry/image-registry-6486bbbddc-s644j" Jun 02 01:23:06.774112 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.774060 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbhxf\" (UniqueName: \"kubernetes.io/projected/895ec876-825f-4148-b184-bd690c4203aa-kube-api-access-pbhxf\") pod \"dns-default-nj4t5\" (UID: \"895ec876-825f-4148-b184-bd690c4203aa\") " pod="openshift-dns/dns-default-nj4t5" Jun 02 01:23:06.774461 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.774435 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnzdc\" (UniqueName: \"kubernetes.io/projected/0c798c74-1434-4c07-86ab-2a20929dbb66-kube-api-access-fnzdc\") pod \"image-registry-6486bbbddc-s644j\" (UID: \"0c798c74-1434-4c07-86ab-2a20929dbb66\") " pod="openshift-image-registry/image-registry-6486bbbddc-s644j" Jun 02 01:23:06.774551 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.774487 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czmw4\" (UniqueName: \"kubernetes.io/projected/3b09f852-0fa3-468e-b22e-8d25a143efc8-kube-api-access-czmw4\") pod \"ingress-canary-m96w4\" (UID: \"3b09f852-0fa3-468e-b22e-8d25a143efc8\") " pod="openshift-ingress-canary/ingress-canary-m96w4" Jun 02 01:23:06.774551 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:06.774531 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0c798c74-1434-4c07-86ab-2a20929dbb66-bound-sa-token\") pod \"image-registry-6486bbbddc-s644j\" (UID: \"0c798c74-1434-4c07-86ab-2a20929dbb66\") " pod="openshift-image-registry/image-registry-6486bbbddc-s644j" Jun 02 01:23:07.228419 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:07.228380 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-96l4l" Jun 02 01:23:07.229227 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:07.228379 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9slcd" Jun 02 01:23:07.229227 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:07.228380 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gcs7z" Jun 02 01:23:07.230973 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:07.230948 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 01:23:07.231131 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:07.231004 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 01:23:07.231196 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:07.231143 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 01:23:07.231335 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:07.231320 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jprs5\"" Jun 02 01:23:07.231374 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:07.231343 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 01:23:07.231810 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:07.231798 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tm89p\"" Jun 02 01:23:07.268489 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:07.268463 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b09f852-0fa3-468e-b22e-8d25a143efc8-cert\") pod \"ingress-canary-m96w4\" (UID: \"3b09f852-0fa3-468e-b22e-8d25a143efc8\") " pod="openshift-ingress-canary/ingress-canary-m96w4" Jun 02 01:23:07.268643 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:07.268517 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/895ec876-825f-4148-b184-bd690c4203aa-metrics-tls\") pod \"dns-default-nj4t5\" (UID: \"895ec876-825f-4148-b184-bd690c4203aa\") " pod="openshift-dns/dns-default-nj4t5" Jun 02 01:23:07.268643 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:07.268610 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:23:07.268643 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:07.268631 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c798c74-1434-4c07-86ab-2a20929dbb66-registry-tls\") pod \"image-registry-6486bbbddc-s644j\" (UID: \"0c798c74-1434-4c07-86ab-2a20929dbb66\") " pod="openshift-image-registry/image-registry-6486bbbddc-s644j" Jun 02 01:23:07.268753 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:07.268610 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:23:07.268753 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:07.268699 2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 01:23:07.268753 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:07.268709 2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6486bbbddc-s644j: secret "image-registry-tls" not found Jun 02 01:23:07.268753 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:07.268666 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/895ec876-825f-4148-b184-bd690c4203aa-metrics-tls podName:895ec876-825f-4148-b184-bd690c4203aa nodeName:}" failed. No retries permitted until 2026-06-02 01:23:08.268648281 +0000 UTC m=+36.598283180 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/895ec876-825f-4148-b184-bd690c4203aa-metrics-tls") pod "dns-default-nj4t5" (UID: "895ec876-825f-4148-b184-bd690c4203aa") : secret "dns-default-metrics-tls" not found Jun 02 01:23:07.268753 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:07.268744 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b09f852-0fa3-468e-b22e-8d25a143efc8-cert podName:3b09f852-0fa3-468e-b22e-8d25a143efc8 nodeName:}" failed. No retries permitted until 2026-06-02 01:23:08.268728838 +0000 UTC m=+36.598363736 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3b09f852-0fa3-468e-b22e-8d25a143efc8-cert") pod "ingress-canary-m96w4" (UID: "3b09f852-0fa3-468e-b22e-8d25a143efc8") : secret "canary-serving-cert" not found Jun 02 01:23:07.268948 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:07.268758 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0c798c74-1434-4c07-86ab-2a20929dbb66-registry-tls podName:0c798c74-1434-4c07-86ab-2a20929dbb66 nodeName:}" failed. No retries permitted until 2026-06-02 01:23:08.268752242 +0000 UTC m=+36.598387139 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0c798c74-1434-4c07-86ab-2a20929dbb66-registry-tls") pod "image-registry-6486bbbddc-s644j" (UID: "0c798c74-1434-4c07-86ab-2a20929dbb66") : secret "image-registry-tls" not found Jun 02 01:23:08.276894 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:08.276828 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b09f852-0fa3-468e-b22e-8d25a143efc8-cert\") pod \"ingress-canary-m96w4\" (UID: \"3b09f852-0fa3-468e-b22e-8d25a143efc8\") " pod="openshift-ingress-canary/ingress-canary-m96w4" Jun 02 01:23:08.277423 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:08.276919 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/895ec876-825f-4148-b184-bd690c4203aa-metrics-tls\") pod \"dns-default-nj4t5\" (UID: \"895ec876-825f-4148-b184-bd690c4203aa\") " pod="openshift-dns/dns-default-nj4t5" Jun 02 01:23:08.277423 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:08.276943 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c798c74-1434-4c07-86ab-2a20929dbb66-registry-tls\") pod \"image-registry-6486bbbddc-s644j\" (UID: \"0c798c74-1434-4c07-86ab-2a20929dbb66\") " pod="openshift-image-registry/image-registry-6486bbbddc-s644j" Jun 02 01:23:08.277423 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:08.276977 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:23:08.277423 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:08.277044 2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 01:23:08.277423 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:08.277048 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:23:08.277423 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:08.277055 2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6486bbbddc-s644j: secret "image-registry-tls" not found Jun 02 01:23:08.277423 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:08.277045 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b09f852-0fa3-468e-b22e-8d25a143efc8-cert podName:3b09f852-0fa3-468e-b22e-8d25a143efc8 nodeName:}" failed. No retries permitted until 2026-06-02 01:23:10.277029531 +0000 UTC m=+38.606664434 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3b09f852-0fa3-468e-b22e-8d25a143efc8-cert") pod "ingress-canary-m96w4" (UID: "3b09f852-0fa3-468e-b22e-8d25a143efc8") : secret "canary-serving-cert" not found Jun 02 01:23:08.277423 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:08.277120 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/895ec876-825f-4148-b184-bd690c4203aa-metrics-tls podName:895ec876-825f-4148-b184-bd690c4203aa nodeName:}" failed. No retries permitted until 2026-06-02 01:23:10.277108248 +0000 UTC m=+38.606743147 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/895ec876-825f-4148-b184-bd690c4203aa-metrics-tls") pod "dns-default-nj4t5" (UID: "895ec876-825f-4148-b184-bd690c4203aa") : secret "dns-default-metrics-tls" not found Jun 02 01:23:08.277423 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:08.277155 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0c798c74-1434-4c07-86ab-2a20929dbb66-registry-tls podName:0c798c74-1434-4c07-86ab-2a20929dbb66 nodeName:}" failed. No retries permitted until 2026-06-02 01:23:10.277125141 +0000 UTC m=+38.606760038 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0c798c74-1434-4c07-86ab-2a20929dbb66-registry-tls") pod "image-registry-6486bbbddc-s644j" (UID: "0c798c74-1434-4c07-86ab-2a20929dbb66") : secret "image-registry-tls" not found Jun 02 01:23:08.578363 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:08.578331 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a69176c4-7342-45a1-87c5-7a25614b5f02-original-pull-secret\") pod \"global-pull-secret-syncer-9slcd\" (UID: \"a69176c4-7342-45a1-87c5-7a25614b5f02\") " pod="kube-system/global-pull-secret-syncer-9slcd" Jun 02 01:23:08.589298 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:08.589265 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a69176c4-7342-45a1-87c5-7a25614b5f02-original-pull-secret\") pod \"global-pull-secret-syncer-9slcd\" (UID: \"a69176c4-7342-45a1-87c5-7a25614b5f02\") " pod="kube-system/global-pull-secret-syncer-9slcd" Jun 02 01:23:08.743976 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:08.743939 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9slcd" Jun 02 01:23:08.914961 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:08.914768 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9slcd"] Jun 02 01:23:08.918786 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:23:08.918750 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda69176c4_7342_45a1_87c5_7a25614b5f02.slice/crio-e93dde450b87911c55b5e6309fad7d32ab477c7e843b25d635f97046ec78b9f1 WatchSource:0}: Error finding container e93dde450b87911c55b5e6309fad7d32ab477c7e843b25d635f97046ec78b9f1: Status 404 returned error can't find the container with id e93dde450b87911c55b5e6309fad7d32ab477c7e843b25d635f97046ec78b9f1 Jun 02 01:23:09.420897 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:09.420861 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9slcd" event={"ID":"a69176c4-7342-45a1-87c5-7a25614b5f02","Type":"ContainerStarted","Data":"e93dde450b87911c55b5e6309fad7d32ab477c7e843b25d635f97046ec78b9f1"} Jun 02 01:23:10.292813 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:10.292775 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/895ec876-825f-4148-b184-bd690c4203aa-metrics-tls\") pod \"dns-default-nj4t5\" (UID: \"895ec876-825f-4148-b184-bd690c4203aa\") " pod="openshift-dns/dns-default-nj4t5" Jun 02 01:23:10.292813 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:10.292820 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c798c74-1434-4c07-86ab-2a20929dbb66-registry-tls\") pod \"image-registry-6486bbbddc-s644j\" (UID: \"0c798c74-1434-4c07-86ab-2a20929dbb66\") " pod="openshift-image-registry/image-registry-6486bbbddc-s644j" Jun 02 01:23:10.293086 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:10.292895 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b09f852-0fa3-468e-b22e-8d25a143efc8-cert\") pod \"ingress-canary-m96w4\" (UID: \"3b09f852-0fa3-468e-b22e-8d25a143efc8\") " pod="openshift-ingress-canary/ingress-canary-m96w4" Jun 02 01:23:10.293086 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:10.292969 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:23:10.293086 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:10.292980 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:23:10.293086 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:10.292994 2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 01:23:10.293086 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:10.293009 2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6486bbbddc-s644j: secret "image-registry-tls" not found Jun 02 01:23:10.293086 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:10.293037 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b09f852-0fa3-468e-b22e-8d25a143efc8-cert podName:3b09f852-0fa3-468e-b22e-8d25a143efc8 nodeName:}" failed. No retries permitted until 2026-06-02 01:23:14.293022419 +0000 UTC m=+42.622657315 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3b09f852-0fa3-468e-b22e-8d25a143efc8-cert") pod "ingress-canary-m96w4" (UID: "3b09f852-0fa3-468e-b22e-8d25a143efc8") : secret "canary-serving-cert" not found Jun 02 01:23:10.293086 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:10.293054 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0c798c74-1434-4c07-86ab-2a20929dbb66-registry-tls podName:0c798c74-1434-4c07-86ab-2a20929dbb66 nodeName:}" failed. No retries permitted until 2026-06-02 01:23:14.293041579 +0000 UTC m=+42.622676476 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0c798c74-1434-4c07-86ab-2a20929dbb66-registry-tls") pod "image-registry-6486bbbddc-s644j" (UID: "0c798c74-1434-4c07-86ab-2a20929dbb66") : secret "image-registry-tls" not found Jun 02 01:23:10.293086 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:10.293067 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/895ec876-825f-4148-b184-bd690c4203aa-metrics-tls podName:895ec876-825f-4148-b184-bd690c4203aa nodeName:}" failed. No retries permitted until 2026-06-02 01:23:14.293061903 +0000 UTC m=+42.622696802 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/895ec876-825f-4148-b184-bd690c4203aa-metrics-tls") pod "dns-default-nj4t5" (UID: "895ec876-825f-4148-b184-bd690c4203aa") : secret "dns-default-metrics-tls" not found Jun 02 01:23:13.368033 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.367993 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9874c78b-pg9jr"] Jun 02 01:23:13.385637 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.385602 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f574b8b74-gdgrj"] Jun 02 01:23:13.399613 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.399584 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4959659c-h454h"] Jun 02 01:23:13.399772 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.399643 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9874c78b-pg9jr" Jun 02 01:23:13.399856 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.399768 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f574b8b74-gdgrj" Jun 02 01:23:13.402365 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.402345 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 02 01:23:13.402587 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.402400 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-r8t9n\"" Jun 02 01:23:13.402698 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.402411 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 02 01:23:13.402698 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.402462 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 02 01:23:13.402698 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.402472 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 02 01:23:13.402698 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.402683 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 02 01:23:13.413782 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.413762 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9874c78b-pg9jr"] Jun 02 01:23:13.413937 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.413787 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f574b8b74-gdgrj"] Jun 02 01:23:13.413937 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.413802 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4959659c-h454h"] Jun 02 01:23:13.413937 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.413898 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4959659c-h454h" Jun 02 01:23:13.416715 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.416694 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 02 01:23:13.416829 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.416745 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 02 01:23:13.416829 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.416749 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 02 01:23:13.416984 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.416880 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 02 01:23:13.521703 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.521664 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/beafa175-5e47-4e56-a7d9-ce33a41bc79f-klusterlet-config\") pod \"klusterlet-addon-workmgr-5f574b8b74-gdgrj\" (UID: \"beafa175-5e47-4e56-a7d9-ce33a41bc79f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f574b8b74-gdgrj" Jun 02 01:23:13.521928 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.521714 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7fea02a9-7e42-4aac-a123-2c33331b64fd-ca\") pod \"cluster-proxy-proxy-agent-c4959659c-h454h\" (UID: \"7fea02a9-7e42-4aac-a123-2c33331b64fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4959659c-h454h" Jun 02 01:23:13.521928 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.521816 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/beafa175-5e47-4e56-a7d9-ce33a41bc79f-tmp\") pod \"klusterlet-addon-workmgr-5f574b8b74-gdgrj\" (UID: \"beafa175-5e47-4e56-a7d9-ce33a41bc79f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f574b8b74-gdgrj" Jun 02 01:23:13.521928 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.521874 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/7fea02a9-7e42-4aac-a123-2c33331b64fd-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-c4959659c-h454h\" (UID: \"7fea02a9-7e42-4aac-a123-2c33331b64fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4959659c-h454h" Jun 02 01:23:13.522094 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.521939 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/47e4f640-0ea2-4443-9fca-1f05dc7d12e7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-9874c78b-pg9jr\" (UID: \"47e4f640-0ea2-4443-9fca-1f05dc7d12e7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9874c78b-pg9jr" Jun 02 01:23:13.522094 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.521963 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlrl2\" (UniqueName: \"kubernetes.io/projected/47e4f640-0ea2-4443-9fca-1f05dc7d12e7-kube-api-access-xlrl2\") pod \"managed-serviceaccount-addon-agent-9874c78b-pg9jr\" (UID: \"47e4f640-0ea2-4443-9fca-1f05dc7d12e7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9874c78b-pg9jr" Jun 02 01:23:13.522094 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.521994 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zz64k\" (UniqueName: \"kubernetes.io/projected/beafa175-5e47-4e56-a7d9-ce33a41bc79f-kube-api-access-zz64k\") pod \"klusterlet-addon-workmgr-5f574b8b74-gdgrj\" (UID: \"beafa175-5e47-4e56-a7d9-ce33a41bc79f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f574b8b74-gdgrj" Jun 02 01:23:13.522094 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.522054 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7fea02a9-7e42-4aac-a123-2c33331b64fd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-c4959659c-h454h\" (UID: \"7fea02a9-7e42-4aac-a123-2c33331b64fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4959659c-h454h" Jun 02 01:23:13.522094 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.522088 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7fea02a9-7e42-4aac-a123-2c33331b64fd-hub\") pod \"cluster-proxy-proxy-agent-c4959659c-h454h\" (UID: \"7fea02a9-7e42-4aac-a123-2c33331b64fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4959659c-h454h" Jun 02 01:23:13.522291 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.522133 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7fea02a9-7e42-4aac-a123-2c33331b64fd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-c4959659c-h454h\" (UID: \"7fea02a9-7e42-4aac-a123-2c33331b64fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4959659c-h454h" Jun 02 01:23:13.522291 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.522153 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9nfg\" (UniqueName: \"kubernetes.io/projected/7fea02a9-7e42-4aac-a123-2c33331b64fd-kube-api-access-t9nfg\") pod \"cluster-proxy-proxy-agent-c4959659c-h454h\" (UID: \"7fea02a9-7e42-4aac-a123-2c33331b64fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4959659c-h454h" Jun 02 01:23:13.623021 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.622928 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/beafa175-5e47-4e56-a7d9-ce33a41bc79f-klusterlet-config\") pod \"klusterlet-addon-workmgr-5f574b8b74-gdgrj\" (UID: \"beafa175-5e47-4e56-a7d9-ce33a41bc79f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f574b8b74-gdgrj" Jun 02 01:23:13.623021 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.622972 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7fea02a9-7e42-4aac-a123-2c33331b64fd-ca\") pod \"cluster-proxy-proxy-agent-c4959659c-h454h\" (UID: \"7fea02a9-7e42-4aac-a123-2c33331b64fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4959659c-h454h" Jun 02 01:23:13.623021 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.623013 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/beafa175-5e47-4e56-a7d9-ce33a41bc79f-tmp\") pod \"klusterlet-addon-workmgr-5f574b8b74-gdgrj\" (UID: \"beafa175-5e47-4e56-a7d9-ce33a41bc79f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f574b8b74-gdgrj" Jun 02 01:23:13.623288 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.623109 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/7fea02a9-7e42-4aac-a123-2c33331b64fd-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-c4959659c-h454h\" (UID: \"7fea02a9-7e42-4aac-a123-2c33331b64fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4959659c-h454h" Jun 02 01:23:13.623288 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.623197 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/47e4f640-0ea2-4443-9fca-1f05dc7d12e7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-9874c78b-pg9jr\" (UID: \"47e4f640-0ea2-4443-9fca-1f05dc7d12e7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9874c78b-pg9jr" Jun 02 01:23:13.623288 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.623231 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xlrl2\" (UniqueName: \"kubernetes.io/projected/47e4f640-0ea2-4443-9fca-1f05dc7d12e7-kube-api-access-xlrl2\") pod \"managed-serviceaccount-addon-agent-9874c78b-pg9jr\" (UID: \"47e4f640-0ea2-4443-9fca-1f05dc7d12e7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9874c78b-pg9jr" Jun 02 01:23:13.623288 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.623256 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zz64k\" (UniqueName: \"kubernetes.io/projected/beafa175-5e47-4e56-a7d9-ce33a41bc79f-kube-api-access-zz64k\") pod \"klusterlet-addon-workmgr-5f574b8b74-gdgrj\" (UID: \"beafa175-5e47-4e56-a7d9-ce33a41bc79f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f574b8b74-gdgrj" Jun 02 01:23:13.623465 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.623293 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7fea02a9-7e42-4aac-a123-2c33331b64fd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-c4959659c-h454h\" (UID: \"7fea02a9-7e42-4aac-a123-2c33331b64fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4959659c-h454h" Jun 02 01:23:13.623465 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.623316 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7fea02a9-7e42-4aac-a123-2c33331b64fd-hub\") pod \"cluster-proxy-proxy-agent-c4959659c-h454h\" (UID: \"7fea02a9-7e42-4aac-a123-2c33331b64fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4959659c-h454h" Jun 02 01:23:13.623465 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.623348 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7fea02a9-7e42-4aac-a123-2c33331b64fd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-c4959659c-h454h\" (UID: \"7fea02a9-7e42-4aac-a123-2c33331b64fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4959659c-h454h" Jun 02 01:23:13.623465 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.623400 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t9nfg\" (UniqueName: \"kubernetes.io/projected/7fea02a9-7e42-4aac-a123-2c33331b64fd-kube-api-access-t9nfg\") pod \"cluster-proxy-proxy-agent-c4959659c-h454h\" (UID: \"7fea02a9-7e42-4aac-a123-2c33331b64fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4959659c-h454h" Jun 02 01:23:13.623659 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.623531 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/beafa175-5e47-4e56-a7d9-ce33a41bc79f-tmp\") pod \"klusterlet-addon-workmgr-5f574b8b74-gdgrj\" (UID: \"beafa175-5e47-4e56-a7d9-ce33a41bc79f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f574b8b74-gdgrj" Jun 02 01:23:13.624032 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.623904 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/7fea02a9-7e42-4aac-a123-2c33331b64fd-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-c4959659c-h454h\" (UID: \"7fea02a9-7e42-4aac-a123-2c33331b64fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4959659c-h454h" Jun 02 01:23:13.627256 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.627231 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7fea02a9-7e42-4aac-a123-2c33331b64fd-ca\") pod \"cluster-proxy-proxy-agent-c4959659c-h454h\" (UID: \"7fea02a9-7e42-4aac-a123-2c33331b64fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4959659c-h454h" Jun 02 01:23:13.627406 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.627384 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/beafa175-5e47-4e56-a7d9-ce33a41bc79f-klusterlet-config\") pod \"klusterlet-addon-workmgr-5f574b8b74-gdgrj\" (UID: \"beafa175-5e47-4e56-a7d9-ce33a41bc79f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f574b8b74-gdgrj" Jun 02 01:23:13.627448 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.627385 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7fea02a9-7e42-4aac-a123-2c33331b64fd-hub\") pod \"cluster-proxy-proxy-agent-c4959659c-h454h\" (UID: \"7fea02a9-7e42-4aac-a123-2c33331b64fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4959659c-h454h" Jun 02 01:23:13.628516 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.628491 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7fea02a9-7e42-4aac-a123-2c33331b64fd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-c4959659c-h454h\" (UID: \"7fea02a9-7e42-4aac-a123-2c33331b64fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4959659c-h454h" Jun 02 01:23:13.628770 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.628750 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/47e4f640-0ea2-4443-9fca-1f05dc7d12e7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-9874c78b-pg9jr\" (UID: \"47e4f640-0ea2-4443-9fca-1f05dc7d12e7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9874c78b-pg9jr" Jun 02 01:23:13.629024 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.629003 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7fea02a9-7e42-4aac-a123-2c33331b64fd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-c4959659c-h454h\" (UID: \"7fea02a9-7e42-4aac-a123-2c33331b64fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4959659c-h454h" Jun 02 01:23:13.631701 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.631678 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlrl2\" (UniqueName: \"kubernetes.io/projected/47e4f640-0ea2-4443-9fca-1f05dc7d12e7-kube-api-access-xlrl2\") pod \"managed-serviceaccount-addon-agent-9874c78b-pg9jr\" (UID: \"47e4f640-0ea2-4443-9fca-1f05dc7d12e7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9874c78b-pg9jr" Jun 02 01:23:13.632003 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.631984 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9nfg\" (UniqueName: \"kubernetes.io/projected/7fea02a9-7e42-4aac-a123-2c33331b64fd-kube-api-access-t9nfg\") pod \"cluster-proxy-proxy-agent-c4959659c-h454h\" (UID: \"7fea02a9-7e42-4aac-a123-2c33331b64fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4959659c-h454h" Jun 02 01:23:13.632118 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.632100 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zz64k\" (UniqueName: \"kubernetes.io/projected/beafa175-5e47-4e56-a7d9-ce33a41bc79f-kube-api-access-zz64k\") pod \"klusterlet-addon-workmgr-5f574b8b74-gdgrj\" (UID: \"beafa175-5e47-4e56-a7d9-ce33a41bc79f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f574b8b74-gdgrj" Jun 02 01:23:13.723921 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.723865 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9874c78b-pg9jr" Jun 02 01:23:13.731691 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.731662 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f574b8b74-gdgrj" Jun 02 01:23:13.737457 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:13.737434 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4959659c-h454h" Jun 02 01:23:14.328231 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:14.328187 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b09f852-0fa3-468e-b22e-8d25a143efc8-cert\") pod \"ingress-canary-m96w4\" (UID: \"3b09f852-0fa3-468e-b22e-8d25a143efc8\") " pod="openshift-ingress-canary/ingress-canary-m96w4" Jun 02 01:23:14.328426 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:14.328242 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/895ec876-825f-4148-b184-bd690c4203aa-metrics-tls\") pod \"dns-default-nj4t5\" (UID: \"895ec876-825f-4148-b184-bd690c4203aa\") " pod="openshift-dns/dns-default-nj4t5" Jun 02 01:23:14.328426 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:14.328268 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c798c74-1434-4c07-86ab-2a20929dbb66-registry-tls\") pod \"image-registry-6486bbbddc-s644j\" (UID: \"0c798c74-1434-4c07-86ab-2a20929dbb66\") " pod="openshift-image-registry/image-registry-6486bbbddc-s644j" Jun 02 01:23:14.328426 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:14.328303 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:23:14.328426 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:14.328381 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b09f852-0fa3-468e-b22e-8d25a143efc8-cert podName:3b09f852-0fa3-468e-b22e-8d25a143efc8 nodeName:}" failed. No retries permitted until 2026-06-02 01:23:22.328366198 +0000 UTC m=+50.658001095 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3b09f852-0fa3-468e-b22e-8d25a143efc8-cert") pod "ingress-canary-m96w4" (UID: "3b09f852-0fa3-468e-b22e-8d25a143efc8") : secret "canary-serving-cert" not found Jun 02 01:23:14.328426 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:14.328384 2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 01:23:14.328426 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:14.328388 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:23:14.328426 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:14.328398 2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6486bbbddc-s644j: secret "image-registry-tls" not found Jun 02 01:23:14.328669 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:14.328442 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/895ec876-825f-4148-b184-bd690c4203aa-metrics-tls podName:895ec876-825f-4148-b184-bd690c4203aa nodeName:}" failed. No retries permitted until 2026-06-02 01:23:22.328423323 +0000 UTC m=+50.658058238 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/895ec876-825f-4148-b184-bd690c4203aa-metrics-tls") pod "dns-default-nj4t5" (UID: "895ec876-825f-4148-b184-bd690c4203aa") : secret "dns-default-metrics-tls" not found Jun 02 01:23:14.328669 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:14.328459 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0c798c74-1434-4c07-86ab-2a20929dbb66-registry-tls podName:0c798c74-1434-4c07-86ab-2a20929dbb66 nodeName:}" failed. No retries permitted until 2026-06-02 01:23:22.328448693 +0000 UTC m=+50.658083589 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0c798c74-1434-4c07-86ab-2a20929dbb66-registry-tls") pod "image-registry-6486bbbddc-s644j" (UID: "0c798c74-1434-4c07-86ab-2a20929dbb66") : secret "image-registry-tls" not found Jun 02 01:23:14.902629 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:14.902427 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f574b8b74-gdgrj"] Jun 02 01:23:14.908482 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:14.908457 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4959659c-h454h"] Jun 02 01:23:14.909182 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:23:14.909147 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeafa175_5e47_4e56_a7d9_ce33a41bc79f.slice/crio-cc37e36af6d82bdb2d4bbea9ab7f9269eae655d4c99ce606fde100ec5c2b9a13 WatchSource:0}: Error finding container cc37e36af6d82bdb2d4bbea9ab7f9269eae655d4c99ce606fde100ec5c2b9a13: Status 404 returned error can't find the container with id cc37e36af6d82bdb2d4bbea9ab7f9269eae655d4c99ce606fde100ec5c2b9a13 Jun 02 01:23:14.912783 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:23:14.912758 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7fea02a9_7e42_4aac_a123_2c33331b64fd.slice/crio-34e899f2d0c7fe993b0d2822de4f5de2935c202f79cb508b9edc6c762b104e5a WatchSource:0}: Error finding container 34e899f2d0c7fe993b0d2822de4f5de2935c202f79cb508b9edc6c762b104e5a: Status 404 returned error can't find the container with id 34e899f2d0c7fe993b0d2822de4f5de2935c202f79cb508b9edc6c762b104e5a Jun 02 01:23:14.921873 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:14.919423 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9874c78b-pg9jr"] Jun 02 01:23:14.927312 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:23:14.927284 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod47e4f640_0ea2_4443_9fca_1f05dc7d12e7.slice/crio-d52ee4809c7a4d7871c63fa0da9421c28db9e4e765f9a3638af91c6de305da2e WatchSource:0}: Error finding container d52ee4809c7a4d7871c63fa0da9421c28db9e4e765f9a3638af91c6de305da2e: Status 404 returned error can't find the container with id d52ee4809c7a4d7871c63fa0da9421c28db9e4e765f9a3638af91c6de305da2e Jun 02 01:23:15.432703 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:15.432662 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f574b8b74-gdgrj" event={"ID":"beafa175-5e47-4e56-a7d9-ce33a41bc79f","Type":"ContainerStarted","Data":"cc37e36af6d82bdb2d4bbea9ab7f9269eae655d4c99ce606fde100ec5c2b9a13"} Jun 02 01:23:15.433719 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:15.433683 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4959659c-h454h" event={"ID":"7fea02a9-7e42-4aac-a123-2c33331b64fd","Type":"ContainerStarted","Data":"34e899f2d0c7fe993b0d2822de4f5de2935c202f79cb508b9edc6c762b104e5a"} Jun 02 01:23:15.435988 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:15.435960 2559 generic.go:358] "Generic (PLEG): container finished" podID="864222f2-b558-4380-b095-b1f285e5b91c" containerID="56ad5f084c344dafef4a1c91749836ffe6bf470a53277974a8999e0d537d1b7e" exitCode=0 Jun 02 01:23:15.436097 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:15.436037 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nqdhn" event={"ID":"864222f2-b558-4380-b095-b1f285e5b91c","Type":"ContainerDied","Data":"56ad5f084c344dafef4a1c91749836ffe6bf470a53277974a8999e0d537d1b7e"} Jun 02 01:23:15.437320 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:15.437294 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9slcd" event={"ID":"a69176c4-7342-45a1-87c5-7a25614b5f02","Type":"ContainerStarted","Data":"11e12de6fbdd13451c7ceec6a7d276043e97211030c6e752b06c20edbe61805e"} Jun 02 01:23:15.438350 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:15.438325 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9874c78b-pg9jr" event={"ID":"47e4f640-0ea2-4443-9fca-1f05dc7d12e7","Type":"ContainerStarted","Data":"d52ee4809c7a4d7871c63fa0da9421c28db9e4e765f9a3638af91c6de305da2e"} Jun 02 01:23:15.472084 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:15.471290 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9slcd" podStartSLOduration=17.659992211 podStartE2EDuration="23.47127322s" podCreationTimestamp="2026-06-02 01:22:52 +0000 UTC" firstStartedPulling="2026-06-02 01:23:08.920609786 +0000 UTC m=+37.250244682" lastFinishedPulling="2026-06-02 01:23:14.731890791 +0000 UTC m=+43.061525691" observedRunningTime="2026-06-02 01:23:15.470705205 +0000 UTC m=+43.800340128" watchObservedRunningTime="2026-06-02 01:23:15.47127322 +0000 UTC m=+43.800908154" Jun 02 01:23:16.447871 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:16.446913 2559 generic.go:358] "Generic (PLEG): container finished" podID="864222f2-b558-4380-b095-b1f285e5b91c" containerID="7c5bb0a8871a38fd28b3f4a588a1c574c02f321858dd0e938a3cc2b5cf6b337f" exitCode=0 Jun 02 01:23:16.448446 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:16.448075 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nqdhn" event={"ID":"864222f2-b558-4380-b095-b1f285e5b91c","Type":"ContainerDied","Data":"7c5bb0a8871a38fd28b3f4a588a1c574c02f321858dd0e938a3cc2b5cf6b337f"} Jun 02 01:23:17.456688 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:17.455959 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nqdhn" event={"ID":"864222f2-b558-4380-b095-b1f285e5b91c","Type":"ContainerStarted","Data":"5093a03e719acf3b850da0209d3956f8a018ca750de2c9923b92643ca0970187"} Jun 02 01:23:17.480150 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:17.480088 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-nqdhn" podStartSLOduration=5.531394905 podStartE2EDuration="45.480070107s" podCreationTimestamp="2026-06-02 01:22:32 +0000 UTC" firstStartedPulling="2026-06-02 01:22:34.787117007 +0000 UTC m=+3.116751916" lastFinishedPulling="2026-06-02 01:23:14.735792214 +0000 UTC m=+43.065427118" observedRunningTime="2026-06-02 01:23:17.478446304 +0000 UTC m=+45.808081224" watchObservedRunningTime="2026-06-02 01:23:17.480070107 +0000 UTC m=+45.809705031" Jun 02 01:23:22.391688 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:22.391659 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b09f852-0fa3-468e-b22e-8d25a143efc8-cert\") pod \"ingress-canary-m96w4\" (UID: \"3b09f852-0fa3-468e-b22e-8d25a143efc8\") " pod="openshift-ingress-canary/ingress-canary-m96w4" Jun 02 01:23:22.391960 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:22.391708 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/895ec876-825f-4148-b184-bd690c4203aa-metrics-tls\") pod \"dns-default-nj4t5\" (UID: \"895ec876-825f-4148-b184-bd690c4203aa\") " pod="openshift-dns/dns-default-nj4t5" Jun 02 01:23:22.391960 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:22.391734 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c798c74-1434-4c07-86ab-2a20929dbb66-registry-tls\") pod \"image-registry-6486bbbddc-s644j\" (UID: \"0c798c74-1434-4c07-86ab-2a20929dbb66\") " pod="openshift-image-registry/image-registry-6486bbbddc-s644j" Jun 02 01:23:22.391960 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:22.391816 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:23:22.391960 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:22.391822 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:23:22.391960 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:22.391861 2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 01:23:22.391960 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:22.391873 2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6486bbbddc-s644j: secret "image-registry-tls" not found Jun 02 01:23:22.391960 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:22.391906 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/895ec876-825f-4148-b184-bd690c4203aa-metrics-tls podName:895ec876-825f-4148-b184-bd690c4203aa nodeName:}" failed. No retries permitted until 2026-06-02 01:23:38.391887385 +0000 UTC m=+66.721522283 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/895ec876-825f-4148-b184-bd690c4203aa-metrics-tls") pod "dns-default-nj4t5" (UID: "895ec876-825f-4148-b184-bd690c4203aa") : secret "dns-default-metrics-tls" not found Jun 02 01:23:22.391960 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:22.391923 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b09f852-0fa3-468e-b22e-8d25a143efc8-cert podName:3b09f852-0fa3-468e-b22e-8d25a143efc8 nodeName:}" failed. No retries permitted until 2026-06-02 01:23:38.391914634 +0000 UTC m=+66.721549531 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3b09f852-0fa3-468e-b22e-8d25a143efc8-cert") pod "ingress-canary-m96w4" (UID: "3b09f852-0fa3-468e-b22e-8d25a143efc8") : secret "canary-serving-cert" not found Jun 02 01:23:22.391960 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:22.391937 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0c798c74-1434-4c07-86ab-2a20929dbb66-registry-tls podName:0c798c74-1434-4c07-86ab-2a20929dbb66 nodeName:}" failed. No retries permitted until 2026-06-02 01:23:38.391929598 +0000 UTC m=+66.721564500 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0c798c74-1434-4c07-86ab-2a20929dbb66-registry-tls") pod "image-registry-6486bbbddc-s644j" (UID: "0c798c74-1434-4c07-86ab-2a20929dbb66") : secret "image-registry-tls" not found Jun 02 01:23:23.471099 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:23.471063 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f574b8b74-gdgrj" event={"ID":"beafa175-5e47-4e56-a7d9-ce33a41bc79f","Type":"ContainerStarted","Data":"bf39e59d0007897b61cad494ceed9f31bbc5539e2d7216167cfdf39f50842543"} Jun 02 01:23:23.471549 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:23.471263 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f574b8b74-gdgrj" Jun 02 01:23:23.472496 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:23.472467 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4959659c-h454h" event={"ID":"7fea02a9-7e42-4aac-a123-2c33331b64fd","Type":"ContainerStarted","Data":"dc84252358258545c07a78c7f0ae9a9cc724e56b3d614d87f085fa318e862950"} Jun 02 01:23:23.473078 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:23.473059 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f574b8b74-gdgrj" Jun 02 01:23:23.473774 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:23.473752 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9874c78b-pg9jr" event={"ID":"47e4f640-0ea2-4443-9fca-1f05dc7d12e7","Type":"ContainerStarted","Data":"c2012914d1fb87d5d32cb76f757c5801642ba310f848f5d01edb7805274a2697"} Jun 02 01:23:23.488929 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:23.488872 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f574b8b74-gdgrj" podStartSLOduration=2.7215218610000003 podStartE2EDuration="10.488857909s" podCreationTimestamp="2026-06-02 01:23:13 +0000 UTC" firstStartedPulling="2026-06-02 01:23:14.910951424 +0000 UTC m=+43.240586323" lastFinishedPulling="2026-06-02 01:23:22.678287472 +0000 UTC m=+51.007922371" observedRunningTime="2026-06-02 01:23:23.488228756 +0000 UTC m=+51.817863679" watchObservedRunningTime="2026-06-02 01:23:23.488857909 +0000 UTC m=+51.818492828" Jun 02 01:23:23.504043 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:23.504007 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9874c78b-pg9jr" podStartSLOduration=2.7714434629999998 podStartE2EDuration="10.50399578s" podCreationTimestamp="2026-06-02 01:23:13 +0000 UTC" firstStartedPulling="2026-06-02 01:23:14.929391312 +0000 UTC m=+43.259026209" lastFinishedPulling="2026-06-02 01:23:22.661943629 +0000 UTC m=+50.991578526" observedRunningTime="2026-06-02 01:23:23.503104738 +0000 UTC m=+51.832739648" watchObservedRunningTime="2026-06-02 01:23:23.50399578 +0000 UTC m=+51.833630722" Jun 02 01:23:26.482363 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:26.482261 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4959659c-h454h" event={"ID":"7fea02a9-7e42-4aac-a123-2c33331b64fd","Type":"ContainerStarted","Data":"22a425d2fe6ca284c1a47c43da4ecce7d0d356ed9f40e6d3454d4d760f84060f"} Jun 02 01:23:26.482363 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:26.482306 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4959659c-h454h" event={"ID":"7fea02a9-7e42-4aac-a123-2c33331b64fd","Type":"ContainerStarted","Data":"de2ebed51f76b4d8930e110c4cb3314c57bb06da8185a4bcc66306b484ad3df4"} Jun 02 01:23:33.420722 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:33.420694 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9jfrv" Jun 02 01:23:33.445686 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:33.445639 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4959659c-h454h" podStartSLOduration=9.219782877 podStartE2EDuration="20.445624328s" podCreationTimestamp="2026-06-02 01:23:13 +0000 UTC" firstStartedPulling="2026-06-02 01:23:14.915582824 +0000 UTC m=+43.245217724" lastFinishedPulling="2026-06-02 01:23:26.141424277 +0000 UTC m=+54.471059175" observedRunningTime="2026-06-02 01:23:26.499409576 +0000 UTC m=+54.829044510" watchObservedRunningTime="2026-06-02 01:23:33.445624328 +0000 UTC m=+61.775259302" Jun 02 01:23:37.913351 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:37.913315 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/564c53f1-521a-42b2-8353-80c10ff44bb2-metrics-certs\") pod \"network-metrics-daemon-96l4l\" (UID: \"564c53f1-521a-42b2-8353-80c10ff44bb2\") " pod="openshift-multus/network-metrics-daemon-96l4l" Jun 02 01:23:37.916185 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:37.916163 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 01:23:37.924209 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:37.924189 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 01:23:37.924265 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:37.924251 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/564c53f1-521a-42b2-8353-80c10ff44bb2-metrics-certs podName:564c53f1-521a-42b2-8353-80c10ff44bb2 nodeName:}" failed. No retries permitted until 2026-06-02 01:24:41.92423596 +0000 UTC m=+130.253870858 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/564c53f1-521a-42b2-8353-80c10ff44bb2-metrics-certs") pod "network-metrics-daemon-96l4l" (UID: "564c53f1-521a-42b2-8353-80c10ff44bb2") : secret "metrics-daemon-secret" not found Jun 02 01:23:38.014151 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:38.014116 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d4tgk\" (UniqueName: \"kubernetes.io/projected/ea44904f-42c9-44c6-84d2-06d8daf3412c-kube-api-access-d4tgk\") pod \"network-check-target-gcs7z\" (UID: \"ea44904f-42c9-44c6-84d2-06d8daf3412c\") " pod="openshift-network-diagnostics/network-check-target-gcs7z" Jun 02 01:23:38.016910 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:38.016893 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 01:23:38.026914 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:38.026894 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 01:23:38.039404 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:38.039378 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4tgk\" (UniqueName: \"kubernetes.io/projected/ea44904f-42c9-44c6-84d2-06d8daf3412c-kube-api-access-d4tgk\") pod \"network-check-target-gcs7z\" (UID: \"ea44904f-42c9-44c6-84d2-06d8daf3412c\") " pod="openshift-network-diagnostics/network-check-target-gcs7z" Jun 02 01:23:38.151057 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:38.151025 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tm89p\"" Jun 02 01:23:38.158738 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:38.158717 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gcs7z" Jun 02 01:23:38.280332 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:38.280294 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gcs7z"] Jun 02 01:23:38.283586 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:23:38.283557 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea44904f_42c9_44c6_84d2_06d8daf3412c.slice/crio-4e42b7994d16bbf515e017267d3de969b88409f8c45f7913782ec2097aa8a362 WatchSource:0}: Error finding container 4e42b7994d16bbf515e017267d3de969b88409f8c45f7913782ec2097aa8a362: Status 404 returned error can't find the container with id 4e42b7994d16bbf515e017267d3de969b88409f8c45f7913782ec2097aa8a362 Jun 02 01:23:38.418039 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:38.417935 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b09f852-0fa3-468e-b22e-8d25a143efc8-cert\") pod \"ingress-canary-m96w4\" (UID: \"3b09f852-0fa3-468e-b22e-8d25a143efc8\") " pod="openshift-ingress-canary/ingress-canary-m96w4" Jun 02 01:23:38.418039 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:38.417998 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/895ec876-825f-4148-b184-bd690c4203aa-metrics-tls\") pod \"dns-default-nj4t5\" (UID: \"895ec876-825f-4148-b184-bd690c4203aa\") " pod="openshift-dns/dns-default-nj4t5" Jun 02 01:23:38.418039 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:38.418031 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c798c74-1434-4c07-86ab-2a20929dbb66-registry-tls\") pod \"image-registry-6486bbbddc-s644j\" (UID: \"0c798c74-1434-4c07-86ab-2a20929dbb66\") " pod="openshift-image-registry/image-registry-6486bbbddc-s644j" Jun 02 01:23:38.418325 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:38.418103 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:23:38.418325 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:38.418153 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:23:38.418325 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:38.418168 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b09f852-0fa3-468e-b22e-8d25a143efc8-cert podName:3b09f852-0fa3-468e-b22e-8d25a143efc8 nodeName:}" failed. No retries permitted until 2026-06-02 01:24:10.418150468 +0000 UTC m=+98.747785378 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3b09f852-0fa3-468e-b22e-8d25a143efc8-cert") pod "ingress-canary-m96w4" (UID: "3b09f852-0fa3-468e-b22e-8d25a143efc8") : secret "canary-serving-cert" not found Jun 02 01:23:38.418325 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:38.418206 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/895ec876-825f-4148-b184-bd690c4203aa-metrics-tls podName:895ec876-825f-4148-b184-bd690c4203aa nodeName:}" failed. No retries permitted until 2026-06-02 01:24:10.41819377 +0000 UTC m=+98.747828679 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/895ec876-825f-4148-b184-bd690c4203aa-metrics-tls") pod "dns-default-nj4t5" (UID: "895ec876-825f-4148-b184-bd690c4203aa") : secret "dns-default-metrics-tls" not found Jun 02 01:23:38.418325 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:38.418216 2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 01:23:38.418325 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:38.418229 2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6486bbbddc-s644j: secret "image-registry-tls" not found Jun 02 01:23:38.418325 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:23:38.418277 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0c798c74-1434-4c07-86ab-2a20929dbb66-registry-tls podName:0c798c74-1434-4c07-86ab-2a20929dbb66 nodeName:}" failed. No retries permitted until 2026-06-02 01:24:10.418262859 +0000 UTC m=+98.747897763 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0c798c74-1434-4c07-86ab-2a20929dbb66-registry-tls") pod "image-registry-6486bbbddc-s644j" (UID: "0c798c74-1434-4c07-86ab-2a20929dbb66") : secret "image-registry-tls" not found Jun 02 01:23:38.511746 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:38.511707 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gcs7z" event={"ID":"ea44904f-42c9-44c6-84d2-06d8daf3412c","Type":"ContainerStarted","Data":"4e42b7994d16bbf515e017267d3de969b88409f8c45f7913782ec2097aa8a362"} Jun 02 01:23:42.523395 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:42.523358 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gcs7z" event={"ID":"ea44904f-42c9-44c6-84d2-06d8daf3412c","Type":"ContainerStarted","Data":"9286a187eb1093c7c4c4014cc9bcd821bcc45cbc2679514468bda1922ccab2a8"} Jun 02 01:23:42.523757 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:42.523470 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gcs7z" Jun 02 01:23:42.540655 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:23:42.539188 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gcs7z" podStartSLOduration=67.215322652 podStartE2EDuration="1m10.53917439s" podCreationTimestamp="2026-06-02 01:22:32 +0000 UTC" firstStartedPulling="2026-06-02 01:23:38.285325995 +0000 UTC m=+66.614960891" lastFinishedPulling="2026-06-02 01:23:41.609177733 +0000 UTC m=+69.938812629" observedRunningTime="2026-06-02 01:23:42.538092729 +0000 UTC m=+70.867727661" watchObservedRunningTime="2026-06-02 01:23:42.53917439 +0000 UTC m=+70.868809320" Jun 02 01:24:10.468724 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:24:10.468688 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/895ec876-825f-4148-b184-bd690c4203aa-metrics-tls\") pod \"dns-default-nj4t5\" (UID: \"895ec876-825f-4148-b184-bd690c4203aa\") " pod="openshift-dns/dns-default-nj4t5" Jun 02 01:24:10.468724 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:24:10.468729 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c798c74-1434-4c07-86ab-2a20929dbb66-registry-tls\") pod \"image-registry-6486bbbddc-s644j\" (UID: \"0c798c74-1434-4c07-86ab-2a20929dbb66\") " pod="openshift-image-registry/image-registry-6486bbbddc-s644j" Jun 02 01:24:10.469305 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:24:10.468774 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b09f852-0fa3-468e-b22e-8d25a143efc8-cert\") pod \"ingress-canary-m96w4\" (UID: \"3b09f852-0fa3-468e-b22e-8d25a143efc8\") " pod="openshift-ingress-canary/ingress-canary-m96w4" Jun 02 01:24:10.469305 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:24:10.468866 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:24:10.469305 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:24:10.468885 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:24:10.469305 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:24:10.468904 2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 01:24:10.469305 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:24:10.468919 2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6486bbbddc-s644j: secret "image-registry-tls" not found Jun 02 01:24:10.469305 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:24:10.468948 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b09f852-0fa3-468e-b22e-8d25a143efc8-cert podName:3b09f852-0fa3-468e-b22e-8d25a143efc8 nodeName:}" failed. No retries permitted until 2026-06-02 01:25:14.468932815 +0000 UTC m=+162.798567712 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3b09f852-0fa3-468e-b22e-8d25a143efc8-cert") pod "ingress-canary-m96w4" (UID: "3b09f852-0fa3-468e-b22e-8d25a143efc8") : secret "canary-serving-cert" not found Jun 02 01:24:10.469305 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:24:10.468968 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0c798c74-1434-4c07-86ab-2a20929dbb66-registry-tls podName:0c798c74-1434-4c07-86ab-2a20929dbb66 nodeName:}" failed. No retries permitted until 2026-06-02 01:25:14.468953986 +0000 UTC m=+162.798588897 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0c798c74-1434-4c07-86ab-2a20929dbb66-registry-tls") pod "image-registry-6486bbbddc-s644j" (UID: "0c798c74-1434-4c07-86ab-2a20929dbb66") : secret "image-registry-tls" not found Jun 02 01:24:10.469305 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:24:10.468982 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/895ec876-825f-4148-b184-bd690c4203aa-metrics-tls podName:895ec876-825f-4148-b184-bd690c4203aa nodeName:}" failed. No retries permitted until 2026-06-02 01:25:14.468975818 +0000 UTC m=+162.798610715 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/895ec876-825f-4148-b184-bd690c4203aa-metrics-tls") pod "dns-default-nj4t5" (UID: "895ec876-825f-4148-b184-bd690c4203aa") : secret "dns-default-metrics-tls" not found Jun 02 01:24:13.528624 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:24:13.528597 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gcs7z" Jun 02 01:24:42.011410 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:24:42.011374 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/564c53f1-521a-42b2-8353-80c10ff44bb2-metrics-certs\") pod \"network-metrics-daemon-96l4l\" (UID: \"564c53f1-521a-42b2-8353-80c10ff44bb2\") " pod="openshift-multus/network-metrics-daemon-96l4l" Jun 02 01:24:42.011976 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:24:42.011540 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 01:24:42.011976 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:24:42.011632 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/564c53f1-521a-42b2-8353-80c10ff44bb2-metrics-certs podName:564c53f1-521a-42b2-8353-80c10ff44bb2 nodeName:}" failed. No retries permitted until 2026-06-02 01:26:44.011609267 +0000 UTC m=+252.341244164 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/564c53f1-521a-42b2-8353-80c10ff44bb2-metrics-certs") pod "network-metrics-daemon-96l4l" (UID: "564c53f1-521a-42b2-8353-80c10ff44bb2") : secret "metrics-daemon-secret" not found Jun 02 01:24:49.758111 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:24:49.758081 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5tkrg_ce15d2ed-5b70-4ef5-bc2c-bdd6c25be7d5/dns-node-resolver/0.log" Jun 02 01:24:50.757972 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:24:50.757945 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7xkdt_4449e4e0-b633-4914-a364-3a22b3408589/node-ca/0.log" Jun 02 01:25:09.533635 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:25:09.533592 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6486bbbddc-s644j" podUID="0c798c74-1434-4c07-86ab-2a20929dbb66" Jun 02 01:25:09.553844 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:25:09.553799 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-m96w4" podUID="3b09f852-0fa3-468e-b22e-8d25a143efc8" Jun 02 01:25:09.576183 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:25:09.576150 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-nj4t5" podUID="895ec876-825f-4148-b184-bd690c4203aa" Jun 02 01:25:09.724433 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:09.724398 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m96w4" Jun 02 01:25:09.962258 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:09.962174 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-54c8v"] Jun 02 01:25:09.965093 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:09.965076 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-54c8v" Jun 02 01:25:09.967468 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:09.967435 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 02 01:25:09.968324 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:09.968300 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 02 01:25:09.968460 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:09.968395 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 02 01:25:09.968460 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:09.968439 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 02 01:25:09.968570 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:09.968499 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cxmpn\"" Jun 02 01:25:09.976181 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:09.976157 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-54c8v"] Jun 02 01:25:10.137254 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:10.137175 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb48v\" (UniqueName: \"kubernetes.io/projected/7fa14ed3-10cb-425a-aeb4-5a7356537c7c-kube-api-access-nb48v\") pod \"insights-runtime-extractor-54c8v\" (UID: \"7fa14ed3-10cb-425a-aeb4-5a7356537c7c\") " pod="openshift-insights/insights-runtime-extractor-54c8v" Jun 02 01:25:10.137254 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:10.137240 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7fa14ed3-10cb-425a-aeb4-5a7356537c7c-data-volume\") pod \"insights-runtime-extractor-54c8v\" (UID: \"7fa14ed3-10cb-425a-aeb4-5a7356537c7c\") " pod="openshift-insights/insights-runtime-extractor-54c8v" Jun 02 01:25:10.137436 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:10.137295 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7fa14ed3-10cb-425a-aeb4-5a7356537c7c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-54c8v\" (UID: \"7fa14ed3-10cb-425a-aeb4-5a7356537c7c\") " pod="openshift-insights/insights-runtime-extractor-54c8v" Jun 02 01:25:10.137436 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:10.137327 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7fa14ed3-10cb-425a-aeb4-5a7356537c7c-crio-socket\") pod \"insights-runtime-extractor-54c8v\" (UID: \"7fa14ed3-10cb-425a-aeb4-5a7356537c7c\") " pod="openshift-insights/insights-runtime-extractor-54c8v" Jun 02 01:25:10.137436 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:10.137395 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7fa14ed3-10cb-425a-aeb4-5a7356537c7c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-54c8v\" (UID: \"7fa14ed3-10cb-425a-aeb4-5a7356537c7c\") " pod="openshift-insights/insights-runtime-extractor-54c8v" Jun 02 01:25:10.238116 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:25:10.238024 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-96l4l" podUID="564c53f1-521a-42b2-8353-80c10ff44bb2" Jun 02 01:25:10.238274 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:10.238109 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7fa14ed3-10cb-425a-aeb4-5a7356537c7c-data-volume\") pod \"insights-runtime-extractor-54c8v\" (UID: \"7fa14ed3-10cb-425a-aeb4-5a7356537c7c\") " pod="openshift-insights/insights-runtime-extractor-54c8v" Jun 02 01:25:10.238274 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:10.238167 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7fa14ed3-10cb-425a-aeb4-5a7356537c7c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-54c8v\" (UID: \"7fa14ed3-10cb-425a-aeb4-5a7356537c7c\") " pod="openshift-insights/insights-runtime-extractor-54c8v" Jun 02 01:25:10.238274 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:10.238204 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7fa14ed3-10cb-425a-aeb4-5a7356537c7c-crio-socket\") pod \"insights-runtime-extractor-54c8v\" (UID: \"7fa14ed3-10cb-425a-aeb4-5a7356537c7c\") " pod="openshift-insights/insights-runtime-extractor-54c8v" Jun 02 01:25:10.238274 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:10.238223 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7fa14ed3-10cb-425a-aeb4-5a7356537c7c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-54c8v\" (UID: \"7fa14ed3-10cb-425a-aeb4-5a7356537c7c\") " pod="openshift-insights/insights-runtime-extractor-54c8v" Jun 02 01:25:10.238274 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:10.238258 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nb48v\" (UniqueName: \"kubernetes.io/projected/7fa14ed3-10cb-425a-aeb4-5a7356537c7c-kube-api-access-nb48v\") pod \"insights-runtime-extractor-54c8v\" (UID: \"7fa14ed3-10cb-425a-aeb4-5a7356537c7c\") " pod="openshift-insights/insights-runtime-extractor-54c8v" Jun 02 01:25:10.238535 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:10.238317 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7fa14ed3-10cb-425a-aeb4-5a7356537c7c-crio-socket\") pod \"insights-runtime-extractor-54c8v\" (UID: \"7fa14ed3-10cb-425a-aeb4-5a7356537c7c\") " pod="openshift-insights/insights-runtime-extractor-54c8v" Jun 02 01:25:10.238535 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:10.238506 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7fa14ed3-10cb-425a-aeb4-5a7356537c7c-data-volume\") pod \"insights-runtime-extractor-54c8v\" (UID: \"7fa14ed3-10cb-425a-aeb4-5a7356537c7c\") " pod="openshift-insights/insights-runtime-extractor-54c8v" Jun 02 01:25:10.238769 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:10.238745 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7fa14ed3-10cb-425a-aeb4-5a7356537c7c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-54c8v\" (UID: \"7fa14ed3-10cb-425a-aeb4-5a7356537c7c\") " pod="openshift-insights/insights-runtime-extractor-54c8v" Jun 02 01:25:10.240732 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:10.240711 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7fa14ed3-10cb-425a-aeb4-5a7356537c7c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-54c8v\" (UID: \"7fa14ed3-10cb-425a-aeb4-5a7356537c7c\") " pod="openshift-insights/insights-runtime-extractor-54c8v" Jun 02 01:25:10.247661 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:10.247629 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb48v\" (UniqueName: \"kubernetes.io/projected/7fa14ed3-10cb-425a-aeb4-5a7356537c7c-kube-api-access-nb48v\") pod \"insights-runtime-extractor-54c8v\" (UID: \"7fa14ed3-10cb-425a-aeb4-5a7356537c7c\") " pod="openshift-insights/insights-runtime-extractor-54c8v" Jun 02 01:25:10.274651 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:10.274616 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-54c8v" Jun 02 01:25:10.403356 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:10.403326 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-54c8v"] Jun 02 01:25:10.408267 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:25:10.408222 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fa14ed3_10cb_425a_aeb4_5a7356537c7c.slice/crio-8f1fc13bbbf01e06d86aab84b692d558bce401cf60fe382045a3c1f8077ad0f2 WatchSource:0}: Error finding container 8f1fc13bbbf01e06d86aab84b692d558bce401cf60fe382045a3c1f8077ad0f2: Status 404 returned error can't find the container with id 8f1fc13bbbf01e06d86aab84b692d558bce401cf60fe382045a3c1f8077ad0f2 Jun 02 01:25:10.728286 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:10.728252 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-54c8v" event={"ID":"7fa14ed3-10cb-425a-aeb4-5a7356537c7c","Type":"ContainerStarted","Data":"6426828e54e4420a9292d47fc68f2c24795a6ad0a248ef7967a562bd9a0a87bb"} Jun 02 01:25:10.728286 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:10.728285 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-54c8v" event={"ID":"7fa14ed3-10cb-425a-aeb4-5a7356537c7c","Type":"ContainerStarted","Data":"8f1fc13bbbf01e06d86aab84b692d558bce401cf60fe382045a3c1f8077ad0f2"} Jun 02 01:25:11.733603 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:11.733561 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-54c8v" event={"ID":"7fa14ed3-10cb-425a-aeb4-5a7356537c7c","Type":"ContainerStarted","Data":"9503b5e12fd6a8b48e7935be6c9311529bcd1a4b46353995a44f3937da1f0e51"} Jun 02 01:25:13.740008 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:13.739976 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-54c8v" event={"ID":"7fa14ed3-10cb-425a-aeb4-5a7356537c7c","Type":"ContainerStarted","Data":"d4a143bc3f6895f51bff9a1d1245e851b2fc08e334544214144aaab718379826"} Jun 02 01:25:13.756570 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:13.756526 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-54c8v" podStartSLOduration=2.148880886 podStartE2EDuration="4.756509028s" podCreationTimestamp="2026-06-02 01:25:09 +0000 UTC" firstStartedPulling="2026-06-02 01:25:10.472619489 +0000 UTC m=+158.802254390" lastFinishedPulling="2026-06-02 01:25:13.080247635 +0000 UTC m=+161.409882532" observedRunningTime="2026-06-02 01:25:13.755967989 +0000 UTC m=+162.085602911" watchObservedRunningTime="2026-06-02 01:25:13.756509028 +0000 UTC m=+162.086143949" Jun 02 01:25:14.473488 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:14.473433 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c798c74-1434-4c07-86ab-2a20929dbb66-registry-tls\") pod \"image-registry-6486bbbddc-s644j\" (UID: \"0c798c74-1434-4c07-86ab-2a20929dbb66\") " pod="openshift-image-registry/image-registry-6486bbbddc-s644j" Jun 02 01:25:14.473690 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:14.473514 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b09f852-0fa3-468e-b22e-8d25a143efc8-cert\") pod \"ingress-canary-m96w4\" (UID: \"3b09f852-0fa3-468e-b22e-8d25a143efc8\") " pod="openshift-ingress-canary/ingress-canary-m96w4" Jun 02 01:25:14.473690 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:14.473594 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/895ec876-825f-4148-b184-bd690c4203aa-metrics-tls\") pod \"dns-default-nj4t5\" (UID: \"895ec876-825f-4148-b184-bd690c4203aa\") " pod="openshift-dns/dns-default-nj4t5" Jun 02 01:25:14.476040 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:14.476014 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/895ec876-825f-4148-b184-bd690c4203aa-metrics-tls\") pod \"dns-default-nj4t5\" (UID: \"895ec876-825f-4148-b184-bd690c4203aa\") " pod="openshift-dns/dns-default-nj4t5" Jun 02 01:25:14.476211 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:14.476180 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b09f852-0fa3-468e-b22e-8d25a143efc8-cert\") pod \"ingress-canary-m96w4\" (UID: \"3b09f852-0fa3-468e-b22e-8d25a143efc8\") " pod="openshift-ingress-canary/ingress-canary-m96w4" Jun 02 01:25:14.476268 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:14.476233 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c798c74-1434-4c07-86ab-2a20929dbb66-registry-tls\") pod \"image-registry-6486bbbddc-s644j\" (UID: \"0c798c74-1434-4c07-86ab-2a20929dbb66\") " pod="openshift-image-registry/image-registry-6486bbbddc-s644j" Jun 02 01:25:14.527754 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:14.527722 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xz25b\"" Jun 02 01:25:14.535578 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:14.535555 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m96w4" Jun 02 01:25:14.656061 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:14.656030 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-m96w4"] Jun 02 01:25:14.659451 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:25:14.659425 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b09f852_0fa3_468e_b22e_8d25a143efc8.slice/crio-b56002488c269c7fd7e9a67f51b2bbcf585fd917b1c80efb86b13806c109743a WatchSource:0}: Error finding container b56002488c269c7fd7e9a67f51b2bbcf585fd917b1c80efb86b13806c109743a: Status 404 returned error can't find the container with id b56002488c269c7fd7e9a67f51b2bbcf585fd917b1c80efb86b13806c109743a Jun 02 01:25:14.743770 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:14.743682 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-m96w4" event={"ID":"3b09f852-0fa3-468e-b22e-8d25a143efc8","Type":"ContainerStarted","Data":"b56002488c269c7fd7e9a67f51b2bbcf585fd917b1c80efb86b13806c109743a"} Jun 02 01:25:16.752203 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:16.752162 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-m96w4" event={"ID":"3b09f852-0fa3-468e-b22e-8d25a143efc8","Type":"ContainerStarted","Data":"e6fdd28ee9215e81aabeccbf4d25c6505bb3ad17003d3b8d6eefec7a0a734e13"} Jun 02 01:25:16.766529 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:16.766466 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-m96w4" podStartSLOduration=128.747781323 podStartE2EDuration="2m10.766449053s" podCreationTimestamp="2026-06-02 01:23:06 +0000 UTC" firstStartedPulling="2026-06-02 01:25:14.661908609 +0000 UTC m=+162.991543506" lastFinishedPulling="2026-06-02 01:25:16.680576335 +0000 UTC m=+165.010211236" observedRunningTime="2026-06-02 01:25:16.766349139 +0000 UTC m=+165.095984071" watchObservedRunningTime="2026-06-02 01:25:16.766449053 +0000 UTC m=+165.096083973" Jun 02 01:25:21.228528 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:21.228493 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nj4t5" Jun 02 01:25:21.231567 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:21.231546 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8tqnd\"" Jun 02 01:25:21.239296 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:21.239279 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nj4t5" Jun 02 01:25:21.359563 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:21.359530 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nj4t5"] Jun 02 01:25:21.363150 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:25:21.363128 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod895ec876_825f_4148_b184_bd690c4203aa.slice/crio-531e584834c08a9b8e51957f979073f8f7f7899c72454ca3ed52acb976ac7ed9 WatchSource:0}: Error finding container 531e584834c08a9b8e51957f979073f8f7f7899c72454ca3ed52acb976ac7ed9: Status 404 returned error can't find the container with id 531e584834c08a9b8e51957f979073f8f7f7899c72454ca3ed52acb976ac7ed9 Jun 02 01:25:21.765523 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:21.765491 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nj4t5" event={"ID":"895ec876-825f-4148-b184-bd690c4203aa","Type":"ContainerStarted","Data":"531e584834c08a9b8e51957f979073f8f7f7899c72454ca3ed52acb976ac7ed9"} Jun 02 01:25:23.472274 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:23.472217 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f574b8b74-gdgrj" podUID="beafa175-5e47-4e56-a7d9-ce33a41bc79f" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.10:8000/readyz\": dial tcp 10.132.0.10:8000: connect: connection refused" Jun 02 01:25:23.725176 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:23.725084 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9874c78b-pg9jr" podUID="47e4f640-0ea2-4443-9fca-1f05dc7d12e7" containerName="addon-agent" probeResult="failure" output="Get \"http://10.132.0.9:8000/healthz\": dial tcp 10.132.0.9:8000: connect: connection refused" Jun 02 01:25:23.732824 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:23.732798 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f574b8b74-gdgrj" podUID="beafa175-5e47-4e56-a7d9-ce33a41bc79f" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.10:8000/healthz\": dial tcp 10.132.0.10:8000: connect: connection refused" Jun 02 01:25:23.771035 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:23.771004 2559 generic.go:358] "Generic (PLEG): container finished" podID="47e4f640-0ea2-4443-9fca-1f05dc7d12e7" containerID="c2012914d1fb87d5d32cb76f757c5801642ba310f848f5d01edb7805274a2697" exitCode=255 Jun 02 01:25:23.771157 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:23.771080 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9874c78b-pg9jr" event={"ID":"47e4f640-0ea2-4443-9fca-1f05dc7d12e7","Type":"ContainerDied","Data":"c2012914d1fb87d5d32cb76f757c5801642ba310f848f5d01edb7805274a2697"} Jun 02 01:25:23.771420 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:23.771398 2559 scope.go:117] "RemoveContainer" containerID="c2012914d1fb87d5d32cb76f757c5801642ba310f848f5d01edb7805274a2697" Jun 02 01:25:23.772496 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:23.772474 2559 generic.go:358] "Generic (PLEG): container finished" podID="beafa175-5e47-4e56-a7d9-ce33a41bc79f" containerID="bf39e59d0007897b61cad494ceed9f31bbc5539e2d7216167cfdf39f50842543" exitCode=1 Jun 02 01:25:23.772591 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:23.772549 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f574b8b74-gdgrj" event={"ID":"beafa175-5e47-4e56-a7d9-ce33a41bc79f","Type":"ContainerDied","Data":"bf39e59d0007897b61cad494ceed9f31bbc5539e2d7216167cfdf39f50842543"} Jun 02 01:25:23.772879 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:23.772865 2559 scope.go:117] "RemoveContainer" containerID="bf39e59d0007897b61cad494ceed9f31bbc5539e2d7216167cfdf39f50842543" Jun 02 01:25:23.774348 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:23.774208 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nj4t5" event={"ID":"895ec876-825f-4148-b184-bd690c4203aa","Type":"ContainerStarted","Data":"b1663aee29923f4c86c0a0509d7d91d2be35d48359cd4d32fe0d3f4a4df6c1bf"} Jun 02 01:25:23.774348 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:23.774232 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nj4t5" event={"ID":"895ec876-825f-4148-b184-bd690c4203aa","Type":"ContainerStarted","Data":"f999f3721a2c6b309a32be2285c238a9f0d868b0174c133dfa4092c1b01d9548"} Jun 02 01:25:23.774451 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:23.774384 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-nj4t5" Jun 02 01:25:23.819670 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:23.819604 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-nj4t5" podStartSLOduration=136.280366213 podStartE2EDuration="2m17.819587314s" podCreationTimestamp="2026-06-02 01:23:06 +0000 UTC" firstStartedPulling="2026-06-02 01:25:21.365361787 +0000 UTC m=+169.694996684" lastFinishedPulling="2026-06-02 01:25:22.904582869 +0000 UTC m=+171.234217785" observedRunningTime="2026-06-02 01:25:23.819082676 +0000 UTC m=+172.148717596" watchObservedRunningTime="2026-06-02 01:25:23.819587314 +0000 UTC m=+172.149222235" Jun 02 01:25:24.228711 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:24.228671 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-96l4l" Jun 02 01:25:24.778221 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:24.778186 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9874c78b-pg9jr" event={"ID":"47e4f640-0ea2-4443-9fca-1f05dc7d12e7","Type":"ContainerStarted","Data":"0dd5e9116e72be098b04476f12a99cf717957cdfa11478d2bfebec9e17cf6c97"} Jun 02 01:25:24.779664 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:24.779640 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f574b8b74-gdgrj" event={"ID":"beafa175-5e47-4e56-a7d9-ce33a41bc79f","Type":"ContainerStarted","Data":"2f081db3dddbfab49ebb513b1b964d89949b4e7b9f5874ee8456762ff2bb7dc7"} Jun 02 01:25:24.779969 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:24.779949 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f574b8b74-gdgrj" Jun 02 01:25:24.780903 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:24.780882 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f574b8b74-gdgrj" Jun 02 01:25:25.228651 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:25.228542 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6486bbbddc-s644j" Jun 02 01:25:25.231472 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:25.231451 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-95blv\"" Jun 02 01:25:25.239454 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:25.239428 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6486bbbddc-s644j" Jun 02 01:25:25.367079 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:25.367048 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6486bbbddc-s644j"] Jun 02 01:25:25.370508 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:25:25.370478 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c798c74_1434_4c07_86ab_2a20929dbb66.slice/crio-257ef24255637ee1af20c8de3be9dcc8c7d4c93cad66673b7c73897fe9603af2 WatchSource:0}: Error finding container 257ef24255637ee1af20c8de3be9dcc8c7d4c93cad66673b7c73897fe9603af2: Status 404 returned error can't find the container with id 257ef24255637ee1af20c8de3be9dcc8c7d4c93cad66673b7c73897fe9603af2 Jun 02 01:25:25.784075 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:25.784036 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6486bbbddc-s644j" event={"ID":"0c798c74-1434-4c07-86ab-2a20929dbb66","Type":"ContainerStarted","Data":"b99b381be6f0117c767b3dcf62af89c9ef373448e1c887c11971da3060de8a34"} Jun 02 01:25:25.784465 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:25.784127 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6486bbbddc-s644j" Jun 02 01:25:25.784465 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:25.784143 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6486bbbddc-s644j" event={"ID":"0c798c74-1434-4c07-86ab-2a20929dbb66","Type":"ContainerStarted","Data":"257ef24255637ee1af20c8de3be9dcc8c7d4c93cad66673b7c73897fe9603af2"} Jun 02 01:25:25.803845 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:25.803787 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6486bbbddc-s644j" podStartSLOduration=173.803770882 podStartE2EDuration="2m53.803770882s" podCreationTimestamp="2026-06-02 01:22:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:25:25.802560856 +0000 UTC m=+174.132195774" watchObservedRunningTime="2026-06-02 01:25:25.803770882 +0000 UTC m=+174.133405806" Jun 02 01:25:26.749431 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:26.749394 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jms2r"] Jun 02 01:25:26.752195 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:26.752168 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jms2r" Jun 02 01:25:26.754948 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:26.754925 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 02 01:25:26.754948 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:26.754936 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 02 01:25:26.755176 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:26.754947 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 02 01:25:26.755176 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:26.755078 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 02 01:25:26.755784 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:26.755768 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 02 01:25:26.755978 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:26.755962 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 02 01:25:26.756051 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:26.756016 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-n7ndj\"" Jun 02 01:25:26.769054 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:26.769031 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/404ae2b7-d943-4cdb-bfce-e144857758c9-node-exporter-textfile\") pod \"node-exporter-jms2r\" (UID: \"404ae2b7-d943-4cdb-bfce-e144857758c9\") " pod="openshift-monitoring/node-exporter-jms2r" Jun 02 01:25:26.769164 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:26.769067 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/404ae2b7-d943-4cdb-bfce-e144857758c9-root\") pod \"node-exporter-jms2r\" (UID: \"404ae2b7-d943-4cdb-bfce-e144857758c9\") " pod="openshift-monitoring/node-exporter-jms2r" Jun 02 01:25:26.769164 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:26.769100 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/404ae2b7-d943-4cdb-bfce-e144857758c9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jms2r\" (UID: \"404ae2b7-d943-4cdb-bfce-e144857758c9\") " pod="openshift-monitoring/node-exporter-jms2r" Jun 02 01:25:26.769164 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:26.769148 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/404ae2b7-d943-4cdb-bfce-e144857758c9-sys\") pod \"node-exporter-jms2r\" (UID: \"404ae2b7-d943-4cdb-bfce-e144857758c9\") " pod="openshift-monitoring/node-exporter-jms2r" Jun 02 01:25:26.769284 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:26.769195 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/404ae2b7-d943-4cdb-bfce-e144857758c9-node-exporter-tls\") pod \"node-exporter-jms2r\" (UID: \"404ae2b7-d943-4cdb-bfce-e144857758c9\") " pod="openshift-monitoring/node-exporter-jms2r" Jun 02 01:25:26.769284 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:26.769225 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/404ae2b7-d943-4cdb-bfce-e144857758c9-metrics-client-ca\") pod \"node-exporter-jms2r\" (UID: \"404ae2b7-d943-4cdb-bfce-e144857758c9\") " pod="openshift-monitoring/node-exporter-jms2r" Jun 02 01:25:26.769284 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:26.769271 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/404ae2b7-d943-4cdb-bfce-e144857758c9-node-exporter-accelerators-collector-config\") pod \"node-exporter-jms2r\" (UID: \"404ae2b7-d943-4cdb-bfce-e144857758c9\") " pod="openshift-monitoring/node-exporter-jms2r" Jun 02 01:25:26.769383 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:26.769291 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6ljb\" (UniqueName: \"kubernetes.io/projected/404ae2b7-d943-4cdb-bfce-e144857758c9-kube-api-access-t6ljb\") pod \"node-exporter-jms2r\" (UID: \"404ae2b7-d943-4cdb-bfce-e144857758c9\") " pod="openshift-monitoring/node-exporter-jms2r" Jun 02 01:25:26.769383 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:26.769316 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/404ae2b7-d943-4cdb-bfce-e144857758c9-node-exporter-wtmp\") pod \"node-exporter-jms2r\" (UID: \"404ae2b7-d943-4cdb-bfce-e144857758c9\") " pod="openshift-monitoring/node-exporter-jms2r" Jun 02 01:25:26.870097 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:26.870064 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/404ae2b7-d943-4cdb-bfce-e144857758c9-node-exporter-textfile\") pod \"node-exporter-jms2r\" (UID: \"404ae2b7-d943-4cdb-bfce-e144857758c9\") " pod="openshift-monitoring/node-exporter-jms2r" Jun 02 01:25:26.870551 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:26.870112 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/404ae2b7-d943-4cdb-bfce-e144857758c9-root\") pod \"node-exporter-jms2r\" (UID: \"404ae2b7-d943-4cdb-bfce-e144857758c9\") " pod="openshift-monitoring/node-exporter-jms2r" Jun 02 01:25:26.870551 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:26.870156 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/404ae2b7-d943-4cdb-bfce-e144857758c9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jms2r\" (UID: \"404ae2b7-d943-4cdb-bfce-e144857758c9\") " pod="openshift-monitoring/node-exporter-jms2r" Jun 02 01:25:26.870551 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:26.870184 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/404ae2b7-d943-4cdb-bfce-e144857758c9-sys\") pod \"node-exporter-jms2r\" (UID: \"404ae2b7-d943-4cdb-bfce-e144857758c9\") " pod="openshift-monitoring/node-exporter-jms2r" Jun 02 01:25:26.870551 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:26.870231 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/404ae2b7-d943-4cdb-bfce-e144857758c9-sys\") pod \"node-exporter-jms2r\" (UID: \"404ae2b7-d943-4cdb-bfce-e144857758c9\") " pod="openshift-monitoring/node-exporter-jms2r" Jun 02 01:25:26.870551 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:26.870231 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/404ae2b7-d943-4cdb-bfce-e144857758c9-root\") pod \"node-exporter-jms2r\" (UID: \"404ae2b7-d943-4cdb-bfce-e144857758c9\") " pod="openshift-monitoring/node-exporter-jms2r" Jun 02 01:25:26.870551 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:26.870361 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/404ae2b7-d943-4cdb-bfce-e144857758c9-node-exporter-tls\") pod \"node-exporter-jms2r\" (UID: \"404ae2b7-d943-4cdb-bfce-e144857758c9\") " pod="openshift-monitoring/node-exporter-jms2r" Jun 02 01:25:26.870551 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:26.870408 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/404ae2b7-d943-4cdb-bfce-e144857758c9-metrics-client-ca\") pod \"node-exporter-jms2r\" (UID: \"404ae2b7-d943-4cdb-bfce-e144857758c9\") " pod="openshift-monitoring/node-exporter-jms2r" Jun 02 01:25:26.870551 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:26.870483 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/404ae2b7-d943-4cdb-bfce-e144857758c9-node-exporter-textfile\") pod \"node-exporter-jms2r\" (UID: \"404ae2b7-d943-4cdb-bfce-e144857758c9\") " pod="openshift-monitoring/node-exporter-jms2r" Jun 02 01:25:26.870551 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:26.870541 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/404ae2b7-d943-4cdb-bfce-e144857758c9-node-exporter-accelerators-collector-config\") pod \"node-exporter-jms2r\" (UID: \"404ae2b7-d943-4cdb-bfce-e144857758c9\") " pod="openshift-monitoring/node-exporter-jms2r" Jun 02 01:25:26.871013 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:26.870594 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t6ljb\" (UniqueName: \"kubernetes.io/projected/404ae2b7-d943-4cdb-bfce-e144857758c9-kube-api-access-t6ljb\") pod \"node-exporter-jms2r\" (UID: \"404ae2b7-d943-4cdb-bfce-e144857758c9\") " pod="openshift-monitoring/node-exporter-jms2r" Jun 02 01:25:26.871013 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:26.870904 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/404ae2b7-d943-4cdb-bfce-e144857758c9-node-exporter-wtmp\") pod \"node-exporter-jms2r\" (UID: \"404ae2b7-d943-4cdb-bfce-e144857758c9\") " pod="openshift-monitoring/node-exporter-jms2r" Jun 02 01:25:26.871103 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:26.871014 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/404ae2b7-d943-4cdb-bfce-e144857758c9-metrics-client-ca\") pod \"node-exporter-jms2r\" (UID: \"404ae2b7-d943-4cdb-bfce-e144857758c9\") " pod="openshift-monitoring/node-exporter-jms2r" Jun 02 01:25:26.871103 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:26.871046 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/404ae2b7-d943-4cdb-bfce-e144857758c9-node-exporter-wtmp\") pod \"node-exporter-jms2r\" (UID: \"404ae2b7-d943-4cdb-bfce-e144857758c9\") " pod="openshift-monitoring/node-exporter-jms2r" Jun 02 01:25:26.871349 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:26.871327 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/404ae2b7-d943-4cdb-bfce-e144857758c9-node-exporter-accelerators-collector-config\") pod \"node-exporter-jms2r\" (UID: \"404ae2b7-d943-4cdb-bfce-e144857758c9\") " pod="openshift-monitoring/node-exporter-jms2r" Jun 02 01:25:26.872872 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:26.872826 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/404ae2b7-d943-4cdb-bfce-e144857758c9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jms2r\" (UID: \"404ae2b7-d943-4cdb-bfce-e144857758c9\") " pod="openshift-monitoring/node-exporter-jms2r" Jun 02 01:25:26.873002 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:26.872826 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/404ae2b7-d943-4cdb-bfce-e144857758c9-node-exporter-tls\") pod \"node-exporter-jms2r\" (UID: \"404ae2b7-d943-4cdb-bfce-e144857758c9\") " pod="openshift-monitoring/node-exporter-jms2r" Jun 02 01:25:26.878929 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:26.878911 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6ljb\" (UniqueName: \"kubernetes.io/projected/404ae2b7-d943-4cdb-bfce-e144857758c9-kube-api-access-t6ljb\") pod \"node-exporter-jms2r\" (UID: \"404ae2b7-d943-4cdb-bfce-e144857758c9\") " pod="openshift-monitoring/node-exporter-jms2r" Jun 02 01:25:27.061199 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:27.061165 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jms2r" Jun 02 01:25:27.069190 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:25:27.069157 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod404ae2b7_d943_4cdb_bfce_e144857758c9.slice/crio-272c78bd8bf9889163f1ac5bad23d75d496fd14fe2517514818e6596a8b52623 WatchSource:0}: Error finding container 272c78bd8bf9889163f1ac5bad23d75d496fd14fe2517514818e6596a8b52623: Status 404 returned error can't find the container with id 272c78bd8bf9889163f1ac5bad23d75d496fd14fe2517514818e6596a8b52623 Jun 02 01:25:27.791428 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:27.791390 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jms2r" event={"ID":"404ae2b7-d943-4cdb-bfce-e144857758c9","Type":"ContainerStarted","Data":"272c78bd8bf9889163f1ac5bad23d75d496fd14fe2517514818e6596a8b52623"} Jun 02 01:25:28.794970 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:28.794930 2559 generic.go:358] "Generic (PLEG): container finished" podID="404ae2b7-d943-4cdb-bfce-e144857758c9" containerID="1a354be66abc25081342f58613740d3457c8d619e42a879f7a2d6456881adb89" exitCode=0 Jun 02 01:25:28.795403 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:28.795002 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jms2r" event={"ID":"404ae2b7-d943-4cdb-bfce-e144857758c9","Type":"ContainerDied","Data":"1a354be66abc25081342f58613740d3457c8d619e42a879f7a2d6456881adb89"} Jun 02 01:25:29.799852 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:29.799802 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jms2r" event={"ID":"404ae2b7-d943-4cdb-bfce-e144857758c9","Type":"ContainerStarted","Data":"079e25f0c36b3cde61f6d3e6ecbacbecca196d8e84ccf4a8fb954fc43ba6bd60"} Jun 02 01:25:29.800241 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:29.799858 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jms2r" event={"ID":"404ae2b7-d943-4cdb-bfce-e144857758c9","Type":"ContainerStarted","Data":"8535ffc642be103cd9cc0017227ac17e740ed1e4a3ebe3bbfaff8d9e2ef89362"} Jun 02 01:25:29.819970 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:29.819919 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jms2r" podStartSLOduration=2.678857371 podStartE2EDuration="3.819903655s" podCreationTimestamp="2026-06-02 01:25:26 +0000 UTC" firstStartedPulling="2026-06-02 01:25:27.070917599 +0000 UTC m=+175.400552504" lastFinishedPulling="2026-06-02 01:25:28.211963878 +0000 UTC m=+176.541598788" observedRunningTime="2026-06-02 01:25:29.818134744 +0000 UTC m=+178.147769663" watchObservedRunningTime="2026-06-02 01:25:29.819903655 +0000 UTC m=+178.149538585" Jun 02 01:25:33.781732 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:33.781698 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-nj4t5" Jun 02 01:25:41.792335 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:41.792282 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6486bbbddc-s644j"] Jun 02 01:25:41.796480 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:41.796453 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6486bbbddc-s644j" Jun 02 01:25:43.739035 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:43.739000 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4959659c-h454h" podUID="7fea02a9-7e42-4aac-a123-2c33331b64fd" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 02 01:25:53.739351 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:25:53.739298 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4959659c-h454h" podUID="7fea02a9-7e42-4aac-a123-2c33331b64fd" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 02 01:26:03.295803 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:03.295771 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jms2r_404ae2b7-d943-4cdb-bfce-e144857758c9/init-textfile/0.log" Jun 02 01:26:03.495624 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:03.495596 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jms2r_404ae2b7-d943-4cdb-bfce-e144857758c9/node-exporter/0.log" Jun 02 01:26:03.694005 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:03.693923 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jms2r_404ae2b7-d943-4cdb-bfce-e144857758c9/kube-rbac-proxy/0.log" Jun 02 01:26:03.739477 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:03.739439 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4959659c-h454h" podUID="7fea02a9-7e42-4aac-a123-2c33331b64fd" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 02 01:26:03.739637 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:03.739515 2559 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4959659c-h454h" Jun 02 01:26:03.740018 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:03.739978 2559 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"22a425d2fe6ca284c1a47c43da4ecce7d0d356ed9f40e6d3454d4d760f84060f"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4959659c-h454h" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 02 01:26:03.740069 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:03.740039 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4959659c-h454h" podUID="7fea02a9-7e42-4aac-a123-2c33331b64fd" containerName="service-proxy" containerID="cri-o://22a425d2fe6ca284c1a47c43da4ecce7d0d356ed9f40e6d3454d4d760f84060f" gracePeriod=30 Jun 02 01:26:03.888941 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:03.888256 2559 generic.go:358] "Generic (PLEG): container finished" podID="7fea02a9-7e42-4aac-a123-2c33331b64fd" containerID="22a425d2fe6ca284c1a47c43da4ecce7d0d356ed9f40e6d3454d4d760f84060f" exitCode=2 Jun 02 01:26:03.889140 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:03.888344 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4959659c-h454h" event={"ID":"7fea02a9-7e42-4aac-a123-2c33331b64fd","Type":"ContainerDied","Data":"22a425d2fe6ca284c1a47c43da4ecce7d0d356ed9f40e6d3454d4d760f84060f"} Jun 02 01:26:04.897550 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:04.897509 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4959659c-h454h" event={"ID":"7fea02a9-7e42-4aac-a123-2c33331b64fd","Type":"ContainerStarted","Data":"941afdfd16c44de9c1e4e5018c9e3c142cb617768edde6a6be2620357d4d00f5"} Jun 02 01:26:06.812163 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:06.812099 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6486bbbddc-s644j" podUID="0c798c74-1434-4c07-86ab-2a20929dbb66" containerName="registry" containerID="cri-o://b99b381be6f0117c767b3dcf62af89c9ef373448e1c887c11971da3060de8a34" gracePeriod=30 Jun 02 01:26:07.063567 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:07.063500 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6486bbbddc-s644j" Jun 02 01:26:07.193561 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:07.193527 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0c798c74-1434-4c07-86ab-2a20929dbb66-registry-certificates\") pod \"0c798c74-1434-4c07-86ab-2a20929dbb66\" (UID: \"0c798c74-1434-4c07-86ab-2a20929dbb66\") " Jun 02 01:26:07.193561 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:07.193566 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0c798c74-1434-4c07-86ab-2a20929dbb66-image-registry-private-configuration\") pod \"0c798c74-1434-4c07-86ab-2a20929dbb66\" (UID: \"0c798c74-1434-4c07-86ab-2a20929dbb66\") " Jun 02 01:26:07.193774 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:07.193629 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0c798c74-1434-4c07-86ab-2a20929dbb66-ca-trust-extracted\") pod \"0c798c74-1434-4c07-86ab-2a20929dbb66\" (UID: \"0c798c74-1434-4c07-86ab-2a20929dbb66\") " Jun 02 01:26:07.193774 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:07.193651 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c798c74-1434-4c07-86ab-2a20929dbb66-registry-tls\") pod \"0c798c74-1434-4c07-86ab-2a20929dbb66\" (UID: \"0c798c74-1434-4c07-86ab-2a20929dbb66\") " Jun 02 01:26:07.193774 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:07.193682 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fnzdc\" (UniqueName: \"kubernetes.io/projected/0c798c74-1434-4c07-86ab-2a20929dbb66-kube-api-access-fnzdc\") pod \"0c798c74-1434-4c07-86ab-2a20929dbb66\" (UID: \"0c798c74-1434-4c07-86ab-2a20929dbb66\") " Jun 02 01:26:07.193774 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:07.193707 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0c798c74-1434-4c07-86ab-2a20929dbb66-trusted-ca\") pod \"0c798c74-1434-4c07-86ab-2a20929dbb66\" (UID: \"0c798c74-1434-4c07-86ab-2a20929dbb66\") " Jun 02 01:26:07.193997 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:07.193781 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0c798c74-1434-4c07-86ab-2a20929dbb66-bound-sa-token\") pod \"0c798c74-1434-4c07-86ab-2a20929dbb66\" (UID: \"0c798c74-1434-4c07-86ab-2a20929dbb66\") " Jun 02 01:26:07.193997 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:07.193864 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0c798c74-1434-4c07-86ab-2a20929dbb66-installation-pull-secrets\") pod \"0c798c74-1434-4c07-86ab-2a20929dbb66\" (UID: \"0c798c74-1434-4c07-86ab-2a20929dbb66\") " Jun 02 01:26:07.194105 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:07.193979 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c798c74-1434-4c07-86ab-2a20929dbb66-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "0c798c74-1434-4c07-86ab-2a20929dbb66" (UID: "0c798c74-1434-4c07-86ab-2a20929dbb66"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:26:07.194224 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:07.194200 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c798c74-1434-4c07-86ab-2a20929dbb66-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "0c798c74-1434-4c07-86ab-2a20929dbb66" (UID: "0c798c74-1434-4c07-86ab-2a20929dbb66"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:26:07.196415 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:07.196385 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c798c74-1434-4c07-86ab-2a20929dbb66-kube-api-access-fnzdc" (OuterVolumeSpecName: "kube-api-access-fnzdc") pod "0c798c74-1434-4c07-86ab-2a20929dbb66" (UID: "0c798c74-1434-4c07-86ab-2a20929dbb66"). InnerVolumeSpecName "kube-api-access-fnzdc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:26:07.196543 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:07.196523 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c798c74-1434-4c07-86ab-2a20929dbb66-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "0c798c74-1434-4c07-86ab-2a20929dbb66" (UID: "0c798c74-1434-4c07-86ab-2a20929dbb66"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:26:07.196605 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:07.196533 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c798c74-1434-4c07-86ab-2a20929dbb66-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0c798c74-1434-4c07-86ab-2a20929dbb66" (UID: "0c798c74-1434-4c07-86ab-2a20929dbb66"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:26:07.196735 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:07.196706 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c798c74-1434-4c07-86ab-2a20929dbb66-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "0c798c74-1434-4c07-86ab-2a20929dbb66" (UID: "0c798c74-1434-4c07-86ab-2a20929dbb66"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:26:07.196895 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:07.196765 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c798c74-1434-4c07-86ab-2a20929dbb66-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "0c798c74-1434-4c07-86ab-2a20929dbb66" (UID: "0c798c74-1434-4c07-86ab-2a20929dbb66"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:26:07.202671 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:07.202650 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c798c74-1434-4c07-86ab-2a20929dbb66-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "0c798c74-1434-4c07-86ab-2a20929dbb66" (UID: "0c798c74-1434-4c07-86ab-2a20929dbb66"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:26:07.295105 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:07.295073 2559 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0c798c74-1434-4c07-86ab-2a20929dbb66-ca-trust-extracted\") on node \"ip-10-0-130-179.ec2.internal\" DevicePath \"\"" Jun 02 01:26:07.295105 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:07.295099 2559 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c798c74-1434-4c07-86ab-2a20929dbb66-registry-tls\") on node \"ip-10-0-130-179.ec2.internal\" DevicePath \"\"" Jun 02 01:26:07.295105 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:07.295108 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnzdc\" (UniqueName: \"kubernetes.io/projected/0c798c74-1434-4c07-86ab-2a20929dbb66-kube-api-access-fnzdc\") on node \"ip-10-0-130-179.ec2.internal\" DevicePath \"\"" Jun 02 01:26:07.295314 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:07.295117 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0c798c74-1434-4c07-86ab-2a20929dbb66-trusted-ca\") on node \"ip-10-0-130-179.ec2.internal\" DevicePath \"\"" Jun 02 01:26:07.295314 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:07.295126 2559 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0c798c74-1434-4c07-86ab-2a20929dbb66-bound-sa-token\") on node \"ip-10-0-130-179.ec2.internal\" DevicePath \"\"" Jun 02 01:26:07.295314 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:07.295134 2559 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0c798c74-1434-4c07-86ab-2a20929dbb66-installation-pull-secrets\") on node \"ip-10-0-130-179.ec2.internal\" DevicePath \"\"" Jun 02 01:26:07.295314 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:07.295142 2559 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0c798c74-1434-4c07-86ab-2a20929dbb66-registry-certificates\") on node \"ip-10-0-130-179.ec2.internal\" DevicePath \"\"" Jun 02 01:26:07.295314 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:07.295154 2559 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0c798c74-1434-4c07-86ab-2a20929dbb66-image-registry-private-configuration\") on node \"ip-10-0-130-179.ec2.internal\" DevicePath \"\"" Jun 02 01:26:07.905850 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:07.905801 2559 generic.go:358] "Generic (PLEG): container finished" podID="0c798c74-1434-4c07-86ab-2a20929dbb66" containerID="b99b381be6f0117c767b3dcf62af89c9ef373448e1c887c11971da3060de8a34" exitCode=0 Jun 02 01:26:07.906248 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:07.905886 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6486bbbddc-s644j" event={"ID":"0c798c74-1434-4c07-86ab-2a20929dbb66","Type":"ContainerDied","Data":"b99b381be6f0117c767b3dcf62af89c9ef373448e1c887c11971da3060de8a34"} Jun 02 01:26:07.906248 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:07.905930 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6486bbbddc-s644j" event={"ID":"0c798c74-1434-4c07-86ab-2a20929dbb66","Type":"ContainerDied","Data":"257ef24255637ee1af20c8de3be9dcc8c7d4c93cad66673b7c73897fe9603af2"} Jun 02 01:26:07.906248 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:07.905945 2559 scope.go:117] "RemoveContainer" containerID="b99b381be6f0117c767b3dcf62af89c9ef373448e1c887c11971da3060de8a34" Jun 02 01:26:07.906248 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:07.905895 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6486bbbddc-s644j" Jun 02 01:26:07.914153 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:07.914138 2559 scope.go:117] "RemoveContainer" containerID="b99b381be6f0117c767b3dcf62af89c9ef373448e1c887c11971da3060de8a34" Jun 02 01:26:07.914394 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:26:07.914375 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b99b381be6f0117c767b3dcf62af89c9ef373448e1c887c11971da3060de8a34\": container with ID starting with b99b381be6f0117c767b3dcf62af89c9ef373448e1c887c11971da3060de8a34 not found: ID does not exist" containerID="b99b381be6f0117c767b3dcf62af89c9ef373448e1c887c11971da3060de8a34" Jun 02 01:26:07.914442 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:07.914403 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b99b381be6f0117c767b3dcf62af89c9ef373448e1c887c11971da3060de8a34"} err="failed to get container status \"b99b381be6f0117c767b3dcf62af89c9ef373448e1c887c11971da3060de8a34\": rpc error: code = NotFound desc = could not find container \"b99b381be6f0117c767b3dcf62af89c9ef373448e1c887c11971da3060de8a34\": container with ID starting with b99b381be6f0117c767b3dcf62af89c9ef373448e1c887c11971da3060de8a34 not found: ID does not exist" Jun 02 01:26:07.926343 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:07.926322 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6486bbbddc-s644j"] Jun 02 01:26:07.930175 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:07.930155 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6486bbbddc-s644j"] Jun 02 01:26:08.231409 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:08.231330 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c798c74-1434-4c07-86ab-2a20929dbb66" path="/var/lib/kubelet/pods/0c798c74-1434-4c07-86ab-2a20929dbb66/volumes" Jun 02 01:26:09.893467 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:09.893434 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-m96w4_3b09f852-0fa3-468e-b22e-8d25a143efc8/serve-healthcheck-canary/0.log" Jun 02 01:26:44.066337 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:44.066231 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/564c53f1-521a-42b2-8353-80c10ff44bb2-metrics-certs\") pod \"network-metrics-daemon-96l4l\" (UID: \"564c53f1-521a-42b2-8353-80c10ff44bb2\") " pod="openshift-multus/network-metrics-daemon-96l4l" Jun 02 01:26:44.068657 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:44.068633 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/564c53f1-521a-42b2-8353-80c10ff44bb2-metrics-certs\") pod \"network-metrics-daemon-96l4l\" (UID: \"564c53f1-521a-42b2-8353-80c10ff44bb2\") " pod="openshift-multus/network-metrics-daemon-96l4l" Jun 02 01:26:44.331876 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:44.331763 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jprs5\"" Jun 02 01:26:44.340083 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:44.340062 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-96l4l" Jun 02 01:26:44.464092 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:44.464063 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-96l4l"] Jun 02 01:26:44.467658 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:26:44.467628 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod564c53f1_521a_42b2_8353_80c10ff44bb2.slice/crio-08c6bd46d5cf215a6eec3f9c650e8725822fc6c398db558b5dab25c331c8d249 WatchSource:0}: Error finding container 08c6bd46d5cf215a6eec3f9c650e8725822fc6c398db558b5dab25c331c8d249: Status 404 returned error can't find the container with id 08c6bd46d5cf215a6eec3f9c650e8725822fc6c398db558b5dab25c331c8d249 Jun 02 01:26:45.000725 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:45.000689 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-96l4l" event={"ID":"564c53f1-521a-42b2-8353-80c10ff44bb2","Type":"ContainerStarted","Data":"08c6bd46d5cf215a6eec3f9c650e8725822fc6c398db558b5dab25c331c8d249"} Jun 02 01:26:46.004759 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:46.004662 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-96l4l" event={"ID":"564c53f1-521a-42b2-8353-80c10ff44bb2","Type":"ContainerStarted","Data":"f478412c1dffff26502c60ae9bf332315a27cff6bb2d56844d81bab43cab2bf7"} Jun 02 01:26:46.004759 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:46.004705 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-96l4l" event={"ID":"564c53f1-521a-42b2-8353-80c10ff44bb2","Type":"ContainerStarted","Data":"6e07094a6044a4e988ea84d6237cf25ba2c89d99db92e3ff2f5846bf928e49ee"} Jun 02 01:26:46.020655 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:26:46.020596 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-96l4l" podStartSLOduration=252.861008579 podStartE2EDuration="4m14.020580607s" podCreationTimestamp="2026-06-02 01:22:32 +0000 UTC" firstStartedPulling="2026-06-02 01:26:44.46953867 +0000 UTC m=+252.799173566" lastFinishedPulling="2026-06-02 01:26:45.629110694 +0000 UTC m=+253.958745594" observedRunningTime="2026-06-02 01:26:46.020080705 +0000 UTC m=+254.349715623" watchObservedRunningTime="2026-06-02 01:26:46.020580607 +0000 UTC m=+254.350215531" Jun 02 01:27:32.114825 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:27:32.114794 2559 kubelet.go:1628] "Image garbage collection succeeded" Jun 02 01:28:52.224630 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:28:52.224593 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-b48hq"] Jun 02 01:28:52.225189 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:28:52.224900 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c798c74-1434-4c07-86ab-2a20929dbb66" containerName="registry" Jun 02 01:28:52.225189 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:28:52.224918 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c798c74-1434-4c07-86ab-2a20929dbb66" containerName="registry" Jun 02 01:28:52.225189 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:28:52.224977 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="0c798c74-1434-4c07-86ab-2a20929dbb66" containerName="registry" Jun 02 01:28:52.226634 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:28:52.226609 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-b48hq" Jun 02 01:28:52.229100 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:28:52.229081 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 02 01:28:52.229888 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:28:52.229861 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-nj7kl\"" Jun 02 01:28:52.229888 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:28:52.229880 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 02 01:28:52.238732 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:28:52.238705 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-b48hq"] Jun 02 01:28:52.259411 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:28:52.259387 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1a3d1337-0cc6-4986-8045-21f5ea0c8a13-tmp\") pod \"openshift-lws-operator-bfc7f696d-b48hq\" (UID: \"1a3d1337-0cc6-4986-8045-21f5ea0c8a13\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-b48hq" Jun 02 01:28:52.259549 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:28:52.259449 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9jmd\" (UniqueName: \"kubernetes.io/projected/1a3d1337-0cc6-4986-8045-21f5ea0c8a13-kube-api-access-k9jmd\") pod \"openshift-lws-operator-bfc7f696d-b48hq\" (UID: \"1a3d1337-0cc6-4986-8045-21f5ea0c8a13\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-b48hq" Jun 02 01:28:52.359965 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:28:52.359926 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1a3d1337-0cc6-4986-8045-21f5ea0c8a13-tmp\") pod \"openshift-lws-operator-bfc7f696d-b48hq\" (UID: \"1a3d1337-0cc6-4986-8045-21f5ea0c8a13\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-b48hq" Jun 02 01:28:52.360162 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:28:52.359993 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k9jmd\" (UniqueName: \"kubernetes.io/projected/1a3d1337-0cc6-4986-8045-21f5ea0c8a13-kube-api-access-k9jmd\") pod \"openshift-lws-operator-bfc7f696d-b48hq\" (UID: \"1a3d1337-0cc6-4986-8045-21f5ea0c8a13\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-b48hq" Jun 02 01:28:52.360323 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:28:52.360301 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1a3d1337-0cc6-4986-8045-21f5ea0c8a13-tmp\") pod \"openshift-lws-operator-bfc7f696d-b48hq\" (UID: \"1a3d1337-0cc6-4986-8045-21f5ea0c8a13\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-b48hq" Jun 02 01:28:52.368515 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:28:52.368484 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9jmd\" (UniqueName: \"kubernetes.io/projected/1a3d1337-0cc6-4986-8045-21f5ea0c8a13-kube-api-access-k9jmd\") pod \"openshift-lws-operator-bfc7f696d-b48hq\" (UID: \"1a3d1337-0cc6-4986-8045-21f5ea0c8a13\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-b48hq" Jun 02 01:28:52.536427 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:28:52.536397 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-b48hq" Jun 02 01:28:52.656570 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:28:52.656426 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-b48hq"] Jun 02 01:28:52.659153 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:28:52.659126 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1a3d1337_0cc6_4986_8045_21f5ea0c8a13.slice/crio-c30abda02531a013b7ab06b9e7a52475d71b5266ea45f03e7c3b69656acdaabf WatchSource:0}: Error finding container c30abda02531a013b7ab06b9e7a52475d71b5266ea45f03e7c3b69656acdaabf: Status 404 returned error can't find the container with id c30abda02531a013b7ab06b9e7a52475d71b5266ea45f03e7c3b69656acdaabf Jun 02 01:28:52.660491 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:28:52.660473 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 01:28:53.332108 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:28:53.332072 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-b48hq" event={"ID":"1a3d1337-0cc6-4986-8045-21f5ea0c8a13","Type":"ContainerStarted","Data":"c30abda02531a013b7ab06b9e7a52475d71b5266ea45f03e7c3b69656acdaabf"} Jun 02 01:28:56.342180 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:28:56.342148 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-b48hq" event={"ID":"1a3d1337-0cc6-4986-8045-21f5ea0c8a13","Type":"ContainerStarted","Data":"fb46c67057ed2503a76cc6c44a95f430179bc1460273f6745efa77a49f4facee"} Jun 02 01:28:56.357737 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:28:56.357684 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-b48hq" podStartSLOduration=1.47365871 podStartE2EDuration="4.357666318s" podCreationTimestamp="2026-06-02 01:28:52 +0000 UTC" firstStartedPulling="2026-06-02 01:28:52.660596959 +0000 UTC m=+380.990231856" lastFinishedPulling="2026-06-02 01:28:55.544604566 +0000 UTC m=+383.874239464" observedRunningTime="2026-06-02 01:28:56.357084994 +0000 UTC m=+384.686719913" watchObservedRunningTime="2026-06-02 01:28:56.357666318 +0000 UTC m=+384.687301240" Jun 02 01:29:11.597959 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:11.597920 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6758f7c588-ftb5k"] Jun 02 01:29:11.600975 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:11.600951 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6758f7c588-ftb5k" Jun 02 01:29:11.603519 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:11.603496 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 02 01:29:11.603798 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:11.603778 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 02 01:29:11.603905 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:11.603860 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 02 01:29:11.603964 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:11.603903 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 02 01:29:11.604020 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:11.603979 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-56xw8\"" Jun 02 01:29:11.618963 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:11.618939 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6758f7c588-ftb5k"] Jun 02 01:29:11.700856 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:11.700800 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14a90475-5513-4375-9c2d-80e8d160fab3-tmp\") pod \"opendatahub-operator-controller-manager-6758f7c588-ftb5k\" (UID: \"14a90475-5513-4375-9c2d-80e8d160fab3\") " pod="opendatahub/opendatahub-operator-controller-manager-6758f7c588-ftb5k" Jun 02 01:29:11.701022 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:11.700867 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/14a90475-5513-4375-9c2d-80e8d160fab3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6758f7c588-ftb5k\" (UID: \"14a90475-5513-4375-9c2d-80e8d160fab3\") " pod="opendatahub/opendatahub-operator-controller-manager-6758f7c588-ftb5k" Jun 02 01:29:11.701022 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:11.700905 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14a90475-5513-4375-9c2d-80e8d160fab3-webhook-cert\") pod \"opendatahub-operator-controller-manager-6758f7c588-ftb5k\" (UID: \"14a90475-5513-4375-9c2d-80e8d160fab3\") " pod="opendatahub/opendatahub-operator-controller-manager-6758f7c588-ftb5k" Jun 02 01:29:11.701022 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:11.700932 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5vwz\" (UniqueName: \"kubernetes.io/projected/14a90475-5513-4375-9c2d-80e8d160fab3-kube-api-access-j5vwz\") pod \"opendatahub-operator-controller-manager-6758f7c588-ftb5k\" (UID: \"14a90475-5513-4375-9c2d-80e8d160fab3\") " pod="opendatahub/opendatahub-operator-controller-manager-6758f7c588-ftb5k" Jun 02 01:29:11.701022 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:11.700968 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/14a90475-5513-4375-9c2d-80e8d160fab3-manifests\") pod \"opendatahub-operator-controller-manager-6758f7c588-ftb5k\" (UID: \"14a90475-5513-4375-9c2d-80e8d160fab3\") " pod="opendatahub/opendatahub-operator-controller-manager-6758f7c588-ftb5k" Jun 02 01:29:11.802322 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:11.802285 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14a90475-5513-4375-9c2d-80e8d160fab3-tmp\") pod \"opendatahub-operator-controller-manager-6758f7c588-ftb5k\" (UID: \"14a90475-5513-4375-9c2d-80e8d160fab3\") " pod="opendatahub/opendatahub-operator-controller-manager-6758f7c588-ftb5k" Jun 02 01:29:11.802322 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:11.802323 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/14a90475-5513-4375-9c2d-80e8d160fab3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6758f7c588-ftb5k\" (UID: \"14a90475-5513-4375-9c2d-80e8d160fab3\") " pod="opendatahub/opendatahub-operator-controller-manager-6758f7c588-ftb5k" Jun 02 01:29:11.802525 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:11.802461 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14a90475-5513-4375-9c2d-80e8d160fab3-webhook-cert\") pod \"opendatahub-operator-controller-manager-6758f7c588-ftb5k\" (UID: \"14a90475-5513-4375-9c2d-80e8d160fab3\") " pod="opendatahub/opendatahub-operator-controller-manager-6758f7c588-ftb5k" Jun 02 01:29:11.802525 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:11.802496 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j5vwz\" (UniqueName: \"kubernetes.io/projected/14a90475-5513-4375-9c2d-80e8d160fab3-kube-api-access-j5vwz\") pod \"opendatahub-operator-controller-manager-6758f7c588-ftb5k\" (UID: \"14a90475-5513-4375-9c2d-80e8d160fab3\") " pod="opendatahub/opendatahub-operator-controller-manager-6758f7c588-ftb5k" Jun 02 01:29:11.802630 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:11.802527 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/14a90475-5513-4375-9c2d-80e8d160fab3-manifests\") pod \"opendatahub-operator-controller-manager-6758f7c588-ftb5k\" (UID: \"14a90475-5513-4375-9c2d-80e8d160fab3\") " pod="opendatahub/opendatahub-operator-controller-manager-6758f7c588-ftb5k" Jun 02 01:29:11.802938 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:11.802911 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/14a90475-5513-4375-9c2d-80e8d160fab3-manifests\") pod \"opendatahub-operator-controller-manager-6758f7c588-ftb5k\" (UID: \"14a90475-5513-4375-9c2d-80e8d160fab3\") " pod="opendatahub/opendatahub-operator-controller-manager-6758f7c588-ftb5k" Jun 02 01:29:11.804759 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:11.804733 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14a90475-5513-4375-9c2d-80e8d160fab3-tmp\") pod \"opendatahub-operator-controller-manager-6758f7c588-ftb5k\" (UID: \"14a90475-5513-4375-9c2d-80e8d160fab3\") " pod="opendatahub/opendatahub-operator-controller-manager-6758f7c588-ftb5k" Jun 02 01:29:11.804917 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:11.804898 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/14a90475-5513-4375-9c2d-80e8d160fab3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6758f7c588-ftb5k\" (UID: \"14a90475-5513-4375-9c2d-80e8d160fab3\") " pod="opendatahub/opendatahub-operator-controller-manager-6758f7c588-ftb5k" Jun 02 01:29:11.805056 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:11.805037 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14a90475-5513-4375-9c2d-80e8d160fab3-webhook-cert\") pod \"opendatahub-operator-controller-manager-6758f7c588-ftb5k\" (UID: \"14a90475-5513-4375-9c2d-80e8d160fab3\") " pod="opendatahub/opendatahub-operator-controller-manager-6758f7c588-ftb5k" Jun 02 01:29:11.811597 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:11.811573 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5vwz\" (UniqueName: \"kubernetes.io/projected/14a90475-5513-4375-9c2d-80e8d160fab3-kube-api-access-j5vwz\") pod \"opendatahub-operator-controller-manager-6758f7c588-ftb5k\" (UID: \"14a90475-5513-4375-9c2d-80e8d160fab3\") " pod="opendatahub/opendatahub-operator-controller-manager-6758f7c588-ftb5k" Jun 02 01:29:11.911543 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:11.911444 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6758f7c588-ftb5k" Jun 02 01:29:12.043645 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:12.043620 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6758f7c588-ftb5k"] Jun 02 01:29:12.045818 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:29:12.045786 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14a90475_5513_4375_9c2d_80e8d160fab3.slice/crio-4c3ab08a5e74f7b8163e6926f887ec07a9b362aab82bff038753b8aff4a766fb WatchSource:0}: Error finding container 4c3ab08a5e74f7b8163e6926f887ec07a9b362aab82bff038753b8aff4a766fb: Status 404 returned error can't find the container with id 4c3ab08a5e74f7b8163e6926f887ec07a9b362aab82bff038753b8aff4a766fb Jun 02 01:29:12.384495 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:12.384458 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6758f7c588-ftb5k" event={"ID":"14a90475-5513-4375-9c2d-80e8d160fab3","Type":"ContainerStarted","Data":"4c3ab08a5e74f7b8163e6926f887ec07a9b362aab82bff038753b8aff4a766fb"} Jun 02 01:29:16.397709 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:16.397663 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6758f7c588-ftb5k" event={"ID":"14a90475-5513-4375-9c2d-80e8d160fab3","Type":"ContainerStarted","Data":"d08b0fd2f024d3882d7e596e87e52f724928a86f9e9d3d12e6a6fe852b60738e"} Jun 02 01:29:17.401896 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:17.401854 2559 generic.go:358] "Generic (PLEG): container finished" podID="14a90475-5513-4375-9c2d-80e8d160fab3" containerID="d08b0fd2f024d3882d7e596e87e52f724928a86f9e9d3d12e6a6fe852b60738e" exitCode=0 Jun 02 01:29:17.402353 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:17.401908 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6758f7c588-ftb5k" event={"ID":"14a90475-5513-4375-9c2d-80e8d160fab3","Type":"ContainerDied","Data":"d08b0fd2f024d3882d7e596e87e52f724928a86f9e9d3d12e6a6fe852b60738e"} Jun 02 01:29:18.406862 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:18.406806 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6758f7c588-ftb5k" event={"ID":"14a90475-5513-4375-9c2d-80e8d160fab3","Type":"ContainerStarted","Data":"c574dc8837e72445dcf9f2a56196750ceba5efa9d75adb9fba4826d89e36dfc7"} Jun 02 01:29:18.407236 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:18.406954 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6758f7c588-ftb5k" Jun 02 01:29:18.427637 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:18.427593 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6758f7c588-ftb5k" podStartSLOduration=1.6846861770000001 podStartE2EDuration="7.427580409s" podCreationTimestamp="2026-06-02 01:29:11 +0000 UTC" firstStartedPulling="2026-06-02 01:29:12.047606876 +0000 UTC m=+400.377241773" lastFinishedPulling="2026-06-02 01:29:17.790501105 +0000 UTC m=+406.120136005" observedRunningTime="2026-06-02 01:29:18.427347936 +0000 UTC m=+406.756982854" watchObservedRunningTime="2026-06-02 01:29:18.427580409 +0000 UTC m=+406.757215328" Jun 02 01:29:29.411868 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:29.411815 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6758f7c588-ftb5k" Jun 02 01:29:34.237609 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:34.237572 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-865b6fd47-8z6ld"] Jun 02 01:29:34.248747 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:34.248723 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-865b6fd47-8z6ld" Jun 02 01:29:34.250941 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:34.250914 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-865b6fd47-8z6ld"] Jun 02 01:29:34.251315 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:34.251287 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 02 01:29:34.251424 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:34.251315 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 02 01:29:34.251424 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:34.251338 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 02 01:29:34.251424 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:34.251345 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 02 01:29:34.373887 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:34.373827 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbebafe4-fb47-4235-9d81-2d16e374d4e2-tls-certs\") pod \"kube-auth-proxy-865b6fd47-8z6ld\" (UID: \"cbebafe4-fb47-4235-9d81-2d16e374d4e2\") " pod="openshift-ingress/kube-auth-proxy-865b6fd47-8z6ld" Jun 02 01:29:34.374046 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:34.373903 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cbebafe4-fb47-4235-9d81-2d16e374d4e2-tmp\") pod \"kube-auth-proxy-865b6fd47-8z6ld\" (UID: \"cbebafe4-fb47-4235-9d81-2d16e374d4e2\") " pod="openshift-ingress/kube-auth-proxy-865b6fd47-8z6ld" Jun 02 01:29:34.374046 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:34.373932 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbskh\" (UniqueName: \"kubernetes.io/projected/cbebafe4-fb47-4235-9d81-2d16e374d4e2-kube-api-access-lbskh\") pod \"kube-auth-proxy-865b6fd47-8z6ld\" (UID: \"cbebafe4-fb47-4235-9d81-2d16e374d4e2\") " pod="openshift-ingress/kube-auth-proxy-865b6fd47-8z6ld" Jun 02 01:29:34.386770 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:34.386738 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-76588b95-b7wwv"] Jun 02 01:29:34.388630 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:34.388616 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-b7wwv" Jun 02 01:29:34.391078 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:34.391053 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-prrst\"" Jun 02 01:29:34.391224 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:34.391208 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 02 01:29:34.398045 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:34.398022 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-b7wwv"] Jun 02 01:29:34.475139 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:34.475103 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggszm\" (UniqueName: \"kubernetes.io/projected/27f0f2c9-8195-4542-a69d-b0687c11dafc-kube-api-access-ggszm\") pod \"odh-model-controller-76588b95-b7wwv\" (UID: \"27f0f2c9-8195-4542-a69d-b0687c11dafc\") " pod="opendatahub/odh-model-controller-76588b95-b7wwv" Jun 02 01:29:34.475313 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:34.475148 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbebafe4-fb47-4235-9d81-2d16e374d4e2-tls-certs\") pod \"kube-auth-proxy-865b6fd47-8z6ld\" (UID: \"cbebafe4-fb47-4235-9d81-2d16e374d4e2\") " pod="openshift-ingress/kube-auth-proxy-865b6fd47-8z6ld" Jun 02 01:29:34.475313 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:34.475203 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cbebafe4-fb47-4235-9d81-2d16e374d4e2-tmp\") pod \"kube-auth-proxy-865b6fd47-8z6ld\" (UID: \"cbebafe4-fb47-4235-9d81-2d16e374d4e2\") " pod="openshift-ingress/kube-auth-proxy-865b6fd47-8z6ld" Jun 02 01:29:34.475313 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:34.475239 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27f0f2c9-8195-4542-a69d-b0687c11dafc-cert\") pod \"odh-model-controller-76588b95-b7wwv\" (UID: \"27f0f2c9-8195-4542-a69d-b0687c11dafc\") " pod="opendatahub/odh-model-controller-76588b95-b7wwv" Jun 02 01:29:34.475477 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:29:34.475320 2559 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 02 01:29:34.475477 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:34.475367 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lbskh\" (UniqueName: \"kubernetes.io/projected/cbebafe4-fb47-4235-9d81-2d16e374d4e2-kube-api-access-lbskh\") pod \"kube-auth-proxy-865b6fd47-8z6ld\" (UID: \"cbebafe4-fb47-4235-9d81-2d16e374d4e2\") " pod="openshift-ingress/kube-auth-proxy-865b6fd47-8z6ld" Jun 02 01:29:34.475477 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:29:34.475391 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbebafe4-fb47-4235-9d81-2d16e374d4e2-tls-certs podName:cbebafe4-fb47-4235-9d81-2d16e374d4e2 nodeName:}" failed. No retries permitted until 2026-06-02 01:29:34.975369897 +0000 UTC m=+423.305004801 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/cbebafe4-fb47-4235-9d81-2d16e374d4e2-tls-certs") pod "kube-auth-proxy-865b6fd47-8z6ld" (UID: "cbebafe4-fb47-4235-9d81-2d16e374d4e2") : secret "kube-auth-proxy-tls" not found Jun 02 01:29:34.477720 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:34.477694 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cbebafe4-fb47-4235-9d81-2d16e374d4e2-tmp\") pod \"kube-auth-proxy-865b6fd47-8z6ld\" (UID: \"cbebafe4-fb47-4235-9d81-2d16e374d4e2\") " pod="openshift-ingress/kube-auth-proxy-865b6fd47-8z6ld" Jun 02 01:29:34.486444 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:34.486417 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbskh\" (UniqueName: \"kubernetes.io/projected/cbebafe4-fb47-4235-9d81-2d16e374d4e2-kube-api-access-lbskh\") pod \"kube-auth-proxy-865b6fd47-8z6ld\" (UID: \"cbebafe4-fb47-4235-9d81-2d16e374d4e2\") " pod="openshift-ingress/kube-auth-proxy-865b6fd47-8z6ld" Jun 02 01:29:34.575881 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:34.575819 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ggszm\" (UniqueName: \"kubernetes.io/projected/27f0f2c9-8195-4542-a69d-b0687c11dafc-kube-api-access-ggszm\") pod \"odh-model-controller-76588b95-b7wwv\" (UID: \"27f0f2c9-8195-4542-a69d-b0687c11dafc\") " pod="opendatahub/odh-model-controller-76588b95-b7wwv" Jun 02 01:29:34.576062 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:34.575916 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27f0f2c9-8195-4542-a69d-b0687c11dafc-cert\") pod \"odh-model-controller-76588b95-b7wwv\" (UID: \"27f0f2c9-8195-4542-a69d-b0687c11dafc\") " pod="opendatahub/odh-model-controller-76588b95-b7wwv" Jun 02 01:29:34.576062 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:29:34.576024 2559 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 02 01:29:34.576148 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:29:34.576069 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27f0f2c9-8195-4542-a69d-b0687c11dafc-cert podName:27f0f2c9-8195-4542-a69d-b0687c11dafc nodeName:}" failed. No retries permitted until 2026-06-02 01:29:35.076055162 +0000 UTC m=+423.405690059 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/27f0f2c9-8195-4542-a69d-b0687c11dafc-cert") pod "odh-model-controller-76588b95-b7wwv" (UID: "27f0f2c9-8195-4542-a69d-b0687c11dafc") : secret "odh-model-controller-webhook-cert" not found Jun 02 01:29:34.584470 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:34.584446 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggszm\" (UniqueName: \"kubernetes.io/projected/27f0f2c9-8195-4542-a69d-b0687c11dafc-kube-api-access-ggszm\") pod \"odh-model-controller-76588b95-b7wwv\" (UID: \"27f0f2c9-8195-4542-a69d-b0687c11dafc\") " pod="opendatahub/odh-model-controller-76588b95-b7wwv" Jun 02 01:29:34.957520 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:34.957442 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-6577596cd5-2pt4b"] Jun 02 01:29:34.962337 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:34.961282 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-2pt4b" Jun 02 01:29:34.963928 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:34.963894 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 02 01:29:34.963928 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:34.963912 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-8jcrz\"" Jun 02 01:29:34.968190 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:34.968167 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-2pt4b"] Jun 02 01:29:34.979850 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:34.979813 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbebafe4-fb47-4235-9d81-2d16e374d4e2-tls-certs\") pod \"kube-auth-proxy-865b6fd47-8z6ld\" (UID: \"cbebafe4-fb47-4235-9d81-2d16e374d4e2\") " pod="openshift-ingress/kube-auth-proxy-865b6fd47-8z6ld" Jun 02 01:29:34.982880 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:34.982856 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbebafe4-fb47-4235-9d81-2d16e374d4e2-tls-certs\") pod \"kube-auth-proxy-865b6fd47-8z6ld\" (UID: \"cbebafe4-fb47-4235-9d81-2d16e374d4e2\") " pod="openshift-ingress/kube-auth-proxy-865b6fd47-8z6ld" Jun 02 01:29:35.080799 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:35.080760 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ebd229c-734c-43f3-bbb6-42878bd60e71-tls-certs\") pod \"model-serving-api-6577596cd5-2pt4b\" (UID: \"8ebd229c-734c-43f3-bbb6-42878bd60e71\") " pod="opendatahub/model-serving-api-6577596cd5-2pt4b" Jun 02 01:29:35.080799 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:35.080800 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qsq7\" (UniqueName: \"kubernetes.io/projected/8ebd229c-734c-43f3-bbb6-42878bd60e71-kube-api-access-8qsq7\") pod \"model-serving-api-6577596cd5-2pt4b\" (UID: \"8ebd229c-734c-43f3-bbb6-42878bd60e71\") " pod="opendatahub/model-serving-api-6577596cd5-2pt4b" Jun 02 01:29:35.081077 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:35.080826 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27f0f2c9-8195-4542-a69d-b0687c11dafc-cert\") pod \"odh-model-controller-76588b95-b7wwv\" (UID: \"27f0f2c9-8195-4542-a69d-b0687c11dafc\") " pod="opendatahub/odh-model-controller-76588b95-b7wwv" Jun 02 01:29:35.083361 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:35.083341 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27f0f2c9-8195-4542-a69d-b0687c11dafc-cert\") pod \"odh-model-controller-76588b95-b7wwv\" (UID: \"27f0f2c9-8195-4542-a69d-b0687c11dafc\") " pod="opendatahub/odh-model-controller-76588b95-b7wwv" Jun 02 01:29:35.158813 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:35.158779 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-865b6fd47-8z6ld" Jun 02 01:29:35.181411 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:35.181372 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ebd229c-734c-43f3-bbb6-42878bd60e71-tls-certs\") pod \"model-serving-api-6577596cd5-2pt4b\" (UID: \"8ebd229c-734c-43f3-bbb6-42878bd60e71\") " pod="opendatahub/model-serving-api-6577596cd5-2pt4b" Jun 02 01:29:35.181549 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:35.181416 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8qsq7\" (UniqueName: \"kubernetes.io/projected/8ebd229c-734c-43f3-bbb6-42878bd60e71-kube-api-access-8qsq7\") pod \"model-serving-api-6577596cd5-2pt4b\" (UID: \"8ebd229c-734c-43f3-bbb6-42878bd60e71\") " pod="opendatahub/model-serving-api-6577596cd5-2pt4b" Jun 02 01:29:35.183778 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:35.183756 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ebd229c-734c-43f3-bbb6-42878bd60e71-tls-certs\") pod \"model-serving-api-6577596cd5-2pt4b\" (UID: \"8ebd229c-734c-43f3-bbb6-42878bd60e71\") " pod="opendatahub/model-serving-api-6577596cd5-2pt4b" Jun 02 01:29:35.188923 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:35.188894 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qsq7\" (UniqueName: \"kubernetes.io/projected/8ebd229c-734c-43f3-bbb6-42878bd60e71-kube-api-access-8qsq7\") pod \"model-serving-api-6577596cd5-2pt4b\" (UID: \"8ebd229c-734c-43f3-bbb6-42878bd60e71\") " pod="opendatahub/model-serving-api-6577596cd5-2pt4b" Jun 02 01:29:35.274143 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:35.274113 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-2pt4b" Jun 02 01:29:35.279240 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:35.279214 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-865b6fd47-8z6ld"] Jun 02 01:29:35.282181 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:29:35.282149 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbebafe4_fb47_4235_9d81_2d16e374d4e2.slice/crio-bac59ce1162239917a556c0af690711f1b1d01e3f160c49d0708e8afe07ba66f WatchSource:0}: Error finding container bac59ce1162239917a556c0af690711f1b1d01e3f160c49d0708e8afe07ba66f: Status 404 returned error can't find the container with id bac59ce1162239917a556c0af690711f1b1d01e3f160c49d0708e8afe07ba66f Jun 02 01:29:35.298856 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:35.298820 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-b7wwv" Jun 02 01:29:35.411323 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:35.411290 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-2pt4b"] Jun 02 01:29:35.414364 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:29:35.414335 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ebd229c_734c_43f3_bbb6_42878bd60e71.slice/crio-abe1e8adac49494d10c678b3b0cc8b43da2b32e5b89ab0fd3ede0340394eeaa6 WatchSource:0}: Error finding container abe1e8adac49494d10c678b3b0cc8b43da2b32e5b89ab0fd3ede0340394eeaa6: Status 404 returned error can't find the container with id abe1e8adac49494d10c678b3b0cc8b43da2b32e5b89ab0fd3ede0340394eeaa6 Jun 02 01:29:35.437808 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:35.437782 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-b7wwv"] Jun 02 01:29:35.441086 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:29:35.441051 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27f0f2c9_8195_4542_a69d_b0687c11dafc.slice/crio-7ce9e8469c37193cc7a6fe65287f3216bb1a1f8e346d70b33d285c40179e2d70 WatchSource:0}: Error finding container 7ce9e8469c37193cc7a6fe65287f3216bb1a1f8e346d70b33d285c40179e2d70: Status 404 returned error can't find the container with id 7ce9e8469c37193cc7a6fe65287f3216bb1a1f8e346d70b33d285c40179e2d70 Jun 02 01:29:35.450540 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:35.450508 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-2pt4b" event={"ID":"8ebd229c-734c-43f3-bbb6-42878bd60e71","Type":"ContainerStarted","Data":"abe1e8adac49494d10c678b3b0cc8b43da2b32e5b89ab0fd3ede0340394eeaa6"} Jun 02 01:29:35.451483 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:35.451459 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-865b6fd47-8z6ld" event={"ID":"cbebafe4-fb47-4235-9d81-2d16e374d4e2","Type":"ContainerStarted","Data":"bac59ce1162239917a556c0af690711f1b1d01e3f160c49d0708e8afe07ba66f"} Jun 02 01:29:35.452374 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:35.452334 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-b7wwv" event={"ID":"27f0f2c9-8195-4542-a69d-b0687c11dafc","Type":"ContainerStarted","Data":"7ce9e8469c37193cc7a6fe65287f3216bb1a1f8e346d70b33d285c40179e2d70"} Jun 02 01:29:40.469823 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:40.469735 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-b7wwv" event={"ID":"27f0f2c9-8195-4542-a69d-b0687c11dafc","Type":"ContainerStarted","Data":"dfec48db516646de51d2353fae46cfe3ad502de18c736bda7a7733e1b6916afe"} Jun 02 01:29:40.470281 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:40.469959 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-76588b95-b7wwv" Jun 02 01:29:40.471262 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:40.471239 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-2pt4b" event={"ID":"8ebd229c-734c-43f3-bbb6-42878bd60e71","Type":"ContainerStarted","Data":"15f747bed93d74eb1952c1973156f7b7f7de42312b63db45f21cae1434386d24"} Jun 02 01:29:40.471382 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:40.471337 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-6577596cd5-2pt4b" Jun 02 01:29:40.472675 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:40.472653 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-865b6fd47-8z6ld" event={"ID":"cbebafe4-fb47-4235-9d81-2d16e374d4e2","Type":"ContainerStarted","Data":"9575451af67e066a0c45c5207ea03c8d8d2c3230829faf3991734de7f2204c07"} Jun 02 01:29:40.485746 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:40.485706 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-76588b95-b7wwv" podStartSLOduration=1.8494063600000001 podStartE2EDuration="6.485694693s" podCreationTimestamp="2026-06-02 01:29:34 +0000 UTC" firstStartedPulling="2026-06-02 01:29:35.442345778 +0000 UTC m=+423.771980674" lastFinishedPulling="2026-06-02 01:29:40.078634106 +0000 UTC m=+428.408269007" observedRunningTime="2026-06-02 01:29:40.485275199 +0000 UTC m=+428.814910122" watchObservedRunningTime="2026-06-02 01:29:40.485694693 +0000 UTC m=+428.815329612" Jun 02 01:29:40.501628 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:40.501570 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/model-serving-api-6577596cd5-2pt4b" podStartSLOduration=1.839599912 podStartE2EDuration="6.501554905s" podCreationTimestamp="2026-06-02 01:29:34 +0000 UTC" firstStartedPulling="2026-06-02 01:29:35.416579993 +0000 UTC m=+423.746214890" lastFinishedPulling="2026-06-02 01:29:40.078534974 +0000 UTC m=+428.408169883" observedRunningTime="2026-06-02 01:29:40.500436452 +0000 UTC m=+428.830071371" watchObservedRunningTime="2026-06-02 01:29:40.501554905 +0000 UTC m=+428.831189825" Jun 02 01:29:40.518632 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:40.518586 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-865b6fd47-8z6ld" podStartSLOduration=1.708147523 podStartE2EDuration="6.518575343s" podCreationTimestamp="2026-06-02 01:29:34 +0000 UTC" firstStartedPulling="2026-06-02 01:29:35.283821394 +0000 UTC m=+423.613456299" lastFinishedPulling="2026-06-02 01:29:40.094249209 +0000 UTC m=+428.423884119" observedRunningTime="2026-06-02 01:29:40.517993118 +0000 UTC m=+428.847628040" watchObservedRunningTime="2026-06-02 01:29:40.518575343 +0000 UTC m=+428.848210274" Jun 02 01:29:45.310356 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:45.310312 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-4g47k"] Jun 02 01:29:45.313418 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:45.313396 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-4g47k" Jun 02 01:29:45.315856 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:45.315818 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-hzmgp\"" Jun 02 01:29:45.315962 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:45.315945 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 02 01:29:45.325338 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:45.325314 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-4g47k"] Jun 02 01:29:45.327099 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:45.327078 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-jhf87"] Jun 02 01:29:45.330047 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:45.330030 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-jhf87" Jun 02 01:29:45.332449 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:45.332425 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 02 01:29:45.332547 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:45.332451 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-5rqrv\"" Jun 02 01:29:45.341883 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:45.341863 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-jhf87"] Jun 02 01:29:45.463228 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:45.463184 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ss9wr\" (UniqueName: \"kubernetes.io/projected/d971463f-5610-48d9-86b6-e4a777066378-kube-api-access-ss9wr\") pod \"kserve-controller-manager-7c99ffcdcd-4g47k\" (UID: \"d971463f-5610-48d9-86b6-e4a777066378\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-4g47k" Jun 02 01:29:45.463418 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:45.463235 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d971463f-5610-48d9-86b6-e4a777066378-cert\") pod \"kserve-controller-manager-7c99ffcdcd-4g47k\" (UID: \"d971463f-5610-48d9-86b6-e4a777066378\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-4g47k" Jun 02 01:29:45.463418 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:45.463273 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf59923b-6615-45e6-95f3-41988bdef0ac-cert\") pod \"llmisvc-controller-manager-c6b9847d7-jhf87\" (UID: \"cf59923b-6615-45e6-95f3-41988bdef0ac\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-jhf87" Jun 02 01:29:45.463418 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:45.463326 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htxrn\" (UniqueName: \"kubernetes.io/projected/cf59923b-6615-45e6-95f3-41988bdef0ac-kube-api-access-htxrn\") pod \"llmisvc-controller-manager-c6b9847d7-jhf87\" (UID: \"cf59923b-6615-45e6-95f3-41988bdef0ac\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-jhf87" Jun 02 01:29:45.564554 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:45.564467 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-htxrn\" (UniqueName: \"kubernetes.io/projected/cf59923b-6615-45e6-95f3-41988bdef0ac-kube-api-access-htxrn\") pod \"llmisvc-controller-manager-c6b9847d7-jhf87\" (UID: \"cf59923b-6615-45e6-95f3-41988bdef0ac\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-jhf87" Jun 02 01:29:45.564554 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:45.564517 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ss9wr\" (UniqueName: \"kubernetes.io/projected/d971463f-5610-48d9-86b6-e4a777066378-kube-api-access-ss9wr\") pod \"kserve-controller-manager-7c99ffcdcd-4g47k\" (UID: \"d971463f-5610-48d9-86b6-e4a777066378\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-4g47k" Jun 02 01:29:45.564554 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:45.564544 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d971463f-5610-48d9-86b6-e4a777066378-cert\") pod \"kserve-controller-manager-7c99ffcdcd-4g47k\" (UID: \"d971463f-5610-48d9-86b6-e4a777066378\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-4g47k" Jun 02 01:29:45.564792 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:45.564561 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf59923b-6615-45e6-95f3-41988bdef0ac-cert\") pod \"llmisvc-controller-manager-c6b9847d7-jhf87\" (UID: \"cf59923b-6615-45e6-95f3-41988bdef0ac\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-jhf87" Jun 02 01:29:45.564792 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:29:45.564659 2559 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 02 01:29:45.564792 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:29:45.564674 2559 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 02 01:29:45.564792 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:29:45.564717 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf59923b-6615-45e6-95f3-41988bdef0ac-cert podName:cf59923b-6615-45e6-95f3-41988bdef0ac nodeName:}" failed. No retries permitted until 2026-06-02 01:29:46.064697821 +0000 UTC m=+434.394332735 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cf59923b-6615-45e6-95f3-41988bdef0ac-cert") pod "llmisvc-controller-manager-c6b9847d7-jhf87" (UID: "cf59923b-6615-45e6-95f3-41988bdef0ac") : secret "llmisvc-webhook-server-cert" not found Jun 02 01:29:45.564792 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:29:45.564747 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d971463f-5610-48d9-86b6-e4a777066378-cert podName:d971463f-5610-48d9-86b6-e4a777066378 nodeName:}" failed. No retries permitted until 2026-06-02 01:29:46.064729503 +0000 UTC m=+434.394364405 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d971463f-5610-48d9-86b6-e4a777066378-cert") pod "kserve-controller-manager-7c99ffcdcd-4g47k" (UID: "d971463f-5610-48d9-86b6-e4a777066378") : secret "kserve-webhook-server-cert" not found Jun 02 01:29:45.577694 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:45.577656 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htxrn\" (UniqueName: \"kubernetes.io/projected/cf59923b-6615-45e6-95f3-41988bdef0ac-kube-api-access-htxrn\") pod \"llmisvc-controller-manager-c6b9847d7-jhf87\" (UID: \"cf59923b-6615-45e6-95f3-41988bdef0ac\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-jhf87" Jun 02 01:29:45.577694 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:45.577679 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ss9wr\" (UniqueName: \"kubernetes.io/projected/d971463f-5610-48d9-86b6-e4a777066378-kube-api-access-ss9wr\") pod \"kserve-controller-manager-7c99ffcdcd-4g47k\" (UID: \"d971463f-5610-48d9-86b6-e4a777066378\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-4g47k" Jun 02 01:29:46.069043 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:46.068995 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d971463f-5610-48d9-86b6-e4a777066378-cert\") pod \"kserve-controller-manager-7c99ffcdcd-4g47k\" (UID: \"d971463f-5610-48d9-86b6-e4a777066378\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-4g47k" Jun 02 01:29:46.069043 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:46.069048 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf59923b-6615-45e6-95f3-41988bdef0ac-cert\") pod \"llmisvc-controller-manager-c6b9847d7-jhf87\" (UID: \"cf59923b-6615-45e6-95f3-41988bdef0ac\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-jhf87" Jun 02 01:29:46.071548 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:46.071513 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d971463f-5610-48d9-86b6-e4a777066378-cert\") pod \"kserve-controller-manager-7c99ffcdcd-4g47k\" (UID: \"d971463f-5610-48d9-86b6-e4a777066378\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-4g47k" Jun 02 01:29:46.071662 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:46.071598 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf59923b-6615-45e6-95f3-41988bdef0ac-cert\") pod \"llmisvc-controller-manager-c6b9847d7-jhf87\" (UID: \"cf59923b-6615-45e6-95f3-41988bdef0ac\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-jhf87" Jun 02 01:29:46.223830 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:46.223791 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-4g47k" Jun 02 01:29:46.239022 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:46.238993 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-jhf87" Jun 02 01:29:46.382685 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:46.382647 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-4g47k"] Jun 02 01:29:46.388248 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:29:46.388224 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd971463f_5610_48d9_86b6_e4a777066378.slice/crio-81a95bd84a57068e534c6082c07d47dceba140443cfc7d29589eb0e117bf49be WatchSource:0}: Error finding container 81a95bd84a57068e534c6082c07d47dceba140443cfc7d29589eb0e117bf49be: Status 404 returned error can't find the container with id 81a95bd84a57068e534c6082c07d47dceba140443cfc7d29589eb0e117bf49be Jun 02 01:29:46.408877 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:46.408851 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-jhf87"] Jun 02 01:29:46.410751 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:29:46.410726 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcf59923b_6615_45e6_95f3_41988bdef0ac.slice/crio-d912a48dc51af1e6c27bf50ae28e2343f3292cf9b61925eb5a39bb1e96af3d77 WatchSource:0}: Error finding container d912a48dc51af1e6c27bf50ae28e2343f3292cf9b61925eb5a39bb1e96af3d77: Status 404 returned error can't find the container with id d912a48dc51af1e6c27bf50ae28e2343f3292cf9b61925eb5a39bb1e96af3d77 Jun 02 01:29:46.491657 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:46.491617 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-jhf87" event={"ID":"cf59923b-6615-45e6-95f3-41988bdef0ac","Type":"ContainerStarted","Data":"d912a48dc51af1e6c27bf50ae28e2343f3292cf9b61925eb5a39bb1e96af3d77"} Jun 02 01:29:46.492694 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:46.492670 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-4g47k" event={"ID":"d971463f-5610-48d9-86b6-e4a777066378","Type":"ContainerStarted","Data":"81a95bd84a57068e534c6082c07d47dceba140443cfc7d29589eb0e117bf49be"} Jun 02 01:29:49.505223 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:49.505127 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-4g47k" event={"ID":"d971463f-5610-48d9-86b6-e4a777066378","Type":"ContainerStarted","Data":"f265e5c6b9772ca384ea5e5a30f79c8270d5369bdbe93ec9b39da29a6b06fbb8"} Jun 02 01:29:49.505658 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:49.505308 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-4g47k" Jun 02 01:29:49.538713 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:49.538650 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-4g47k" podStartSLOduration=1.812465559 podStartE2EDuration="4.538630842s" podCreationTimestamp="2026-06-02 01:29:45 +0000 UTC" firstStartedPulling="2026-06-02 01:29:46.389493527 +0000 UTC m=+434.719128424" lastFinishedPulling="2026-06-02 01:29:49.11565881 +0000 UTC m=+437.445293707" observedRunningTime="2026-06-02 01:29:49.538200013 +0000 UTC m=+437.867834946" watchObservedRunningTime="2026-06-02 01:29:49.538630842 +0000 UTC m=+437.868265764" Jun 02 01:29:50.509278 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:50.509241 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-jhf87" event={"ID":"cf59923b-6615-45e6-95f3-41988bdef0ac","Type":"ContainerStarted","Data":"a5c21e10fc655e6ff4176d2a6fd0c832e37b5351a939eb581a4e66576b59f241"} Jun 02 01:29:50.509655 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:50.509339 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-jhf87" Jun 02 01:29:50.559294 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:50.559237 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-jhf87" podStartSLOduration=2.153892634 podStartE2EDuration="5.559222935s" podCreationTimestamp="2026-06-02 01:29:45 +0000 UTC" firstStartedPulling="2026-06-02 01:29:46.412120782 +0000 UTC m=+434.741755683" lastFinishedPulling="2026-06-02 01:29:49.817451076 +0000 UTC m=+438.147085984" observedRunningTime="2026-06-02 01:29:50.554176528 +0000 UTC m=+438.883811447" watchObservedRunningTime="2026-06-02 01:29:50.559222935 +0000 UTC m=+438.888857881" Jun 02 01:29:51.479559 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:51.479526 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-76588b95-b7wwv" Jun 02 01:29:51.482129 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:51.482108 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-6577596cd5-2pt4b" Jun 02 01:29:53.186300 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:53.186264 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-fsndk"] Jun 02 01:29:53.189755 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:53.189738 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-fsndk" Jun 02 01:29:53.192425 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:53.192396 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-gslkr\"" Jun 02 01:29:53.192555 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:53.192531 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 02 01:29:53.192660 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:53.192644 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 02 01:29:53.204012 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:53.203988 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-fsndk"] Jun 02 01:29:53.327546 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:53.327502 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/69818873-15d3-4ea5-9185-6162b87461ed-operator-config\") pod \"servicemesh-operator3-55f49c5f94-fsndk\" (UID: \"69818873-15d3-4ea5-9185-6162b87461ed\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-fsndk" Jun 02 01:29:53.327738 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:53.327680 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fl846\" (UniqueName: \"kubernetes.io/projected/69818873-15d3-4ea5-9185-6162b87461ed-kube-api-access-fl846\") pod \"servicemesh-operator3-55f49c5f94-fsndk\" (UID: \"69818873-15d3-4ea5-9185-6162b87461ed\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-fsndk" Jun 02 01:29:53.429049 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:53.428992 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/69818873-15d3-4ea5-9185-6162b87461ed-operator-config\") pod \"servicemesh-operator3-55f49c5f94-fsndk\" (UID: \"69818873-15d3-4ea5-9185-6162b87461ed\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-fsndk" Jun 02 01:29:53.429223 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:53.429084 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fl846\" (UniqueName: \"kubernetes.io/projected/69818873-15d3-4ea5-9185-6162b87461ed-kube-api-access-fl846\") pod \"servicemesh-operator3-55f49c5f94-fsndk\" (UID: \"69818873-15d3-4ea5-9185-6162b87461ed\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-fsndk" Jun 02 01:29:53.431677 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:53.431649 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/69818873-15d3-4ea5-9185-6162b87461ed-operator-config\") pod \"servicemesh-operator3-55f49c5f94-fsndk\" (UID: \"69818873-15d3-4ea5-9185-6162b87461ed\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-fsndk" Jun 02 01:29:53.438857 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:53.438773 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fl846\" (UniqueName: \"kubernetes.io/projected/69818873-15d3-4ea5-9185-6162b87461ed-kube-api-access-fl846\") pod \"servicemesh-operator3-55f49c5f94-fsndk\" (UID: \"69818873-15d3-4ea5-9185-6162b87461ed\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-fsndk" Jun 02 01:29:53.498803 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:53.498766 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-fsndk" Jun 02 01:29:53.633474 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:53.633438 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-fsndk"] Jun 02 01:29:53.636489 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:29:53.636463 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69818873_15d3_4ea5_9185_6162b87461ed.slice/crio-87bca96a65acb5e1e304776c972ad70439103b77bc40463baced270abca7db50 WatchSource:0}: Error finding container 87bca96a65acb5e1e304776c972ad70439103b77bc40463baced270abca7db50: Status 404 returned error can't find the container with id 87bca96a65acb5e1e304776c972ad70439103b77bc40463baced270abca7db50 Jun 02 01:29:54.522897 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:54.522856 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-fsndk" event={"ID":"69818873-15d3-4ea5-9185-6162b87461ed","Type":"ContainerStarted","Data":"87bca96a65acb5e1e304776c972ad70439103b77bc40463baced270abca7db50"} Jun 02 01:29:58.538378 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:58.538340 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-fsndk" event={"ID":"69818873-15d3-4ea5-9185-6162b87461ed","Type":"ContainerStarted","Data":"348e963c83848cc59bea0cdfbdd3dd12f120a9665cddb2555cb504867f1cc6f9"} Jun 02 01:29:58.538734 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:58.538464 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-fsndk" Jun 02 01:29:58.562590 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:29:58.562543 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-fsndk" podStartSLOduration=1.126209937 podStartE2EDuration="5.562530311s" podCreationTimestamp="2026-06-02 01:29:53 +0000 UTC" firstStartedPulling="2026-06-02 01:29:53.639003277 +0000 UTC m=+441.968638173" lastFinishedPulling="2026-06-02 01:29:58.075323631 +0000 UTC m=+446.404958547" observedRunningTime="2026-06-02 01:29:58.560901481 +0000 UTC m=+446.890536401" watchObservedRunningTime="2026-06-02 01:29:58.562530311 +0000 UTC m=+446.892165230" Jun 02 01:30:04.175936 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:04.175900 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-czn5m"] Jun 02 01:30:04.179226 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:04.179207 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-czn5m" Jun 02 01:30:04.182178 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:04.182139 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-sxxp5\"" Jun 02 01:30:04.182378 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:04.182355 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 02 01:30:04.182459 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:04.182390 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 02 01:30:04.182658 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:04.182642 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 02 01:30:04.182895 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:04.182880 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 02 01:30:04.202194 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:04.202162 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-czn5m"] Jun 02 01:30:04.204479 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:04.204454 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/025e8655-c031-4252-83af-0285281432fd-cacerts\") pod \"istiod-openshift-gateway-798958bb55-czn5m\" (UID: \"025e8655-c031-4252-83af-0285281432fd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-czn5m" Jun 02 01:30:04.204605 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:04.204494 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/025e8655-c031-4252-83af-0285281432fd-istio-token\") pod \"istiod-openshift-gateway-798958bb55-czn5m\" (UID: \"025e8655-c031-4252-83af-0285281432fd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-czn5m" Jun 02 01:30:04.204605 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:04.204561 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/025e8655-c031-4252-83af-0285281432fd-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-czn5m\" (UID: \"025e8655-c031-4252-83af-0285281432fd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-czn5m" Jun 02 01:30:04.204714 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:04.204600 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/025e8655-c031-4252-83af-0285281432fd-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-czn5m\" (UID: \"025e8655-c031-4252-83af-0285281432fd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-czn5m" Jun 02 01:30:04.204714 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:04.204622 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqwbq\" (UniqueName: \"kubernetes.io/projected/025e8655-c031-4252-83af-0285281432fd-kube-api-access-rqwbq\") pod \"istiod-openshift-gateway-798958bb55-czn5m\" (UID: \"025e8655-c031-4252-83af-0285281432fd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-czn5m" Jun 02 01:30:04.204714 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:04.204689 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/025e8655-c031-4252-83af-0285281432fd-local-certs\") pod \"istiod-openshift-gateway-798958bb55-czn5m\" (UID: \"025e8655-c031-4252-83af-0285281432fd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-czn5m" Jun 02 01:30:04.204714 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:04.204712 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/025e8655-c031-4252-83af-0285281432fd-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-czn5m\" (UID: \"025e8655-c031-4252-83af-0285281432fd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-czn5m" Jun 02 01:30:04.305908 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:04.305824 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/025e8655-c031-4252-83af-0285281432fd-istio-token\") pod \"istiod-openshift-gateway-798958bb55-czn5m\" (UID: \"025e8655-c031-4252-83af-0285281432fd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-czn5m" Jun 02 01:30:04.305908 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:04.305907 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/025e8655-c031-4252-83af-0285281432fd-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-czn5m\" (UID: \"025e8655-c031-4252-83af-0285281432fd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-czn5m" Jun 02 01:30:04.306166 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:04.305939 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/025e8655-c031-4252-83af-0285281432fd-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-czn5m\" (UID: \"025e8655-c031-4252-83af-0285281432fd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-czn5m" Jun 02 01:30:04.306166 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:04.305954 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rqwbq\" (UniqueName: \"kubernetes.io/projected/025e8655-c031-4252-83af-0285281432fd-kube-api-access-rqwbq\") pod \"istiod-openshift-gateway-798958bb55-czn5m\" (UID: \"025e8655-c031-4252-83af-0285281432fd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-czn5m" Jun 02 01:30:04.306166 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:04.306012 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/025e8655-c031-4252-83af-0285281432fd-local-certs\") pod \"istiod-openshift-gateway-798958bb55-czn5m\" (UID: \"025e8655-c031-4252-83af-0285281432fd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-czn5m" Jun 02 01:30:04.306166 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:04.306042 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/025e8655-c031-4252-83af-0285281432fd-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-czn5m\" (UID: \"025e8655-c031-4252-83af-0285281432fd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-czn5m" Jun 02 01:30:04.306166 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:04.306095 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/025e8655-c031-4252-83af-0285281432fd-cacerts\") pod \"istiod-openshift-gateway-798958bb55-czn5m\" (UID: \"025e8655-c031-4252-83af-0285281432fd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-czn5m" Jun 02 01:30:04.306661 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:04.306635 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/025e8655-c031-4252-83af-0285281432fd-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-czn5m\" (UID: \"025e8655-c031-4252-83af-0285281432fd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-czn5m" Jun 02 01:30:04.308533 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:04.308501 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/025e8655-c031-4252-83af-0285281432fd-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-czn5m\" (UID: \"025e8655-c031-4252-83af-0285281432fd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-czn5m" Jun 02 01:30:04.308679 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:04.308655 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/025e8655-c031-4252-83af-0285281432fd-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-czn5m\" (UID: \"025e8655-c031-4252-83af-0285281432fd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-czn5m" Jun 02 01:30:04.308964 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:04.308944 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/025e8655-c031-4252-83af-0285281432fd-local-certs\") pod \"istiod-openshift-gateway-798958bb55-czn5m\" (UID: \"025e8655-c031-4252-83af-0285281432fd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-czn5m" Jun 02 01:30:04.309039 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:04.308981 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/025e8655-c031-4252-83af-0285281432fd-cacerts\") pod \"istiod-openshift-gateway-798958bb55-czn5m\" (UID: \"025e8655-c031-4252-83af-0285281432fd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-czn5m" Jun 02 01:30:04.314232 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:04.314206 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/025e8655-c031-4252-83af-0285281432fd-istio-token\") pod \"istiod-openshift-gateway-798958bb55-czn5m\" (UID: \"025e8655-c031-4252-83af-0285281432fd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-czn5m" Jun 02 01:30:04.314408 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:04.314389 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqwbq\" (UniqueName: \"kubernetes.io/projected/025e8655-c031-4252-83af-0285281432fd-kube-api-access-rqwbq\") pod \"istiod-openshift-gateway-798958bb55-czn5m\" (UID: \"025e8655-c031-4252-83af-0285281432fd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-czn5m" Jun 02 01:30:04.493211 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:04.493106 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-czn5m" Jun 02 01:30:04.629779 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:04.629748 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-czn5m"] Jun 02 01:30:05.559985 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:05.559943 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-czn5m" event={"ID":"025e8655-c031-4252-83af-0285281432fd","Type":"ContainerStarted","Data":"02ace18d720347f63e34616b602aa8bcb9376b7f0a9dee052c1af246f6cd9331"} Jun 02 01:30:09.544495 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:09.544460 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-fsndk" Jun 02 01:30:17.715278 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:17.715238 2559 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 02 01:30:17.715492 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:17.715310 2559 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 02 01:30:18.602729 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:18.602681 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-czn5m" event={"ID":"025e8655-c031-4252-83af-0285281432fd","Type":"ContainerStarted","Data":"5f43c1ecf219f1fbe3ea44c244311d22b44a64acbd5bd51843f8dbb44a49ac4a"} Jun 02 01:30:18.602964 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:18.602868 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-czn5m" Jun 02 01:30:18.604426 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:18.604399 2559 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-czn5m container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 02 01:30:18.604538 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:18.604454 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-czn5m" podUID="025e8655-c031-4252-83af-0285281432fd" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 01:30:18.645094 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:18.645032 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-czn5m" podStartSLOduration=1.5668809750000001 podStartE2EDuration="14.645012195s" podCreationTimestamp="2026-06-02 01:30:04 +0000 UTC" firstStartedPulling="2026-06-02 01:30:04.636886285 +0000 UTC m=+452.966521181" lastFinishedPulling="2026-06-02 01:30:17.71501749 +0000 UTC m=+466.044652401" observedRunningTime="2026-06-02 01:30:18.643224263 +0000 UTC m=+466.972859183" watchObservedRunningTime="2026-06-02 01:30:18.645012195 +0000 UTC m=+466.974647115" Jun 02 01:30:19.606761 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:19.606731 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-czn5m" Jun 02 01:30:20.514470 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:20.514433 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-4g47k" Jun 02 01:30:21.514867 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:21.514816 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-jhf87" Jun 02 01:30:24.980271 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:24.980230 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-7598c6c7c5-b45rj"] Jun 02 01:30:24.984956 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:24.984935 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7598c6c7c5-b45rj" Jun 02 01:30:24.987519 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:24.987497 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-9dhrw\"" Jun 02 01:30:24.987519 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:24.987515 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 02 01:30:24.992883 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:24.992857 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7598c6c7c5-b45rj"] Jun 02 01:30:25.065034 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:25.064997 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/43b04c98-5f6c-4108-8dfd-6b32395343af-redirect-config\") pod \"dashboard-redirect-7598c6c7c5-b45rj\" (UID: \"43b04c98-5f6c-4108-8dfd-6b32395343af\") " pod="opendatahub/dashboard-redirect-7598c6c7c5-b45rj" Jun 02 01:30:25.065196 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:25.065065 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5dqq\" (UniqueName: \"kubernetes.io/projected/43b04c98-5f6c-4108-8dfd-6b32395343af-kube-api-access-s5dqq\") pod \"dashboard-redirect-7598c6c7c5-b45rj\" (UID: \"43b04c98-5f6c-4108-8dfd-6b32395343af\") " pod="opendatahub/dashboard-redirect-7598c6c7c5-b45rj" Jun 02 01:30:25.166384 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:25.166343 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s5dqq\" (UniqueName: \"kubernetes.io/projected/43b04c98-5f6c-4108-8dfd-6b32395343af-kube-api-access-s5dqq\") pod \"dashboard-redirect-7598c6c7c5-b45rj\" (UID: \"43b04c98-5f6c-4108-8dfd-6b32395343af\") " pod="opendatahub/dashboard-redirect-7598c6c7c5-b45rj" Jun 02 01:30:25.166547 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:25.166404 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/43b04c98-5f6c-4108-8dfd-6b32395343af-redirect-config\") pod \"dashboard-redirect-7598c6c7c5-b45rj\" (UID: \"43b04c98-5f6c-4108-8dfd-6b32395343af\") " pod="opendatahub/dashboard-redirect-7598c6c7c5-b45rj" Jun 02 01:30:25.167131 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:25.167109 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/43b04c98-5f6c-4108-8dfd-6b32395343af-redirect-config\") pod \"dashboard-redirect-7598c6c7c5-b45rj\" (UID: \"43b04c98-5f6c-4108-8dfd-6b32395343af\") " pod="opendatahub/dashboard-redirect-7598c6c7c5-b45rj" Jun 02 01:30:25.174628 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:25.174608 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5dqq\" (UniqueName: \"kubernetes.io/projected/43b04c98-5f6c-4108-8dfd-6b32395343af-kube-api-access-s5dqq\") pod \"dashboard-redirect-7598c6c7c5-b45rj\" (UID: \"43b04c98-5f6c-4108-8dfd-6b32395343af\") " pod="opendatahub/dashboard-redirect-7598c6c7c5-b45rj" Jun 02 01:30:25.295875 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:25.295819 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7598c6c7c5-b45rj" Jun 02 01:30:25.426551 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:25.426514 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7598c6c7c5-b45rj"] Jun 02 01:30:25.430559 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:30:25.430532 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43b04c98_5f6c_4108_8dfd_6b32395343af.slice/crio-1246c9b9786cb08a0fe0a26ec86e4d4241cadbfad02112c354f85ac0254c515a WatchSource:0}: Error finding container 1246c9b9786cb08a0fe0a26ec86e4d4241cadbfad02112c354f85ac0254c515a: Status 404 returned error can't find the container with id 1246c9b9786cb08a0fe0a26ec86e4d4241cadbfad02112c354f85ac0254c515a Jun 02 01:30:25.626761 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:25.626673 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7598c6c7c5-b45rj" event={"ID":"43b04c98-5f6c-4108-8dfd-6b32395343af","Type":"ContainerStarted","Data":"1246c9b9786cb08a0fe0a26ec86e4d4241cadbfad02112c354f85ac0254c515a"} Jun 02 01:30:27.634466 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:27.634427 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7598c6c7c5-b45rj" event={"ID":"43b04c98-5f6c-4108-8dfd-6b32395343af","Type":"ContainerStarted","Data":"61f9f61f7dc38eecf3ce24d914b005266b1ccf2abe58c99651ab80941228a168"} Jun 02 01:30:27.650887 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:30:27.650810 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-7598c6c7c5-b45rj" podStartSLOduration=1.6636084389999999 podStartE2EDuration="3.650795564s" podCreationTimestamp="2026-06-02 01:30:24 +0000 UTC" firstStartedPulling="2026-06-02 01:30:25.432245986 +0000 UTC m=+473.761880884" lastFinishedPulling="2026-06-02 01:30:27.419433112 +0000 UTC m=+475.749068009" observedRunningTime="2026-06-02 01:30:27.648809452 +0000 UTC m=+475.978444371" watchObservedRunningTime="2026-06-02 01:30:27.650795564 +0000 UTC m=+475.980430482" Jun 02 01:31:09.964567 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:09.964523 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rxn42"] Jun 02 01:31:09.978854 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:09.978821 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rxn42" Jun 02 01:31:09.981577 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:09.981552 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-s45vr\"" Jun 02 01:31:09.981745 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:09.981723 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 01:31:09.981826 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:09.981806 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 01:31:09.982208 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:09.982183 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rxn42"] Jun 02 01:31:10.022437 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:10.022408 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/88661321-40c5-4412-8fee-fd770c0ca6b5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-rxn42\" (UID: \"88661321-40c5-4412-8fee-fd770c0ca6b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rxn42" Jun 02 01:31:10.022593 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:10.022486 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvlpq\" (UniqueName: \"kubernetes.io/projected/88661321-40c5-4412-8fee-fd770c0ca6b5-kube-api-access-mvlpq\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-rxn42\" (UID: \"88661321-40c5-4412-8fee-fd770c0ca6b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rxn42" Jun 02 01:31:10.123722 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:10.123644 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/88661321-40c5-4412-8fee-fd770c0ca6b5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-rxn42\" (UID: \"88661321-40c5-4412-8fee-fd770c0ca6b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rxn42" Jun 02 01:31:10.123722 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:10.123700 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mvlpq\" (UniqueName: \"kubernetes.io/projected/88661321-40c5-4412-8fee-fd770c0ca6b5-kube-api-access-mvlpq\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-rxn42\" (UID: \"88661321-40c5-4412-8fee-fd770c0ca6b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rxn42" Jun 02 01:31:10.124064 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:10.124041 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/88661321-40c5-4412-8fee-fd770c0ca6b5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-rxn42\" (UID: \"88661321-40c5-4412-8fee-fd770c0ca6b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rxn42" Jun 02 01:31:10.132021 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:10.132000 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvlpq\" (UniqueName: \"kubernetes.io/projected/88661321-40c5-4412-8fee-fd770c0ca6b5-kube-api-access-mvlpq\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-rxn42\" (UID: \"88661321-40c5-4412-8fee-fd770c0ca6b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rxn42" Jun 02 01:31:10.291046 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:10.291014 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rxn42" Jun 02 01:31:10.425571 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:10.425535 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rxn42"] Jun 02 01:31:10.428487 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:31:10.428459 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88661321_40c5_4412_8fee_fd770c0ca6b5.slice/crio-040872bcc1222378292d81fcc1b40af0b749cff0986ba040e7e0158aed77d77b WatchSource:0}: Error finding container 040872bcc1222378292d81fcc1b40af0b749cff0986ba040e7e0158aed77d77b: Status 404 returned error can't find the container with id 040872bcc1222378292d81fcc1b40af0b749cff0986ba040e7e0158aed77d77b Jun 02 01:31:10.766799 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:10.766721 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rxn42" event={"ID":"88661321-40c5-4412-8fee-fd770c0ca6b5","Type":"ContainerStarted","Data":"040872bcc1222378292d81fcc1b40af0b749cff0986ba040e7e0158aed77d77b"} Jun 02 01:31:16.788402 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:16.788362 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rxn42" event={"ID":"88661321-40c5-4412-8fee-fd770c0ca6b5","Type":"ContainerStarted","Data":"a9ddaacd9656608fa26cdc6a4e1197ed83c584a6a9c5ae2d852724cc8844020c"} Jun 02 01:31:16.788776 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:16.788507 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rxn42" Jun 02 01:31:16.813130 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:16.813080 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rxn42" podStartSLOduration=2.157581248 podStartE2EDuration="7.813065719s" podCreationTimestamp="2026-06-02 01:31:09 +0000 UTC" firstStartedPulling="2026-06-02 01:31:10.430668677 +0000 UTC m=+518.760303574" lastFinishedPulling="2026-06-02 01:31:16.086153148 +0000 UTC m=+524.415788045" observedRunningTime="2026-06-02 01:31:16.811884595 +0000 UTC m=+525.141519513" watchObservedRunningTime="2026-06-02 01:31:16.813065719 +0000 UTC m=+525.142700658" Jun 02 01:31:27.792984 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:27.792949 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rxn42" Jun 02 01:31:29.489334 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:29.489288 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rxn42"] Jun 02 01:31:29.489792 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:29.489508 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rxn42" podUID="88661321-40c5-4412-8fee-fd770c0ca6b5" containerName="manager" containerID="cri-o://a9ddaacd9656608fa26cdc6a4e1197ed83c584a6a9c5ae2d852724cc8844020c" gracePeriod=2 Jun 02 01:31:29.491691 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:29.491654 2559 status_manager.go:895] "Failed to get status for pod" podUID="88661321-40c5-4412-8fee-fd770c0ca6b5" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rxn42" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-rxn42\" is forbidden: User \"system:node:ip-10-0-130-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-179.ec2.internal' and this object" Jun 02 01:31:29.493323 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:29.493295 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rxn42"] Jun 02 01:31:29.511930 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:29.511900 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wxx8z"] Jun 02 01:31:29.512220 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:29.512208 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88661321-40c5-4412-8fee-fd770c0ca6b5" containerName="manager" Jun 02 01:31:29.512270 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:29.512223 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="88661321-40c5-4412-8fee-fd770c0ca6b5" containerName="manager" Jun 02 01:31:29.512304 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:29.512286 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="88661321-40c5-4412-8fee-fd770c0ca6b5" containerName="manager" Jun 02 01:31:29.515059 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:29.515044 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wxx8z" Jun 02 01:31:29.532286 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:29.532236 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wxx8z"] Jun 02 01:31:29.566463 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:29.566350 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkh66\" (UniqueName: \"kubernetes.io/projected/0048967e-6f59-4e5c-b498-ba4808ad41f2-kube-api-access-qkh66\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-wxx8z\" (UID: \"0048967e-6f59-4e5c-b498-ba4808ad41f2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wxx8z" Jun 02 01:31:29.566463 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:29.566426 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0048967e-6f59-4e5c-b498-ba4808ad41f2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-wxx8z\" (UID: \"0048967e-6f59-4e5c-b498-ba4808ad41f2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wxx8z" Jun 02 01:31:29.573768 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:29.573733 2559 status_manager.go:895] "Failed to get status for pod" podUID="88661321-40c5-4412-8fee-fd770c0ca6b5" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rxn42" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-rxn42\" is forbidden: User \"system:node:ip-10-0-130-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-179.ec2.internal' and this object" Jun 02 01:31:29.667346 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:29.667316 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qkh66\" (UniqueName: \"kubernetes.io/projected/0048967e-6f59-4e5c-b498-ba4808ad41f2-kube-api-access-qkh66\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-wxx8z\" (UID: \"0048967e-6f59-4e5c-b498-ba4808ad41f2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wxx8z" Jun 02 01:31:29.667478 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:29.667367 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0048967e-6f59-4e5c-b498-ba4808ad41f2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-wxx8z\" (UID: \"0048967e-6f59-4e5c-b498-ba4808ad41f2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wxx8z" Jun 02 01:31:29.667716 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:29.667699 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0048967e-6f59-4e5c-b498-ba4808ad41f2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-wxx8z\" (UID: \"0048967e-6f59-4e5c-b498-ba4808ad41f2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wxx8z" Jun 02 01:31:29.678968 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:29.678940 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkh66\" (UniqueName: \"kubernetes.io/projected/0048967e-6f59-4e5c-b498-ba4808ad41f2-kube-api-access-qkh66\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-wxx8z\" (UID: \"0048967e-6f59-4e5c-b498-ba4808ad41f2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wxx8z" Jun 02 01:31:29.722256 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:29.722234 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rxn42" Jun 02 01:31:29.724549 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:29.724525 2559 status_manager.go:895] "Failed to get status for pod" podUID="88661321-40c5-4412-8fee-fd770c0ca6b5" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rxn42" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-rxn42\" is forbidden: User \"system:node:ip-10-0-130-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-179.ec2.internal' and this object" Jun 02 01:31:29.768003 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:29.767934 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mvlpq\" (UniqueName: \"kubernetes.io/projected/88661321-40c5-4412-8fee-fd770c0ca6b5-kube-api-access-mvlpq\") pod \"88661321-40c5-4412-8fee-fd770c0ca6b5\" (UID: \"88661321-40c5-4412-8fee-fd770c0ca6b5\") " Jun 02 01:31:29.768003 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:29.767969 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/88661321-40c5-4412-8fee-fd770c0ca6b5-extensions-socket-volume\") pod \"88661321-40c5-4412-8fee-fd770c0ca6b5\" (UID: \"88661321-40c5-4412-8fee-fd770c0ca6b5\") " Jun 02 01:31:29.768501 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:29.768474 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88661321-40c5-4412-8fee-fd770c0ca6b5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "88661321-40c5-4412-8fee-fd770c0ca6b5" (UID: "88661321-40c5-4412-8fee-fd770c0ca6b5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:31:29.770342 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:29.770319 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88661321-40c5-4412-8fee-fd770c0ca6b5-kube-api-access-mvlpq" (OuterVolumeSpecName: "kube-api-access-mvlpq") pod "88661321-40c5-4412-8fee-fd770c0ca6b5" (UID: "88661321-40c5-4412-8fee-fd770c0ca6b5"). InnerVolumeSpecName "kube-api-access-mvlpq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:31:29.830129 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:29.830096 2559 generic.go:358] "Generic (PLEG): container finished" podID="88661321-40c5-4412-8fee-fd770c0ca6b5" containerID="a9ddaacd9656608fa26cdc6a4e1197ed83c584a6a9c5ae2d852724cc8844020c" exitCode=0 Jun 02 01:31:29.830290 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:29.830147 2559 scope.go:117] "RemoveContainer" containerID="a9ddaacd9656608fa26cdc6a4e1197ed83c584a6a9c5ae2d852724cc8844020c" Jun 02 01:31:29.830290 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:29.830143 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rxn42" Jun 02 01:31:29.832467 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:29.832436 2559 status_manager.go:895] "Failed to get status for pod" podUID="88661321-40c5-4412-8fee-fd770c0ca6b5" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rxn42" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-rxn42\" is forbidden: User \"system:node:ip-10-0-130-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-179.ec2.internal' and this object" Jun 02 01:31:29.838468 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:29.838449 2559 scope.go:117] "RemoveContainer" containerID="a9ddaacd9656608fa26cdc6a4e1197ed83c584a6a9c5ae2d852724cc8844020c" Jun 02 01:31:29.838710 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:31:29.838690 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9ddaacd9656608fa26cdc6a4e1197ed83c584a6a9c5ae2d852724cc8844020c\": container with ID starting with a9ddaacd9656608fa26cdc6a4e1197ed83c584a6a9c5ae2d852724cc8844020c not found: ID does not exist" containerID="a9ddaacd9656608fa26cdc6a4e1197ed83c584a6a9c5ae2d852724cc8844020c" Jun 02 01:31:29.838758 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:29.838718 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9ddaacd9656608fa26cdc6a4e1197ed83c584a6a9c5ae2d852724cc8844020c"} err="failed to get container status \"a9ddaacd9656608fa26cdc6a4e1197ed83c584a6a9c5ae2d852724cc8844020c\": rpc error: code = NotFound desc = could not find container \"a9ddaacd9656608fa26cdc6a4e1197ed83c584a6a9c5ae2d852724cc8844020c\": container with ID starting with a9ddaacd9656608fa26cdc6a4e1197ed83c584a6a9c5ae2d852724cc8844020c not found: ID does not exist" Jun 02 01:31:29.839813 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:29.839793 2559 status_manager.go:895] "Failed to get status for pod" podUID="88661321-40c5-4412-8fee-fd770c0ca6b5" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rxn42" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-rxn42\" is forbidden: User \"system:node:ip-10-0-130-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-179.ec2.internal' and this object" Jun 02 01:31:29.869251 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:29.869225 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mvlpq\" (UniqueName: \"kubernetes.io/projected/88661321-40c5-4412-8fee-fd770c0ca6b5-kube-api-access-mvlpq\") on node \"ip-10-0-130-179.ec2.internal\" DevicePath \"\"" Jun 02 01:31:29.869251 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:29.869253 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/88661321-40c5-4412-8fee-fd770c0ca6b5-extensions-socket-volume\") on node \"ip-10-0-130-179.ec2.internal\" DevicePath \"\"" Jun 02 01:31:29.871183 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:29.871166 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wxx8z" Jun 02 01:31:29.999853 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:29.999802 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wxx8z"] Jun 02 01:31:30.004281 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:31:30.004254 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0048967e_6f59_4e5c_b498_ba4808ad41f2.slice/crio-efd99d17b32e2c7a82c820c8493bd17304a53c06c862c38c18ac37f085033c8d WatchSource:0}: Error finding container efd99d17b32e2c7a82c820c8493bd17304a53c06c862c38c18ac37f085033c8d: Status 404 returned error can't find the container with id efd99d17b32e2c7a82c820c8493bd17304a53c06c862c38c18ac37f085033c8d Jun 02 01:31:30.232304 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:30.232270 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88661321-40c5-4412-8fee-fd770c0ca6b5" path="/var/lib/kubelet/pods/88661321-40c5-4412-8fee-fd770c0ca6b5/volumes" Jun 02 01:31:30.834668 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:30.834629 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wxx8z" event={"ID":"0048967e-6f59-4e5c-b498-ba4808ad41f2","Type":"ContainerStarted","Data":"1caec28e5b5ea54c49efee2e62ba20037b62f133f4fc29031ac2e1f465fa070a"} Jun 02 01:31:30.834668 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:30.834684 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wxx8z" Jun 02 01:31:30.835221 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:30.834702 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wxx8z" event={"ID":"0048967e-6f59-4e5c-b498-ba4808ad41f2","Type":"ContainerStarted","Data":"efd99d17b32e2c7a82c820c8493bd17304a53c06c862c38c18ac37f085033c8d"} Jun 02 01:31:30.862662 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:30.862601 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wxx8z" podStartSLOduration=1.8625827080000001 podStartE2EDuration="1.862582708s" podCreationTimestamp="2026-06-02 01:31:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:31:30.861745988 +0000 UTC m=+539.191380919" watchObservedRunningTime="2026-06-02 01:31:30.862582708 +0000 UTC m=+539.192217628" Jun 02 01:31:41.841344 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:41.841312 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wxx8z" Jun 02 01:31:44.972191 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:44.972154 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wxx8z"] Jun 02 01:31:44.972593 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:44.972411 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wxx8z" podUID="0048967e-6f59-4e5c-b498-ba4808ad41f2" containerName="manager" containerID="cri-o://1caec28e5b5ea54c49efee2e62ba20037b62f133f4fc29031ac2e1f465fa070a" gracePeriod=10 Jun 02 01:31:45.189549 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:45.189515 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-grn2v"] Jun 02 01:31:45.192782 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:45.192762 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-grn2v" Jun 02 01:31:45.210307 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:45.208881 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-grn2v"] Jun 02 01:31:45.242692 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:45.242672 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wxx8z" Jun 02 01:31:45.288053 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:45.288022 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qkh66\" (UniqueName: \"kubernetes.io/projected/0048967e-6f59-4e5c-b498-ba4808ad41f2-kube-api-access-qkh66\") pod \"0048967e-6f59-4e5c-b498-ba4808ad41f2\" (UID: \"0048967e-6f59-4e5c-b498-ba4808ad41f2\") " Jun 02 01:31:45.288206 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:45.288134 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0048967e-6f59-4e5c-b498-ba4808ad41f2-extensions-socket-volume\") pod \"0048967e-6f59-4e5c-b498-ba4808ad41f2\" (UID: \"0048967e-6f59-4e5c-b498-ba4808ad41f2\") " Jun 02 01:31:45.288286 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:45.288266 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px4rh\" (UniqueName: \"kubernetes.io/projected/90bc02bb-d989-4866-bc6c-ba96e864475f-kube-api-access-px4rh\") pod \"kuadrant-operator-controller-manager-55c7f4c975-grn2v\" (UID: \"90bc02bb-d989-4866-bc6c-ba96e864475f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-grn2v" Jun 02 01:31:45.288382 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:45.288341 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/90bc02bb-d989-4866-bc6c-ba96e864475f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-grn2v\" (UID: \"90bc02bb-d989-4866-bc6c-ba96e864475f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-grn2v" Jun 02 01:31:45.288518 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:45.288500 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0048967e-6f59-4e5c-b498-ba4808ad41f2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0048967e-6f59-4e5c-b498-ba4808ad41f2" (UID: "0048967e-6f59-4e5c-b498-ba4808ad41f2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:31:45.290125 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:45.290101 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0048967e-6f59-4e5c-b498-ba4808ad41f2-kube-api-access-qkh66" (OuterVolumeSpecName: "kube-api-access-qkh66") pod "0048967e-6f59-4e5c-b498-ba4808ad41f2" (UID: "0048967e-6f59-4e5c-b498-ba4808ad41f2"). InnerVolumeSpecName "kube-api-access-qkh66". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:31:45.389616 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:45.389578 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-px4rh\" (UniqueName: \"kubernetes.io/projected/90bc02bb-d989-4866-bc6c-ba96e864475f-kube-api-access-px4rh\") pod \"kuadrant-operator-controller-manager-55c7f4c975-grn2v\" (UID: \"90bc02bb-d989-4866-bc6c-ba96e864475f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-grn2v" Jun 02 01:31:45.389801 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:45.389624 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/90bc02bb-d989-4866-bc6c-ba96e864475f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-grn2v\" (UID: \"90bc02bb-d989-4866-bc6c-ba96e864475f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-grn2v" Jun 02 01:31:45.389801 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:45.389717 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0048967e-6f59-4e5c-b498-ba4808ad41f2-extensions-socket-volume\") on node \"ip-10-0-130-179.ec2.internal\" DevicePath \"\"" Jun 02 01:31:45.389801 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:45.389731 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qkh66\" (UniqueName: \"kubernetes.io/projected/0048967e-6f59-4e5c-b498-ba4808ad41f2-kube-api-access-qkh66\") on node \"ip-10-0-130-179.ec2.internal\" DevicePath \"\"" Jun 02 01:31:45.390064 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:45.390043 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/90bc02bb-d989-4866-bc6c-ba96e864475f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-grn2v\" (UID: \"90bc02bb-d989-4866-bc6c-ba96e864475f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-grn2v" Jun 02 01:31:45.400256 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:45.400234 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-px4rh\" (UniqueName: \"kubernetes.io/projected/90bc02bb-d989-4866-bc6c-ba96e864475f-kube-api-access-px4rh\") pod \"kuadrant-operator-controller-manager-55c7f4c975-grn2v\" (UID: \"90bc02bb-d989-4866-bc6c-ba96e864475f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-grn2v" Jun 02 01:31:45.511724 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:45.511636 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-grn2v" Jun 02 01:31:45.640769 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:45.640738 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-grn2v"] Jun 02 01:31:45.645455 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:31:45.645415 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90bc02bb_d989_4866_bc6c_ba96e864475f.slice/crio-374e328a8723407c89a2ef45c39f733806d9840274f5959856c526648229882c WatchSource:0}: Error finding container 374e328a8723407c89a2ef45c39f733806d9840274f5959856c526648229882c: Status 404 returned error can't find the container with id 374e328a8723407c89a2ef45c39f733806d9840274f5959856c526648229882c Jun 02 01:31:45.886369 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:45.886334 2559 generic.go:358] "Generic (PLEG): container finished" podID="0048967e-6f59-4e5c-b498-ba4808ad41f2" containerID="1caec28e5b5ea54c49efee2e62ba20037b62f133f4fc29031ac2e1f465fa070a" exitCode=0 Jun 02 01:31:45.886554 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:45.886404 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wxx8z" Jun 02 01:31:45.886554 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:45.886426 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wxx8z" event={"ID":"0048967e-6f59-4e5c-b498-ba4808ad41f2","Type":"ContainerDied","Data":"1caec28e5b5ea54c49efee2e62ba20037b62f133f4fc29031ac2e1f465fa070a"} Jun 02 01:31:45.886554 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:45.886466 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wxx8z" event={"ID":"0048967e-6f59-4e5c-b498-ba4808ad41f2","Type":"ContainerDied","Data":"efd99d17b32e2c7a82c820c8493bd17304a53c06c862c38c18ac37f085033c8d"} Jun 02 01:31:45.886554 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:45.886486 2559 scope.go:117] "RemoveContainer" containerID="1caec28e5b5ea54c49efee2e62ba20037b62f133f4fc29031ac2e1f465fa070a" Jun 02 01:31:45.887787 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:45.887762 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-grn2v" event={"ID":"90bc02bb-d989-4866-bc6c-ba96e864475f","Type":"ContainerStarted","Data":"d4ee0295c1f591d8c2700301414b5269bd05bfe4369d7b44737a8e8830503ff7"} Jun 02 01:31:45.888082 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:45.887797 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-grn2v" event={"ID":"90bc02bb-d989-4866-bc6c-ba96e864475f","Type":"ContainerStarted","Data":"374e328a8723407c89a2ef45c39f733806d9840274f5959856c526648229882c"} Jun 02 01:31:45.888082 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:45.887964 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-grn2v" Jun 02 01:31:45.894569 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:45.894553 2559 scope.go:117] "RemoveContainer" containerID="1caec28e5b5ea54c49efee2e62ba20037b62f133f4fc29031ac2e1f465fa070a" Jun 02 01:31:45.894822 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:31:45.894803 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1caec28e5b5ea54c49efee2e62ba20037b62f133f4fc29031ac2e1f465fa070a\": container with ID starting with 1caec28e5b5ea54c49efee2e62ba20037b62f133f4fc29031ac2e1f465fa070a not found: ID does not exist" containerID="1caec28e5b5ea54c49efee2e62ba20037b62f133f4fc29031ac2e1f465fa070a" Jun 02 01:31:45.894909 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:45.894828 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1caec28e5b5ea54c49efee2e62ba20037b62f133f4fc29031ac2e1f465fa070a"} err="failed to get container status \"1caec28e5b5ea54c49efee2e62ba20037b62f133f4fc29031ac2e1f465fa070a\": rpc error: code = NotFound desc = could not find container \"1caec28e5b5ea54c49efee2e62ba20037b62f133f4fc29031ac2e1f465fa070a\": container with ID starting with 1caec28e5b5ea54c49efee2e62ba20037b62f133f4fc29031ac2e1f465fa070a not found: ID does not exist" Jun 02 01:31:45.914144 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:45.914102 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-grn2v" podStartSLOduration=0.914090974 podStartE2EDuration="914.090974ms" podCreationTimestamp="2026-06-02 01:31:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:31:45.91251434 +0000 UTC m=+554.242149259" watchObservedRunningTime="2026-06-02 01:31:45.914090974 +0000 UTC m=+554.243725894" Jun 02 01:31:45.930541 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:45.930512 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wxx8z"] Jun 02 01:31:45.936259 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:45.936234 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wxx8z"] Jun 02 01:31:46.232971 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:46.232900 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0048967e-6f59-4e5c-b498-ba4808ad41f2" path="/var/lib/kubelet/pods/0048967e-6f59-4e5c-b498-ba4808ad41f2/volumes" Jun 02 01:31:56.894083 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:31:56.894048 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-grn2v" Jun 02 01:32:18.096964 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:18.096925 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-cx2nt"] Jun 02 01:32:18.097436 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:18.097214 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0048967e-6f59-4e5c-b498-ba4808ad41f2" containerName="manager" Jun 02 01:32:18.097436 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:18.097225 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0048967e-6f59-4e5c-b498-ba4808ad41f2" containerName="manager" Jun 02 01:32:18.097436 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:18.097285 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="0048967e-6f59-4e5c-b498-ba4808ad41f2" containerName="manager" Jun 02 01:32:18.100225 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:18.100208 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-cx2nt" Jun 02 01:32:18.102547 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:18.102512 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 02 01:32:18.102660 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:18.102587 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gvlrz\"" Jun 02 01:32:18.107179 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:18.107150 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-cx2nt"] Jun 02 01:32:18.194742 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:18.194705 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-cx2nt"] Jun 02 01:32:18.266353 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:18.266314 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4148df4c-8747-4bfb-8cf6-6f8475bb8262-config-file\") pod \"limitador-limitador-7d549b5b-cx2nt\" (UID: \"4148df4c-8747-4bfb-8cf6-6f8475bb8262\") " pod="kuadrant-system/limitador-limitador-7d549b5b-cx2nt" Jun 02 01:32:18.266539 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:18.266364 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzptj\" (UniqueName: \"kubernetes.io/projected/4148df4c-8747-4bfb-8cf6-6f8475bb8262-kube-api-access-zzptj\") pod \"limitador-limitador-7d549b5b-cx2nt\" (UID: \"4148df4c-8747-4bfb-8cf6-6f8475bb8262\") " pod="kuadrant-system/limitador-limitador-7d549b5b-cx2nt" Jun 02 01:32:18.367766 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:18.367663 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4148df4c-8747-4bfb-8cf6-6f8475bb8262-config-file\") pod \"limitador-limitador-7d549b5b-cx2nt\" (UID: \"4148df4c-8747-4bfb-8cf6-6f8475bb8262\") " pod="kuadrant-system/limitador-limitador-7d549b5b-cx2nt" Jun 02 01:32:18.367766 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:18.367718 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zzptj\" (UniqueName: \"kubernetes.io/projected/4148df4c-8747-4bfb-8cf6-6f8475bb8262-kube-api-access-zzptj\") pod \"limitador-limitador-7d549b5b-cx2nt\" (UID: \"4148df4c-8747-4bfb-8cf6-6f8475bb8262\") " pod="kuadrant-system/limitador-limitador-7d549b5b-cx2nt" Jun 02 01:32:18.368414 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:18.368393 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4148df4c-8747-4bfb-8cf6-6f8475bb8262-config-file\") pod \"limitador-limitador-7d549b5b-cx2nt\" (UID: \"4148df4c-8747-4bfb-8cf6-6f8475bb8262\") " pod="kuadrant-system/limitador-limitador-7d549b5b-cx2nt" Jun 02 01:32:18.376508 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:18.376482 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzptj\" (UniqueName: \"kubernetes.io/projected/4148df4c-8747-4bfb-8cf6-6f8475bb8262-kube-api-access-zzptj\") pod \"limitador-limitador-7d549b5b-cx2nt\" (UID: \"4148df4c-8747-4bfb-8cf6-6f8475bb8262\") " pod="kuadrant-system/limitador-limitador-7d549b5b-cx2nt" Jun 02 01:32:18.413052 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:18.413009 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-cx2nt" Jun 02 01:32:18.552450 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:18.552410 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-cx2nt"] Jun 02 01:32:18.555534 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:32:18.555508 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4148df4c_8747_4bfb_8cf6_6f8475bb8262.slice/crio-80555af8b1aa8dee71efae87f50e8cc91cd6ef1733a76bb845f35b024ced3e43 WatchSource:0}: Error finding container 80555af8b1aa8dee71efae87f50e8cc91cd6ef1733a76bb845f35b024ced3e43: Status 404 returned error can't find the container with id 80555af8b1aa8dee71efae87f50e8cc91cd6ef1733a76bb845f35b024ced3e43 Jun 02 01:32:18.998391 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:18.998352 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-cx2nt" event={"ID":"4148df4c-8747-4bfb-8cf6-6f8475bb8262","Type":"ContainerStarted","Data":"80555af8b1aa8dee71efae87f50e8cc91cd6ef1733a76bb845f35b024ced3e43"} Jun 02 01:32:22.009153 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:22.009116 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-cx2nt" event={"ID":"4148df4c-8747-4bfb-8cf6-6f8475bb8262","Type":"ContainerStarted","Data":"71ae3281b84827549e67a904860bfe887c45dc543502dbc3c2d9296e41b8721c"} Jun 02 01:32:22.009519 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:22.009183 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-cx2nt" Jun 02 01:32:22.028200 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:22.028146 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-cx2nt" podStartSLOduration=1.246341909 podStartE2EDuration="4.028131132s" podCreationTimestamp="2026-06-02 01:32:18 +0000 UTC" firstStartedPulling="2026-06-02 01:32:18.557518203 +0000 UTC m=+586.887153101" lastFinishedPulling="2026-06-02 01:32:21.339307427 +0000 UTC m=+589.668942324" observedRunningTime="2026-06-02 01:32:22.026293028 +0000 UTC m=+590.355927953" watchObservedRunningTime="2026-06-02 01:32:22.028131132 +0000 UTC m=+590.357766051" Jun 02 01:32:33.013576 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:33.013536 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-cx2nt" Jun 02 01:32:35.234609 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:35.234564 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-cx2nt"] Jun 02 01:32:35.235059 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:35.234812 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-cx2nt" podUID="4148df4c-8747-4bfb-8cf6-6f8475bb8262" containerName="limitador" containerID="cri-o://71ae3281b84827549e67a904860bfe887c45dc543502dbc3c2d9296e41b8721c" gracePeriod=30 Jun 02 01:32:35.777511 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:35.777486 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-cx2nt" Jun 02 01:32:35.793517 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:35.793481 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zzptj\" (UniqueName: \"kubernetes.io/projected/4148df4c-8747-4bfb-8cf6-6f8475bb8262-kube-api-access-zzptj\") pod \"4148df4c-8747-4bfb-8cf6-6f8475bb8262\" (UID: \"4148df4c-8747-4bfb-8cf6-6f8475bb8262\") " Jun 02 01:32:35.793517 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:35.793525 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4148df4c-8747-4bfb-8cf6-6f8475bb8262-config-file\") pod \"4148df4c-8747-4bfb-8cf6-6f8475bb8262\" (UID: \"4148df4c-8747-4bfb-8cf6-6f8475bb8262\") " Jun 02 01:32:35.794516 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:35.794441 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4148df4c-8747-4bfb-8cf6-6f8475bb8262-config-file" (OuterVolumeSpecName: "config-file") pod "4148df4c-8747-4bfb-8cf6-6f8475bb8262" (UID: "4148df4c-8747-4bfb-8cf6-6f8475bb8262"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:32:35.796030 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:35.795997 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4148df4c-8747-4bfb-8cf6-6f8475bb8262-kube-api-access-zzptj" (OuterVolumeSpecName: "kube-api-access-zzptj") pod "4148df4c-8747-4bfb-8cf6-6f8475bb8262" (UID: "4148df4c-8747-4bfb-8cf6-6f8475bb8262"). InnerVolumeSpecName "kube-api-access-zzptj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:32:35.894524 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:35.894482 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zzptj\" (UniqueName: \"kubernetes.io/projected/4148df4c-8747-4bfb-8cf6-6f8475bb8262-kube-api-access-zzptj\") on node \"ip-10-0-130-179.ec2.internal\" DevicePath \"\"" Jun 02 01:32:35.894524 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:35.894517 2559 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4148df4c-8747-4bfb-8cf6-6f8475bb8262-config-file\") on node \"ip-10-0-130-179.ec2.internal\" DevicePath \"\"" Jun 02 01:32:36.056999 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:36.056900 2559 generic.go:358] "Generic (PLEG): container finished" podID="4148df4c-8747-4bfb-8cf6-6f8475bb8262" containerID="71ae3281b84827549e67a904860bfe887c45dc543502dbc3c2d9296e41b8721c" exitCode=0 Jun 02 01:32:36.056999 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:36.056979 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-cx2nt" Jun 02 01:32:36.057213 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:36.056992 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-cx2nt" event={"ID":"4148df4c-8747-4bfb-8cf6-6f8475bb8262","Type":"ContainerDied","Data":"71ae3281b84827549e67a904860bfe887c45dc543502dbc3c2d9296e41b8721c"} Jun 02 01:32:36.057213 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:36.057032 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-cx2nt" event={"ID":"4148df4c-8747-4bfb-8cf6-6f8475bb8262","Type":"ContainerDied","Data":"80555af8b1aa8dee71efae87f50e8cc91cd6ef1733a76bb845f35b024ced3e43"} Jun 02 01:32:36.057213 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:36.057048 2559 scope.go:117] "RemoveContainer" containerID="71ae3281b84827549e67a904860bfe887c45dc543502dbc3c2d9296e41b8721c" Jun 02 01:32:36.065256 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:36.065235 2559 scope.go:117] "RemoveContainer" containerID="71ae3281b84827549e67a904860bfe887c45dc543502dbc3c2d9296e41b8721c" Jun 02 01:32:36.065529 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:32:36.065509 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71ae3281b84827549e67a904860bfe887c45dc543502dbc3c2d9296e41b8721c\": container with ID starting with 71ae3281b84827549e67a904860bfe887c45dc543502dbc3c2d9296e41b8721c not found: ID does not exist" containerID="71ae3281b84827549e67a904860bfe887c45dc543502dbc3c2d9296e41b8721c" Jun 02 01:32:36.065581 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:36.065537 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71ae3281b84827549e67a904860bfe887c45dc543502dbc3c2d9296e41b8721c"} err="failed to get container status \"71ae3281b84827549e67a904860bfe887c45dc543502dbc3c2d9296e41b8721c\": rpc error: code = NotFound desc = could not find container \"71ae3281b84827549e67a904860bfe887c45dc543502dbc3c2d9296e41b8721c\": container with ID starting with 71ae3281b84827549e67a904860bfe887c45dc543502dbc3c2d9296e41b8721c not found: ID does not exist" Jun 02 01:32:36.076917 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:36.076886 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-cx2nt"] Jun 02 01:32:36.078691 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:36.078666 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-cx2nt"] Jun 02 01:32:36.232673 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:36.232630 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4148df4c-8747-4bfb-8cf6-6f8475bb8262" path="/var/lib/kubelet/pods/4148df4c-8747-4bfb-8cf6-6f8475bb8262/volumes" Jun 02 01:32:37.165025 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:37.164993 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-k7drq"] Jun 02 01:32:37.165488 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:37.165281 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4148df4c-8747-4bfb-8cf6-6f8475bb8262" containerName="limitador" Jun 02 01:32:37.165488 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:37.165292 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4148df4c-8747-4bfb-8cf6-6f8475bb8262" containerName="limitador" Jun 02 01:32:37.165488 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:37.165347 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="4148df4c-8747-4bfb-8cf6-6f8475bb8262" containerName="limitador" Jun 02 01:32:37.169295 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:37.169274 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-k7drq" Jun 02 01:32:37.171486 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:37.171458 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 02 01:32:37.174373 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:37.174347 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-k7drq"] Jun 02 01:32:37.205612 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:37.205573 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r55wt\" (UniqueName: \"kubernetes.io/projected/4f331ce7-d0eb-4548-bae6-b81bc9a27bea-kube-api-access-r55wt\") pod \"postgres-68c4fbbd6f-k7drq\" (UID: \"4f331ce7-d0eb-4548-bae6-b81bc9a27bea\") " pod="opendatahub/postgres-68c4fbbd6f-k7drq" Jun 02 01:32:37.205612 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:37.205614 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4f331ce7-d0eb-4548-bae6-b81bc9a27bea-data\") pod \"postgres-68c4fbbd6f-k7drq\" (UID: \"4f331ce7-d0eb-4548-bae6-b81bc9a27bea\") " pod="opendatahub/postgres-68c4fbbd6f-k7drq" Jun 02 01:32:37.306670 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:37.306627 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r55wt\" (UniqueName: \"kubernetes.io/projected/4f331ce7-d0eb-4548-bae6-b81bc9a27bea-kube-api-access-r55wt\") pod \"postgres-68c4fbbd6f-k7drq\" (UID: \"4f331ce7-d0eb-4548-bae6-b81bc9a27bea\") " pod="opendatahub/postgres-68c4fbbd6f-k7drq" Jun 02 01:32:37.306881 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:37.306678 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4f331ce7-d0eb-4548-bae6-b81bc9a27bea-data\") pod \"postgres-68c4fbbd6f-k7drq\" (UID: \"4f331ce7-d0eb-4548-bae6-b81bc9a27bea\") " pod="opendatahub/postgres-68c4fbbd6f-k7drq" Jun 02 01:32:37.307109 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:37.307085 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4f331ce7-d0eb-4548-bae6-b81bc9a27bea-data\") pod \"postgres-68c4fbbd6f-k7drq\" (UID: \"4f331ce7-d0eb-4548-bae6-b81bc9a27bea\") " pod="opendatahub/postgres-68c4fbbd6f-k7drq" Jun 02 01:32:37.315010 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:37.314985 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r55wt\" (UniqueName: \"kubernetes.io/projected/4f331ce7-d0eb-4548-bae6-b81bc9a27bea-kube-api-access-r55wt\") pod \"postgres-68c4fbbd6f-k7drq\" (UID: \"4f331ce7-d0eb-4548-bae6-b81bc9a27bea\") " pod="opendatahub/postgres-68c4fbbd6f-k7drq" Jun 02 01:32:37.483983 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:37.483883 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-k7drq" Jun 02 01:32:37.613100 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:37.613069 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-k7drq"] Jun 02 01:32:37.616271 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:32:37.616244 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f331ce7_d0eb_4548_bae6_b81bc9a27bea.slice/crio-259ddbc9332dc3b08eb364f02b08dd67502c2f3a994d0c6efd7e9b4d08f7fdc1 WatchSource:0}: Error finding container 259ddbc9332dc3b08eb364f02b08dd67502c2f3a994d0c6efd7e9b4d08f7fdc1: Status 404 returned error can't find the container with id 259ddbc9332dc3b08eb364f02b08dd67502c2f3a994d0c6efd7e9b4d08f7fdc1 Jun 02 01:32:38.065696 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:38.065659 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-k7drq" event={"ID":"4f331ce7-d0eb-4548-bae6-b81bc9a27bea","Type":"ContainerStarted","Data":"259ddbc9332dc3b08eb364f02b08dd67502c2f3a994d0c6efd7e9b4d08f7fdc1"} Jun 02 01:32:41.077216 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:41.077174 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-k7drq" event={"ID":"4f331ce7-d0eb-4548-bae6-b81bc9a27bea","Type":"ContainerStarted","Data":"e4ac8a0ec99831ce3b2b20a78eb1a06c5518c749aa8e17752162c4f80a72ff5f"} Jun 02 01:32:41.077594 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:41.077315 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-k7drq" Jun 02 01:32:41.094376 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:41.094321 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-k7drq" podStartSLOduration=1.245203142 podStartE2EDuration="4.094304587s" podCreationTimestamp="2026-06-02 01:32:37 +0000 UTC" firstStartedPulling="2026-06-02 01:32:37.617502107 +0000 UTC m=+605.947137003" lastFinishedPulling="2026-06-02 01:32:40.466603537 +0000 UTC m=+608.796238448" observedRunningTime="2026-06-02 01:32:41.091723477 +0000 UTC m=+609.421358395" watchObservedRunningTime="2026-06-02 01:32:41.094304587 +0000 UTC m=+609.423939505" Jun 02 01:32:47.114204 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:32:47.114173 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-k7drq" Jun 02 01:33:11.963265 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:33:11.963226 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 01:33:11.966331 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:33:11.966315 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 02 01:33:11.968574 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:33:11.968551 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 02 01:33:11.969293 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:33:11.969279 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 02 01:33:11.969293 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:33:11.969287 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-m9ptp\"" Jun 02 01:33:11.969401 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:33:11.969290 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 02 01:33:11.974119 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:33:11.974095 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 01:33:12.103194 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:33:12.103154 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q47pn\" (UniqueName: \"kubernetes.io/projected/bc989a47-094a-4a65-85ea-0a5744c853a9-kube-api-access-q47pn\") pod \"maas-keycloak-0\" (UID: \"bc989a47-094a-4a65-85ea-0a5744c853a9\") " pod="keycloak-system/maas-keycloak-0" Jun 02 01:33:12.203993 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:33:12.203954 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q47pn\" (UniqueName: \"kubernetes.io/projected/bc989a47-094a-4a65-85ea-0a5744c853a9-kube-api-access-q47pn\") pod \"maas-keycloak-0\" (UID: \"bc989a47-094a-4a65-85ea-0a5744c853a9\") " pod="keycloak-system/maas-keycloak-0" Jun 02 01:33:12.212797 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:33:12.212765 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q47pn\" (UniqueName: \"kubernetes.io/projected/bc989a47-094a-4a65-85ea-0a5744c853a9-kube-api-access-q47pn\") pod \"maas-keycloak-0\" (UID: \"bc989a47-094a-4a65-85ea-0a5744c853a9\") " pod="keycloak-system/maas-keycloak-0" Jun 02 01:33:12.276480 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:33:12.276388 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 02 01:33:12.407470 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:33:12.407408 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 01:33:12.409765 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:33:12.409734 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc989a47_094a_4a65_85ea_0a5744c853a9.slice/crio-1ee867ed4ec8aa94153c0567cdfb4b1b98ac7779f210214963404601ae47e90b WatchSource:0}: Error finding container 1ee867ed4ec8aa94153c0567cdfb4b1b98ac7779f210214963404601ae47e90b: Status 404 returned error can't find the container with id 1ee867ed4ec8aa94153c0567cdfb4b1b98ac7779f210214963404601ae47e90b Jun 02 01:33:13.183940 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:33:13.183905 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"bc989a47-094a-4a65-85ea-0a5744c853a9","Type":"ContainerStarted","Data":"1ee867ed4ec8aa94153c0567cdfb4b1b98ac7779f210214963404601ae47e90b"} Jun 02 01:33:17.204944 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:33:17.204809 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"bc989a47-094a-4a65-85ea-0a5744c853a9","Type":"ContainerStarted","Data":"e789c49a59a3289412b2e6df7546b8b72d03a788da9a0b1e49f4e3f43855d6f8"} Jun 02 01:33:17.221462 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:33:17.221401 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.712433742 podStartE2EDuration="6.221380258s" podCreationTimestamp="2026-06-02 01:33:11 +0000 UTC" firstStartedPulling="2026-06-02 01:33:12.411163249 +0000 UTC m=+640.740798149" lastFinishedPulling="2026-06-02 01:33:16.920109768 +0000 UTC m=+645.249744665" observedRunningTime="2026-06-02 01:33:17.220713585 +0000 UTC m=+645.550348505" watchObservedRunningTime="2026-06-02 01:33:17.221380258 +0000 UTC m=+645.551015178" Jun 02 01:33:17.277023 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:33:17.276969 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 02 01:33:17.278493 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:33:17.278462 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bc989a47-094a-4a65-85ea-0a5744c853a9" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" Jun 02 01:33:18.277236 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:33:18.277188 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bc989a47-094a-4a65-85ea-0a5744c853a9" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" Jun 02 01:33:19.276939 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:33:19.276875 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bc989a47-094a-4a65-85ea-0a5744c853a9" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" Jun 02 01:33:20.277021 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:33:20.276973 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bc989a47-094a-4a65-85ea-0a5744c853a9" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" Jun 02 01:33:21.277762 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:33:21.277696 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bc989a47-094a-4a65-85ea-0a5744c853a9" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" Jun 02 01:33:22.277265 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:33:22.277232 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 02 01:33:22.278187 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:33:22.278143 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bc989a47-094a-4a65-85ea-0a5744c853a9" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" Jun 02 01:33:23.277377 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:33:23.277320 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bc989a47-094a-4a65-85ea-0a5744c853a9" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" Jun 02 01:33:24.277161 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:33:24.277100 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bc989a47-094a-4a65-85ea-0a5744c853a9" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" Jun 02 01:33:25.277065 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:33:25.277007 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bc989a47-094a-4a65-85ea-0a5744c853a9" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" Jun 02 01:33:26.277421 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:33:26.277369 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bc989a47-094a-4a65-85ea-0a5744c853a9" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" Jun 02 01:33:27.277654 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:33:27.277606 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bc989a47-094a-4a65-85ea-0a5744c853a9" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" Jun 02 01:33:28.277443 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:33:28.277383 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bc989a47-094a-4a65-85ea-0a5744c853a9" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" Jun 02 01:33:29.277132 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:33:29.277088 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bc989a47-094a-4a65-85ea-0a5744c853a9" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.28:9000/health/started\": dial tcp 10.132.0.28:9000: connect: connection refused" Jun 02 01:33:30.389131 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:33:30.389091 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 02 01:33:30.411635 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:33:30.411284 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="bc989a47-094a-4a65-85ea-0a5744c853a9" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 01:33:40.395430 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:33:40.395394 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 02 01:34:21.290322 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:21.290285 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-fpfsx"] Jun 02 01:34:21.293533 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:21.293513 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-fpfsx" Jun 02 01:34:21.295716 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:21.295696 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-snrqb\"" Jun 02 01:34:21.295809 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:21.295722 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 02 01:34:21.301716 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:21.301676 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-fpfsx"] Jun 02 01:34:21.309672 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:21.309637 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2t7hf\" (UniqueName: \"kubernetes.io/projected/3d99c551-42e0-4735-9845-2e6f813e6a43-kube-api-access-2t7hf\") pod \"payload-processing-58b6c8fdc7-fpfsx\" (UID: \"3d99c551-42e0-4735-9845-2e6f813e6a43\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-fpfsx" Jun 02 01:34:21.410783 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:21.410752 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2t7hf\" (UniqueName: \"kubernetes.io/projected/3d99c551-42e0-4735-9845-2e6f813e6a43-kube-api-access-2t7hf\") pod \"payload-processing-58b6c8fdc7-fpfsx\" (UID: \"3d99c551-42e0-4735-9845-2e6f813e6a43\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-fpfsx" Jun 02 01:34:21.418752 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:21.418728 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2t7hf\" (UniqueName: \"kubernetes.io/projected/3d99c551-42e0-4735-9845-2e6f813e6a43-kube-api-access-2t7hf\") pod \"payload-processing-58b6c8fdc7-fpfsx\" (UID: \"3d99c551-42e0-4735-9845-2e6f813e6a43\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-fpfsx" Jun 02 01:34:21.604850 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:21.604751 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-fpfsx" Jun 02 01:34:21.757542 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:21.757497 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-fpfsx"] Jun 02 01:34:21.760665 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:34:21.760636 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d99c551_42e0_4735_9845_2e6f813e6a43.slice/crio-214da2f49e64e632c6b8310855d7dc10796e30cdf0e733d84fb5bea800633e7b WatchSource:0}: Error finding container 214da2f49e64e632c6b8310855d7dc10796e30cdf0e733d84fb5bea800633e7b: Status 404 returned error can't find the container with id 214da2f49e64e632c6b8310855d7dc10796e30cdf0e733d84fb5bea800633e7b Jun 02 01:34:21.762884 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:21.762865 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 01:34:22.448488 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:22.448447 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-fpfsx" event={"ID":"3d99c551-42e0-4735-9845-2e6f813e6a43","Type":"ContainerStarted","Data":"214da2f49e64e632c6b8310855d7dc10796e30cdf0e733d84fb5bea800633e7b"} Jun 02 01:34:24.456947 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:24.456910 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-fpfsx" event={"ID":"3d99c551-42e0-4735-9845-2e6f813e6a43","Type":"ContainerStarted","Data":"fff73b3463b5ad2945a3508870cc2bfd4de617322e87e45c77f7d69ded3ca2ae"} Jun 02 01:34:24.457348 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:24.457032 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-fpfsx" Jun 02 01:34:24.472663 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:24.472610 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-fpfsx" podStartSLOduration=1.228702816 podStartE2EDuration="3.472594075s" podCreationTimestamp="2026-06-02 01:34:21 +0000 UTC" firstStartedPulling="2026-06-02 01:34:21.763011365 +0000 UTC m=+710.092646262" lastFinishedPulling="2026-06-02 01:34:24.00690262 +0000 UTC m=+712.336537521" observedRunningTime="2026-06-02 01:34:24.471649371 +0000 UTC m=+712.801284289" watchObservedRunningTime="2026-06-02 01:34:24.472594075 +0000 UTC m=+712.802228996" Jun 02 01:34:32.447760 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:32.447714 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 01:34:32.448274 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:32.447957 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="bc989a47-094a-4a65-85ea-0a5744c853a9" containerName="keycloak" containerID="cri-o://e789c49a59a3289412b2e6df7546b8b72d03a788da9a0b1e49f4e3f43855d6f8" gracePeriod=30 Jun 02 01:34:33.896911 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:34:33.896878 2559 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc989a47_094a_4a65_85ea_0a5744c853a9.slice/crio-conmon-e789c49a59a3289412b2e6df7546b8b72d03a788da9a0b1e49f4e3f43855d6f8.scope\": RecentStats: unable to find data in memory cache]" Jun 02 01:34:34.492539 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:34.492512 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 02 01:34:34.493102 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:34.493074 2559 generic.go:358] "Generic (PLEG): container finished" podID="bc989a47-094a-4a65-85ea-0a5744c853a9" containerID="e789c49a59a3289412b2e6df7546b8b72d03a788da9a0b1e49f4e3f43855d6f8" exitCode=143 Jun 02 01:34:34.493193 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:34.493142 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"bc989a47-094a-4a65-85ea-0a5744c853a9","Type":"ContainerDied","Data":"e789c49a59a3289412b2e6df7546b8b72d03a788da9a0b1e49f4e3f43855d6f8"} Jun 02 01:34:34.493193 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:34.493173 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"bc989a47-094a-4a65-85ea-0a5744c853a9","Type":"ContainerDied","Data":"1ee867ed4ec8aa94153c0567cdfb4b1b98ac7779f210214963404601ae47e90b"} Jun 02 01:34:34.493193 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:34.493190 2559 scope.go:117] "RemoveContainer" containerID="e789c49a59a3289412b2e6df7546b8b72d03a788da9a0b1e49f4e3f43855d6f8" Jun 02 01:34:34.503417 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:34.503380 2559 scope.go:117] "RemoveContainer" containerID="e789c49a59a3289412b2e6df7546b8b72d03a788da9a0b1e49f4e3f43855d6f8" Jun 02 01:34:34.503773 ip-10-0-130-179 kubenswrapper[2559]: E0602 01:34:34.503755 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e789c49a59a3289412b2e6df7546b8b72d03a788da9a0b1e49f4e3f43855d6f8\": container with ID starting with e789c49a59a3289412b2e6df7546b8b72d03a788da9a0b1e49f4e3f43855d6f8 not found: ID does not exist" containerID="e789c49a59a3289412b2e6df7546b8b72d03a788da9a0b1e49f4e3f43855d6f8" Jun 02 01:34:34.503823 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:34.503785 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e789c49a59a3289412b2e6df7546b8b72d03a788da9a0b1e49f4e3f43855d6f8"} err="failed to get container status \"e789c49a59a3289412b2e6df7546b8b72d03a788da9a0b1e49f4e3f43855d6f8\": rpc error: code = NotFound desc = could not find container \"e789c49a59a3289412b2e6df7546b8b72d03a788da9a0b1e49f4e3f43855d6f8\": container with ID starting with e789c49a59a3289412b2e6df7546b8b72d03a788da9a0b1e49f4e3f43855d6f8 not found: ID does not exist" Jun 02 01:34:34.623172 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:34.623080 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q47pn\" (UniqueName: \"kubernetes.io/projected/bc989a47-094a-4a65-85ea-0a5744c853a9-kube-api-access-q47pn\") pod \"bc989a47-094a-4a65-85ea-0a5744c853a9\" (UID: \"bc989a47-094a-4a65-85ea-0a5744c853a9\") " Jun 02 01:34:34.625922 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:34.625877 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc989a47-094a-4a65-85ea-0a5744c853a9-kube-api-access-q47pn" (OuterVolumeSpecName: "kube-api-access-q47pn") pod "bc989a47-094a-4a65-85ea-0a5744c853a9" (UID: "bc989a47-094a-4a65-85ea-0a5744c853a9"). InnerVolumeSpecName "kube-api-access-q47pn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:34:34.724524 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:34.724489 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q47pn\" (UniqueName: \"kubernetes.io/projected/bc989a47-094a-4a65-85ea-0a5744c853a9-kube-api-access-q47pn\") on node \"ip-10-0-130-179.ec2.internal\" DevicePath \"\"" Jun 02 01:34:35.463509 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:35.463481 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-fpfsx" Jun 02 01:34:35.497933 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:35.497905 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 02 01:34:35.517579 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:35.517547 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 01:34:35.521854 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:35.521810 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 01:34:35.543773 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:35.543742 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 01:34:35.544093 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:35.544080 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc989a47-094a-4a65-85ea-0a5744c853a9" containerName="keycloak" Jun 02 01:34:35.544137 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:35.544095 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc989a47-094a-4a65-85ea-0a5744c853a9" containerName="keycloak" Jun 02 01:34:35.544174 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:35.544144 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="bc989a47-094a-4a65-85ea-0a5744c853a9" containerName="keycloak" Jun 02 01:34:35.548228 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:35.548210 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 02 01:34:35.550614 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:35.550583 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 02 01:34:35.550614 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:35.550585 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 02 01:34:35.550777 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:35.550594 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-m9ptp\"" Jun 02 01:34:35.550917 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:35.550901 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 02 01:34:35.550972 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:35.550901 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 02 01:34:35.555783 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:35.555285 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 01:34:35.631905 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:35.631865 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/eaeea40a-557d-4145-bd6b-4602c915d505-test-realms\") pod \"maas-keycloak-0\" (UID: \"eaeea40a-557d-4145-bd6b-4602c915d505\") " pod="keycloak-system/maas-keycloak-0" Jun 02 01:34:35.632080 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:35.631929 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8p5m\" (UniqueName: \"kubernetes.io/projected/eaeea40a-557d-4145-bd6b-4602c915d505-kube-api-access-d8p5m\") pod \"maas-keycloak-0\" (UID: \"eaeea40a-557d-4145-bd6b-4602c915d505\") " pod="keycloak-system/maas-keycloak-0" Jun 02 01:34:35.733282 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:35.733193 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d8p5m\" (UniqueName: \"kubernetes.io/projected/eaeea40a-557d-4145-bd6b-4602c915d505-kube-api-access-d8p5m\") pod \"maas-keycloak-0\" (UID: \"eaeea40a-557d-4145-bd6b-4602c915d505\") " pod="keycloak-system/maas-keycloak-0" Jun 02 01:34:35.733282 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:35.733262 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/eaeea40a-557d-4145-bd6b-4602c915d505-test-realms\") pod \"maas-keycloak-0\" (UID: \"eaeea40a-557d-4145-bd6b-4602c915d505\") " pod="keycloak-system/maas-keycloak-0" Jun 02 01:34:35.733896 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:35.733880 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/eaeea40a-557d-4145-bd6b-4602c915d505-test-realms\") pod \"maas-keycloak-0\" (UID: \"eaeea40a-557d-4145-bd6b-4602c915d505\") " pod="keycloak-system/maas-keycloak-0" Jun 02 01:34:35.741354 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:35.741334 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8p5m\" (UniqueName: \"kubernetes.io/projected/eaeea40a-557d-4145-bd6b-4602c915d505-kube-api-access-d8p5m\") pod \"maas-keycloak-0\" (UID: \"eaeea40a-557d-4145-bd6b-4602c915d505\") " pod="keycloak-system/maas-keycloak-0" Jun 02 01:34:35.858050 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:35.858012 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 02 01:34:35.989102 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:35.989078 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 01:34:35.991390 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:34:35.991354 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaeea40a_557d_4145_bd6b_4602c915d505.slice/crio-6305d9d4fc0fe16264bddb435256ba56665393cc9f984c23ce62f1cccbb73673 WatchSource:0}: Error finding container 6305d9d4fc0fe16264bddb435256ba56665393cc9f984c23ce62f1cccbb73673: Status 404 returned error can't find the container with id 6305d9d4fc0fe16264bddb435256ba56665393cc9f984c23ce62f1cccbb73673 Jun 02 01:34:36.232882 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:36.232828 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc989a47-094a-4a65-85ea-0a5744c853a9" path="/var/lib/kubelet/pods/bc989a47-094a-4a65-85ea-0a5744c853a9/volumes" Jun 02 01:34:36.502810 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:36.502773 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"eaeea40a-557d-4145-bd6b-4602c915d505","Type":"ContainerStarted","Data":"62c439581ea46d0a319cf080495620aa4dfc4ae4fdaf8d76a3dadf202c4c6a56"} Jun 02 01:34:36.502810 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:36.502812 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"eaeea40a-557d-4145-bd6b-4602c915d505","Type":"ContainerStarted","Data":"6305d9d4fc0fe16264bddb435256ba56665393cc9f984c23ce62f1cccbb73673"} Jun 02 01:34:36.520549 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:36.520487 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.197843491 podStartE2EDuration="1.520467608s" podCreationTimestamp="2026-06-02 01:34:35 +0000 UTC" firstStartedPulling="2026-06-02 01:34:35.992856364 +0000 UTC m=+724.322491271" lastFinishedPulling="2026-06-02 01:34:36.31548049 +0000 UTC m=+724.645115388" observedRunningTime="2026-06-02 01:34:36.519230984 +0000 UTC m=+724.848865903" watchObservedRunningTime="2026-06-02 01:34:36.520467608 +0000 UTC m=+724.850102526" Jun 02 01:34:36.858299 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:36.858258 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 02 01:34:36.859963 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:36.859927 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="eaeea40a-557d-4145-bd6b-4602c915d505" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused" Jun 02 01:34:37.858780 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:37.858731 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="eaeea40a-557d-4145-bd6b-4602c915d505" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused" Jun 02 01:34:38.859485 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:38.859430 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="eaeea40a-557d-4145-bd6b-4602c915d505" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused" Jun 02 01:34:39.858775 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:39.858718 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="eaeea40a-557d-4145-bd6b-4602c915d505" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused" Jun 02 01:34:40.859418 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:40.859368 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="eaeea40a-557d-4145-bd6b-4602c915d505" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused" Jun 02 01:34:41.858775 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:41.858716 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="eaeea40a-557d-4145-bd6b-4602c915d505" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused" Jun 02 01:34:42.859190 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:42.859136 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="eaeea40a-557d-4145-bd6b-4602c915d505" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused" Jun 02 01:34:43.858920 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:43.858863 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="eaeea40a-557d-4145-bd6b-4602c915d505" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused" Jun 02 01:34:44.859300 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:44.859248 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="eaeea40a-557d-4145-bd6b-4602c915d505" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused" Jun 02 01:34:45.859160 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:45.859112 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 02 01:34:45.859474 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:45.859441 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="eaeea40a-557d-4145-bd6b-4602c915d505" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused" Jun 02 01:34:46.859491 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:46.859433 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="eaeea40a-557d-4145-bd6b-4602c915d505" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused" Jun 02 01:34:47.858591 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:47.858553 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="eaeea40a-557d-4145-bd6b-4602c915d505" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused" Jun 02 01:34:48.858911 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:48.858852 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="eaeea40a-557d-4145-bd6b-4602c915d505" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused" Jun 02 01:34:49.982857 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:49.982799 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 02 01:34:49.998588 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:49.998526 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="eaeea40a-557d-4145-bd6b-4602c915d505" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 01:34:59.988970 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:34:59.988936 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 02 01:35:21.896784 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:21.896748 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs"] Jun 02 01:35:21.900465 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:21.900445 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs" Jun 02 01:35:21.903018 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:21.902994 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 02 01:35:21.903128 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:21.903042 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 02 01:35:21.903944 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:21.903927 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 02 01:35:21.904010 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:21.903962 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-hpnsh\"" Jun 02 01:35:21.912111 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:21.912089 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs"] Jun 02 01:35:21.930992 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:21.930961 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/140db40b-6ef0-4c90-8df3-8133c0c56a0f-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs\" (UID: \"140db40b-6ef0-4c90-8df3-8133c0c56a0f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs" Jun 02 01:35:21.931148 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:21.930995 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/140db40b-6ef0-4c90-8df3-8133c0c56a0f-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs\" (UID: \"140db40b-6ef0-4c90-8df3-8133c0c56a0f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs" Jun 02 01:35:21.931148 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:21.931021 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/140db40b-6ef0-4c90-8df3-8133c0c56a0f-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs\" (UID: \"140db40b-6ef0-4c90-8df3-8133c0c56a0f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs" Jun 02 01:35:21.931148 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:21.931047 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/140db40b-6ef0-4c90-8df3-8133c0c56a0f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs\" (UID: \"140db40b-6ef0-4c90-8df3-8133c0c56a0f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs" Jun 02 01:35:21.931148 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:21.931111 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/140db40b-6ef0-4c90-8df3-8133c0c56a0f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs\" (UID: \"140db40b-6ef0-4c90-8df3-8133c0c56a0f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs" Jun 02 01:35:21.931148 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:21.931140 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx8rh\" (UniqueName: \"kubernetes.io/projected/140db40b-6ef0-4c90-8df3-8133c0c56a0f-kube-api-access-qx8rh\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs\" (UID: \"140db40b-6ef0-4c90-8df3-8133c0c56a0f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs" Jun 02 01:35:22.031936 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:22.031891 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/140db40b-6ef0-4c90-8df3-8133c0c56a0f-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs\" (UID: \"140db40b-6ef0-4c90-8df3-8133c0c56a0f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs" Jun 02 01:35:22.031936 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:22.031938 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/140db40b-6ef0-4c90-8df3-8133c0c56a0f-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs\" (UID: \"140db40b-6ef0-4c90-8df3-8133c0c56a0f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs" Jun 02 01:35:22.032168 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:22.031975 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/140db40b-6ef0-4c90-8df3-8133c0c56a0f-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs\" (UID: \"140db40b-6ef0-4c90-8df3-8133c0c56a0f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs" Jun 02 01:35:22.032168 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:22.032012 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/140db40b-6ef0-4c90-8df3-8133c0c56a0f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs\" (UID: \"140db40b-6ef0-4c90-8df3-8133c0c56a0f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs" Jun 02 01:35:22.032250 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:22.032180 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/140db40b-6ef0-4c90-8df3-8133c0c56a0f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs\" (UID: \"140db40b-6ef0-4c90-8df3-8133c0c56a0f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs" Jun 02 01:35:22.032250 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:22.032227 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qx8rh\" (UniqueName: \"kubernetes.io/projected/140db40b-6ef0-4c90-8df3-8133c0c56a0f-kube-api-access-qx8rh\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs\" (UID: \"140db40b-6ef0-4c90-8df3-8133c0c56a0f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs" Jun 02 01:35:22.032436 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:22.032413 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/140db40b-6ef0-4c90-8df3-8133c0c56a0f-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs\" (UID: \"140db40b-6ef0-4c90-8df3-8133c0c56a0f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs" Jun 02 01:35:22.032514 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:22.032445 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/140db40b-6ef0-4c90-8df3-8133c0c56a0f-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs\" (UID: \"140db40b-6ef0-4c90-8df3-8133c0c56a0f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs" Jun 02 01:35:22.032514 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:22.032494 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/140db40b-6ef0-4c90-8df3-8133c0c56a0f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs\" (UID: \"140db40b-6ef0-4c90-8df3-8133c0c56a0f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs" Jun 02 01:35:22.034272 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:22.034251 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/140db40b-6ef0-4c90-8df3-8133c0c56a0f-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs\" (UID: \"140db40b-6ef0-4c90-8df3-8133c0c56a0f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs" Jun 02 01:35:22.034644 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:22.034626 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/140db40b-6ef0-4c90-8df3-8133c0c56a0f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs\" (UID: \"140db40b-6ef0-4c90-8df3-8133c0c56a0f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs" Jun 02 01:35:22.039988 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:22.039966 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx8rh\" (UniqueName: \"kubernetes.io/projected/140db40b-6ef0-4c90-8df3-8133c0c56a0f-kube-api-access-qx8rh\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs\" (UID: \"140db40b-6ef0-4c90-8df3-8133c0c56a0f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs" Jun 02 01:35:22.212626 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:22.212549 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs" Jun 02 01:35:22.350914 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:22.350879 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs"] Jun 02 01:35:22.355120 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:35:22.355073 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod140db40b_6ef0_4c90_8df3_8133c0c56a0f.slice/crio-34464e9ff54b5fd587ba7364ed6e7895e6db6314dc2fdd4793f5bda3a210043d WatchSource:0}: Error finding container 34464e9ff54b5fd587ba7364ed6e7895e6db6314dc2fdd4793f5bda3a210043d: Status 404 returned error can't find the container with id 34464e9ff54b5fd587ba7364ed6e7895e6db6314dc2fdd4793f5bda3a210043d Jun 02 01:35:22.670185 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:22.670142 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs" event={"ID":"140db40b-6ef0-4c90-8df3-8133c0c56a0f","Type":"ContainerStarted","Data":"34464e9ff54b5fd587ba7364ed6e7895e6db6314dc2fdd4793f5bda3a210043d"} Jun 02 01:35:27.689402 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:27.689357 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs" event={"ID":"140db40b-6ef0-4c90-8df3-8133c0c56a0f","Type":"ContainerStarted","Data":"134dfea2942984d41cb24310a8ec8ddda1243c8be8ada074cbd23bd235868bd3"} Jun 02 01:35:28.694429 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:28.694392 2559 generic.go:358] "Generic (PLEG): container finished" podID="140db40b-6ef0-4c90-8df3-8133c0c56a0f" containerID="134dfea2942984d41cb24310a8ec8ddda1243c8be8ada074cbd23bd235868bd3" exitCode=0 Jun 02 01:35:28.694905 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:28.694476 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs" event={"ID":"140db40b-6ef0-4c90-8df3-8133c0c56a0f","Type":"ContainerDied","Data":"134dfea2942984d41cb24310a8ec8ddda1243c8be8ada074cbd23bd235868bd3"} Jun 02 01:35:30.704099 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:30.704061 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs" event={"ID":"140db40b-6ef0-4c90-8df3-8133c0c56a0f","Type":"ContainerStarted","Data":"3864af6e6eca3fcddcd80b2abddb351c460979e3a739ed2187a109e5acd4a0fe"} Jun 02 01:35:30.726030 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:30.725979 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs" podStartSLOduration=2.3190853430000002 podStartE2EDuration="9.725964721s" podCreationTimestamp="2026-06-02 01:35:21 +0000 UTC" firstStartedPulling="2026-06-02 01:35:22.360772287 +0000 UTC m=+770.690407190" lastFinishedPulling="2026-06-02 01:35:29.767651655 +0000 UTC m=+778.097286568" observedRunningTime="2026-06-02 01:35:30.724604047 +0000 UTC m=+779.054238966" watchObservedRunningTime="2026-06-02 01:35:30.725964721 +0000 UTC m=+779.055599644" Jun 02 01:35:32.213456 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:32.213426 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs" Jun 02 01:35:32.213783 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:32.213470 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs" Jun 02 01:35:32.226352 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:32.226328 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs" Jun 02 01:35:32.721386 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:32.721357 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs" Jun 02 01:35:42.304921 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:42.304819 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv"] Jun 02 01:35:42.309675 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:42.309649 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv" Jun 02 01:35:42.311991 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:42.311973 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 02 01:35:42.322103 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:42.322080 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv"] Jun 02 01:35:42.411680 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:42.411640 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe1e6cc8-0e9c-4fd9-81a3-d8b970a91bc1-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv\" (UID: \"fe1e6cc8-0e9c-4fd9-81a3-d8b970a91bc1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv" Jun 02 01:35:42.411680 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:42.411683 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe1e6cc8-0e9c-4fd9-81a3-d8b970a91bc1-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv\" (UID: \"fe1e6cc8-0e9c-4fd9-81a3-d8b970a91bc1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv" Jun 02 01:35:42.411988 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:42.411777 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe1e6cc8-0e9c-4fd9-81a3-d8b970a91bc1-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv\" (UID: \"fe1e6cc8-0e9c-4fd9-81a3-d8b970a91bc1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv" Jun 02 01:35:42.411988 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:42.411821 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe1e6cc8-0e9c-4fd9-81a3-d8b970a91bc1-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv\" (UID: \"fe1e6cc8-0e9c-4fd9-81a3-d8b970a91bc1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv" Jun 02 01:35:42.411988 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:42.411926 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fe1e6cc8-0e9c-4fd9-81a3-d8b970a91bc1-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv\" (UID: \"fe1e6cc8-0e9c-4fd9-81a3-d8b970a91bc1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv" Jun 02 01:35:42.411988 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:42.411961 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p42m\" (UniqueName: \"kubernetes.io/projected/fe1e6cc8-0e9c-4fd9-81a3-d8b970a91bc1-kube-api-access-5p42m\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv\" (UID: \"fe1e6cc8-0e9c-4fd9-81a3-d8b970a91bc1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv" Jun 02 01:35:42.512728 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:42.512690 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe1e6cc8-0e9c-4fd9-81a3-d8b970a91bc1-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv\" (UID: \"fe1e6cc8-0e9c-4fd9-81a3-d8b970a91bc1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv" Jun 02 01:35:42.512936 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:42.512766 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fe1e6cc8-0e9c-4fd9-81a3-d8b970a91bc1-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv\" (UID: \"fe1e6cc8-0e9c-4fd9-81a3-d8b970a91bc1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv" Jun 02 01:35:42.512936 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:42.512798 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5p42m\" (UniqueName: \"kubernetes.io/projected/fe1e6cc8-0e9c-4fd9-81a3-d8b970a91bc1-kube-api-access-5p42m\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv\" (UID: \"fe1e6cc8-0e9c-4fd9-81a3-d8b970a91bc1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv" Jun 02 01:35:42.512936 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:42.512874 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe1e6cc8-0e9c-4fd9-81a3-d8b970a91bc1-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv\" (UID: \"fe1e6cc8-0e9c-4fd9-81a3-d8b970a91bc1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv" Jun 02 01:35:42.512936 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:42.512905 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe1e6cc8-0e9c-4fd9-81a3-d8b970a91bc1-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv\" (UID: \"fe1e6cc8-0e9c-4fd9-81a3-d8b970a91bc1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv" Jun 02 01:35:42.513154 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:42.513052 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe1e6cc8-0e9c-4fd9-81a3-d8b970a91bc1-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv\" (UID: \"fe1e6cc8-0e9c-4fd9-81a3-d8b970a91bc1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv" Jun 02 01:35:42.513212 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:42.513169 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe1e6cc8-0e9c-4fd9-81a3-d8b970a91bc1-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv\" (UID: \"fe1e6cc8-0e9c-4fd9-81a3-d8b970a91bc1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv" Jun 02 01:35:42.513270 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:42.513233 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fe1e6cc8-0e9c-4fd9-81a3-d8b970a91bc1-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv\" (UID: \"fe1e6cc8-0e9c-4fd9-81a3-d8b970a91bc1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv" Jun 02 01:35:42.513312 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:42.513271 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe1e6cc8-0e9c-4fd9-81a3-d8b970a91bc1-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv\" (UID: \"fe1e6cc8-0e9c-4fd9-81a3-d8b970a91bc1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv" Jun 02 01:35:42.515578 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:42.515553 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe1e6cc8-0e9c-4fd9-81a3-d8b970a91bc1-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv\" (UID: \"fe1e6cc8-0e9c-4fd9-81a3-d8b970a91bc1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv" Jun 02 01:35:42.515796 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:42.515776 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe1e6cc8-0e9c-4fd9-81a3-d8b970a91bc1-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv\" (UID: \"fe1e6cc8-0e9c-4fd9-81a3-d8b970a91bc1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv" Jun 02 01:35:42.520474 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:42.520450 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p42m\" (UniqueName: \"kubernetes.io/projected/fe1e6cc8-0e9c-4fd9-81a3-d8b970a91bc1-kube-api-access-5p42m\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv\" (UID: \"fe1e6cc8-0e9c-4fd9-81a3-d8b970a91bc1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv" Jun 02 01:35:42.619864 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:42.619751 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv" Jun 02 01:35:42.753533 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:42.753486 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv"] Jun 02 01:35:42.756487 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:35:42.756448 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe1e6cc8_0e9c_4fd9_81a3_d8b970a91bc1.slice/crio-e8e65621dacbf44fcfc4274d4650b162ad5a879646cac34f99b2771f65a85129 WatchSource:0}: Error finding container e8e65621dacbf44fcfc4274d4650b162ad5a879646cac34f99b2771f65a85129: Status 404 returned error can't find the container with id e8e65621dacbf44fcfc4274d4650b162ad5a879646cac34f99b2771f65a85129 Jun 02 01:35:43.749603 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:43.749565 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv" event={"ID":"fe1e6cc8-0e9c-4fd9-81a3-d8b970a91bc1","Type":"ContainerStarted","Data":"ced19df4acf149469ac1e96fcb66fe95caef3ea527229f703ea0f694ffc5ffb5"} Jun 02 01:35:43.750048 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:43.749610 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv" event={"ID":"fe1e6cc8-0e9c-4fd9-81a3-d8b970a91bc1","Type":"ContainerStarted","Data":"e8e65621dacbf44fcfc4274d4650b162ad5a879646cac34f99b2771f65a85129"} Jun 02 01:35:44.754362 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:44.754321 2559 generic.go:358] "Generic (PLEG): container finished" podID="fe1e6cc8-0e9c-4fd9-81a3-d8b970a91bc1" containerID="ced19df4acf149469ac1e96fcb66fe95caef3ea527229f703ea0f694ffc5ffb5" exitCode=0 Jun 02 01:35:44.754767 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:44.754413 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv" event={"ID":"fe1e6cc8-0e9c-4fd9-81a3-d8b970a91bc1","Type":"ContainerDied","Data":"ced19df4acf149469ac1e96fcb66fe95caef3ea527229f703ea0f694ffc5ffb5"} Jun 02 01:35:45.759639 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:45.759604 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv" event={"ID":"fe1e6cc8-0e9c-4fd9-81a3-d8b970a91bc1","Type":"ContainerStarted","Data":"e3b060cb96f5fcc4042513eda47d276ffa3e831389832684c88f37f05ec66ac7"} Jun 02 01:35:45.778115 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:45.778061 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv" podStartSLOduration=3.601392489 podStartE2EDuration="3.778043964s" podCreationTimestamp="2026-06-02 01:35:42 +0000 UTC" firstStartedPulling="2026-06-02 01:35:44.754995659 +0000 UTC m=+793.084630556" lastFinishedPulling="2026-06-02 01:35:44.931647121 +0000 UTC m=+793.261282031" observedRunningTime="2026-06-02 01:35:45.775763882 +0000 UTC m=+794.105398803" watchObservedRunningTime="2026-06-02 01:35:45.778043964 +0000 UTC m=+794.107678887" Jun 02 01:35:49.302208 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:49.302169 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn"] Jun 02 01:35:49.316167 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:49.316138 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn"] Jun 02 01:35:49.316316 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:49.316259 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn" Jun 02 01:35:49.318733 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:49.318707 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 02 01:35:49.487158 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:49.487121 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11e32cb9-91ef-4282-afc0-968c2be0a18c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn\" (UID: \"11e32cb9-91ef-4282-afc0-968c2be0a18c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn" Jun 02 01:35:49.487356 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:49.487262 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxtf6\" (UniqueName: \"kubernetes.io/projected/11e32cb9-91ef-4282-afc0-968c2be0a18c-kube-api-access-rxtf6\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn\" (UID: \"11e32cb9-91ef-4282-afc0-968c2be0a18c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn" Jun 02 01:35:49.487356 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:49.487345 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11e32cb9-91ef-4282-afc0-968c2be0a18c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn\" (UID: \"11e32cb9-91ef-4282-afc0-968c2be0a18c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn" Jun 02 01:35:49.487488 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:49.487401 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/11e32cb9-91ef-4282-afc0-968c2be0a18c-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn\" (UID: \"11e32cb9-91ef-4282-afc0-968c2be0a18c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn" Jun 02 01:35:49.487488 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:49.487435 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11e32cb9-91ef-4282-afc0-968c2be0a18c-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn\" (UID: \"11e32cb9-91ef-4282-afc0-968c2be0a18c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn" Jun 02 01:35:49.487488 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:49.487465 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11e32cb9-91ef-4282-afc0-968c2be0a18c-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn\" (UID: \"11e32cb9-91ef-4282-afc0-968c2be0a18c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn" Jun 02 01:35:49.588498 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:49.588415 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11e32cb9-91ef-4282-afc0-968c2be0a18c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn\" (UID: \"11e32cb9-91ef-4282-afc0-968c2be0a18c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn" Jun 02 01:35:49.588498 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:49.588466 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/11e32cb9-91ef-4282-afc0-968c2be0a18c-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn\" (UID: \"11e32cb9-91ef-4282-afc0-968c2be0a18c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn" Jun 02 01:35:49.588498 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:49.588486 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11e32cb9-91ef-4282-afc0-968c2be0a18c-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn\" (UID: \"11e32cb9-91ef-4282-afc0-968c2be0a18c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn" Jun 02 01:35:49.588737 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:49.588511 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11e32cb9-91ef-4282-afc0-968c2be0a18c-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn\" (UID: \"11e32cb9-91ef-4282-afc0-968c2be0a18c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn" Jun 02 01:35:49.588737 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:49.588547 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11e32cb9-91ef-4282-afc0-968c2be0a18c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn\" (UID: \"11e32cb9-91ef-4282-afc0-968c2be0a18c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn" Jun 02 01:35:49.588737 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:49.588618 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rxtf6\" (UniqueName: \"kubernetes.io/projected/11e32cb9-91ef-4282-afc0-968c2be0a18c-kube-api-access-rxtf6\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn\" (UID: \"11e32cb9-91ef-4282-afc0-968c2be0a18c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn" Jun 02 01:35:49.588941 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:49.588889 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11e32cb9-91ef-4282-afc0-968c2be0a18c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn\" (UID: \"11e32cb9-91ef-4282-afc0-968c2be0a18c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn" Jun 02 01:35:49.589011 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:49.588917 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/11e32cb9-91ef-4282-afc0-968c2be0a18c-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn\" (UID: \"11e32cb9-91ef-4282-afc0-968c2be0a18c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn" Jun 02 01:35:49.589011 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:49.588971 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11e32cb9-91ef-4282-afc0-968c2be0a18c-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn\" (UID: \"11e32cb9-91ef-4282-afc0-968c2be0a18c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn" Jun 02 01:35:49.591010 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:49.590983 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11e32cb9-91ef-4282-afc0-968c2be0a18c-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn\" (UID: \"11e32cb9-91ef-4282-afc0-968c2be0a18c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn" Jun 02 01:35:49.591250 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:49.591230 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11e32cb9-91ef-4282-afc0-968c2be0a18c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn\" (UID: \"11e32cb9-91ef-4282-afc0-968c2be0a18c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn" Jun 02 01:35:49.601262 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:49.601236 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxtf6\" (UniqueName: \"kubernetes.io/projected/11e32cb9-91ef-4282-afc0-968c2be0a18c-kube-api-access-rxtf6\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn\" (UID: \"11e32cb9-91ef-4282-afc0-968c2be0a18c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn" Jun 02 01:35:49.626949 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:49.626923 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn" Jun 02 01:35:49.762074 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:49.762049 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn"] Jun 02 01:35:49.764746 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:35:49.764718 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11e32cb9_91ef_4282_afc0_968c2be0a18c.slice/crio-c7ca7b5ee6dbd3b27f331bdf34ea882e1d3298f3444a237875fa8f2651a37192 WatchSource:0}: Error finding container c7ca7b5ee6dbd3b27f331bdf34ea882e1d3298f3444a237875fa8f2651a37192: Status 404 returned error can't find the container with id c7ca7b5ee6dbd3b27f331bdf34ea882e1d3298f3444a237875fa8f2651a37192 Jun 02 01:35:49.773204 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:49.773178 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn" event={"ID":"11e32cb9-91ef-4282-afc0-968c2be0a18c","Type":"ContainerStarted","Data":"c7ca7b5ee6dbd3b27f331bdf34ea882e1d3298f3444a237875fa8f2651a37192"} Jun 02 01:35:50.778182 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:50.778146 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn" event={"ID":"11e32cb9-91ef-4282-afc0-968c2be0a18c","Type":"ContainerStarted","Data":"0ec629e86de0ca4da0a086b84d81a3d51aaaa924442e0bf0dad1e552defb11d2"} Jun 02 01:35:51.782997 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:51.782962 2559 generic.go:358] "Generic (PLEG): container finished" podID="11e32cb9-91ef-4282-afc0-968c2be0a18c" containerID="0ec629e86de0ca4da0a086b84d81a3d51aaaa924442e0bf0dad1e552defb11d2" exitCode=0 Jun 02 01:35:51.783419 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:51.783048 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn" event={"ID":"11e32cb9-91ef-4282-afc0-968c2be0a18c","Type":"ContainerDied","Data":"0ec629e86de0ca4da0a086b84d81a3d51aaaa924442e0bf0dad1e552defb11d2"} Jun 02 01:35:52.620779 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:52.620745 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv" Jun 02 01:35:52.620993 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:52.620813 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv" Jun 02 01:35:52.633126 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:52.633100 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv" Jun 02 01:35:52.788235 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:52.788199 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn" event={"ID":"11e32cb9-91ef-4282-afc0-968c2be0a18c","Type":"ContainerStarted","Data":"9f16144bff61a9a61693be3130ff17fdb60362e1024c4077e8981b6ee976fac6"} Jun 02 01:35:52.800106 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:52.800077 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv" Jun 02 01:35:52.805276 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:52.805235 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn" podStartSLOduration=3.601502674 podStartE2EDuration="3.80522273s" podCreationTimestamp="2026-06-02 01:35:49 +0000 UTC" firstStartedPulling="2026-06-02 01:35:51.783556685 +0000 UTC m=+800.113191582" lastFinishedPulling="2026-06-02 01:35:51.987276722 +0000 UTC m=+800.316911638" observedRunningTime="2026-06-02 01:35:52.8040851 +0000 UTC m=+801.133720033" watchObservedRunningTime="2026-06-02 01:35:52.80522273 +0000 UTC m=+801.134857652" Jun 02 01:35:59.627854 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:59.627798 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn" Jun 02 01:35:59.628416 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:59.627863 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn" Jun 02 01:35:59.640209 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:59.640186 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn" Jun 02 01:35:59.828091 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:35:59.828064 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn" Jun 02 01:42:08.309209 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:08.309174 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7598c6c7c5-b45rj_43b04c98-5f6c-4108-8dfd-6b32395343af/nginx/0.log" Jun 02 01:42:08.552223 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:08.552175 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-4g47k_d971463f-5610-48d9-86b6-e4a777066378/manager/0.log" Jun 02 01:42:08.671694 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:08.671619 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-jhf87_cf59923b-6615-45e6-95f3-41988bdef0ac/manager/0.log" Jun 02 01:42:09.018890 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:09.018791 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-2pt4b_8ebd229c-734c-43f3-bbb6-42878bd60e71/server/0.log" Jun 02 01:42:09.135611 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:09.135587 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-b7wwv_27f0f2c9-8195-4542-a69d-b0687c11dafc/manager/0.log" Jun 02 01:42:09.523769 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:09.523738 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6758f7c588-ftb5k_14a90475-5513-4375-9c2d-80e8d160fab3/copy-manifests/0.log" Jun 02 01:42:09.532454 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:09.532431 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6758f7c588-ftb5k_14a90475-5513-4375-9c2d-80e8d160fab3/manager/0.log" Jun 02 01:42:09.645175 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:09.645147 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-k7drq_4f331ce7-d0eb-4548-bae6-b81bc9a27bea/postgres/0.log" Jun 02 01:42:11.490614 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:11.490582 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-grn2v_90bc02bb-d989-4866-bc6c-ba96e864475f/manager/0.log" Jun 02 01:42:12.183214 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:12.183174 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-czn5m_025e8655-c031-4252-83af-0285281432fd/discovery/0.log" Jun 02 01:42:12.301564 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:12.301522 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-865b6fd47-8z6ld_cbebafe4-fb47-4235-9d81-2d16e374d4e2/kube-auth-proxy/0.log" Jun 02 01:42:12.626681 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:12.626650 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-fpfsx_3d99c551-42e0-4735-9845-2e6f813e6a43/payload-processing/0.log" Jun 02 01:42:13.089255 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:13.089227 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs_140db40b-6ef0-4c90-8df3-8133c0c56a0f/storage-initializer/0.log" Jun 02 01:42:13.096661 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:13.096639 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-sn8rs_140db40b-6ef0-4c90-8df3-8133c0c56a0f/main/0.log" Jun 02 01:42:13.447110 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:13.447026 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv_fe1e6cc8-0e9c-4fd9-81a3-d8b970a91bc1/storage-initializer/0.log" Jun 02 01:42:13.454418 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:13.454392 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f92v6pv_fe1e6cc8-0e9c-4fd9-81a3-d8b970a91bc1/main/0.log" Jun 02 01:42:13.568301 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:13.568270 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn_11e32cb9-91ef-4282-afc0-968c2be0a18c/storage-initializer/0.log" Jun 02 01:42:13.575250 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:13.575226 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-2ngxn_11e32cb9-91ef-4282-afc0-968c2be0a18c/main/0.log" Jun 02 01:42:20.933361 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:20.933327 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9slcd_a69176c4-7342-45a1-87c5-7a25614b5f02/global-pull-secret-syncer/0.log" Jun 02 01:42:20.981761 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:20.981717 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lgtvp_f410a064-878f-4457-ad8e-f4456e889346/konnectivity-agent/0.log" Jun 02 01:42:21.065405 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:21.065375 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-179.ec2.internal_d4741659fb407ec36ac08d8abc23301e/haproxy/0.log" Jun 02 01:42:25.521113 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:25.521080 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-grn2v_90bc02bb-d989-4866-bc6c-ba96e864475f/manager/0.log" Jun 02 01:42:27.278200 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:27.278170 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jms2r_404ae2b7-d943-4cdb-bfce-e144857758c9/node-exporter/0.log" Jun 02 01:42:27.303084 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:27.303055 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jms2r_404ae2b7-d943-4cdb-bfce-e144857758c9/kube-rbac-proxy/0.log" Jun 02 01:42:27.328773 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:27.328742 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jms2r_404ae2b7-d943-4cdb-bfce-e144857758c9/init-textfile/0.log" Jun 02 01:42:30.462404 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:30.462366 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-524c7/perf-node-gather-daemonset-f5gkj"] Jun 02 01:42:30.465779 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:30.465756 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-524c7/perf-node-gather-daemonset-f5gkj" Jun 02 01:42:30.468047 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:30.468026 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-524c7\"/\"kube-root-ca.crt\"" Jun 02 01:42:30.468860 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:30.468822 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-524c7\"/\"openshift-service-ca.crt\"" Jun 02 01:42:30.468954 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:30.468822 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-524c7\"/\"default-dockercfg-45n7s\"" Jun 02 01:42:30.474280 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:30.474260 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-524c7/perf-node-gather-daemonset-f5gkj"] Jun 02 01:42:30.531965 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:30.531933 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ed0934e0-b09b-476d-a9f3-e9497284dfa7-podres\") pod \"perf-node-gather-daemonset-f5gkj\" (UID: \"ed0934e0-b09b-476d-a9f3-e9497284dfa7\") " pod="openshift-must-gather-524c7/perf-node-gather-daemonset-f5gkj" Jun 02 01:42:30.532114 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:30.531976 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ed0934e0-b09b-476d-a9f3-e9497284dfa7-sys\") pod \"perf-node-gather-daemonset-f5gkj\" (UID: \"ed0934e0-b09b-476d-a9f3-e9497284dfa7\") " pod="openshift-must-gather-524c7/perf-node-gather-daemonset-f5gkj" Jun 02 01:42:30.532114 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:30.532046 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ed0934e0-b09b-476d-a9f3-e9497284dfa7-proc\") pod \"perf-node-gather-daemonset-f5gkj\" (UID: \"ed0934e0-b09b-476d-a9f3-e9497284dfa7\") " pod="openshift-must-gather-524c7/perf-node-gather-daemonset-f5gkj" Jun 02 01:42:30.532114 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:30.532062 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ed0934e0-b09b-476d-a9f3-e9497284dfa7-lib-modules\") pod \"perf-node-gather-daemonset-f5gkj\" (UID: \"ed0934e0-b09b-476d-a9f3-e9497284dfa7\") " pod="openshift-must-gather-524c7/perf-node-gather-daemonset-f5gkj" Jun 02 01:42:30.532114 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:30.532094 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whwkx\" (UniqueName: \"kubernetes.io/projected/ed0934e0-b09b-476d-a9f3-e9497284dfa7-kube-api-access-whwkx\") pod \"perf-node-gather-daemonset-f5gkj\" (UID: \"ed0934e0-b09b-476d-a9f3-e9497284dfa7\") " pod="openshift-must-gather-524c7/perf-node-gather-daemonset-f5gkj" Jun 02 01:42:30.632961 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:30.632926 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ed0934e0-b09b-476d-a9f3-e9497284dfa7-proc\") pod \"perf-node-gather-daemonset-f5gkj\" (UID: \"ed0934e0-b09b-476d-a9f3-e9497284dfa7\") " pod="openshift-must-gather-524c7/perf-node-gather-daemonset-f5gkj" Jun 02 01:42:30.632961 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:30.632966 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ed0934e0-b09b-476d-a9f3-e9497284dfa7-lib-modules\") pod \"perf-node-gather-daemonset-f5gkj\" (UID: \"ed0934e0-b09b-476d-a9f3-e9497284dfa7\") " pod="openshift-must-gather-524c7/perf-node-gather-daemonset-f5gkj" Jun 02 01:42:30.633192 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:30.633016 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-whwkx\" (UniqueName: \"kubernetes.io/projected/ed0934e0-b09b-476d-a9f3-e9497284dfa7-kube-api-access-whwkx\") pod \"perf-node-gather-daemonset-f5gkj\" (UID: \"ed0934e0-b09b-476d-a9f3-e9497284dfa7\") " pod="openshift-must-gather-524c7/perf-node-gather-daemonset-f5gkj" Jun 02 01:42:30.633192 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:30.633052 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ed0934e0-b09b-476d-a9f3-e9497284dfa7-podres\") pod \"perf-node-gather-daemonset-f5gkj\" (UID: \"ed0934e0-b09b-476d-a9f3-e9497284dfa7\") " pod="openshift-must-gather-524c7/perf-node-gather-daemonset-f5gkj" Jun 02 01:42:30.633192 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:30.633052 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ed0934e0-b09b-476d-a9f3-e9497284dfa7-proc\") pod \"perf-node-gather-daemonset-f5gkj\" (UID: \"ed0934e0-b09b-476d-a9f3-e9497284dfa7\") " pod="openshift-must-gather-524c7/perf-node-gather-daemonset-f5gkj" Jun 02 01:42:30.633192 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:30.633092 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ed0934e0-b09b-476d-a9f3-e9497284dfa7-sys\") pod \"perf-node-gather-daemonset-f5gkj\" (UID: \"ed0934e0-b09b-476d-a9f3-e9497284dfa7\") " pod="openshift-must-gather-524c7/perf-node-gather-daemonset-f5gkj" Jun 02 01:42:30.633192 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:30.633162 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ed0934e0-b09b-476d-a9f3-e9497284dfa7-lib-modules\") pod \"perf-node-gather-daemonset-f5gkj\" (UID: \"ed0934e0-b09b-476d-a9f3-e9497284dfa7\") " pod="openshift-must-gather-524c7/perf-node-gather-daemonset-f5gkj" Jun 02 01:42:30.633192 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:30.633182 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ed0934e0-b09b-476d-a9f3-e9497284dfa7-podres\") pod \"perf-node-gather-daemonset-f5gkj\" (UID: \"ed0934e0-b09b-476d-a9f3-e9497284dfa7\") " pod="openshift-must-gather-524c7/perf-node-gather-daemonset-f5gkj" Jun 02 01:42:30.633380 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:30.633187 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ed0934e0-b09b-476d-a9f3-e9497284dfa7-sys\") pod \"perf-node-gather-daemonset-f5gkj\" (UID: \"ed0934e0-b09b-476d-a9f3-e9497284dfa7\") " pod="openshift-must-gather-524c7/perf-node-gather-daemonset-f5gkj" Jun 02 01:42:30.640898 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:30.640871 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whwkx\" (UniqueName: \"kubernetes.io/projected/ed0934e0-b09b-476d-a9f3-e9497284dfa7-kube-api-access-whwkx\") pod \"perf-node-gather-daemonset-f5gkj\" (UID: \"ed0934e0-b09b-476d-a9f3-e9497284dfa7\") " pod="openshift-must-gather-524c7/perf-node-gather-daemonset-f5gkj" Jun 02 01:42:30.775477 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:30.775391 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-524c7/perf-node-gather-daemonset-f5gkj" Jun 02 01:42:30.911174 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:30.911139 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-524c7/perf-node-gather-daemonset-f5gkj"] Jun 02 01:42:30.913611 ip-10-0-130-179 kubenswrapper[2559]: W0602 01:42:30.913576 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poded0934e0_b09b_476d_a9f3_e9497284dfa7.slice/crio-ba14add015560674f7742dd8c7325f5581348732e4125be41e5dfe44b5823aa5 WatchSource:0}: Error finding container ba14add015560674f7742dd8c7325f5581348732e4125be41e5dfe44b5823aa5: Status 404 returned error can't find the container with id ba14add015560674f7742dd8c7325f5581348732e4125be41e5dfe44b5823aa5 Jun 02 01:42:30.915429 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:30.915397 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 01:42:31.168902 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:31.168867 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-524c7/perf-node-gather-daemonset-f5gkj" event={"ID":"ed0934e0-b09b-476d-a9f3-e9497284dfa7","Type":"ContainerStarted","Data":"cc78e72a1547fdc4c6b3c029ae157031bc69b4dda81e6ef54f0a566763abd166"} Jun 02 01:42:31.168902 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:31.168906 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-524c7/perf-node-gather-daemonset-f5gkj" event={"ID":"ed0934e0-b09b-476d-a9f3-e9497284dfa7","Type":"ContainerStarted","Data":"ba14add015560674f7742dd8c7325f5581348732e4125be41e5dfe44b5823aa5"} Jun 02 01:42:31.169115 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:31.168931 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-524c7/perf-node-gather-daemonset-f5gkj" Jun 02 01:42:31.183615 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:31.183566 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-524c7/perf-node-gather-daemonset-f5gkj" podStartSLOduration=1.183551596 podStartE2EDuration="1.183551596s" podCreationTimestamp="2026-06-02 01:42:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:42:31.182995694 +0000 UTC m=+1199.512630614" watchObservedRunningTime="2026-06-02 01:42:31.183551596 +0000 UTC m=+1199.513186515" Jun 02 01:42:31.532250 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:31.532229 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nj4t5_895ec876-825f-4148-b184-bd690c4203aa/dns/0.log" Jun 02 01:42:31.551285 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:31.551252 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nj4t5_895ec876-825f-4148-b184-bd690c4203aa/kube-rbac-proxy/0.log" Jun 02 01:42:31.668105 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:31.668077 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5tkrg_ce15d2ed-5b70-4ef5-bc2c-bdd6c25be7d5/dns-node-resolver/0.log" Jun 02 01:42:32.150958 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:32.150927 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7xkdt_4449e4e0-b633-4914-a364-3a22b3408589/node-ca/0.log" Jun 02 01:42:33.055114 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:33.055078 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-czn5m_025e8655-c031-4252-83af-0285281432fd/discovery/0.log" Jun 02 01:42:33.074027 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:33.073998 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-865b6fd47-8z6ld_cbebafe4-fb47-4235-9d81-2d16e374d4e2/kube-auth-proxy/0.log" Jun 02 01:42:33.148714 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:33.148682 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-fpfsx_3d99c551-42e0-4735-9845-2e6f813e6a43/payload-processing/0.log" Jun 02 01:42:33.674149 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:33.674119 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-m96w4_3b09f852-0fa3-468e-b22e-8d25a143efc8/serve-healthcheck-canary/0.log" Jun 02 01:42:34.172412 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:34.172384 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-54c8v_7fa14ed3-10cb-425a-aeb4-5a7356537c7c/kube-rbac-proxy/0.log" Jun 02 01:42:34.197969 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:34.197947 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-54c8v_7fa14ed3-10cb-425a-aeb4-5a7356537c7c/exporter/0.log" Jun 02 01:42:34.219182 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:34.219147 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-54c8v_7fa14ed3-10cb-425a-aeb4-5a7356537c7c/extractor/0.log" Jun 02 01:42:36.324801 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:36.324773 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7598c6c7c5-b45rj_43b04c98-5f6c-4108-8dfd-6b32395343af/nginx/0.log" Jun 02 01:42:36.368494 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:36.368467 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-4g47k_d971463f-5610-48d9-86b6-e4a777066378/manager/0.log" Jun 02 01:42:36.398525 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:36.398493 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-jhf87_cf59923b-6615-45e6-95f3-41988bdef0ac/manager/0.log" Jun 02 01:42:36.464060 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:36.464031 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-2pt4b_8ebd229c-734c-43f3-bbb6-42878bd60e71/server/0.log" Jun 02 01:42:36.506642 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:36.506609 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-b7wwv_27f0f2c9-8195-4542-a69d-b0687c11dafc/manager/0.log" Jun 02 01:42:36.651374 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:36.651284 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6758f7c588-ftb5k_14a90475-5513-4375-9c2d-80e8d160fab3/manager/0.log" Jun 02 01:42:36.670453 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:36.670426 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6758f7c588-ftb5k_14a90475-5513-4375-9c2d-80e8d160fab3/copy-manifests/0.log" Jun 02 01:42:36.697737 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:36.697710 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-k7drq_4f331ce7-d0eb-4548-bae6-b81bc9a27bea/postgres/0.log" Jun 02 01:42:37.186209 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:37.186178 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-524c7/perf-node-gather-daemonset-f5gkj" Jun 02 01:42:37.971984 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:37.971954 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-b48hq_1a3d1337-0cc6-4986-8045-21f5ea0c8a13/openshift-lws-operator/0.log" Jun 02 01:42:44.372356 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:44.372325 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nqdhn_864222f2-b558-4380-b095-b1f285e5b91c/kube-multus-additional-cni-plugins/0.log" Jun 02 01:42:44.390691 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:44.390667 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nqdhn_864222f2-b558-4380-b095-b1f285e5b91c/egress-router-binary-copy/0.log" Jun 02 01:42:44.409607 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:44.409587 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nqdhn_864222f2-b558-4380-b095-b1f285e5b91c/cni-plugins/0.log" Jun 02 01:42:44.428539 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:44.428516 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nqdhn_864222f2-b558-4380-b095-b1f285e5b91c/bond-cni-plugin/0.log" Jun 02 01:42:44.450272 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:44.450249 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nqdhn_864222f2-b558-4380-b095-b1f285e5b91c/routeoverride-cni/0.log" Jun 02 01:42:44.468723 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:44.468703 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nqdhn_864222f2-b558-4380-b095-b1f285e5b91c/whereabouts-cni-bincopy/0.log" Jun 02 01:42:44.487809 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:44.487793 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nqdhn_864222f2-b558-4380-b095-b1f285e5b91c/whereabouts-cni/0.log" Jun 02 01:42:44.516158 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:44.516134 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-n22l6_585b1860-a049-4dc9-9dae-78a15997c822/kube-multus/0.log" Jun 02 01:42:44.534898 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:44.534875 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-96l4l_564c53f1-521a-42b2-8353-80c10ff44bb2/network-metrics-daemon/0.log" Jun 02 01:42:44.553752 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:44.553726 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-96l4l_564c53f1-521a-42b2-8353-80c10ff44bb2/kube-rbac-proxy/0.log" Jun 02 01:42:45.391056 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:45.391030 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9jfrv_83e1fd53-fa87-472e-91cc-c15dfac10b11/ovn-controller/0.log" Jun 02 01:42:45.412392 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:45.412368 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9jfrv_83e1fd53-fa87-472e-91cc-c15dfac10b11/ovn-acl-logging/0.log" Jun 02 01:42:45.429763 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:45.429744 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9jfrv_83e1fd53-fa87-472e-91cc-c15dfac10b11/kube-rbac-proxy-node/0.log" Jun 02 01:42:45.450012 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:45.449990 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9jfrv_83e1fd53-fa87-472e-91cc-c15dfac10b11/kube-rbac-proxy-ovn-metrics/0.log" Jun 02 01:42:45.467659 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:45.467643 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9jfrv_83e1fd53-fa87-472e-91cc-c15dfac10b11/northd/0.log" Jun 02 01:42:45.488947 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:45.488928 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9jfrv_83e1fd53-fa87-472e-91cc-c15dfac10b11/nbdb/0.log" Jun 02 01:42:45.507739 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:45.507721 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9jfrv_83e1fd53-fa87-472e-91cc-c15dfac10b11/sbdb/0.log" Jun 02 01:42:45.604653 ip-10-0-130-179 kubenswrapper[2559]: I0602 01:42:45.604622 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9jfrv_83e1fd53-fa87-472e-91cc-c15dfac10b11/ovnkube-controller/0.log"