May 21 18:17:39.489438 ip-10-0-142-242 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 21 18:17:39.489450 ip-10-0-142-242 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 21 18:17:39.489459 ip-10-0-142-242 systemd[1]: kubelet.service: Failed with result 'resources'. May 21 18:17:39.489762 ip-10-0-142-242 systemd[1]: Failed to start Kubernetes Kubelet. May 21 18:17:49.549589 ip-10-0-142-242 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 21 18:17:49.549605 ip-10-0-142-242 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot c192c62756574056881eab9ae1ede753 -- May 21 18:20:17.003153 ip-10-0-142-242 systemd[1]: Starting Kubernetes Kubelet... May 21 18:20:17.441973 ip-10-0-142-242 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 18:20:17.441973 ip-10-0-142-242 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 21 18:20:17.441973 ip-10-0-142-242 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 18:20:17.441973 ip-10-0-142-242 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 21 18:20:17.441973 ip-10-0-142-242 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 18:20:17.442817 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.442671 2575 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 21 18:20:17.448512 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448497 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 18:20:17.448512 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448513 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 18:20:17.448577 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448516 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 18:20:17.448577 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448520 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 18:20:17.448577 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448523 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 18:20:17.448577 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448526 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 18:20:17.448577 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448529 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 18:20:17.448577 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448533 2575 feature_gate.go:328] unrecognized feature gate: Example2 May 21 18:20:17.448577 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448537 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 18:20:17.448577 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448540 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 18:20:17.448577 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448543 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 18:20:17.448577 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448545 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 18:20:17.448577 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448548 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 18:20:17.448577 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448551 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 18:20:17.448577 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448554 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 18:20:17.448577 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448557 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 18:20:17.448577 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448559 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 18:20:17.448577 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448562 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 18:20:17.448577 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448565 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 18:20:17.448577 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448568 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 18:20:17.448577 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448578 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 18:20:17.448577 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448582 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 18:20:17.449071 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448585 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 18:20:17.449071 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448587 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 18:20:17.449071 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448590 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 18:20:17.449071 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448593 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 18:20:17.449071 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448596 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 18:20:17.449071 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448598 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 18:20:17.449071 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448601 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 18:20:17.449071 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448603 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 18:20:17.449071 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448606 2575 feature_gate.go:328] unrecognized feature gate: Example May 21 18:20:17.449071 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448610 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 18:20:17.449071 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448612 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 18:20:17.449071 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448614 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 18:20:17.449071 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448617 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 18:20:17.449071 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448621 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 18:20:17.449071 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448625 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 18:20:17.449071 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448628 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 18:20:17.449071 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448631 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 18:20:17.449071 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448634 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 18:20:17.449071 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448637 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 18:20:17.449642 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448639 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 18:20:17.449642 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448642 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 18:20:17.449642 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448644 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 18:20:17.449642 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448646 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 18:20:17.449642 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448649 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 18:20:17.449642 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448652 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 18:20:17.449642 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448654 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 18:20:17.449642 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448657 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 18:20:17.449642 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448660 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 18:20:17.449642 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448662 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 18:20:17.449642 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448665 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 18:20:17.449642 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448668 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 18:20:17.449642 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448670 2575 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 18:20:17.449642 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448673 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 18:20:17.449642 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448676 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 18:20:17.449642 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448679 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 18:20:17.449642 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448681 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 18:20:17.449642 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448683 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 18:20:17.449642 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448686 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 18:20:17.449642 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448689 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 18:20:17.450148 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448691 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 18:20:17.450148 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448694 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 18:20:17.450148 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448709 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 18:20:17.450148 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448712 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 18:20:17.450148 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448715 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 18:20:17.450148 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448719 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 18:20:17.450148 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448722 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 18:20:17.450148 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448725 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 18:20:17.450148 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448727 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 18:20:17.450148 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448730 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 18:20:17.450148 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448732 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 18:20:17.450148 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448735 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 18:20:17.450148 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448737 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 18:20:17.450148 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448740 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 18:20:17.450148 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448743 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 18:20:17.450148 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448745 2575 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 18:20:17.450148 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448748 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 18:20:17.450148 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448750 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 18:20:17.450148 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448753 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 18:20:17.450148 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448756 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 18:20:17.450635 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448759 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 18:20:17.450635 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448761 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 18:20:17.450635 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448765 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 18:20:17.450635 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448769 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 18:20:17.450635 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.448771 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 18:20:17.450635 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449155 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 18:20:17.450635 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449160 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 18:20:17.450635 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449163 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 18:20:17.450635 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449166 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 18:20:17.450635 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449169 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 18:20:17.450635 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449171 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 18:20:17.450635 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449174 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 18:20:17.450635 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449176 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 18:20:17.450635 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449179 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 18:20:17.450635 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449182 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 18:20:17.450635 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449185 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 18:20:17.450635 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449188 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 18:20:17.450635 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449190 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 18:20:17.450635 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449193 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 18:20:17.451158 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449195 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 18:20:17.451158 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449198 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 18:20:17.451158 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449201 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 18:20:17.451158 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449203 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 18:20:17.451158 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449206 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 18:20:17.451158 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449208 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 18:20:17.451158 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449211 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 18:20:17.451158 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449214 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 18:20:17.451158 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449217 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 18:20:17.451158 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449220 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 18:20:17.451158 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449222 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 18:20:17.451158 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449225 2575 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 18:20:17.451158 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449227 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 18:20:17.451158 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449230 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 18:20:17.451158 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449232 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 18:20:17.451158 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449235 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 18:20:17.451158 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449238 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 18:20:17.451158 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449241 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 18:20:17.451158 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449243 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 18:20:17.451158 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449246 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 18:20:17.451661 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449248 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 18:20:17.451661 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449250 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 18:20:17.451661 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449253 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 18:20:17.451661 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449256 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 18:20:17.451661 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449258 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 18:20:17.451661 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449260 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 18:20:17.451661 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449263 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 18:20:17.451661 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449267 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 18:20:17.451661 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449269 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 18:20:17.451661 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449272 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 18:20:17.451661 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449274 2575 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 18:20:17.451661 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449277 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 18:20:17.451661 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449279 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 18:20:17.451661 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449282 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 18:20:17.451661 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449284 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 18:20:17.451661 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449287 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 18:20:17.451661 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449289 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 18:20:17.451661 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449291 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 18:20:17.451661 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449294 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 18:20:17.451661 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449296 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 18:20:17.452165 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449299 2575 feature_gate.go:328] unrecognized feature gate: Example May 21 18:20:17.452165 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449302 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 18:20:17.452165 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449304 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 18:20:17.452165 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449307 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 18:20:17.452165 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449309 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 18:20:17.452165 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449312 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 18:20:17.452165 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449314 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 18:20:17.452165 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449318 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 18:20:17.452165 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449322 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 18:20:17.452165 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449326 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 18:20:17.452165 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449329 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 18:20:17.452165 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449332 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 18:20:17.452165 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449334 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 18:20:17.452165 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449337 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 18:20:17.452165 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449340 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 18:20:17.452165 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449342 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 18:20:17.452165 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449344 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 18:20:17.452165 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449347 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 18:20:17.452165 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449349 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 18:20:17.452629 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449352 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 18:20:17.452629 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449356 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 18:20:17.452629 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449359 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 18:20:17.452629 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449361 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 18:20:17.452629 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449364 2575 feature_gate.go:328] unrecognized feature gate: Example2 May 21 18:20:17.452629 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449366 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 18:20:17.452629 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449370 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 18:20:17.452629 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449372 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 18:20:17.452629 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449375 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 18:20:17.452629 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449378 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 18:20:17.452629 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449380 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 18:20:17.452629 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449383 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 18:20:17.452629 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.449385 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 18:20:17.452629 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.449462 2575 flags.go:64] FLAG: --address="0.0.0.0" May 21 18:20:17.452629 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.449470 2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 21 18:20:17.452629 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.449476 2575 flags.go:64] FLAG: --anonymous-auth="true" May 21 18:20:17.452629 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.449481 2575 flags.go:64] FLAG: --application-metrics-count-limit="100" May 21 18:20:17.452629 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.449485 2575 flags.go:64] FLAG: --authentication-token-webhook="false" May 21 18:20:17.452629 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.449489 2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 21 18:20:17.452629 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.449494 2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 21 18:20:17.452629 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.449499 2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 21 18:20:17.453158 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.449503 2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 21 18:20:17.453158 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.449506 2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 21 18:20:17.453158 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.449509 2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 21 18:20:17.453158 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.449513 2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 21 18:20:17.453158 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.449516 2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 21 18:20:17.453158 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.449519 2575 flags.go:64] FLAG: --cgroup-root="" May 21 18:20:17.453158 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.449522 2575 flags.go:64] FLAG: --cgroups-per-qos="true" May 21 18:20:17.453158 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.449525 2575 flags.go:64] FLAG: --client-ca-file="" May 21 18:20:17.453158 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.449528 2575 flags.go:64] FLAG: --cloud-config="" May 21 18:20:17.453158 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.449531 2575 flags.go:64] FLAG: --cloud-provider="external" May 21 18:20:17.453158 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.449534 2575 flags.go:64] FLAG: --cluster-dns="[]" May 21 18:20:17.453158 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450077 2575 flags.go:64] FLAG: --cluster-domain="" May 21 18:20:17.453158 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450081 2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 21 18:20:17.453158 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450084 2575 flags.go:64] FLAG: --config-dir="" May 21 18:20:17.453158 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450088 2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 21 18:20:17.453158 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450091 2575 flags.go:64] FLAG: --container-log-max-files="5" May 21 18:20:17.453158 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450096 2575 flags.go:64] FLAG: --container-log-max-size="10Mi" May 21 18:20:17.453158 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450099 2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 21 18:20:17.453158 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450102 2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 21 18:20:17.453158 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450106 2575 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 21 18:20:17.453158 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450109 2575 flags.go:64] FLAG: --contention-profiling="false" May 21 18:20:17.453158 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450112 2575 flags.go:64] FLAG: --cpu-cfs-quota="true" May 21 18:20:17.453158 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450115 2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 21 18:20:17.453158 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450118 2575 flags.go:64] FLAG: --cpu-manager-policy="none" May 21 18:20:17.453158 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450121 2575 flags.go:64] FLAG: --cpu-manager-policy-options="" May 21 18:20:17.453778 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450125 2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 21 18:20:17.453778 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450133 2575 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 21 18:20:17.453778 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450136 2575 flags.go:64] FLAG: --enable-debugging-handlers="true" May 21 18:20:17.453778 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450139 2575 flags.go:64] FLAG: --enable-load-reader="false" May 21 18:20:17.453778 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450142 2575 flags.go:64] FLAG: --enable-server="true" May 21 18:20:17.453778 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450146 2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 21 18:20:17.453778 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450151 2575 flags.go:64] FLAG: --event-burst="100" May 21 18:20:17.453778 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450154 2575 flags.go:64] FLAG: --event-qps="50" May 21 18:20:17.453778 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450157 2575 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 21 18:20:17.453778 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450161 2575 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 21 18:20:17.453778 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450164 2575 flags.go:64] FLAG: --eviction-hard="" May 21 18:20:17.453778 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450168 2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 21 18:20:17.453778 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450171 2575 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 21 18:20:17.453778 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450174 2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 21 18:20:17.453778 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450183 2575 flags.go:64] FLAG: --eviction-soft="" May 21 18:20:17.453778 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450187 2575 flags.go:64] FLAG: --eviction-soft-grace-period="" May 21 18:20:17.453778 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450190 2575 flags.go:64] FLAG: --exit-on-lock-contention="false" May 21 18:20:17.453778 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450194 2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 21 18:20:17.453778 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450196 2575 flags.go:64] FLAG: --experimental-mounter-path="" May 21 18:20:17.453778 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450199 2575 flags.go:64] FLAG: --fail-cgroupv1="false" May 21 18:20:17.453778 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450202 2575 flags.go:64] FLAG: --fail-swap-on="true" May 21 18:20:17.453778 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450205 2575 flags.go:64] FLAG: --feature-gates="" May 21 18:20:17.453778 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450209 2575 flags.go:64] FLAG: --file-check-frequency="20s" May 21 18:20:17.453778 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450212 2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 21 18:20:17.453778 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450216 2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 21 18:20:17.454403 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450219 2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 21 18:20:17.454403 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450222 2575 flags.go:64] FLAG: --healthz-port="10248" May 21 18:20:17.454403 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450225 2575 flags.go:64] FLAG: --help="false" May 21 18:20:17.454403 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450228 2575 flags.go:64] FLAG: --hostname-override="ip-10-0-142-242.ec2.internal" May 21 18:20:17.454403 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450231 2575 flags.go:64] FLAG: --housekeeping-interval="10s" May 21 18:20:17.454403 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450234 2575 flags.go:64] FLAG: --http-check-frequency="20s" May 21 18:20:17.454403 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450237 2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 21 18:20:17.454403 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450240 2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 21 18:20:17.454403 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450244 2575 flags.go:64] FLAG: --image-gc-high-threshold="85" May 21 18:20:17.454403 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450248 2575 flags.go:64] FLAG: --image-gc-low-threshold="80" May 21 18:20:17.454403 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450251 2575 flags.go:64] FLAG: --image-service-endpoint="" May 21 18:20:17.454403 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450253 2575 flags.go:64] FLAG: --kernel-memcg-notification="false" May 21 18:20:17.454403 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450257 2575 flags.go:64] FLAG: --kube-api-burst="100" May 21 18:20:17.454403 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450260 2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 21 18:20:17.454403 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450263 2575 flags.go:64] FLAG: --kube-api-qps="50" May 21 18:20:17.454403 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450266 2575 flags.go:64] FLAG: --kube-reserved="" May 21 18:20:17.454403 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450269 2575 flags.go:64] FLAG: --kube-reserved-cgroup="" May 21 18:20:17.454403 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450272 2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 21 18:20:17.454403 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450275 2575 flags.go:64] FLAG: --kubelet-cgroups="" May 21 18:20:17.454403 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450278 2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 21 18:20:17.454403 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450281 2575 flags.go:64] FLAG: --lock-file="" May 21 18:20:17.454403 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450284 2575 flags.go:64] FLAG: --log-cadvisor-usage="false" May 21 18:20:17.454403 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450287 2575 flags.go:64] FLAG: --log-flush-frequency="5s" May 21 18:20:17.454403 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450289 2575 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 21 18:20:17.455024 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450295 2575 flags.go:64] FLAG: --log-json-split-stream="false" May 21 18:20:17.455024 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450298 2575 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 21 18:20:17.455024 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450301 2575 flags.go:64] FLAG: --log-text-split-stream="false" May 21 18:20:17.455024 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450303 2575 flags.go:64] FLAG: --logging-format="text" May 21 18:20:17.455024 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450306 2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 21 18:20:17.455024 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450310 2575 flags.go:64] FLAG: --make-iptables-util-chains="true" May 21 18:20:17.455024 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450313 2575 flags.go:64] FLAG: --manifest-url="" May 21 18:20:17.455024 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450315 2575 flags.go:64] FLAG: --manifest-url-header="" May 21 18:20:17.455024 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450320 2575 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 21 18:20:17.455024 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450323 2575 flags.go:64] FLAG: --max-open-files="1000000" May 21 18:20:17.455024 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450330 2575 flags.go:64] FLAG: --max-pods="110" May 21 18:20:17.455024 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450333 2575 flags.go:64] FLAG: --maximum-dead-containers="-1" May 21 18:20:17.455024 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450336 2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 21 18:20:17.455024 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450339 2575 flags.go:64] FLAG: --memory-manager-policy="None" May 21 18:20:17.455024 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450342 2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 21 18:20:17.455024 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450345 2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 21 18:20:17.455024 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450352 2575 flags.go:64] FLAG: --node-ip="0.0.0.0" May 21 18:20:17.455024 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450355 2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 21 18:20:17.455024 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450364 2575 flags.go:64] FLAG: --node-status-max-images="50" May 21 18:20:17.455024 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450367 2575 flags.go:64] FLAG: --node-status-update-frequency="10s" May 21 18:20:17.455024 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450370 2575 flags.go:64] FLAG: --oom-score-adj="-999" May 21 18:20:17.455024 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450373 2575 flags.go:64] FLAG: --pod-cidr="" May 21 18:20:17.455024 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450376 2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 21 18:20:17.455583 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450381 2575 flags.go:64] FLAG: --pod-manifest-path="" May 21 18:20:17.455583 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450385 2575 flags.go:64] FLAG: --pod-max-pids="-1" May 21 18:20:17.455583 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450388 2575 flags.go:64] FLAG: --pods-per-core="0" May 21 18:20:17.455583 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450391 2575 flags.go:64] FLAG: --port="10250" May 21 18:20:17.455583 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450394 2575 flags.go:64] FLAG: --protect-kernel-defaults="false" May 21 18:20:17.455583 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450397 2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-034d6bc690b68ed48" May 21 18:20:17.455583 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450400 2575 flags.go:64] FLAG: --qos-reserved="" May 21 18:20:17.455583 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450403 2575 flags.go:64] FLAG: --read-only-port="10255" May 21 18:20:17.455583 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450406 2575 flags.go:64] FLAG: --register-node="true" May 21 18:20:17.455583 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450409 2575 flags.go:64] FLAG: --register-schedulable="true" May 21 18:20:17.455583 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450412 2575 flags.go:64] FLAG: --register-with-taints="" May 21 18:20:17.455583 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450415 2575 flags.go:64] FLAG: --registry-burst="10" May 21 18:20:17.455583 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450418 2575 flags.go:64] FLAG: --registry-qps="5" May 21 18:20:17.455583 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450421 2575 flags.go:64] FLAG: --reserved-cpus="" May 21 18:20:17.455583 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450424 2575 flags.go:64] FLAG: --reserved-memory="" May 21 18:20:17.455583 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450428 2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 21 18:20:17.455583 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450431 2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 21 18:20:17.455583 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450434 2575 flags.go:64] FLAG: --rotate-certificates="false" May 21 18:20:17.455583 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450437 2575 flags.go:64] FLAG: --rotate-server-certificates="false" May 21 18:20:17.455583 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450440 2575 flags.go:64] FLAG: --runonce="false" May 21 18:20:17.455583 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450442 2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 21 18:20:17.455583 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450446 2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 21 18:20:17.455583 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450449 2575 flags.go:64] FLAG: --seccomp-default="false" May 21 18:20:17.455583 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450452 2575 flags.go:64] FLAG: --serialize-image-pulls="true" May 21 18:20:17.455583 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450454 2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 21 18:20:17.455583 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450457 2575 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 21 18:20:17.456246 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450462 2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 21 18:20:17.456246 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450466 2575 flags.go:64] FLAG: --storage-driver-password="root" May 21 18:20:17.456246 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450469 2575 flags.go:64] FLAG: --storage-driver-secure="false" May 21 18:20:17.456246 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450472 2575 flags.go:64] FLAG: --storage-driver-table="stats" May 21 18:20:17.456246 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450475 2575 flags.go:64] FLAG: --storage-driver-user="root" May 21 18:20:17.456246 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450478 2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 21 18:20:17.456246 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450481 2575 flags.go:64] FLAG: --sync-frequency="1m0s" May 21 18:20:17.456246 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450484 2575 flags.go:64] FLAG: --system-cgroups="" May 21 18:20:17.456246 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450487 2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 21 18:20:17.456246 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450492 2575 flags.go:64] FLAG: --system-reserved-cgroup="" May 21 18:20:17.456246 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450495 2575 flags.go:64] FLAG: --tls-cert-file="" May 21 18:20:17.456246 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450498 2575 flags.go:64] FLAG: --tls-cipher-suites="[]" May 21 18:20:17.456246 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450502 2575 flags.go:64] FLAG: --tls-min-version="" May 21 18:20:17.456246 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450505 2575 flags.go:64] FLAG: --tls-private-key-file="" May 21 18:20:17.456246 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450508 2575 flags.go:64] FLAG: --topology-manager-policy="none" May 21 18:20:17.456246 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450511 2575 flags.go:64] FLAG: --topology-manager-policy-options="" May 21 18:20:17.456246 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450514 2575 flags.go:64] FLAG: --topology-manager-scope="container" May 21 18:20:17.456246 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450517 2575 flags.go:64] FLAG: --v="2" May 21 18:20:17.456246 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450521 2575 flags.go:64] FLAG: --version="false" May 21 18:20:17.456246 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450525 2575 flags.go:64] FLAG: --vmodule="" May 21 18:20:17.456246 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450529 2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 21 18:20:17.456246 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.450532 2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 21 18:20:17.456246 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450631 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 18:20:17.456246 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450636 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 18:20:17.456865 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450639 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 18:20:17.456865 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450644 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 18:20:17.456865 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450647 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 18:20:17.456865 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450650 2575 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 18:20:17.456865 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450653 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 18:20:17.456865 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450656 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 18:20:17.456865 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450659 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 18:20:17.456865 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450662 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 18:20:17.456865 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450666 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 18:20:17.456865 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450668 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 18:20:17.456865 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450671 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 18:20:17.456865 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450674 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 18:20:17.456865 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450677 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 18:20:17.456865 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450680 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 18:20:17.456865 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450682 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 18:20:17.456865 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450685 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 18:20:17.456865 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450688 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 18:20:17.456865 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450690 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 18:20:17.456865 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450693 2575 feature_gate.go:328] unrecognized feature gate: Example2 May 21 18:20:17.456865 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450695 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 18:20:17.457382 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450711 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 18:20:17.457382 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450715 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 18:20:17.457382 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450719 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 18:20:17.457382 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450722 2575 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 18:20:17.457382 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450726 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 18:20:17.457382 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450730 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 18:20:17.457382 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450733 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 18:20:17.457382 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450736 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 18:20:17.457382 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450738 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 18:20:17.457382 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450741 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 18:20:17.457382 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450744 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 18:20:17.457382 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450747 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 18:20:17.457382 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450750 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 18:20:17.457382 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450752 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 18:20:17.457382 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450755 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 18:20:17.457382 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450757 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 18:20:17.457382 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450761 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 18:20:17.457382 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450763 2575 feature_gate.go:328] unrecognized feature gate: Example May 21 18:20:17.457382 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450766 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 18:20:17.457382 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450770 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 18:20:17.457905 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450775 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 18:20:17.457905 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450779 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 18:20:17.457905 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450782 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 18:20:17.457905 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450784 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 18:20:17.457905 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450788 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 18:20:17.457905 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450790 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 18:20:17.457905 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450793 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 18:20:17.457905 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450796 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 18:20:17.457905 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450798 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 18:20:17.457905 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450801 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 18:20:17.457905 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450804 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 18:20:17.457905 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450807 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 18:20:17.457905 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450809 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 18:20:17.457905 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450812 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 18:20:17.457905 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450815 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 18:20:17.457905 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450817 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 18:20:17.457905 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450820 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 18:20:17.457905 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450822 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 18:20:17.457905 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450825 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 18:20:17.458383 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450827 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 18:20:17.458383 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450830 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 18:20:17.458383 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450833 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 18:20:17.458383 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450835 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 18:20:17.458383 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450838 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 18:20:17.458383 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450840 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 18:20:17.458383 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450843 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 18:20:17.458383 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450845 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 18:20:17.458383 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450848 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 18:20:17.458383 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450850 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 18:20:17.458383 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450853 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 18:20:17.458383 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450856 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 18:20:17.458383 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450859 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 18:20:17.458383 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450863 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 18:20:17.458383 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450866 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 18:20:17.458383 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450868 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 18:20:17.458383 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450871 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 18:20:17.458383 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450873 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 18:20:17.458383 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450877 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 18:20:17.458861 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450879 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 18:20:17.458861 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450882 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 18:20:17.458861 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450884 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 18:20:17.458861 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450887 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 18:20:17.458861 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450889 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 18:20:17.458861 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.450892 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 18:20:17.458861 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.451500 2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 18:20:17.458861 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.458046 2575 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 21 18:20:17.458861 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.458062 2575 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 21 18:20:17.458861 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458113 2575 feature_gate.go:328] unrecognized feature gate: Example2 May 21 18:20:17.458861 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458118 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 18:20:17.458861 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458121 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 18:20:17.458861 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458124 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 18:20:17.458861 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458127 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 18:20:17.458861 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458131 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 18:20:17.459245 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458134 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 18:20:17.459245 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458137 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 18:20:17.459245 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458140 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 18:20:17.459245 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458143 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 18:20:17.459245 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458145 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 18:20:17.459245 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458148 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 18:20:17.459245 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458151 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 18:20:17.459245 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458154 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 18:20:17.459245 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458157 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 18:20:17.459245 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458160 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 18:20:17.459245 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458163 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 18:20:17.459245 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458165 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 18:20:17.459245 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458169 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 18:20:17.459245 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458180 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 18:20:17.459245 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458183 2575 feature_gate.go:328] unrecognized feature gate: Example May 21 18:20:17.459245 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458186 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 18:20:17.459245 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458189 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 18:20:17.459245 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458191 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 18:20:17.459245 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458194 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 18:20:17.459245 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458197 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 18:20:17.459778 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458199 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 18:20:17.459778 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458202 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 18:20:17.459778 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458205 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 18:20:17.459778 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458207 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 18:20:17.459778 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458210 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 18:20:17.459778 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458215 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 18:20:17.459778 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458218 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 18:20:17.459778 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458221 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 18:20:17.459778 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458224 2575 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 18:20:17.459778 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458226 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 18:20:17.459778 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458229 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 18:20:17.459778 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458231 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 18:20:17.459778 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458234 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 18:20:17.459778 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458237 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 18:20:17.459778 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458241 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 18:20:17.459778 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458245 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 18:20:17.459778 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458248 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 18:20:17.459778 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458251 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 18:20:17.459778 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458253 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 18:20:17.460247 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458256 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 18:20:17.460247 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458259 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 18:20:17.460247 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458262 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 18:20:17.460247 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458265 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 18:20:17.460247 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458268 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 18:20:17.460247 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458271 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 18:20:17.460247 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458274 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 18:20:17.460247 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458276 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 18:20:17.460247 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458279 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 18:20:17.460247 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458281 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 18:20:17.460247 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458284 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 18:20:17.460247 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458286 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 18:20:17.460247 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458289 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 18:20:17.460247 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458291 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 18:20:17.460247 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458294 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 18:20:17.460247 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458296 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 18:20:17.460247 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458299 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 18:20:17.460247 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458301 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 18:20:17.460247 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458305 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 18:20:17.460721 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458308 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 18:20:17.460721 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458311 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 18:20:17.460721 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458313 2575 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 18:20:17.460721 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458316 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 18:20:17.460721 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458319 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 18:20:17.460721 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458321 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 18:20:17.460721 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458324 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 18:20:17.460721 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458326 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 18:20:17.460721 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458329 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 18:20:17.460721 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458332 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 18:20:17.460721 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458334 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 18:20:17.460721 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458337 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 18:20:17.460721 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458339 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 18:20:17.460721 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458342 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 18:20:17.460721 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458344 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 18:20:17.460721 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458347 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 18:20:17.460721 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458349 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 18:20:17.460721 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458352 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 18:20:17.460721 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458356 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 18:20:17.460721 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458360 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 18:20:17.461227 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458362 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 18:20:17.461227 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458365 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 18:20:17.461227 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.458370 2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 18:20:17.461227 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458497 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 18:20:17.461227 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458503 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 18:20:17.461227 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458506 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 18:20:17.461227 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458509 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 18:20:17.461227 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458511 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 18:20:17.461227 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458514 2575 feature_gate.go:328] unrecognized feature gate: Example May 21 18:20:17.461227 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458517 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 18:20:17.461227 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458519 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 18:20:17.461227 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458522 2575 feature_gate.go:328] unrecognized feature gate: Example2 May 21 18:20:17.461227 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458525 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 18:20:17.461227 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458528 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 18:20:17.461227 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458531 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 18:20:17.461227 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458533 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 18:20:17.461627 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458536 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 18:20:17.461627 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458538 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 18:20:17.461627 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458540 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 18:20:17.461627 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458543 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 18:20:17.461627 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458546 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 18:20:17.461627 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458549 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 18:20:17.461627 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458551 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 18:20:17.461627 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458554 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 18:20:17.461627 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458556 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 18:20:17.461627 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458560 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 18:20:17.461627 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458562 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 18:20:17.461627 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458565 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 18:20:17.461627 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458567 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 18:20:17.461627 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458570 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 18:20:17.461627 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458573 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 18:20:17.461627 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458575 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 18:20:17.461627 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458578 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 18:20:17.461627 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458580 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 18:20:17.461627 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458583 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 18:20:17.461627 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458585 2575 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 18:20:17.462279 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458588 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 18:20:17.462279 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458590 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 18:20:17.462279 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458593 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 18:20:17.462279 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458595 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 18:20:17.462279 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458597 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 18:20:17.462279 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458600 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 18:20:17.462279 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458603 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 18:20:17.462279 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458606 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 18:20:17.462279 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458608 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 18:20:17.462279 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458611 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 18:20:17.462279 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458614 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 18:20:17.462279 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458617 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 18:20:17.462279 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458619 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 18:20:17.462279 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458622 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 18:20:17.462279 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458624 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 18:20:17.462279 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458627 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 18:20:17.462279 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458630 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 18:20:17.462279 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458632 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 18:20:17.462279 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458635 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 18:20:17.462279 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458637 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 18:20:17.462798 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458640 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 18:20:17.462798 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458643 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 18:20:17.462798 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458646 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 18:20:17.462798 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458648 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 18:20:17.462798 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458651 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 18:20:17.462798 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458655 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 18:20:17.462798 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458658 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 18:20:17.462798 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458662 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 18:20:17.462798 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458665 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 18:20:17.462798 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458667 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 18:20:17.462798 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458670 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 18:20:17.462798 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458673 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 18:20:17.462798 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458676 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 18:20:17.462798 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458678 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 18:20:17.462798 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458681 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 18:20:17.462798 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458684 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 18:20:17.462798 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458688 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 18:20:17.462798 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458691 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 18:20:17.463276 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458693 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 18:20:17.463276 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458710 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 18:20:17.463276 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458714 2575 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 18:20:17.463276 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458717 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 18:20:17.463276 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458719 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 18:20:17.463276 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458723 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 18:20:17.463276 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458725 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 18:20:17.463276 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458728 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 18:20:17.463276 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458731 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 18:20:17.463276 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458734 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 18:20:17.463276 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458736 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 18:20:17.463276 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458739 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 18:20:17.463276 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458741 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 18:20:17.463276 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458744 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 18:20:17.463276 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:17.458746 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 18:20:17.463276 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.458752 2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 18:20:17.463665 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.459470 2575 server.go:962] "Client rotation is on, will bootstrap in background" May 21 18:20:17.463696 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.463688 2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 21 18:20:17.464610 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.464598 2575 server.go:1019] "Starting client certificate rotation" May 21 18:20:17.464733 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.464715 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 18:20:17.464770 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.464754 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 18:20:17.485543 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.485517 2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 18:20:17.487313 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.487226 2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 18:20:17.504692 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.504671 2575 log.go:25] "Validated CRI v1 runtime API" May 21 18:20:17.509457 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.509440 2575 log.go:25] "Validated CRI v1 image API" May 21 18:20:17.510534 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.510520 2575 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 21 18:20:17.518232 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.518178 2575 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8cdaa596-dc35-423f-a285-b642ea741292:/dev/nvme0n1p4 b1dea369-94c1-41c6-bd45-93a8d14b4d97:/dev/nvme0n1p3] May 21 18:20:17.518294 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.518233 2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 21 18:20:17.523422 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.523310 2575 manager.go:217] Machine: {Timestamp:2026-05-21 18:20:17.522816096 +0000 UTC m=+0.395034984 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3112503 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ab6be9a81e8798b1168b48ffdbcce SystemUUID:ec2ab6be-9a81-e879-8b11-68b48ffdbcce BootID:c192c627-5657-4056-881e-ab9ae1ede753 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a3:4c:96:2d:e5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a3:4c:96:2d:e5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ba:28:70:8f:50:1a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 21 18:20:17.524103 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.524092 2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 21 18:20:17.524226 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.524214 2575 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 21 18:20:17.526276 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.526248 2575 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 21 18:20:17.526453 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.526276 2575 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-242.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 21 18:20:17.526526 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.526467 2575 topology_manager.go:138] "Creating topology manager with none policy" May 21 18:20:17.526526 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.526475 2575 container_manager_linux.go:306] "Creating device plugin manager" May 21 18:20:17.526526 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.526482 2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 18:20:17.527277 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.527263 2575 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 18:20:17.528579 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.528569 2575 state_mem.go:36] "Initialized new in-memory state store" May 21 18:20:17.528872 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.528862 2575 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 21 18:20:17.531676 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.531666 2575 kubelet.go:491] "Attempting to sync node with API server" May 21 18:20:17.531735 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.531682 2575 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 21 18:20:17.531735 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.531693 2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 21 18:20:17.531735 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.531717 2575 kubelet.go:397] "Adding apiserver pod source" May 21 18:20:17.531735 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.531728 2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 21 18:20:17.532852 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.532840 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 18:20:17.532900 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.532869 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 18:20:17.536362 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.536331 2575 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 21 18:20:17.537906 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.537892 2575 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 21 18:20:17.538212 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.538196 2575 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 18:20:17.540194 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.540154 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 21 18:20:17.540194 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.540194 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 21 18:20:17.540352 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.540204 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 21 18:20:17.540352 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.540213 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 21 18:20:17.540352 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.540226 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 21 18:20:17.540352 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.540244 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 21 18:20:17.540352 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.540252 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 21 18:20:17.540352 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.540260 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 21 18:20:17.540352 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.540271 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 21 18:20:17.540352 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.540279 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 21 18:20:17.540352 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.540292 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 21 18:20:17.540352 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.540301 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 21 18:20:17.541118 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.541102 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 21 18:20:17.541176 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.541136 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 21 18:20:17.543356 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:17.543330 2575 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-242.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 21 18:20:17.544432 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.544414 2575 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 21 18:20:17.544514 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.544496 2575 server.go:1295] "Started kubelet" May 21 18:20:17.545217 ip-10-0-142-242 systemd[1]: Started Kubernetes Kubelet. May 21 18:20:17.550655 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.550423 2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 21 18:20:17.562464 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:17.550724 2575 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 21 18:20:17.562464 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.550409 2575 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 21 18:20:17.562464 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.550847 2575 server_v1.go:47] "podresources" method="list" useActivePods=true May 21 18:20:17.563767 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.563751 2575 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 21 18:20:17.565950 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.565935 2575 server.go:317] "Adding debug handlers to kubelet server" May 21 18:20:17.566039 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:17.565975 2575 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 21 18:20:17.567855 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.567841 2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 21 18:20:17.567923 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.567856 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 21 18:20:17.567988 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.567932 2575 volume_manager.go:295] "The desired_state_of_world populator starts" May 21 18:20:17.567988 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.567948 2575 volume_manager.go:297] "Starting Kubelet Volume Manager" May 21 18:20:17.568097 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.568081 2575 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 21 18:20:17.568175 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.568159 2575 reconstruct.go:97] "Volume reconstruction finished" May 21 18:20:17.568175 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.568174 2575 reconciler.go:26] "Reconciler: start to sync state" May 21 18:20:17.568784 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.568770 2575 factory.go:153] Registering CRI-O factory May 21 18:20:17.568883 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.568872 2575 factory.go:223] Registration of the crio container factory successfully May 21 18:20:17.569020 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.569000 2575 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-242.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 21 18:20:17.569080 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:17.568873 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-242.ec2.internal\" not found" May 21 18:20:17.569179 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.569159 2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 21 18:20:17.569179 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.569181 2575 factory.go:55] Registering systemd factory May 21 18:20:17.569327 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.569190 2575 factory.go:223] Registration of the systemd container factory successfully May 21 18:20:17.569327 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.569208 2575 factory.go:103] Registering Raw factory May 21 18:20:17.569327 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.569222 2575 manager.go:1196] Started watching for new ooms in manager May 21 18:20:17.569773 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.569758 2575 manager.go:319] Starting recovery of all containers May 21 18:20:17.570044 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:17.568807 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-242.ec2.internal.18b1a79c4d76e07b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-242.ec2.internal,UID:ip-10-0-142-242.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-242.ec2.internal,},FirstTimestamp:2026-05-21 18:20:17.544429691 +0000 UTC m=+0.416648584,LastTimestamp:2026-05-21 18:20:17.544429691 +0000 UTC m=+0.416648584,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-242.ec2.internal,}" May 21 18:20:17.580718 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:17.580674 2575 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 21 18:20:17.580968 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:17.580930 2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-242.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" May 21 18:20:17.581172 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.581157 2575 manager.go:324] Recovery completed May 21 18:20:17.586261 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.586245 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 18:20:17.587107 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.587090 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rlxb6" May 21 18:20:17.588217 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.588204 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasSufficientMemory" May 21 18:20:17.588271 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.588231 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasNoDiskPressure" May 21 18:20:17.588271 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.588240 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasSufficientPID" May 21 18:20:17.588839 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.588822 2575 cpu_manager.go:222] "Starting CPU manager" policy="none" May 21 18:20:17.588839 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.588834 2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 21 18:20:17.588962 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.588850 2575 state_mem.go:36] "Initialized new in-memory state store" May 21 18:20:17.590398 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:17.590331 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-242.ec2.internal.18b1a79c50130913 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-242.ec2.internal,UID:ip-10-0-142-242.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-242.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-242.ec2.internal,},FirstTimestamp:2026-05-21 18:20:17.588218131 +0000 UTC m=+0.460437020,LastTimestamp:2026-05-21 18:20:17.588218131 +0000 UTC m=+0.460437020,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-242.ec2.internal,}" May 21 18:20:17.591206 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.591192 2575 policy_none.go:49] "None policy: Start" May 21 18:20:17.591278 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.591210 2575 memory_manager.go:186] "Starting memorymanager" policy="None" May 21 18:20:17.591278 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.591221 2575 state_mem.go:35] "Initializing new in-memory state store" May 21 18:20:17.594941 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.594925 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rlxb6" May 21 18:20:17.623357 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.623340 2575 manager.go:341] "Starting Device Plugin manager" May 21 18:20:17.629384 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:17.623453 2575 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 21 18:20:17.629384 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.623467 2575 server.go:85] "Starting device plugin registration server" May 21 18:20:17.629384 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.623727 2575 eviction_manager.go:189] "Eviction manager: starting control loop" May 21 18:20:17.629384 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.623738 2575 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 21 18:20:17.629384 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.623817 2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 21 18:20:17.629384 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.623896 2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 21 18:20:17.629384 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.623905 2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 21 18:20:17.629384 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:17.624386 2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 21 18:20:17.629384 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:17.624419 2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-242.ec2.internal\" not found" May 21 18:20:17.691199 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.691158 2575 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 21 18:20:17.692473 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.692413 2575 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 21 18:20:17.692473 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.692436 2575 status_manager.go:230] "Starting to sync pod status with apiserver" May 21 18:20:17.692473 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.692457 2575 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 21 18:20:17.692473 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.692466 2575 kubelet.go:2451] "Starting kubelet main sync loop" May 21 18:20:17.692676 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:17.692514 2575 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 21 18:20:17.694567 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.694544 2575 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 18:20:17.724580 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.724545 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 18:20:17.725474 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.725456 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasSufficientMemory" May 21 18:20:17.725595 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.725491 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasNoDiskPressure" May 21 18:20:17.725595 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.725507 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasSufficientPID" May 21 18:20:17.725595 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.725536 2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-242.ec2.internal" May 21 18:20:17.733974 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.733959 2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-242.ec2.internal" May 21 18:20:17.734034 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:17.733982 2575 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-242.ec2.internal\": node \"ip-10-0-142-242.ec2.internal\" not found" May 21 18:20:17.752880 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:17.752853 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-242.ec2.internal\" not found" May 21 18:20:17.792658 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.792633 2575 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-242.ec2.internal"] May 21 18:20:17.792771 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.792716 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 18:20:17.794513 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.794494 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasSufficientMemory" May 21 18:20:17.794595 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.794540 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasNoDiskPressure" May 21 18:20:17.794595 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.794554 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasSufficientPID" May 21 18:20:17.795636 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.795624 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 18:20:17.795820 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.795806 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal" May 21 18:20:17.795864 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.795837 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 18:20:17.796409 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.796392 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasSufficientMemory" May 21 18:20:17.796486 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.796421 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasNoDiskPressure" May 21 18:20:17.796486 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.796435 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasSufficientPID" May 21 18:20:17.796486 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.796426 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasSufficientMemory" May 21 18:20:17.796486 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.796462 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasNoDiskPressure" May 21 18:20:17.796486 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.796472 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasSufficientPID" May 21 18:20:17.797761 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.797748 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-242.ec2.internal" May 21 18:20:17.797816 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.797784 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 18:20:17.798423 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.798409 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasSufficientMemory" May 21 18:20:17.798492 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.798438 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasNoDiskPressure" May 21 18:20:17.798492 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.798450 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasSufficientPID" May 21 18:20:17.818490 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:17.818467 2575 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-242.ec2.internal\" not found" node="ip-10-0-142-242.ec2.internal" May 21 18:20:17.822988 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:17.822972 2575 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-242.ec2.internal\" not found" node="ip-10-0-142-242.ec2.internal" May 21 18:20:17.853070 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:17.853034 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-242.ec2.internal\" not found" May 21 18:20:17.870975 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.870948 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/df398a303bb444f283f55f92aa86b2c1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal\" (UID: \"df398a303bb444f283f55f92aa86b2c1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal" May 21 18:20:17.871055 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.870979 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2c23003bb529fbcd873744269cc9dc4a-config\") pod \"kube-apiserver-proxy-ip-10-0-142-242.ec2.internal\" (UID: \"2c23003bb529fbcd873744269cc9dc4a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-242.ec2.internal" May 21 18:20:17.871055 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.870999 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/df398a303bb444f283f55f92aa86b2c1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal\" (UID: \"df398a303bb444f283f55f92aa86b2c1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal" May 21 18:20:17.954147 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:17.954075 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-242.ec2.internal\" not found" May 21 18:20:17.971469 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.971442 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/df398a303bb444f283f55f92aa86b2c1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal\" (UID: \"df398a303bb444f283f55f92aa86b2c1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal" May 21 18:20:17.971545 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.971475 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/df398a303bb444f283f55f92aa86b2c1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal\" (UID: \"df398a303bb444f283f55f92aa86b2c1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal" May 21 18:20:17.971545 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.971494 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2c23003bb529fbcd873744269cc9dc4a-config\") pod \"kube-apiserver-proxy-ip-10-0-142-242.ec2.internal\" (UID: \"2c23003bb529fbcd873744269cc9dc4a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-242.ec2.internal" May 21 18:20:17.971606 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.971546 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/df398a303bb444f283f55f92aa86b2c1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal\" (UID: \"df398a303bb444f283f55f92aa86b2c1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal" May 21 18:20:17.971606 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.971565 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2c23003bb529fbcd873744269cc9dc4a-config\") pod \"kube-apiserver-proxy-ip-10-0-142-242.ec2.internal\" (UID: \"2c23003bb529fbcd873744269cc9dc4a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-242.ec2.internal" May 21 18:20:17.971606 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:17.971546 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/df398a303bb444f283f55f92aa86b2c1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal\" (UID: \"df398a303bb444f283f55f92aa86b2c1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal" May 21 18:20:18.054806 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:18.054761 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-242.ec2.internal\" not found" May 21 18:20:18.121261 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:18.121219 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal" May 21 18:20:18.125765 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:18.125748 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-242.ec2.internal" May 21 18:20:18.155272 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:18.155236 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-242.ec2.internal\" not found" May 21 18:20:18.255852 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:18.255764 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-242.ec2.internal\" not found" May 21 18:20:18.356310 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:18.356281 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-242.ec2.internal\" not found" May 21 18:20:18.456830 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:18.456793 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-242.ec2.internal\" not found" May 21 18:20:18.464990 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:18.464967 2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 21 18:20:18.465147 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:18.465121 2575 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 18:20:18.557975 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:18.557896 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-242.ec2.internal\" not found" May 21 18:20:18.568026 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:18.567999 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 21 18:20:18.587507 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:18.587482 2575 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 18:20:18.592746 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:18.592686 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c23003bb529fbcd873744269cc9dc4a.slice/crio-51cf00f4ab02d5403fe8c5ee053250158816e1fee100536d85853b692db5d153 WatchSource:0}: Error finding container 51cf00f4ab02d5403fe8c5ee053250158816e1fee100536d85853b692db5d153: Status 404 returned error can't find the container with id 51cf00f4ab02d5403fe8c5ee053250158816e1fee100536d85853b692db5d153 May 21 18:20:18.592991 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:18.592969 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf398a303bb444f283f55f92aa86b2c1.slice/crio-a079a0fc0c3298140c0f12ac56aa4902cd6db726fc8f05c15b1be219b92ef2f5 WatchSource:0}: Error finding container a079a0fc0c3298140c0f12ac56aa4902cd6db726fc8f05c15b1be219b92ef2f5: Status 404 returned error can't find the container with id a079a0fc0c3298140c0f12ac56aa4902cd6db726fc8f05c15b1be219b92ef2f5 May 21 18:20:18.596500 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:18.596461 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 18:15:17 +0000 UTC" deadline="2027-12-05 19:29:32.791178878 +0000 UTC" May 21 18:20:18.596564 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:18.596501 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13513h9m14.194681117s" May 21 18:20:18.596564 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:18.596509 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 18:20:18.609797 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:18.609778 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-v48pk" May 21 18:20:18.617493 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:18.617473 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-v48pk" May 21 18:20:18.658139 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:18.658109 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-242.ec2.internal\" not found" May 21 18:20:18.697555 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:18.697495 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal" event={"ID":"df398a303bb444f283f55f92aa86b2c1","Type":"ContainerStarted","Data":"a079a0fc0c3298140c0f12ac56aa4902cd6db726fc8f05c15b1be219b92ef2f5"} May 21 18:20:18.698445 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:18.698424 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-242.ec2.internal" event={"ID":"2c23003bb529fbcd873744269cc9dc4a","Type":"ContainerStarted","Data":"51cf00f4ab02d5403fe8c5ee053250158816e1fee100536d85853b692db5d153"} May 21 18:20:18.758656 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:18.758620 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-242.ec2.internal\" not found" May 21 18:20:18.859219 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:18.859133 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-242.ec2.internal\" not found" May 21 18:20:18.890038 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:18.890008 2575 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 18:20:18.959303 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:18.959263 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-242.ec2.internal\" not found" May 21 18:20:18.969239 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:18.969214 2575 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 21 18:20:19.068102 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.068072 2575 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal" May 21 18:20:19.082078 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.082043 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 18:20:19.083867 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.083831 2575 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-242.ec2.internal" May 21 18:20:19.092647 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.092617 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 18:20:19.118655 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.118565 2575 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 21 18:20:19.533144 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.533079 2575 apiserver.go:52] "Watching apiserver" May 21 18:20:19.539989 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.539962 2575 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 21 18:20:19.540372 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.540347 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-wdw4s","openshift-multus/multus-4zq8z","openshift-multus/multus-additional-cni-plugins-t6hgn","openshift-multus/network-metrics-daemon-2t2w2","openshift-network-diagnostics/network-check-target-4jkfk","openshift-network-operator/iptables-alerter-clf55","openshift-ovn-kubernetes/ovnkube-node-n4lmv","kube-system/konnectivity-agent-m7nqz","kube-system/kube-apiserver-proxy-ip-10-0-142-242.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97twf","openshift-image-registry/node-ca-nbg9h","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal","openshift-cluster-node-tuning-operator/tuned-4lctr"] May 21 18:20:19.541848 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.541830 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.543020 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.542999 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4zq8z" May 21 18:20:19.544257 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.544236 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-t6hgn" May 21 18:20:19.544756 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.544739 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9wzpb\"" May 21 18:20:19.544849 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.544822 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 21 18:20:19.544910 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.544848 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 21 18:20:19.545405 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.545390 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t2w2" May 21 18:20:19.545487 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:19.545459 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t2w2" podUID="fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2" May 21 18:20:19.545973 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.545732 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 21 18:20:19.545973 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.545768 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 21 18:20:19.545973 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.545789 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 21 18:20:19.545973 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.545732 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 21 18:20:19.545973 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.545926 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 21 18:20:19.546272 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.546077 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 21 18:20:19.546272 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.546194 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 21 18:20:19.546411 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.546396 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 21 18:20:19.546478 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.546395 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-s4nk7\"" May 21 18:20:19.546974 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.546956 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jkfk" May 21 18:20:19.547055 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:19.547032 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jkfk" podUID="cd76353a-e179-4a53-8e6d-5cd72be55da8" May 21 18:20:19.547342 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.547325 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-b7d54\"" May 21 18:20:19.547474 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.547449 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 21 18:20:19.547474 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.547330 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 21 18:20:19.548215 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.548171 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wdw4s" May 21 18:20:19.549623 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.549603 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-m7nqz" May 21 18:20:19.550475 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.550445 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 21 18:20:19.550475 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.550458 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-n8qtt\"" May 21 18:20:19.550624 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.550503 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 21 18:20:19.551152 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.550913 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nbg9h" May 21 18:20:19.552292 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.552274 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 21 18:20:19.552491 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.552471 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 21 18:20:19.552645 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.552629 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-sx62s\"" May 21 18:20:19.553401 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.553383 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4lctr" May 21 18:20:19.553593 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.553576 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-cmsx9\"" May 21 18:20:19.554224 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.554203 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 21 18:20:19.554687 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.554667 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 21 18:20:19.554830 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.554672 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 21 18:20:19.556780 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.556750 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 21 18:20:19.556880 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.556758 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-clf55" May 21 18:20:19.556880 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.556872 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-j58fw\"" May 21 18:20:19.558159 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.558075 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 21 18:20:19.558916 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.558897 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97twf" May 21 18:20:19.560157 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.560132 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 21 18:20:19.560157 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.560154 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 21 18:20:19.560308 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.560188 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 21 18:20:19.560308 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.560281 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8v9cq\"" May 21 18:20:19.561328 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.561310 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 21 18:20:19.561441 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.561373 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 21 18:20:19.561441 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.561400 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pbl6l\"" May 21 18:20:19.561549 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.561484 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 21 18:20:19.569474 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.569455 2575 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 21 18:20:19.580626 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.580603 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/63415a78-59b2-4662-8084-59f37cb58502-etc-sysctl-conf\") pod \"tuned-4lctr\" (UID: \"63415a78-59b2-4662-8084-59f37cb58502\") " pod="openshift-cluster-node-tuning-operator/tuned-4lctr" May 21 18:20:19.580763 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.580649 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68586\" (UniqueName: \"kubernetes.io/projected/63415a78-59b2-4662-8084-59f37cb58502-kube-api-access-68586\") pod \"tuned-4lctr\" (UID: \"63415a78-59b2-4662-8084-59f37cb58502\") " pod="openshift-cluster-node-tuning-operator/tuned-4lctr" May 21 18:20:19.580763 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.580676 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a443b811-896a-45da-a1c0-6fdea5e9465d-host-slash\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.580763 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.580712 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a443b811-896a-45da-a1c0-6fdea5e9465d-run-systemd\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.580763 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.580741 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/42a0c0b9-f647-485a-90a7-84cb93415e1b-host\") pod \"node-ca-nbg9h\" (UID: \"42a0c0b9-f647-485a-90a7-84cb93415e1b\") " pod="openshift-image-registry/node-ca-nbg9h" May 21 18:20:19.580955 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.580794 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/63415a78-59b2-4662-8084-59f37cb58502-etc-sysconfig\") pod \"tuned-4lctr\" (UID: \"63415a78-59b2-4662-8084-59f37cb58502\") " pod="openshift-cluster-node-tuning-operator/tuned-4lctr" May 21 18:20:19.580955 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.580827 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63415a78-59b2-4662-8084-59f37cb58502-etc-kubernetes\") pod \"tuned-4lctr\" (UID: \"63415a78-59b2-4662-8084-59f37cb58502\") " pod="openshift-cluster-node-tuning-operator/tuned-4lctr" May 21 18:20:19.580955 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.580852 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63415a78-59b2-4662-8084-59f37cb58502-tmp\") pod \"tuned-4lctr\" (UID: \"63415a78-59b2-4662-8084-59f37cb58502\") " pod="openshift-cluster-node-tuning-operator/tuned-4lctr" May 21 18:20:19.580955 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.580877 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/71b45bd9-d908-47c0-b612-7db98e5a6fe7-hosts-file\") pod \"node-resolver-wdw4s\" (UID: \"71b45bd9-d908-47c0-b612-7db98e5a6fe7\") " pod="openshift-dns/node-resolver-wdw4s" May 21 18:20:19.580955 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.580900 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e378d2b5-094e-4d44-b650-f030492b9e30-multus-conf-dir\") pod \"multus-4zq8z\" (UID: \"e378d2b5-094e-4d44-b650-f030492b9e30\") " pod="openshift-multus/multus-4zq8z" May 21 18:20:19.580955 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.580922 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/63415a78-59b2-4662-8084-59f37cb58502-etc-sysctl-d\") pod \"tuned-4lctr\" (UID: \"63415a78-59b2-4662-8084-59f37cb58502\") " pod="openshift-cluster-node-tuning-operator/tuned-4lctr" May 21 18:20:19.581220 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.580968 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a443b811-896a-45da-a1c0-6fdea5e9465d-run-ovn\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.581220 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.580995 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mr4fb\" (UniqueName: \"kubernetes.io/projected/a443b811-896a-45da-a1c0-6fdea5e9465d-kube-api-access-mr4fb\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.581220 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.581024 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e378d2b5-094e-4d44-b650-f030492b9e30-multus-daemon-config\") pod \"multus-4zq8z\" (UID: \"e378d2b5-094e-4d44-b650-f030492b9e30\") " pod="openshift-multus/multus-4zq8z" May 21 18:20:19.581220 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.581049 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65r2x\" (UniqueName: \"kubernetes.io/projected/27f7f26f-c37c-4ead-85af-112a370e400e-kube-api-access-65r2x\") pod \"multus-additional-cni-plugins-t6hgn\" (UID: \"27f7f26f-c37c-4ead-85af-112a370e400e\") " pod="openshift-multus/multus-additional-cni-plugins-t6hgn" May 21 18:20:19.581220 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.581075 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2230ed31-9307-4367-8e2d-3e62a2a9024e-socket-dir\") pod \"aws-ebs-csi-driver-node-97twf\" (UID: \"2230ed31-9307-4367-8e2d-3e62a2a9024e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97twf" May 21 18:20:19.581220 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.581101 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2230ed31-9307-4367-8e2d-3e62a2a9024e-sys-fs\") pod \"aws-ebs-csi-driver-node-97twf\" (UID: \"2230ed31-9307-4367-8e2d-3e62a2a9024e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97twf" May 21 18:20:19.581220 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.581126 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64qfn\" (UniqueName: \"kubernetes.io/projected/2230ed31-9307-4367-8e2d-3e62a2a9024e-kube-api-access-64qfn\") pod \"aws-ebs-csi-driver-node-97twf\" (UID: \"2230ed31-9307-4367-8e2d-3e62a2a9024e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97twf" May 21 18:20:19.581220 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.581149 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a443b811-896a-45da-a1c0-6fdea5e9465d-var-lib-openvswitch\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.581220 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.581173 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a443b811-896a-45da-a1c0-6fdea5e9465d-ovnkube-script-lib\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.581616 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.581224 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/63415a78-59b2-4662-8084-59f37cb58502-host\") pod \"tuned-4lctr\" (UID: \"63415a78-59b2-4662-8084-59f37cb58502\") " pod="openshift-cluster-node-tuning-operator/tuned-4lctr" May 21 18:20:19.581616 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.581247 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmrmz\" (UniqueName: \"kubernetes.io/projected/fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2-kube-api-access-rmrmz\") pod \"network-metrics-daemon-2t2w2\" (UID: \"fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2\") " pod="openshift-multus/network-metrics-daemon-2t2w2" May 21 18:20:19.581616 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.581271 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a443b811-896a-45da-a1c0-6fdea5e9465d-host-run-netns\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.581616 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.581318 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/27f7f26f-c37c-4ead-85af-112a370e400e-cni-binary-copy\") pod \"multus-additional-cni-plugins-t6hgn\" (UID: \"27f7f26f-c37c-4ead-85af-112a370e400e\") " pod="openshift-multus/multus-additional-cni-plugins-t6hgn" May 21 18:20:19.581616 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.581361 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/63415a78-59b2-4662-8084-59f37cb58502-sys\") pod \"tuned-4lctr\" (UID: \"63415a78-59b2-4662-8084-59f37cb58502\") " pod="openshift-cluster-node-tuning-operator/tuned-4lctr" May 21 18:20:19.581616 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.581384 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cbk5\" (UniqueName: \"kubernetes.io/projected/71b45bd9-d908-47c0-b612-7db98e5a6fe7-kube-api-access-2cbk5\") pod \"node-resolver-wdw4s\" (UID: \"71b45bd9-d908-47c0-b612-7db98e5a6fe7\") " pod="openshift-dns/node-resolver-wdw4s" May 21 18:20:19.581616 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.581411 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2230ed31-9307-4367-8e2d-3e62a2a9024e-device-dir\") pod \"aws-ebs-csi-driver-node-97twf\" (UID: \"2230ed31-9307-4367-8e2d-3e62a2a9024e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97twf" May 21 18:20:19.581616 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.581433 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e378d2b5-094e-4d44-b650-f030492b9e30-system-cni-dir\") pod \"multus-4zq8z\" (UID: \"e378d2b5-094e-4d44-b650-f030492b9e30\") " pod="openshift-multus/multus-4zq8z" May 21 18:20:19.581616 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.581474 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/63415a78-59b2-4662-8084-59f37cb58502-lib-modules\") pod \"tuned-4lctr\" (UID: \"63415a78-59b2-4662-8084-59f37cb58502\") " pod="openshift-cluster-node-tuning-operator/tuned-4lctr" May 21 18:20:19.581616 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.581525 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8985453b-f388-46b3-bdbc-51cf28a797f7-iptables-alerter-script\") pod \"iptables-alerter-clf55\" (UID: \"8985453b-f388-46b3-bdbc-51cf28a797f7\") " pod="openshift-network-operator/iptables-alerter-clf55" May 21 18:20:19.581616 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.581586 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmnrh\" (UniqueName: \"kubernetes.io/projected/8985453b-f388-46b3-bdbc-51cf28a797f7-kube-api-access-jmnrh\") pod \"iptables-alerter-clf55\" (UID: \"8985453b-f388-46b3-bdbc-51cf28a797f7\") " pod="openshift-network-operator/iptables-alerter-clf55" May 21 18:20:19.581616 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.581614 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a443b811-896a-45da-a1c0-6fdea5e9465d-systemd-units\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.582185 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.581633 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e378d2b5-094e-4d44-b650-f030492b9e30-cni-binary-copy\") pod \"multus-4zq8z\" (UID: \"e378d2b5-094e-4d44-b650-f030492b9e30\") " pod="openshift-multus/multus-4zq8z" May 21 18:20:19.582185 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.581662 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e378d2b5-094e-4d44-b650-f030492b9e30-etc-kubernetes\") pod \"multus-4zq8z\" (UID: \"e378d2b5-094e-4d44-b650-f030492b9e30\") " pod="openshift-multus/multus-4zq8z" May 21 18:20:19.582185 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.581686 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2xgg\" (UniqueName: \"kubernetes.io/projected/e378d2b5-094e-4d44-b650-f030492b9e30-kube-api-access-h2xgg\") pod \"multus-4zq8z\" (UID: \"e378d2b5-094e-4d44-b650-f030492b9e30\") " pod="openshift-multus/multus-4zq8z" May 21 18:20:19.582185 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.581738 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7lqt\" (UniqueName: \"kubernetes.io/projected/cd76353a-e179-4a53-8e6d-5cd72be55da8-kube-api-access-t7lqt\") pod \"network-check-target-4jkfk\" (UID: \"cd76353a-e179-4a53-8e6d-5cd72be55da8\") " pod="openshift-network-diagnostics/network-check-target-4jkfk" May 21 18:20:19.582185 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.581758 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a443b811-896a-45da-a1c0-6fdea5e9465d-etc-openvswitch\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.582185 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.581783 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a443b811-896a-45da-a1c0-6fdea5e9465d-node-log\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.582185 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.581811 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a443b811-896a-45da-a1c0-6fdea5e9465d-host-run-ovn-kubernetes\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.582185 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.581833 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e378d2b5-094e-4d44-b650-f030492b9e30-multus-cni-dir\") pod \"multus-4zq8z\" (UID: \"e378d2b5-094e-4d44-b650-f030492b9e30\") " pod="openshift-multus/multus-4zq8z" May 21 18:20:19.582185 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.581855 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e378d2b5-094e-4d44-b650-f030492b9e30-host-var-lib-cni-bin\") pod \"multus-4zq8z\" (UID: \"e378d2b5-094e-4d44-b650-f030492b9e30\") " pod="openshift-multus/multus-4zq8z" May 21 18:20:19.582185 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.581876 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e378d2b5-094e-4d44-b650-f030492b9e30-hostroot\") pod \"multus-4zq8z\" (UID: \"e378d2b5-094e-4d44-b650-f030492b9e30\") " pod="openshift-multus/multus-4zq8z" May 21 18:20:19.582185 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.581898 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/27f7f26f-c37c-4ead-85af-112a370e400e-os-release\") pod \"multus-additional-cni-plugins-t6hgn\" (UID: \"27f7f26f-c37c-4ead-85af-112a370e400e\") " pod="openshift-multus/multus-additional-cni-plugins-t6hgn" May 21 18:20:19.582185 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.581936 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vmth\" (UniqueName: \"kubernetes.io/projected/42a0c0b9-f647-485a-90a7-84cb93415e1b-kube-api-access-6vmth\") pod \"node-ca-nbg9h\" (UID: \"42a0c0b9-f647-485a-90a7-84cb93415e1b\") " pod="openshift-image-registry/node-ca-nbg9h" May 21 18:20:19.582185 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.581981 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8985453b-f388-46b3-bdbc-51cf28a797f7-host-slash\") pod \"iptables-alerter-clf55\" (UID: \"8985453b-f388-46b3-bdbc-51cf28a797f7\") " pod="openshift-network-operator/iptables-alerter-clf55" May 21 18:20:19.582185 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.582007 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a443b811-896a-45da-a1c0-6fdea5e9465d-run-openvswitch\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.582185 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.582039 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/63415a78-59b2-4662-8084-59f37cb58502-etc-modprobe-d\") pod \"tuned-4lctr\" (UID: \"63415a78-59b2-4662-8084-59f37cb58502\") " pod="openshift-cluster-node-tuning-operator/tuned-4lctr" May 21 18:20:19.582185 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.582068 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63415a78-59b2-4662-8084-59f37cb58502-var-lib-kubelet\") pod \"tuned-4lctr\" (UID: \"63415a78-59b2-4662-8084-59f37cb58502\") " pod="openshift-cluster-node-tuning-operator/tuned-4lctr" May 21 18:20:19.582937 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.582193 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a443b811-896a-45da-a1c0-6fdea5e9465d-host-kubelet\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.582937 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.582260 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a443b811-896a-45da-a1c0-6fdea5e9465d-ovnkube-config\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.582937 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.582297 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a443b811-896a-45da-a1c0-6fdea5e9465d-ovn-node-metrics-cert\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.582937 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.582346 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2-metrics-certs\") pod \"network-metrics-daemon-2t2w2\" (UID: \"fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2\") " pod="openshift-multus/network-metrics-daemon-2t2w2" May 21 18:20:19.582937 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.582391 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/27f7f26f-c37c-4ead-85af-112a370e400e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t6hgn\" (UID: \"27f7f26f-c37c-4ead-85af-112a370e400e\") " pod="openshift-multus/multus-additional-cni-plugins-t6hgn" May 21 18:20:19.582937 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.582421 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e378d2b5-094e-4d44-b650-f030492b9e30-host-run-multus-certs\") pod \"multus-4zq8z\" (UID: \"e378d2b5-094e-4d44-b650-f030492b9e30\") " pod="openshift-multus/multus-4zq8z" May 21 18:20:19.582937 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.582454 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a6d06917-90d7-4b14-bd75-be7260a75d7e-konnectivity-ca\") pod \"konnectivity-agent-m7nqz\" (UID: \"a6d06917-90d7-4b14-bd75-be7260a75d7e\") " pod="kube-system/konnectivity-agent-m7nqz" May 21 18:20:19.582937 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.582478 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/63415a78-59b2-4662-8084-59f37cb58502-run\") pod \"tuned-4lctr\" (UID: \"63415a78-59b2-4662-8084-59f37cb58502\") " pod="openshift-cluster-node-tuning-operator/tuned-4lctr" May 21 18:20:19.582937 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.582510 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2230ed31-9307-4367-8e2d-3e62a2a9024e-registration-dir\") pod \"aws-ebs-csi-driver-node-97twf\" (UID: \"2230ed31-9307-4367-8e2d-3e62a2a9024e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97twf" May 21 18:20:19.582937 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.582531 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a443b811-896a-45da-a1c0-6fdea5e9465d-log-socket\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.582937 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.582596 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a443b811-896a-45da-a1c0-6fdea5e9465d-host-cni-bin\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.582937 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.582621 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a443b811-896a-45da-a1c0-6fdea5e9465d-host-cni-netd\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.582937 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.582649 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a443b811-896a-45da-a1c0-6fdea5e9465d-env-overrides\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.582937 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.582668 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e378d2b5-094e-4d44-b650-f030492b9e30-multus-socket-dir-parent\") pod \"multus-4zq8z\" (UID: \"e378d2b5-094e-4d44-b650-f030492b9e30\") " pod="openshift-multus/multus-4zq8z" May 21 18:20:19.582937 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.582691 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e378d2b5-094e-4d44-b650-f030492b9e30-host-run-netns\") pod \"multus-4zq8z\" (UID: \"e378d2b5-094e-4d44-b650-f030492b9e30\") " pod="openshift-multus/multus-4zq8z" May 21 18:20:19.582937 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.582726 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/63415a78-59b2-4662-8084-59f37cb58502-etc-tuned\") pod \"tuned-4lctr\" (UID: \"63415a78-59b2-4662-8084-59f37cb58502\") " pod="openshift-cluster-node-tuning-operator/tuned-4lctr" May 21 18:20:19.583736 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.582747 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2230ed31-9307-4367-8e2d-3e62a2a9024e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-97twf\" (UID: \"2230ed31-9307-4367-8e2d-3e62a2a9024e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97twf" May 21 18:20:19.583736 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.582769 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e378d2b5-094e-4d44-b650-f030492b9e30-os-release\") pod \"multus-4zq8z\" (UID: \"e378d2b5-094e-4d44-b650-f030492b9e30\") " pod="openshift-multus/multus-4zq8z" May 21 18:20:19.583736 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.582808 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e378d2b5-094e-4d44-b650-f030492b9e30-host-var-lib-kubelet\") pod \"multus-4zq8z\" (UID: \"e378d2b5-094e-4d44-b650-f030492b9e30\") " pod="openshift-multus/multus-4zq8z" May 21 18:20:19.583736 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.582844 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/27f7f26f-c37c-4ead-85af-112a370e400e-cnibin\") pod \"multus-additional-cni-plugins-t6hgn\" (UID: \"27f7f26f-c37c-4ead-85af-112a370e400e\") " pod="openshift-multus/multus-additional-cni-plugins-t6hgn" May 21 18:20:19.583736 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.582882 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/27f7f26f-c37c-4ead-85af-112a370e400e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t6hgn\" (UID: \"27f7f26f-c37c-4ead-85af-112a370e400e\") " pod="openshift-multus/multus-additional-cni-plugins-t6hgn" May 21 18:20:19.583736 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.582905 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71b45bd9-d908-47c0-b612-7db98e5a6fe7-tmp-dir\") pod \"node-resolver-wdw4s\" (UID: \"71b45bd9-d908-47c0-b612-7db98e5a6fe7\") " pod="openshift-dns/node-resolver-wdw4s" May 21 18:20:19.583736 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.582926 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a443b811-896a-45da-a1c0-6fdea5e9465d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.583736 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.582950 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e378d2b5-094e-4d44-b650-f030492b9e30-cnibin\") pod \"multus-4zq8z\" (UID: \"e378d2b5-094e-4d44-b650-f030492b9e30\") " pod="openshift-multus/multus-4zq8z" May 21 18:20:19.583736 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.582969 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/27f7f26f-c37c-4ead-85af-112a370e400e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t6hgn\" (UID: \"27f7f26f-c37c-4ead-85af-112a370e400e\") " pod="openshift-multus/multus-additional-cni-plugins-t6hgn" May 21 18:20:19.583736 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.583001 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a6d06917-90d7-4b14-bd75-be7260a75d7e-agent-certs\") pod \"konnectivity-agent-m7nqz\" (UID: \"a6d06917-90d7-4b14-bd75-be7260a75d7e\") " pod="kube-system/konnectivity-agent-m7nqz" May 21 18:20:19.583736 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.583039 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/63415a78-59b2-4662-8084-59f37cb58502-etc-systemd\") pod \"tuned-4lctr\" (UID: \"63415a78-59b2-4662-8084-59f37cb58502\") " pod="openshift-cluster-node-tuning-operator/tuned-4lctr" May 21 18:20:19.583736 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.583072 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2230ed31-9307-4367-8e2d-3e62a2a9024e-etc-selinux\") pod \"aws-ebs-csi-driver-node-97twf\" (UID: \"2230ed31-9307-4367-8e2d-3e62a2a9024e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97twf" May 21 18:20:19.583736 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.583099 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e378d2b5-094e-4d44-b650-f030492b9e30-host-run-k8s-cni-cncf-io\") pod \"multus-4zq8z\" (UID: \"e378d2b5-094e-4d44-b650-f030492b9e30\") " pod="openshift-multus/multus-4zq8z" May 21 18:20:19.583736 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.583125 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e378d2b5-094e-4d44-b650-f030492b9e30-host-var-lib-cni-multus\") pod \"multus-4zq8z\" (UID: \"e378d2b5-094e-4d44-b650-f030492b9e30\") " pod="openshift-multus/multus-4zq8z" May 21 18:20:19.583736 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.583149 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/27f7f26f-c37c-4ead-85af-112a370e400e-system-cni-dir\") pod \"multus-additional-cni-plugins-t6hgn\" (UID: \"27f7f26f-c37c-4ead-85af-112a370e400e\") " pod="openshift-multus/multus-additional-cni-plugins-t6hgn" May 21 18:20:19.583736 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.583174 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/42a0c0b9-f647-485a-90a7-84cb93415e1b-serviceca\") pod \"node-ca-nbg9h\" (UID: \"42a0c0b9-f647-485a-90a7-84cb93415e1b\") " pod="openshift-image-registry/node-ca-nbg9h" May 21 18:20:19.618136 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.618098 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 18:15:18 +0000 UTC" deadline="2028-01-23 07:54:02.746541137 +0000 UTC" May 21 18:20:19.618136 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.618129 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14677h33m43.128415199s" May 21 18:20:19.683913 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.683880 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a443b811-896a-45da-a1c0-6fdea5e9465d-host-kubelet\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.683913 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.683920 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a443b811-896a-45da-a1c0-6fdea5e9465d-ovnkube-config\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.684162 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.683945 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a443b811-896a-45da-a1c0-6fdea5e9465d-ovn-node-metrics-cert\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.684162 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.683966 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2-metrics-certs\") pod \"network-metrics-daemon-2t2w2\" (UID: \"fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2\") " pod="openshift-multus/network-metrics-daemon-2t2w2" May 21 18:20:19.684162 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.683990 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/27f7f26f-c37c-4ead-85af-112a370e400e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t6hgn\" (UID: \"27f7f26f-c37c-4ead-85af-112a370e400e\") " pod="openshift-multus/multus-additional-cni-plugins-t6hgn" May 21 18:20:19.684162 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.684012 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e378d2b5-094e-4d44-b650-f030492b9e30-host-run-multus-certs\") pod \"multus-4zq8z\" (UID: \"e378d2b5-094e-4d44-b650-f030492b9e30\") " pod="openshift-multus/multus-4zq8z" May 21 18:20:19.684162 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.684011 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a443b811-896a-45da-a1c0-6fdea5e9465d-host-kubelet\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.684162 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.684037 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a6d06917-90d7-4b14-bd75-be7260a75d7e-konnectivity-ca\") pod \"konnectivity-agent-m7nqz\" (UID: \"a6d06917-90d7-4b14-bd75-be7260a75d7e\") " pod="kube-system/konnectivity-agent-m7nqz" May 21 18:20:19.684162 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.684062 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/63415a78-59b2-4662-8084-59f37cb58502-run\") pod \"tuned-4lctr\" (UID: \"63415a78-59b2-4662-8084-59f37cb58502\") " pod="openshift-cluster-node-tuning-operator/tuned-4lctr" May 21 18:20:19.684162 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.684075 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e378d2b5-094e-4d44-b650-f030492b9e30-host-run-multus-certs\") pod \"multus-4zq8z\" (UID: \"e378d2b5-094e-4d44-b650-f030492b9e30\") " pod="openshift-multus/multus-4zq8z" May 21 18:20:19.684162 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.684083 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2230ed31-9307-4367-8e2d-3e62a2a9024e-registration-dir\") pod \"aws-ebs-csi-driver-node-97twf\" (UID: \"2230ed31-9307-4367-8e2d-3e62a2a9024e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97twf" May 21 18:20:19.684162 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.684150 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/63415a78-59b2-4662-8084-59f37cb58502-run\") pod \"tuned-4lctr\" (UID: \"63415a78-59b2-4662-8084-59f37cb58502\") " pod="openshift-cluster-node-tuning-operator/tuned-4lctr" May 21 18:20:19.684584 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:19.684177 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 18:20:19.684584 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.684201 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2230ed31-9307-4367-8e2d-3e62a2a9024e-registration-dir\") pod \"aws-ebs-csi-driver-node-97twf\" (UID: \"2230ed31-9307-4367-8e2d-3e62a2a9024e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97twf" May 21 18:20:19.684584 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.684230 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/27f7f26f-c37c-4ead-85af-112a370e400e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t6hgn\" (UID: \"27f7f26f-c37c-4ead-85af-112a370e400e\") " pod="openshift-multus/multus-additional-cni-plugins-t6hgn" May 21 18:20:19.684584 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:19.684270 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2-metrics-certs podName:fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:20.184240183 +0000 UTC m=+3.056459081 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2-metrics-certs") pod "network-metrics-daemon-2t2w2" (UID: "fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 18:20:19.684584 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.684293 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a443b811-896a-45da-a1c0-6fdea5e9465d-log-socket\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.684584 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.684313 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a443b811-896a-45da-a1c0-6fdea5e9465d-host-cni-bin\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.684584 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.684338 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a443b811-896a-45da-a1c0-6fdea5e9465d-host-cni-netd\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.684584 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.684363 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a443b811-896a-45da-a1c0-6fdea5e9465d-env-overrides\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.684584 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.684361 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a443b811-896a-45da-a1c0-6fdea5e9465d-log-socket\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.684584 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.684367 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a443b811-896a-45da-a1c0-6fdea5e9465d-host-cni-bin\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.684584 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.684390 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e378d2b5-094e-4d44-b650-f030492b9e30-multus-socket-dir-parent\") pod \"multus-4zq8z\" (UID: \"e378d2b5-094e-4d44-b650-f030492b9e30\") " pod="openshift-multus/multus-4zq8z" May 21 18:20:19.684584 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.684396 2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 21 18:20:19.684584 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.684409 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a443b811-896a-45da-a1c0-6fdea5e9465d-host-cni-netd\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.684584 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.684416 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e378d2b5-094e-4d44-b650-f030492b9e30-host-run-netns\") pod \"multus-4zq8z\" (UID: \"e378d2b5-094e-4d44-b650-f030492b9e30\") " pod="openshift-multus/multus-4zq8z" May 21 18:20:19.684584 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.684456 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e378d2b5-094e-4d44-b650-f030492b9e30-host-run-netns\") pod \"multus-4zq8z\" (UID: \"e378d2b5-094e-4d44-b650-f030492b9e30\") " pod="openshift-multus/multus-4zq8z" May 21 18:20:19.684584 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.684462 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e378d2b5-094e-4d44-b650-f030492b9e30-multus-socket-dir-parent\") pod \"multus-4zq8z\" (UID: \"e378d2b5-094e-4d44-b650-f030492b9e30\") " pod="openshift-multus/multus-4zq8z" May 21 18:20:19.684584 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.684494 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/63415a78-59b2-4662-8084-59f37cb58502-etc-tuned\") pod \"tuned-4lctr\" (UID: \"63415a78-59b2-4662-8084-59f37cb58502\") " pod="openshift-cluster-node-tuning-operator/tuned-4lctr" May 21 18:20:19.684584 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.684519 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2230ed31-9307-4367-8e2d-3e62a2a9024e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-97twf\" (UID: \"2230ed31-9307-4367-8e2d-3e62a2a9024e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97twf" May 21 18:20:19.685425 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.684544 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e378d2b5-094e-4d44-b650-f030492b9e30-os-release\") pod \"multus-4zq8z\" (UID: \"e378d2b5-094e-4d44-b650-f030492b9e30\") " pod="openshift-multus/multus-4zq8z" May 21 18:20:19.685425 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.684567 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e378d2b5-094e-4d44-b650-f030492b9e30-host-var-lib-kubelet\") pod \"multus-4zq8z\" (UID: \"e378d2b5-094e-4d44-b650-f030492b9e30\") " pod="openshift-multus/multus-4zq8z" May 21 18:20:19.685425 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.684590 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/27f7f26f-c37c-4ead-85af-112a370e400e-cnibin\") pod \"multus-additional-cni-plugins-t6hgn\" (UID: \"27f7f26f-c37c-4ead-85af-112a370e400e\") " pod="openshift-multus/multus-additional-cni-plugins-t6hgn" May 21 18:20:19.685425 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.684601 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2230ed31-9307-4367-8e2d-3e62a2a9024e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-97twf\" (UID: \"2230ed31-9307-4367-8e2d-3e62a2a9024e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97twf" May 21 18:20:19.685425 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.684619 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/27f7f26f-c37c-4ead-85af-112a370e400e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t6hgn\" (UID: \"27f7f26f-c37c-4ead-85af-112a370e400e\") " pod="openshift-multus/multus-additional-cni-plugins-t6hgn" May 21 18:20:19.685425 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.684624 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a6d06917-90d7-4b14-bd75-be7260a75d7e-konnectivity-ca\") pod \"konnectivity-agent-m7nqz\" (UID: \"a6d06917-90d7-4b14-bd75-be7260a75d7e\") " pod="kube-system/konnectivity-agent-m7nqz" May 21 18:20:19.685425 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.684650 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71b45bd9-d908-47c0-b612-7db98e5a6fe7-tmp-dir\") pod \"node-resolver-wdw4s\" (UID: \"71b45bd9-d908-47c0-b612-7db98e5a6fe7\") " pod="openshift-dns/node-resolver-wdw4s" May 21 18:20:19.685425 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.684672 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e378d2b5-094e-4d44-b650-f030492b9e30-os-release\") pod \"multus-4zq8z\" (UID: \"e378d2b5-094e-4d44-b650-f030492b9e30\") " pod="openshift-multus/multus-4zq8z" May 21 18:20:19.685425 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.684684 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a443b811-896a-45da-a1c0-6fdea5e9465d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.685425 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.684653 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e378d2b5-094e-4d44-b650-f030492b9e30-host-var-lib-kubelet\") pod \"multus-4zq8z\" (UID: \"e378d2b5-094e-4d44-b650-f030492b9e30\") " pod="openshift-multus/multus-4zq8z" May 21 18:20:19.685425 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.684728 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e378d2b5-094e-4d44-b650-f030492b9e30-cnibin\") pod \"multus-4zq8z\" (UID: \"e378d2b5-094e-4d44-b650-f030492b9e30\") " pod="openshift-multus/multus-4zq8z" May 21 18:20:19.685425 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.684754 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/27f7f26f-c37c-4ead-85af-112a370e400e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t6hgn\" (UID: \"27f7f26f-c37c-4ead-85af-112a370e400e\") " pod="openshift-multus/multus-additional-cni-plugins-t6hgn" May 21 18:20:19.685425 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.684780 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a6d06917-90d7-4b14-bd75-be7260a75d7e-agent-certs\") pod \"konnectivity-agent-m7nqz\" (UID: \"a6d06917-90d7-4b14-bd75-be7260a75d7e\") " pod="kube-system/konnectivity-agent-m7nqz" May 21 18:20:19.685425 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.684806 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/27f7f26f-c37c-4ead-85af-112a370e400e-cnibin\") pod \"multus-additional-cni-plugins-t6hgn\" (UID: \"27f7f26f-c37c-4ead-85af-112a370e400e\") " pod="openshift-multus/multus-additional-cni-plugins-t6hgn" May 21 18:20:19.685425 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.684832 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e378d2b5-094e-4d44-b650-f030492b9e30-cnibin\") pod \"multus-4zq8z\" (UID: \"e378d2b5-094e-4d44-b650-f030492b9e30\") " pod="openshift-multus/multus-4zq8z" May 21 18:20:19.685425 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.684854 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a443b811-896a-45da-a1c0-6fdea5e9465d-env-overrides\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.685425 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.684878 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/63415a78-59b2-4662-8084-59f37cb58502-etc-systemd\") pod \"tuned-4lctr\" (UID: \"63415a78-59b2-4662-8084-59f37cb58502\") " pod="openshift-cluster-node-tuning-operator/tuned-4lctr" May 21 18:20:19.686265 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.684906 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2230ed31-9307-4367-8e2d-3e62a2a9024e-etc-selinux\") pod \"aws-ebs-csi-driver-node-97twf\" (UID: \"2230ed31-9307-4367-8e2d-3e62a2a9024e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97twf" May 21 18:20:19.686265 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.684910 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a443b811-896a-45da-a1c0-6fdea5e9465d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.686265 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.684933 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e378d2b5-094e-4d44-b650-f030492b9e30-host-run-k8s-cni-cncf-io\") pod \"multus-4zq8z\" (UID: \"e378d2b5-094e-4d44-b650-f030492b9e30\") " pod="openshift-multus/multus-4zq8z" May 21 18:20:19.686265 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.684958 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/63415a78-59b2-4662-8084-59f37cb58502-etc-systemd\") pod \"tuned-4lctr\" (UID: \"63415a78-59b2-4662-8084-59f37cb58502\") " pod="openshift-cluster-node-tuning-operator/tuned-4lctr" May 21 18:20:19.686265 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.684961 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e378d2b5-094e-4d44-b650-f030492b9e30-host-var-lib-cni-multus\") pod \"multus-4zq8z\" (UID: \"e378d2b5-094e-4d44-b650-f030492b9e30\") " pod="openshift-multus/multus-4zq8z" May 21 18:20:19.686265 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.684976 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71b45bd9-d908-47c0-b612-7db98e5a6fe7-tmp-dir\") pod \"node-resolver-wdw4s\" (UID: \"71b45bd9-d908-47c0-b612-7db98e5a6fe7\") " pod="openshift-dns/node-resolver-wdw4s" May 21 18:20:19.686265 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.684995 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e378d2b5-094e-4d44-b650-f030492b9e30-host-var-lib-cni-multus\") pod \"multus-4zq8z\" (UID: \"e378d2b5-094e-4d44-b650-f030492b9e30\") " pod="openshift-multus/multus-4zq8z" May 21 18:20:19.686265 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.684993 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/27f7f26f-c37c-4ead-85af-112a370e400e-system-cni-dir\") pod \"multus-additional-cni-plugins-t6hgn\" (UID: \"27f7f26f-c37c-4ead-85af-112a370e400e\") " pod="openshift-multus/multus-additional-cni-plugins-t6hgn" May 21 18:20:19.686265 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.685032 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/42a0c0b9-f647-485a-90a7-84cb93415e1b-serviceca\") pod \"node-ca-nbg9h\" (UID: \"42a0c0b9-f647-485a-90a7-84cb93415e1b\") " pod="openshift-image-registry/node-ca-nbg9h" May 21 18:20:19.686265 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.685039 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2230ed31-9307-4367-8e2d-3e62a2a9024e-etc-selinux\") pod \"aws-ebs-csi-driver-node-97twf\" (UID: \"2230ed31-9307-4367-8e2d-3e62a2a9024e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97twf" May 21 18:20:19.686265 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.685075 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/63415a78-59b2-4662-8084-59f37cb58502-etc-sysctl-conf\") pod \"tuned-4lctr\" (UID: \"63415a78-59b2-4662-8084-59f37cb58502\") " pod="openshift-cluster-node-tuning-operator/tuned-4lctr" May 21 18:20:19.686265 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.685101 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-68586\" (UniqueName: \"kubernetes.io/projected/63415a78-59b2-4662-8084-59f37cb58502-kube-api-access-68586\") pod \"tuned-4lctr\" (UID: \"63415a78-59b2-4662-8084-59f37cb58502\") " pod="openshift-cluster-node-tuning-operator/tuned-4lctr" May 21 18:20:19.686265 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.685075 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/27f7f26f-c37c-4ead-85af-112a370e400e-system-cni-dir\") pod \"multus-additional-cni-plugins-t6hgn\" (UID: \"27f7f26f-c37c-4ead-85af-112a370e400e\") " pod="openshift-multus/multus-additional-cni-plugins-t6hgn" May 21 18:20:19.686265 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.685143 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a443b811-896a-45da-a1c0-6fdea5e9465d-host-slash\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.686265 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.685169 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a443b811-896a-45da-a1c0-6fdea5e9465d-run-systemd\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.686265 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.685194 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/42a0c0b9-f647-485a-90a7-84cb93415e1b-host\") pod \"node-ca-nbg9h\" (UID: \"42a0c0b9-f647-485a-90a7-84cb93415e1b\") " pod="openshift-image-registry/node-ca-nbg9h" May 21 18:20:19.686265 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.685218 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/63415a78-59b2-4662-8084-59f37cb58502-etc-sysconfig\") pod \"tuned-4lctr\" (UID: \"63415a78-59b2-4662-8084-59f37cb58502\") " pod="openshift-cluster-node-tuning-operator/tuned-4lctr" May 21 18:20:19.687042 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.685211 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a443b811-896a-45da-a1c0-6fdea5e9465d-ovnkube-config\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.687042 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.685270 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/42a0c0b9-f647-485a-90a7-84cb93415e1b-host\") pod \"node-ca-nbg9h\" (UID: \"42a0c0b9-f647-485a-90a7-84cb93415e1b\") " pod="openshift-image-registry/node-ca-nbg9h" May 21 18:20:19.687042 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.685296 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e378d2b5-094e-4d44-b650-f030492b9e30-host-run-k8s-cni-cncf-io\") pod \"multus-4zq8z\" (UID: \"e378d2b5-094e-4d44-b650-f030492b9e30\") " pod="openshift-multus/multus-4zq8z" May 21 18:20:19.687042 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.685360 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63415a78-59b2-4662-8084-59f37cb58502-etc-kubernetes\") pod \"tuned-4lctr\" (UID: \"63415a78-59b2-4662-8084-59f37cb58502\") " pod="openshift-cluster-node-tuning-operator/tuned-4lctr" May 21 18:20:19.687042 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.685366 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/27f7f26f-c37c-4ead-85af-112a370e400e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t6hgn\" (UID: \"27f7f26f-c37c-4ead-85af-112a370e400e\") " pod="openshift-multus/multus-additional-cni-plugins-t6hgn" May 21 18:20:19.687042 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.685392 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/63415a78-59b2-4662-8084-59f37cb58502-etc-sysctl-conf\") pod \"tuned-4lctr\" (UID: \"63415a78-59b2-4662-8084-59f37cb58502\") " pod="openshift-cluster-node-tuning-operator/tuned-4lctr" May 21 18:20:19.687042 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.685397 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63415a78-59b2-4662-8084-59f37cb58502-tmp\") pod \"tuned-4lctr\" (UID: \"63415a78-59b2-4662-8084-59f37cb58502\") " pod="openshift-cluster-node-tuning-operator/tuned-4lctr" May 21 18:20:19.687042 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.685409 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a443b811-896a-45da-a1c0-6fdea5e9465d-host-slash\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.687042 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.685432 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a443b811-896a-45da-a1c0-6fdea5e9465d-run-systemd\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.687042 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.685434 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/71b45bd9-d908-47c0-b612-7db98e5a6fe7-hosts-file\") pod \"node-resolver-wdw4s\" (UID: \"71b45bd9-d908-47c0-b612-7db98e5a6fe7\") " pod="openshift-dns/node-resolver-wdw4s" May 21 18:20:19.687042 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.685449 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/42a0c0b9-f647-485a-90a7-84cb93415e1b-serviceca\") pod \"node-ca-nbg9h\" (UID: \"42a0c0b9-f647-485a-90a7-84cb93415e1b\") " pod="openshift-image-registry/node-ca-nbg9h" May 21 18:20:19.687042 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.685469 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e378d2b5-094e-4d44-b650-f030492b9e30-multus-conf-dir\") pod \"multus-4zq8z\" (UID: \"e378d2b5-094e-4d44-b650-f030492b9e30\") " pod="openshift-multus/multus-4zq8z" May 21 18:20:19.687042 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.685493 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/63415a78-59b2-4662-8084-59f37cb58502-etc-sysctl-d\") pod \"tuned-4lctr\" (UID: \"63415a78-59b2-4662-8084-59f37cb58502\") " pod="openshift-cluster-node-tuning-operator/tuned-4lctr" May 21 18:20:19.687042 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.685507 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/71b45bd9-d908-47c0-b612-7db98e5a6fe7-hosts-file\") pod \"node-resolver-wdw4s\" (UID: \"71b45bd9-d908-47c0-b612-7db98e5a6fe7\") " pod="openshift-dns/node-resolver-wdw4s" May 21 18:20:19.687042 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.685522 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a443b811-896a-45da-a1c0-6fdea5e9465d-run-ovn\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.687042 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.685552 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/63415a78-59b2-4662-8084-59f37cb58502-etc-sysconfig\") pod \"tuned-4lctr\" (UID: \"63415a78-59b2-4662-8084-59f37cb58502\") " pod="openshift-cluster-node-tuning-operator/tuned-4lctr" May 21 18:20:19.687042 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.685558 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mr4fb\" (UniqueName: \"kubernetes.io/projected/a443b811-896a-45da-a1c0-6fdea5e9465d-kube-api-access-mr4fb\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.687042 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.685590 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e378d2b5-094e-4d44-b650-f030492b9e30-multus-daemon-config\") pod \"multus-4zq8z\" (UID: \"e378d2b5-094e-4d44-b650-f030492b9e30\") " pod="openshift-multus/multus-4zq8z" May 21 18:20:19.687859 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.685617 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-65r2x\" (UniqueName: \"kubernetes.io/projected/27f7f26f-c37c-4ead-85af-112a370e400e-kube-api-access-65r2x\") pod \"multus-additional-cni-plugins-t6hgn\" (UID: \"27f7f26f-c37c-4ead-85af-112a370e400e\") " pod="openshift-multus/multus-additional-cni-plugins-t6hgn" May 21 18:20:19.687859 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.685667 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2230ed31-9307-4367-8e2d-3e62a2a9024e-socket-dir\") pod \"aws-ebs-csi-driver-node-97twf\" (UID: \"2230ed31-9307-4367-8e2d-3e62a2a9024e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97twf" May 21 18:20:19.687859 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.685692 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2230ed31-9307-4367-8e2d-3e62a2a9024e-sys-fs\") pod \"aws-ebs-csi-driver-node-97twf\" (UID: \"2230ed31-9307-4367-8e2d-3e62a2a9024e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97twf" May 21 18:20:19.687859 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.685728 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e378d2b5-094e-4d44-b650-f030492b9e30-multus-conf-dir\") pod \"multus-4zq8z\" (UID: \"e378d2b5-094e-4d44-b650-f030492b9e30\") " pod="openshift-multus/multus-4zq8z" May 21 18:20:19.687859 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.685737 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-64qfn\" (UniqueName: \"kubernetes.io/projected/2230ed31-9307-4367-8e2d-3e62a2a9024e-kube-api-access-64qfn\") pod \"aws-ebs-csi-driver-node-97twf\" (UID: \"2230ed31-9307-4367-8e2d-3e62a2a9024e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97twf" May 21 18:20:19.687859 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.685777 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a443b811-896a-45da-a1c0-6fdea5e9465d-var-lib-openvswitch\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.687859 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.685804 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a443b811-896a-45da-a1c0-6fdea5e9465d-ovnkube-script-lib\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.687859 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.685853 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/63415a78-59b2-4662-8084-59f37cb58502-host\") pod \"tuned-4lctr\" (UID: \"63415a78-59b2-4662-8084-59f37cb58502\") " pod="openshift-cluster-node-tuning-operator/tuned-4lctr" May 21 18:20:19.687859 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.685885 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rmrmz\" (UniqueName: \"kubernetes.io/projected/fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2-kube-api-access-rmrmz\") pod \"network-metrics-daemon-2t2w2\" (UID: \"fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2\") " pod="openshift-multus/network-metrics-daemon-2t2w2" May 21 18:20:19.687859 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.685910 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a443b811-896a-45da-a1c0-6fdea5e9465d-host-run-netns\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.687859 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.685908 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/27f7f26f-c37c-4ead-85af-112a370e400e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t6hgn\" (UID: \"27f7f26f-c37c-4ead-85af-112a370e400e\") " pod="openshift-multus/multus-additional-cni-plugins-t6hgn" May 21 18:20:19.687859 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.685940 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a443b811-896a-45da-a1c0-6fdea5e9465d-var-lib-openvswitch\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.687859 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.685988 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a443b811-896a-45da-a1c0-6fdea5e9465d-run-ovn\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.687859 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.685531 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63415a78-59b2-4662-8084-59f37cb58502-etc-kubernetes\") pod \"tuned-4lctr\" (UID: \"63415a78-59b2-4662-8084-59f37cb58502\") " pod="openshift-cluster-node-tuning-operator/tuned-4lctr" May 21 18:20:19.687859 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.685999 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/63415a78-59b2-4662-8084-59f37cb58502-host\") pod \"tuned-4lctr\" (UID: \"63415a78-59b2-4662-8084-59f37cb58502\") " pod="openshift-cluster-node-tuning-operator/tuned-4lctr" May 21 18:20:19.687859 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.686023 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2230ed31-9307-4367-8e2d-3e62a2a9024e-sys-fs\") pod \"aws-ebs-csi-driver-node-97twf\" (UID: \"2230ed31-9307-4367-8e2d-3e62a2a9024e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97twf" May 21 18:20:19.687859 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.686084 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2230ed31-9307-4367-8e2d-3e62a2a9024e-socket-dir\") pod \"aws-ebs-csi-driver-node-97twf\" (UID: \"2230ed31-9307-4367-8e2d-3e62a2a9024e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97twf" May 21 18:20:19.688641 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.686120 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/63415a78-59b2-4662-8084-59f37cb58502-etc-sysctl-d\") pod \"tuned-4lctr\" (UID: \"63415a78-59b2-4662-8084-59f37cb58502\") " pod="openshift-cluster-node-tuning-operator/tuned-4lctr" May 21 18:20:19.688641 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.686143 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a443b811-896a-45da-a1c0-6fdea5e9465d-host-run-netns\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.688641 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.686158 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/27f7f26f-c37c-4ead-85af-112a370e400e-cni-binary-copy\") pod \"multus-additional-cni-plugins-t6hgn\" (UID: \"27f7f26f-c37c-4ead-85af-112a370e400e\") " pod="openshift-multus/multus-additional-cni-plugins-t6hgn" May 21 18:20:19.688641 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.686199 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/63415a78-59b2-4662-8084-59f37cb58502-sys\") pod \"tuned-4lctr\" (UID: \"63415a78-59b2-4662-8084-59f37cb58502\") " pod="openshift-cluster-node-tuning-operator/tuned-4lctr" May 21 18:20:19.688641 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.686239 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2cbk5\" (UniqueName: \"kubernetes.io/projected/71b45bd9-d908-47c0-b612-7db98e5a6fe7-kube-api-access-2cbk5\") pod \"node-resolver-wdw4s\" (UID: \"71b45bd9-d908-47c0-b612-7db98e5a6fe7\") " pod="openshift-dns/node-resolver-wdw4s" May 21 18:20:19.688641 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.686275 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2230ed31-9307-4367-8e2d-3e62a2a9024e-device-dir\") pod \"aws-ebs-csi-driver-node-97twf\" (UID: \"2230ed31-9307-4367-8e2d-3e62a2a9024e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97twf" May 21 18:20:19.688641 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.686300 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e378d2b5-094e-4d44-b650-f030492b9e30-system-cni-dir\") pod \"multus-4zq8z\" (UID: \"e378d2b5-094e-4d44-b650-f030492b9e30\") " pod="openshift-multus/multus-4zq8z" May 21 18:20:19.688641 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.686347 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/63415a78-59b2-4662-8084-59f37cb58502-lib-modules\") pod \"tuned-4lctr\" (UID: \"63415a78-59b2-4662-8084-59f37cb58502\") " pod="openshift-cluster-node-tuning-operator/tuned-4lctr" May 21 18:20:19.688641 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.686375 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8985453b-f388-46b3-bdbc-51cf28a797f7-iptables-alerter-script\") pod \"iptables-alerter-clf55\" (UID: \"8985453b-f388-46b3-bdbc-51cf28a797f7\") " pod="openshift-network-operator/iptables-alerter-clf55" May 21 18:20:19.688641 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.686402 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jmnrh\" (UniqueName: \"kubernetes.io/projected/8985453b-f388-46b3-bdbc-51cf28a797f7-kube-api-access-jmnrh\") pod \"iptables-alerter-clf55\" (UID: \"8985453b-f388-46b3-bdbc-51cf28a797f7\") " pod="openshift-network-operator/iptables-alerter-clf55" May 21 18:20:19.688641 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.686426 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a443b811-896a-45da-a1c0-6fdea5e9465d-systemd-units\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.688641 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.686441 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e378d2b5-094e-4d44-b650-f030492b9e30-multus-daemon-config\") pod \"multus-4zq8z\" (UID: \"e378d2b5-094e-4d44-b650-f030492b9e30\") " pod="openshift-multus/multus-4zq8z" May 21 18:20:19.688641 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.686453 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e378d2b5-094e-4d44-b650-f030492b9e30-cni-binary-copy\") pod \"multus-4zq8z\" (UID: \"e378d2b5-094e-4d44-b650-f030492b9e30\") " pod="openshift-multus/multus-4zq8z" May 21 18:20:19.688641 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.686494 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e378d2b5-094e-4d44-b650-f030492b9e30-etc-kubernetes\") pod \"multus-4zq8z\" (UID: \"e378d2b5-094e-4d44-b650-f030492b9e30\") " pod="openshift-multus/multus-4zq8z" May 21 18:20:19.688641 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.686520 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h2xgg\" (UniqueName: \"kubernetes.io/projected/e378d2b5-094e-4d44-b650-f030492b9e30-kube-api-access-h2xgg\") pod \"multus-4zq8z\" (UID: \"e378d2b5-094e-4d44-b650-f030492b9e30\") " pod="openshift-multus/multus-4zq8z" May 21 18:20:19.688641 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.686546 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t7lqt\" (UniqueName: \"kubernetes.io/projected/cd76353a-e179-4a53-8e6d-5cd72be55da8-kube-api-access-t7lqt\") pod \"network-check-target-4jkfk\" (UID: \"cd76353a-e179-4a53-8e6d-5cd72be55da8\") " pod="openshift-network-diagnostics/network-check-target-4jkfk" May 21 18:20:19.688641 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.686571 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a443b811-896a-45da-a1c0-6fdea5e9465d-etc-openvswitch\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.689433 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.686596 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a443b811-896a-45da-a1c0-6fdea5e9465d-node-log\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.689433 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.686622 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a443b811-896a-45da-a1c0-6fdea5e9465d-host-run-ovn-kubernetes\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.689433 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.686647 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e378d2b5-094e-4d44-b650-f030492b9e30-multus-cni-dir\") pod \"multus-4zq8z\" (UID: \"e378d2b5-094e-4d44-b650-f030492b9e30\") " pod="openshift-multus/multus-4zq8z" May 21 18:20:19.689433 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.686671 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e378d2b5-094e-4d44-b650-f030492b9e30-host-var-lib-cni-bin\") pod \"multus-4zq8z\" (UID: \"e378d2b5-094e-4d44-b650-f030492b9e30\") " pod="openshift-multus/multus-4zq8z" May 21 18:20:19.689433 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.686695 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e378d2b5-094e-4d44-b650-f030492b9e30-hostroot\") pod \"multus-4zq8z\" (UID: \"e378d2b5-094e-4d44-b650-f030492b9e30\") " pod="openshift-multus/multus-4zq8z" May 21 18:20:19.689433 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.686738 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/27f7f26f-c37c-4ead-85af-112a370e400e-os-release\") pod \"multus-additional-cni-plugins-t6hgn\" (UID: \"27f7f26f-c37c-4ead-85af-112a370e400e\") " pod="openshift-multus/multus-additional-cni-plugins-t6hgn" May 21 18:20:19.689433 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.686761 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/27f7f26f-c37c-4ead-85af-112a370e400e-cni-binary-copy\") pod \"multus-additional-cni-plugins-t6hgn\" (UID: \"27f7f26f-c37c-4ead-85af-112a370e400e\") " pod="openshift-multus/multus-additional-cni-plugins-t6hgn" May 21 18:20:19.689433 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.686805 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a443b811-896a-45da-a1c0-6fdea5e9465d-ovnkube-script-lib\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.689433 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.686809 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e378d2b5-094e-4d44-b650-f030492b9e30-etc-kubernetes\") pod \"multus-4zq8z\" (UID: \"e378d2b5-094e-4d44-b650-f030492b9e30\") " pod="openshift-multus/multus-4zq8z" May 21 18:20:19.689433 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.686885 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a443b811-896a-45da-a1c0-6fdea5e9465d-host-run-ovn-kubernetes\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.689433 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.686924 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e378d2b5-094e-4d44-b650-f030492b9e30-cni-binary-copy\") pod \"multus-4zq8z\" (UID: \"e378d2b5-094e-4d44-b650-f030492b9e30\") " pod="openshift-multus/multus-4zq8z" May 21 18:20:19.689433 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.686975 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e378d2b5-094e-4d44-b650-f030492b9e30-multus-cni-dir\") pod \"multus-4zq8z\" (UID: \"e378d2b5-094e-4d44-b650-f030492b9e30\") " pod="openshift-multus/multus-4zq8z" May 21 18:20:19.689433 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.687010 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/63415a78-59b2-4662-8084-59f37cb58502-sys\") pod \"tuned-4lctr\" (UID: \"63415a78-59b2-4662-8084-59f37cb58502\") " pod="openshift-cluster-node-tuning-operator/tuned-4lctr" May 21 18:20:19.689433 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.687017 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e378d2b5-094e-4d44-b650-f030492b9e30-host-var-lib-cni-bin\") pod \"multus-4zq8z\" (UID: \"e378d2b5-094e-4d44-b650-f030492b9e30\") " pod="openshift-multus/multus-4zq8z" May 21 18:20:19.689433 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.687051 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a443b811-896a-45da-a1c0-6fdea5e9465d-etc-openvswitch\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.689433 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.686769 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6vmth\" (UniqueName: \"kubernetes.io/projected/42a0c0b9-f647-485a-90a7-84cb93415e1b-kube-api-access-6vmth\") pod \"node-ca-nbg9h\" (UID: \"42a0c0b9-f647-485a-90a7-84cb93415e1b\") " pod="openshift-image-registry/node-ca-nbg9h" May 21 18:20:19.689433 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.687071 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2230ed31-9307-4367-8e2d-3e62a2a9024e-device-dir\") pod \"aws-ebs-csi-driver-node-97twf\" (UID: \"2230ed31-9307-4367-8e2d-3e62a2a9024e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97twf" May 21 18:20:19.689433 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.687075 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/27f7f26f-c37c-4ead-85af-112a370e400e-os-release\") pod \"multus-additional-cni-plugins-t6hgn\" (UID: \"27f7f26f-c37c-4ead-85af-112a370e400e\") " pod="openshift-multus/multus-additional-cni-plugins-t6hgn" May 21 18:20:19.690243 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.687096 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8985453b-f388-46b3-bdbc-51cf28a797f7-host-slash\") pod \"iptables-alerter-clf55\" (UID: \"8985453b-f388-46b3-bdbc-51cf28a797f7\") " pod="openshift-network-operator/iptables-alerter-clf55" May 21 18:20:19.690243 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.687096 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a443b811-896a-45da-a1c0-6fdea5e9465d-node-log\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.690243 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.687115 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e378d2b5-094e-4d44-b650-f030492b9e30-hostroot\") pod \"multus-4zq8z\" (UID: \"e378d2b5-094e-4d44-b650-f030492b9e30\") " pod="openshift-multus/multus-4zq8z" May 21 18:20:19.690243 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.687125 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a443b811-896a-45da-a1c0-6fdea5e9465d-run-openvswitch\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.690243 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.687153 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/63415a78-59b2-4662-8084-59f37cb58502-etc-modprobe-d\") pod \"tuned-4lctr\" (UID: \"63415a78-59b2-4662-8084-59f37cb58502\") " pod="openshift-cluster-node-tuning-operator/tuned-4lctr" May 21 18:20:19.690243 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.687172 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/63415a78-59b2-4662-8084-59f37cb58502-lib-modules\") pod \"tuned-4lctr\" (UID: \"63415a78-59b2-4662-8084-59f37cb58502\") " pod="openshift-cluster-node-tuning-operator/tuned-4lctr" May 21 18:20:19.690243 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.687184 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63415a78-59b2-4662-8084-59f37cb58502-var-lib-kubelet\") pod \"tuned-4lctr\" (UID: \"63415a78-59b2-4662-8084-59f37cb58502\") " pod="openshift-cluster-node-tuning-operator/tuned-4lctr" May 21 18:20:19.690243 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.687201 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a443b811-896a-45da-a1c0-6fdea5e9465d-systemd-units\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.690243 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.687239 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a443b811-896a-45da-a1c0-6fdea5e9465d-run-openvswitch\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.690243 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.687280 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63415a78-59b2-4662-8084-59f37cb58502-var-lib-kubelet\") pod \"tuned-4lctr\" (UID: \"63415a78-59b2-4662-8084-59f37cb58502\") " pod="openshift-cluster-node-tuning-operator/tuned-4lctr" May 21 18:20:19.690243 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.687279 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8985453b-f388-46b3-bdbc-51cf28a797f7-host-slash\") pod \"iptables-alerter-clf55\" (UID: \"8985453b-f388-46b3-bdbc-51cf28a797f7\") " pod="openshift-network-operator/iptables-alerter-clf55" May 21 18:20:19.690243 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.687156 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e378d2b5-094e-4d44-b650-f030492b9e30-system-cni-dir\") pod \"multus-4zq8z\" (UID: \"e378d2b5-094e-4d44-b650-f030492b9e30\") " pod="openshift-multus/multus-4zq8z" May 21 18:20:19.690243 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.687340 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/63415a78-59b2-4662-8084-59f37cb58502-etc-modprobe-d\") pod \"tuned-4lctr\" (UID: \"63415a78-59b2-4662-8084-59f37cb58502\") " pod="openshift-cluster-node-tuning-operator/tuned-4lctr" May 21 18:20:19.690243 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.687780 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8985453b-f388-46b3-bdbc-51cf28a797f7-iptables-alerter-script\") pod \"iptables-alerter-clf55\" (UID: \"8985453b-f388-46b3-bdbc-51cf28a797f7\") " pod="openshift-network-operator/iptables-alerter-clf55" May 21 18:20:19.690243 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.689672 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/63415a78-59b2-4662-8084-59f37cb58502-etc-tuned\") pod \"tuned-4lctr\" (UID: \"63415a78-59b2-4662-8084-59f37cb58502\") " pod="openshift-cluster-node-tuning-operator/tuned-4lctr" May 21 18:20:19.690243 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.689725 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63415a78-59b2-4662-8084-59f37cb58502-tmp\") pod \"tuned-4lctr\" (UID: \"63415a78-59b2-4662-8084-59f37cb58502\") " pod="openshift-cluster-node-tuning-operator/tuned-4lctr" May 21 18:20:19.690243 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.689816 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a443b811-896a-45da-a1c0-6fdea5e9465d-ovn-node-metrics-cert\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.690243 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.689944 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a6d06917-90d7-4b14-bd75-be7260a75d7e-agent-certs\") pod \"konnectivity-agent-m7nqz\" (UID: \"a6d06917-90d7-4b14-bd75-be7260a75d7e\") " pod="kube-system/konnectivity-agent-m7nqz" May 21 18:20:19.692806 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:19.692456 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 18:20:19.692806 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:19.692481 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 18:20:19.692806 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:19.692495 2575 projected.go:194] Error preparing data for projected volume kube-api-access-t7lqt for pod openshift-network-diagnostics/network-check-target-4jkfk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 18:20:19.692806 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:19.692555 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd76353a-e179-4a53-8e6d-5cd72be55da8-kube-api-access-t7lqt podName:cd76353a-e179-4a53-8e6d-5cd72be55da8 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:20.192537864 +0000 UTC m=+3.064756786 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-t7lqt" (UniqueName: "kubernetes.io/projected/cd76353a-e179-4a53-8e6d-5cd72be55da8-kube-api-access-t7lqt") pod "network-check-target-4jkfk" (UID: "cd76353a-e179-4a53-8e6d-5cd72be55da8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 18:20:19.694636 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.694606 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmrmz\" (UniqueName: \"kubernetes.io/projected/fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2-kube-api-access-rmrmz\") pod \"network-metrics-daemon-2t2w2\" (UID: \"fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2\") " pod="openshift-multus/network-metrics-daemon-2t2w2" May 21 18:20:19.695328 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.695306 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2xgg\" (UniqueName: \"kubernetes.io/projected/e378d2b5-094e-4d44-b650-f030492b9e30-kube-api-access-h2xgg\") pod \"multus-4zq8z\" (UID: \"e378d2b5-094e-4d44-b650-f030492b9e30\") " pod="openshift-multus/multus-4zq8z" May 21 18:20:19.695418 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.695403 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64qfn\" (UniqueName: \"kubernetes.io/projected/2230ed31-9307-4367-8e2d-3e62a2a9024e-kube-api-access-64qfn\") pod \"aws-ebs-csi-driver-node-97twf\" (UID: \"2230ed31-9307-4367-8e2d-3e62a2a9024e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97twf" May 21 18:20:19.695818 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.695745 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68586\" (UniqueName: \"kubernetes.io/projected/63415a78-59b2-4662-8084-59f37cb58502-kube-api-access-68586\") pod \"tuned-4lctr\" (UID: \"63415a78-59b2-4662-8084-59f37cb58502\") " pod="openshift-cluster-node-tuning-operator/tuned-4lctr" May 21 18:20:19.696166 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.696141 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vmth\" (UniqueName: \"kubernetes.io/projected/42a0c0b9-f647-485a-90a7-84cb93415e1b-kube-api-access-6vmth\") pod \"node-ca-nbg9h\" (UID: \"42a0c0b9-f647-485a-90a7-84cb93415e1b\") " pod="openshift-image-registry/node-ca-nbg9h" May 21 18:20:19.697048 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.697006 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mr4fb\" (UniqueName: \"kubernetes.io/projected/a443b811-896a-45da-a1c0-6fdea5e9465d-kube-api-access-mr4fb\") pod \"ovnkube-node-n4lmv\" (UID: \"a443b811-896a-45da-a1c0-6fdea5e9465d\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.697474 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.697453 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmnrh\" (UniqueName: \"kubernetes.io/projected/8985453b-f388-46b3-bdbc-51cf28a797f7-kube-api-access-jmnrh\") pod \"iptables-alerter-clf55\" (UID: \"8985453b-f388-46b3-bdbc-51cf28a797f7\") " pod="openshift-network-operator/iptables-alerter-clf55" May 21 18:20:19.698585 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.698568 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cbk5\" (UniqueName: \"kubernetes.io/projected/71b45bd9-d908-47c0-b612-7db98e5a6fe7-kube-api-access-2cbk5\") pod \"node-resolver-wdw4s\" (UID: \"71b45bd9-d908-47c0-b612-7db98e5a6fe7\") " pod="openshift-dns/node-resolver-wdw4s" May 21 18:20:19.698959 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.698937 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65r2x\" (UniqueName: \"kubernetes.io/projected/27f7f26f-c37c-4ead-85af-112a370e400e-kube-api-access-65r2x\") pod \"multus-additional-cni-plugins-t6hgn\" (UID: \"27f7f26f-c37c-4ead-85af-112a370e400e\") " pod="openshift-multus/multus-additional-cni-plugins-t6hgn" May 21 18:20:19.856078 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.855992 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:19.861807 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.861785 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4zq8z" May 21 18:20:19.871462 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.871437 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-t6hgn" May 21 18:20:19.874804 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.874786 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wdw4s" May 21 18:20:19.881330 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.881310 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-m7nqz" May 21 18:20:19.888918 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.888899 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nbg9h" May 21 18:20:19.894460 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.894435 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4lctr" May 21 18:20:19.902040 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.902018 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-clf55" May 21 18:20:19.907637 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.907615 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97twf" May 21 18:20:19.987406 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.987377 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-qdhhw"] May 21 18:20:19.989110 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:19.989092 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdhhw" May 21 18:20:19.989203 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:19.989163 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdhhw" podUID="d926e5e1-fb8a-4636-b0f6-3894327080b2" May 21 18:20:20.031265 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:20.031234 2575 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 18:20:20.090144 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:20.090109 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d926e5e1-fb8a-4636-b0f6-3894327080b2-dbus\") pod \"global-pull-secret-syncer-qdhhw\" (UID: \"d926e5e1-fb8a-4636-b0f6-3894327080b2\") " pod="kube-system/global-pull-secret-syncer-qdhhw" May 21 18:20:20.090341 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:20.090178 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d926e5e1-fb8a-4636-b0f6-3894327080b2-kubelet-config\") pod \"global-pull-secret-syncer-qdhhw\" (UID: \"d926e5e1-fb8a-4636-b0f6-3894327080b2\") " pod="kube-system/global-pull-secret-syncer-qdhhw" May 21 18:20:20.090341 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:20.090217 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d926e5e1-fb8a-4636-b0f6-3894327080b2-original-pull-secret\") pod \"global-pull-secret-syncer-qdhhw\" (UID: \"d926e5e1-fb8a-4636-b0f6-3894327080b2\") " pod="kube-system/global-pull-secret-syncer-qdhhw" May 21 18:20:20.190590 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:20.190522 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d926e5e1-fb8a-4636-b0f6-3894327080b2-dbus\") pod \"global-pull-secret-syncer-qdhhw\" (UID: \"d926e5e1-fb8a-4636-b0f6-3894327080b2\") " pod="kube-system/global-pull-secret-syncer-qdhhw" May 21 18:20:20.190590 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:20.190595 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2-metrics-certs\") pod \"network-metrics-daemon-2t2w2\" (UID: \"fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2\") " pod="openshift-multus/network-metrics-daemon-2t2w2" May 21 18:20:20.190876 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:20.190624 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d926e5e1-fb8a-4636-b0f6-3894327080b2-kubelet-config\") pod \"global-pull-secret-syncer-qdhhw\" (UID: \"d926e5e1-fb8a-4636-b0f6-3894327080b2\") " pod="kube-system/global-pull-secret-syncer-qdhhw" May 21 18:20:20.190876 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:20.190665 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d926e5e1-fb8a-4636-b0f6-3894327080b2-original-pull-secret\") pod \"global-pull-secret-syncer-qdhhw\" (UID: \"d926e5e1-fb8a-4636-b0f6-3894327080b2\") " pod="kube-system/global-pull-secret-syncer-qdhhw" May 21 18:20:20.190876 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:20.190755 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d926e5e1-fb8a-4636-b0f6-3894327080b2-kubelet-config\") pod \"global-pull-secret-syncer-qdhhw\" (UID: \"d926e5e1-fb8a-4636-b0f6-3894327080b2\") " pod="kube-system/global-pull-secret-syncer-qdhhw" May 21 18:20:20.190876 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:20.190779 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 18:20:20.190876 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:20.190758 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d926e5e1-fb8a-4636-b0f6-3894327080b2-dbus\") pod \"global-pull-secret-syncer-qdhhw\" (UID: \"d926e5e1-fb8a-4636-b0f6-3894327080b2\") " pod="kube-system/global-pull-secret-syncer-qdhhw" May 21 18:20:20.190876 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:20.190839 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d926e5e1-fb8a-4636-b0f6-3894327080b2-original-pull-secret podName:d926e5e1-fb8a-4636-b0f6-3894327080b2 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:20.690821267 +0000 UTC m=+3.563040163 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d926e5e1-fb8a-4636-b0f6-3894327080b2-original-pull-secret") pod "global-pull-secret-syncer-qdhhw" (UID: "d926e5e1-fb8a-4636-b0f6-3894327080b2") : object "kube-system"/"original-pull-secret" not registered May 21 18:20:20.190876 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:20.190780 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 18:20:20.191240 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:20.190897 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2-metrics-certs podName:fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:21.190885595 +0000 UTC m=+4.063104477 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2-metrics-certs") pod "network-metrics-daemon-2t2w2" (UID: "fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 18:20:20.291566 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:20.291533 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t7lqt\" (UniqueName: \"kubernetes.io/projected/cd76353a-e179-4a53-8e6d-5cd72be55da8-kube-api-access-t7lqt\") pod \"network-check-target-4jkfk\" (UID: \"cd76353a-e179-4a53-8e6d-5cd72be55da8\") " pod="openshift-network-diagnostics/network-check-target-4jkfk" May 21 18:20:20.291744 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:20.291726 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 18:20:20.291798 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:20.291749 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 18:20:20.291798 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:20.291758 2575 projected.go:194] Error preparing data for projected volume kube-api-access-t7lqt for pod openshift-network-diagnostics/network-check-target-4jkfk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 18:20:20.291892 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:20.291812 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd76353a-e179-4a53-8e6d-5cd72be55da8-kube-api-access-t7lqt podName:cd76353a-e179-4a53-8e6d-5cd72be55da8 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:21.291798041 +0000 UTC m=+4.164016930 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-t7lqt" (UniqueName: "kubernetes.io/projected/cd76353a-e179-4a53-8e6d-5cd72be55da8-kube-api-access-t7lqt") pod "network-check-target-4jkfk" (UID: "cd76353a-e179-4a53-8e6d-5cd72be55da8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 18:20:20.298496 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:20.298270 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63415a78_59b2_4662_8084_59f37cb58502.slice/crio-dfb00c0e6352c2103dc6cbda64420e76d4f6e24edef0cd52a1f2f11bcca1c2c6 WatchSource:0}: Error finding container dfb00c0e6352c2103dc6cbda64420e76d4f6e24edef0cd52a1f2f11bcca1c2c6: Status 404 returned error can't find the container with id dfb00c0e6352c2103dc6cbda64420e76d4f6e24edef0cd52a1f2f11bcca1c2c6 May 21 18:20:20.299861 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:20.299820 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2230ed31_9307_4367_8e2d_3e62a2a9024e.slice/crio-58effdf014903f63f174be1c97749240120e3a976a9a239d56693cebe1fcf345 WatchSource:0}: Error finding container 58effdf014903f63f174be1c97749240120e3a976a9a239d56693cebe1fcf345: Status 404 returned error can't find the container with id 58effdf014903f63f174be1c97749240120e3a976a9a239d56693cebe1fcf345 May 21 18:20:20.301441 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:20.301405 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8985453b_f388_46b3_bdbc_51cf28a797f7.slice/crio-4b14f2f40d71bda25da7c858c9aca8bc891667d4a82f7ceacf9b578eb56cb734 WatchSource:0}: Error finding container 4b14f2f40d71bda25da7c858c9aca8bc891667d4a82f7ceacf9b578eb56cb734: Status 404 returned error can't find the container with id 4b14f2f40d71bda25da7c858c9aca8bc891667d4a82f7ceacf9b578eb56cb734 May 21 18:20:20.302647 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:20.302620 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27f7f26f_c37c_4ead_85af_112a370e400e.slice/crio-f8deaeb427aa26819a1a2f207193072ebbe24745e87a2e7b990e0b7e56eda1f2 WatchSource:0}: Error finding container f8deaeb427aa26819a1a2f207193072ebbe24745e87a2e7b990e0b7e56eda1f2: Status 404 returned error can't find the container with id f8deaeb427aa26819a1a2f207193072ebbe24745e87a2e7b990e0b7e56eda1f2 May 21 18:20:20.304893 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:20.304803 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda443b811_896a_45da_a1c0_6fdea5e9465d.slice/crio-06c1a75f7e33c1d4c8f043dca10034911714c291aa596bc7e59bc6d31ab303bc WatchSource:0}: Error finding container 06c1a75f7e33c1d4c8f043dca10034911714c291aa596bc7e59bc6d31ab303bc: Status 404 returned error can't find the container with id 06c1a75f7e33c1d4c8f043dca10034911714c291aa596bc7e59bc6d31ab303bc May 21 18:20:20.305626 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:20.305597 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode378d2b5_094e_4d44_b650_f030492b9e30.slice/crio-3a74b382dfa488a09a9fbb4e3f7602d7e37df9d2c37649a6d8ccf0fca72d8012 WatchSource:0}: Error finding container 3a74b382dfa488a09a9fbb4e3f7602d7e37df9d2c37649a6d8ccf0fca72d8012: Status 404 returned error can't find the container with id 3a74b382dfa488a09a9fbb4e3f7602d7e37df9d2c37649a6d8ccf0fca72d8012 May 21 18:20:20.306941 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:20.306906 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42a0c0b9_f647_485a_90a7_84cb93415e1b.slice/crio-876d608807c36dea963c6061a19c628f7f75455103efe4e043fec39927b82a91 WatchSource:0}: Error finding container 876d608807c36dea963c6061a19c628f7f75455103efe4e043fec39927b82a91: Status 404 returned error can't find the container with id 876d608807c36dea963c6061a19c628f7f75455103efe4e043fec39927b82a91 May 21 18:20:20.618843 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:20.618803 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 18:15:18 +0000 UTC" deadline="2027-12-05 10:13:56.278875759 +0000 UTC" May 21 18:20:20.618843 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:20.618837 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13503h53m35.660041119s" May 21 18:20:20.693286 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:20.693251 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jkfk" May 21 18:20:20.693443 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:20.693385 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jkfk" podUID="cd76353a-e179-4a53-8e6d-5cd72be55da8" May 21 18:20:20.694346 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:20.694325 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d926e5e1-fb8a-4636-b0f6-3894327080b2-original-pull-secret\") pod \"global-pull-secret-syncer-qdhhw\" (UID: \"d926e5e1-fb8a-4636-b0f6-3894327080b2\") " pod="kube-system/global-pull-secret-syncer-qdhhw" May 21 18:20:20.694495 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:20.694475 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 18:20:20.694545 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:20.694536 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d926e5e1-fb8a-4636-b0f6-3894327080b2-original-pull-secret podName:d926e5e1-fb8a-4636-b0f6-3894327080b2 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:21.694521931 +0000 UTC m=+4.566740823 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d926e5e1-fb8a-4636-b0f6-3894327080b2-original-pull-secret") pod "global-pull-secret-syncer-qdhhw" (UID: "d926e5e1-fb8a-4636-b0f6-3894327080b2") : object "kube-system"/"original-pull-secret" not registered May 21 18:20:20.702616 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:20.702584 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wdw4s" event={"ID":"71b45bd9-d908-47c0-b612-7db98e5a6fe7","Type":"ContainerStarted","Data":"2d1f886a70e9c8586bf08b03e06ab3827c0ab9b05f1bbb401ba0a150ca7a151b"} May 21 18:20:20.703826 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:20.703790 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-clf55" event={"ID":"8985453b-f388-46b3-bdbc-51cf28a797f7","Type":"ContainerStarted","Data":"4b14f2f40d71bda25da7c858c9aca8bc891667d4a82f7ceacf9b578eb56cb734"} May 21 18:20:20.704986 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:20.704945 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4lctr" event={"ID":"63415a78-59b2-4662-8084-59f37cb58502","Type":"ContainerStarted","Data":"dfb00c0e6352c2103dc6cbda64420e76d4f6e24edef0cd52a1f2f11bcca1c2c6"} May 21 18:20:20.708097 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:20.707400 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-242.ec2.internal" event={"ID":"2c23003bb529fbcd873744269cc9dc4a","Type":"ContainerStarted","Data":"98e91ff92023f0331cb959df2552df38d6ebaac6b49389e09e26f1423f41fe05"} May 21 18:20:20.709612 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:20.709583 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-m7nqz" event={"ID":"a6d06917-90d7-4b14-bd75-be7260a75d7e","Type":"ContainerStarted","Data":"7b5d58ffce05839eeaca71a99c8e4237c6b25887728c44b5d21e6ddc4561d7ea"} May 21 18:20:20.711503 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:20.711473 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nbg9h" event={"ID":"42a0c0b9-f647-485a-90a7-84cb93415e1b","Type":"ContainerStarted","Data":"876d608807c36dea963c6061a19c628f7f75455103efe4e043fec39927b82a91"} May 21 18:20:20.712764 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:20.712738 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4zq8z" event={"ID":"e378d2b5-094e-4d44-b650-f030492b9e30","Type":"ContainerStarted","Data":"3a74b382dfa488a09a9fbb4e3f7602d7e37df9d2c37649a6d8ccf0fca72d8012"} May 21 18:20:20.713981 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:20.713958 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" event={"ID":"a443b811-896a-45da-a1c0-6fdea5e9465d","Type":"ContainerStarted","Data":"06c1a75f7e33c1d4c8f043dca10034911714c291aa596bc7e59bc6d31ab303bc"} May 21 18:20:20.715216 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:20.715182 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t6hgn" event={"ID":"27f7f26f-c37c-4ead-85af-112a370e400e","Type":"ContainerStarted","Data":"f8deaeb427aa26819a1a2f207193072ebbe24745e87a2e7b990e0b7e56eda1f2"} May 21 18:20:20.716216 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:20.716186 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97twf" event={"ID":"2230ed31-9307-4367-8e2d-3e62a2a9024e","Type":"ContainerStarted","Data":"58effdf014903f63f174be1c97749240120e3a976a9a239d56693cebe1fcf345"} May 21 18:20:20.717591 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:20.717560 2575 generic.go:358] "Generic (PLEG): container finished" podID="df398a303bb444f283f55f92aa86b2c1" containerID="d016909849b3750e89c4953b743af2c19ca0d607c922ac6028a8d40c76a572e8" exitCode=0 May 21 18:20:20.717683 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:20.717597 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal" event={"ID":"df398a303bb444f283f55f92aa86b2c1","Type":"ContainerDied","Data":"d016909849b3750e89c4953b743af2c19ca0d607c922ac6028a8d40c76a572e8"} May 21 18:20:20.721456 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:20.721408 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-242.ec2.internal" podStartSLOduration=1.7213940509999999 podStartE2EDuration="1.721394051s" podCreationTimestamp="2026-05-21 18:20:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:20:20.720769727 +0000 UTC m=+3.592988623" watchObservedRunningTime="2026-05-21 18:20:20.721394051 +0000 UTC m=+3.593612951" May 21 18:20:21.199355 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:21.198668 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2-metrics-certs\") pod \"network-metrics-daemon-2t2w2\" (UID: \"fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2\") " pod="openshift-multus/network-metrics-daemon-2t2w2" May 21 18:20:21.199355 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:21.198887 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 18:20:21.199355 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:21.198957 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2-metrics-certs podName:fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:23.198935877 +0000 UTC m=+6.071154758 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2-metrics-certs") pod "network-metrics-daemon-2t2w2" (UID: "fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 18:20:21.300143 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:21.299451 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t7lqt\" (UniqueName: \"kubernetes.io/projected/cd76353a-e179-4a53-8e6d-5cd72be55da8-kube-api-access-t7lqt\") pod \"network-check-target-4jkfk\" (UID: \"cd76353a-e179-4a53-8e6d-5cd72be55da8\") " pod="openshift-network-diagnostics/network-check-target-4jkfk" May 21 18:20:21.300143 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:21.299679 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 18:20:21.300143 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:21.299715 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 18:20:21.300143 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:21.299729 2575 projected.go:194] Error preparing data for projected volume kube-api-access-t7lqt for pod openshift-network-diagnostics/network-check-target-4jkfk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 18:20:21.300143 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:21.299791 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd76353a-e179-4a53-8e6d-5cd72be55da8-kube-api-access-t7lqt podName:cd76353a-e179-4a53-8e6d-5cd72be55da8 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:23.299772162 +0000 UTC m=+6.171991040 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-t7lqt" (UniqueName: "kubernetes.io/projected/cd76353a-e179-4a53-8e6d-5cd72be55da8-kube-api-access-t7lqt") pod "network-check-target-4jkfk" (UID: "cd76353a-e179-4a53-8e6d-5cd72be55da8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 18:20:21.694903 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:21.694869 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdhhw" May 21 18:20:21.695380 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:21.695007 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdhhw" podUID="d926e5e1-fb8a-4636-b0f6-3894327080b2" May 21 18:20:21.695549 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:21.695515 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t2w2" May 21 18:20:21.695680 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:21.695631 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t2w2" podUID="fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2" May 21 18:20:21.702692 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:21.702662 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d926e5e1-fb8a-4636-b0f6-3894327080b2-original-pull-secret\") pod \"global-pull-secret-syncer-qdhhw\" (UID: \"d926e5e1-fb8a-4636-b0f6-3894327080b2\") " pod="kube-system/global-pull-secret-syncer-qdhhw" May 21 18:20:21.702918 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:21.702897 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 18:20:21.703008 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:21.702965 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d926e5e1-fb8a-4636-b0f6-3894327080b2-original-pull-secret podName:d926e5e1-fb8a-4636-b0f6-3894327080b2 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:23.702944757 +0000 UTC m=+6.575163652 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d926e5e1-fb8a-4636-b0f6-3894327080b2-original-pull-secret") pod "global-pull-secret-syncer-qdhhw" (UID: "d926e5e1-fb8a-4636-b0f6-3894327080b2") : object "kube-system"/"original-pull-secret" not registered May 21 18:20:21.739980 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:21.739944 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal" event={"ID":"df398a303bb444f283f55f92aa86b2c1","Type":"ContainerStarted","Data":"da4179d20aa15188a8a2fb05f52f291b205799d0e82801c76f7fa67734abdc28"} May 21 18:20:21.753779 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:21.753723 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal" podStartSLOduration=2.753691218 podStartE2EDuration="2.753691218s" podCreationTimestamp="2026-05-21 18:20:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:20:21.7534303 +0000 UTC m=+4.625649202" watchObservedRunningTime="2026-05-21 18:20:21.753691218 +0000 UTC m=+4.625910117" May 21 18:20:22.693563 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:22.693076 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jkfk" May 21 18:20:22.693563 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:22.693207 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jkfk" podUID="cd76353a-e179-4a53-8e6d-5cd72be55da8" May 21 18:20:23.216560 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:23.216523 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2-metrics-certs\") pod \"network-metrics-daemon-2t2w2\" (UID: \"fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2\") " pod="openshift-multus/network-metrics-daemon-2t2w2" May 21 18:20:23.217062 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:23.216696 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 18:20:23.217062 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:23.216777 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2-metrics-certs podName:fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:27.216756214 +0000 UTC m=+10.088975107 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2-metrics-certs") pod "network-metrics-daemon-2t2w2" (UID: "fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 18:20:23.317450 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:23.317410 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t7lqt\" (UniqueName: \"kubernetes.io/projected/cd76353a-e179-4a53-8e6d-5cd72be55da8-kube-api-access-t7lqt\") pod \"network-check-target-4jkfk\" (UID: \"cd76353a-e179-4a53-8e6d-5cd72be55da8\") " pod="openshift-network-diagnostics/network-check-target-4jkfk" May 21 18:20:23.317670 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:23.317640 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 18:20:23.317670 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:23.317670 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 18:20:23.317832 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:23.317684 2575 projected.go:194] Error preparing data for projected volume kube-api-access-t7lqt for pod openshift-network-diagnostics/network-check-target-4jkfk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 18:20:23.317832 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:23.317767 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd76353a-e179-4a53-8e6d-5cd72be55da8-kube-api-access-t7lqt podName:cd76353a-e179-4a53-8e6d-5cd72be55da8 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:27.317747437 +0000 UTC m=+10.189966336 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-t7lqt" (UniqueName: "kubernetes.io/projected/cd76353a-e179-4a53-8e6d-5cd72be55da8-kube-api-access-t7lqt") pod "network-check-target-4jkfk" (UID: "cd76353a-e179-4a53-8e6d-5cd72be55da8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 18:20:23.693193 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:23.693159 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdhhw" May 21 18:20:23.693372 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:23.693322 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdhhw" podUID="d926e5e1-fb8a-4636-b0f6-3894327080b2" May 21 18:20:23.693835 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:23.693812 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t2w2" May 21 18:20:23.694692 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:23.694655 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t2w2" podUID="fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2" May 21 18:20:23.721439 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:23.721400 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d926e5e1-fb8a-4636-b0f6-3894327080b2-original-pull-secret\") pod \"global-pull-secret-syncer-qdhhw\" (UID: \"d926e5e1-fb8a-4636-b0f6-3894327080b2\") " pod="kube-system/global-pull-secret-syncer-qdhhw" May 21 18:20:23.721605 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:23.721567 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 18:20:23.721677 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:23.721635 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d926e5e1-fb8a-4636-b0f6-3894327080b2-original-pull-secret podName:d926e5e1-fb8a-4636-b0f6-3894327080b2 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:27.721616274 +0000 UTC m=+10.593835165 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d926e5e1-fb8a-4636-b0f6-3894327080b2-original-pull-secret") pod "global-pull-secret-syncer-qdhhw" (UID: "d926e5e1-fb8a-4636-b0f6-3894327080b2") : object "kube-system"/"original-pull-secret" not registered May 21 18:20:24.693756 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:24.693446 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jkfk" May 21 18:20:24.693756 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:24.693575 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jkfk" podUID="cd76353a-e179-4a53-8e6d-5cd72be55da8" May 21 18:20:25.694787 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:25.693693 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdhhw" May 21 18:20:25.694787 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:25.693876 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdhhw" podUID="d926e5e1-fb8a-4636-b0f6-3894327080b2" May 21 18:20:25.694787 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:25.693693 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t2w2" May 21 18:20:25.694787 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:25.694379 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t2w2" podUID="fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2" May 21 18:20:26.693648 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:26.693612 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jkfk" May 21 18:20:26.693831 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:26.693779 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jkfk" podUID="cd76353a-e179-4a53-8e6d-5cd72be55da8" May 21 18:20:27.251364 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:27.251275 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2-metrics-certs\") pod \"network-metrics-daemon-2t2w2\" (UID: \"fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2\") " pod="openshift-multus/network-metrics-daemon-2t2w2" May 21 18:20:27.251972 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:27.251446 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 18:20:27.251972 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:27.251513 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2-metrics-certs podName:fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:35.251493661 +0000 UTC m=+18.123712551 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2-metrics-certs") pod "network-metrics-daemon-2t2w2" (UID: "fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 18:20:27.352791 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:27.352730 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t7lqt\" (UniqueName: \"kubernetes.io/projected/cd76353a-e179-4a53-8e6d-5cd72be55da8-kube-api-access-t7lqt\") pod \"network-check-target-4jkfk\" (UID: \"cd76353a-e179-4a53-8e6d-5cd72be55da8\") " pod="openshift-network-diagnostics/network-check-target-4jkfk" May 21 18:20:27.352981 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:27.352914 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 18:20:27.352981 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:27.352944 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 18:20:27.352981 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:27.352958 2575 projected.go:194] Error preparing data for projected volume kube-api-access-t7lqt for pod openshift-network-diagnostics/network-check-target-4jkfk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 18:20:27.353152 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:27.353030 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd76353a-e179-4a53-8e6d-5cd72be55da8-kube-api-access-t7lqt podName:cd76353a-e179-4a53-8e6d-5cd72be55da8 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:35.353010566 +0000 UTC m=+18.225229459 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-t7lqt" (UniqueName: "kubernetes.io/projected/cd76353a-e179-4a53-8e6d-5cd72be55da8-kube-api-access-t7lqt") pod "network-check-target-4jkfk" (UID: "cd76353a-e179-4a53-8e6d-5cd72be55da8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 18:20:27.694796 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:27.693966 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t2w2" May 21 18:20:27.694796 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:27.694111 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t2w2" podUID="fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2" May 21 18:20:27.694796 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:27.694559 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdhhw" May 21 18:20:27.694796 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:27.694688 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdhhw" podUID="d926e5e1-fb8a-4636-b0f6-3894327080b2" May 21 18:20:27.757060 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:27.756488 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d926e5e1-fb8a-4636-b0f6-3894327080b2-original-pull-secret\") pod \"global-pull-secret-syncer-qdhhw\" (UID: \"d926e5e1-fb8a-4636-b0f6-3894327080b2\") " pod="kube-system/global-pull-secret-syncer-qdhhw" May 21 18:20:27.757060 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:27.756659 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 18:20:27.757060 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:27.756737 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d926e5e1-fb8a-4636-b0f6-3894327080b2-original-pull-secret podName:d926e5e1-fb8a-4636-b0f6-3894327080b2 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:35.756717093 +0000 UTC m=+18.628935987 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d926e5e1-fb8a-4636-b0f6-3894327080b2-original-pull-secret") pod "global-pull-secret-syncer-qdhhw" (UID: "d926e5e1-fb8a-4636-b0f6-3894327080b2") : object "kube-system"/"original-pull-secret" not registered May 21 18:20:28.692778 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:28.692733 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jkfk" May 21 18:20:28.693245 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:28.692869 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jkfk" podUID="cd76353a-e179-4a53-8e6d-5cd72be55da8" May 21 18:20:29.696505 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:29.696467 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t2w2" May 21 18:20:29.697012 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:29.696601 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t2w2" podUID="fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2" May 21 18:20:29.697012 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:29.696792 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdhhw" May 21 18:20:29.697012 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:29.696877 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdhhw" podUID="d926e5e1-fb8a-4636-b0f6-3894327080b2" May 21 18:20:30.693611 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:30.693577 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jkfk" May 21 18:20:30.693828 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:30.693724 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jkfk" podUID="cd76353a-e179-4a53-8e6d-5cd72be55da8" May 21 18:20:31.693265 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:31.693227 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t2w2" May 21 18:20:31.693691 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:31.693242 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdhhw" May 21 18:20:31.693691 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:31.693381 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t2w2" podUID="fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2" May 21 18:20:31.693691 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:31.693441 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdhhw" podUID="d926e5e1-fb8a-4636-b0f6-3894327080b2" May 21 18:20:32.693070 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:32.693033 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jkfk" May 21 18:20:32.693242 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:32.693149 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jkfk" podUID="cd76353a-e179-4a53-8e6d-5cd72be55da8" May 21 18:20:33.696336 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:33.696303 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdhhw" May 21 18:20:33.696832 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:33.696414 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdhhw" podUID="d926e5e1-fb8a-4636-b0f6-3894327080b2" May 21 18:20:33.696832 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:33.696474 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t2w2" May 21 18:20:33.696832 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:33.696570 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t2w2" podUID="fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2" May 21 18:20:34.692948 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:34.692916 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jkfk" May 21 18:20:34.693114 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:34.693054 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jkfk" podUID="cd76353a-e179-4a53-8e6d-5cd72be55da8" May 21 18:20:35.310395 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:35.310354 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2-metrics-certs\") pod \"network-metrics-daemon-2t2w2\" (UID: \"fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2\") " pod="openshift-multus/network-metrics-daemon-2t2w2" May 21 18:20:35.310854 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:35.310532 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 18:20:35.310854 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:35.310611 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2-metrics-certs podName:fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:51.310591292 +0000 UTC m=+34.182810174 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2-metrics-certs") pod "network-metrics-daemon-2t2w2" (UID: "fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 18:20:35.411663 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:35.411632 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t7lqt\" (UniqueName: \"kubernetes.io/projected/cd76353a-e179-4a53-8e6d-5cd72be55da8-kube-api-access-t7lqt\") pod \"network-check-target-4jkfk\" (UID: \"cd76353a-e179-4a53-8e6d-5cd72be55da8\") " pod="openshift-network-diagnostics/network-check-target-4jkfk" May 21 18:20:35.411834 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:35.411816 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 18:20:35.411834 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:35.411835 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 18:20:35.411952 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:35.411844 2575 projected.go:194] Error preparing data for projected volume kube-api-access-t7lqt for pod openshift-network-diagnostics/network-check-target-4jkfk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 18:20:35.411952 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:35.411893 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd76353a-e179-4a53-8e6d-5cd72be55da8-kube-api-access-t7lqt podName:cd76353a-e179-4a53-8e6d-5cd72be55da8 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:51.411880796 +0000 UTC m=+34.284099684 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-t7lqt" (UniqueName: "kubernetes.io/projected/cd76353a-e179-4a53-8e6d-5cd72be55da8-kube-api-access-t7lqt") pod "network-check-target-4jkfk" (UID: "cd76353a-e179-4a53-8e6d-5cd72be55da8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 18:20:35.693232 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:35.693200 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdhhw" May 21 18:20:35.693396 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:35.693206 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t2w2" May 21 18:20:35.693396 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:35.693341 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdhhw" podUID="d926e5e1-fb8a-4636-b0f6-3894327080b2" May 21 18:20:35.693524 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:35.693420 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t2w2" podUID="fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2" May 21 18:20:35.813452 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:35.813418 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d926e5e1-fb8a-4636-b0f6-3894327080b2-original-pull-secret\") pod \"global-pull-secret-syncer-qdhhw\" (UID: \"d926e5e1-fb8a-4636-b0f6-3894327080b2\") " pod="kube-system/global-pull-secret-syncer-qdhhw" May 21 18:20:35.813593 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:35.813571 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 18:20:35.813653 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:35.813635 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d926e5e1-fb8a-4636-b0f6-3894327080b2-original-pull-secret podName:d926e5e1-fb8a-4636-b0f6-3894327080b2 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:51.813618343 +0000 UTC m=+34.685837226 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d926e5e1-fb8a-4636-b0f6-3894327080b2-original-pull-secret") pod "global-pull-secret-syncer-qdhhw" (UID: "d926e5e1-fb8a-4636-b0f6-3894327080b2") : object "kube-system"/"original-pull-secret" not registered May 21 18:20:36.692683 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:36.692652 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jkfk" May 21 18:20:36.693045 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:36.692775 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jkfk" podUID="cd76353a-e179-4a53-8e6d-5cd72be55da8" May 21 18:20:37.694562 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:37.694522 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t2w2" May 21 18:20:37.695034 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:37.694645 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t2w2" podUID="fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2" May 21 18:20:37.695034 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:37.694724 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdhhw" May 21 18:20:37.695034 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:37.694858 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdhhw" podUID="d926e5e1-fb8a-4636-b0f6-3894327080b2" May 21 18:20:38.693795 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:38.693476 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jkfk" May 21 18:20:38.693915 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:38.693893 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jkfk" podUID="cd76353a-e179-4a53-8e6d-5cd72be55da8" May 21 18:20:38.770762 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:38.770725 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-m7nqz" event={"ID":"a6d06917-90d7-4b14-bd75-be7260a75d7e","Type":"ContainerStarted","Data":"f719fcf396822092cc9c0b30876f19bffe2130e11beac5486f7ae3db9ce80ae4"} May 21 18:20:38.772324 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:38.772292 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nbg9h" event={"ID":"42a0c0b9-f647-485a-90a7-84cb93415e1b","Type":"ContainerStarted","Data":"39efcce9ae5cabb5f132361c3b372d6ba64ce97dc32e389de955fcf13387eace"} May 21 18:20:38.773615 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:38.773585 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4zq8z" event={"ID":"e378d2b5-094e-4d44-b650-f030492b9e30","Type":"ContainerStarted","Data":"03570029c690230d7a506f9e72a2f282212fb4bfe1de0ccbebd5f342ccb69219"} May 21 18:20:38.776281 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:38.776254 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" event={"ID":"a443b811-896a-45da-a1c0-6fdea5e9465d","Type":"ContainerStarted","Data":"c6da6259bd254570a444baf5444ae76150976f85b2ef49bdf214515680c4f5b8"} May 21 18:20:38.776383 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:38.776289 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" event={"ID":"a443b811-896a-45da-a1c0-6fdea5e9465d","Type":"ContainerStarted","Data":"ee9c50acc2f0e3bdfbf9d79dc71957d2c657158ca41107c746bfd317ab108aae"} May 21 18:20:38.776383 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:38.776302 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" event={"ID":"a443b811-896a-45da-a1c0-6fdea5e9465d","Type":"ContainerStarted","Data":"6ca4df38902425d898906ca1db06d369dc39c6e2d74453f14a54a83f76557a2b"} May 21 18:20:38.776383 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:38.776314 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" event={"ID":"a443b811-896a-45da-a1c0-6fdea5e9465d","Type":"ContainerStarted","Data":"84b17e1e9689861358ed7e58007b1009f97cdcfc0213b453ee3da11b6de50d62"} May 21 18:20:38.776383 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:38.776327 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" event={"ID":"a443b811-896a-45da-a1c0-6fdea5e9465d","Type":"ContainerStarted","Data":"daeae2b01790ea3c553f62fbb62400413ddcb2a4fa35dae9c739a074ed7a33f5"} May 21 18:20:38.776383 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:38.776337 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" event={"ID":"a443b811-896a-45da-a1c0-6fdea5e9465d","Type":"ContainerStarted","Data":"9001851f67bb4faa3614e8c68633616ed4565b18f80f4354d8ba3953fca2bec8"} May 21 18:20:38.777720 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:38.777679 2575 generic.go:358] "Generic (PLEG): container finished" podID="27f7f26f-c37c-4ead-85af-112a370e400e" containerID="6db21f6673f6550850cc468df5e696cfe0287c5a2f88b9ef8c726c5a01c6f4ce" exitCode=0 May 21 18:20:38.777816 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:38.777741 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t6hgn" event={"ID":"27f7f26f-c37c-4ead-85af-112a370e400e","Type":"ContainerDied","Data":"6db21f6673f6550850cc468df5e696cfe0287c5a2f88b9ef8c726c5a01c6f4ce"} May 21 18:20:38.779448 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:38.779423 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97twf" event={"ID":"2230ed31-9307-4367-8e2d-3e62a2a9024e","Type":"ContainerStarted","Data":"092c6d80fbd618a828440288eb1bac3d937685bc93f369cbebe4fe29bd15a110"} May 21 18:20:38.780852 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:38.780791 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wdw4s" event={"ID":"71b45bd9-d908-47c0-b612-7db98e5a6fe7","Type":"ContainerStarted","Data":"6b33f5a518bfff3850290f06e16c9cfca637a638688e8059d283c450c106e540"} May 21 18:20:38.782111 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:38.782089 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4lctr" event={"ID":"63415a78-59b2-4662-8084-59f37cb58502","Type":"ContainerStarted","Data":"24055a64f1ba3c26aa15f3fb87aebe469557e8fab8dbe733056fa5240724d7fa"} May 21 18:20:38.785345 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:38.785309 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-m7nqz" podStartSLOduration=3.87908965 podStartE2EDuration="21.785298923s" podCreationTimestamp="2026-05-21 18:20:17 +0000 UTC" firstStartedPulling="2026-05-21 18:20:20.313364938 +0000 UTC m=+3.185583832" lastFinishedPulling="2026-05-21 18:20:38.219574225 +0000 UTC m=+21.091793105" observedRunningTime="2026-05-21 18:20:38.784942879 +0000 UTC m=+21.657161779" watchObservedRunningTime="2026-05-21 18:20:38.785298923 +0000 UTC m=+21.657517820" May 21 18:20:38.816354 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:38.816296 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4lctr" podStartSLOduration=3.887927338 podStartE2EDuration="21.816276277s" podCreationTimestamp="2026-05-21 18:20:17 +0000 UTC" firstStartedPulling="2026-05-21 18:20:20.300235228 +0000 UTC m=+3.172454104" lastFinishedPulling="2026-05-21 18:20:38.228584153 +0000 UTC m=+21.100803043" observedRunningTime="2026-05-21 18:20:38.799201407 +0000 UTC m=+21.671420307" watchObservedRunningTime="2026-05-21 18:20:38.816276277 +0000 UTC m=+21.688495178" May 21 18:20:38.816515 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:38.816488 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-4zq8z" podStartSLOduration=3.839060725 podStartE2EDuration="21.816483006s" podCreationTimestamp="2026-05-21 18:20:17 +0000 UTC" firstStartedPulling="2026-05-21 18:20:20.309114532 +0000 UTC m=+3.181333412" lastFinishedPulling="2026-05-21 18:20:38.286536802 +0000 UTC m=+21.158755693" observedRunningTime="2026-05-21 18:20:38.816057583 +0000 UTC m=+21.688276482" watchObservedRunningTime="2026-05-21 18:20:38.816483006 +0000 UTC m=+21.688701905" May 21 18:20:38.834389 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:38.834331 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-wdw4s" podStartSLOduration=3.930895138 podStartE2EDuration="21.834314962s" podCreationTimestamp="2026-05-21 18:20:17 +0000 UTC" firstStartedPulling="2026-05-21 18:20:20.316146313 +0000 UTC m=+3.188365193" lastFinishedPulling="2026-05-21 18:20:38.219566126 +0000 UTC m=+21.091785017" observedRunningTime="2026-05-21 18:20:38.834204981 +0000 UTC m=+21.706423881" watchObservedRunningTime="2026-05-21 18:20:38.834314962 +0000 UTC m=+21.706533859" May 21 18:20:38.850459 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:38.850407 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nbg9h" podStartSLOduration=11.878444384 podStartE2EDuration="21.850387049s" podCreationTimestamp="2026-05-21 18:20:17 +0000 UTC" firstStartedPulling="2026-05-21 18:20:20.313446388 +0000 UTC m=+3.185665275" lastFinishedPulling="2026-05-21 18:20:30.285389064 +0000 UTC m=+13.157607940" observedRunningTime="2026-05-21 18:20:38.849325523 +0000 UTC m=+21.721544420" watchObservedRunningTime="2026-05-21 18:20:38.850387049 +0000 UTC m=+21.722605948" May 21 18:20:39.283990 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:39.283965 2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 21 18:20:39.637321 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:39.637197 2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T18:20:39.283988162Z","UUID":"f3419db8-ebe3-486a-a5ac-4abc6bde53e0","Handler":null,"Name":"","Endpoint":""} May 21 18:20:39.639122 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:39.639101 2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 21 18:20:39.639122 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:39.639127 2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 21 18:20:39.693595 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:39.693556 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdhhw" May 21 18:20:39.693595 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:39.693588 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t2w2" May 21 18:20:39.693855 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:39.693663 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdhhw" podUID="d926e5e1-fb8a-4636-b0f6-3894327080b2" May 21 18:20:39.693855 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:39.693788 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t2w2" podUID="fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2" May 21 18:20:39.786005 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:39.785913 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97twf" event={"ID":"2230ed31-9307-4367-8e2d-3e62a2a9024e","Type":"ContainerStarted","Data":"3110105fd7a0ed7a1dac69907ba5624d09254d3d27c152a770cc423c7d34b667"} May 21 18:20:39.787539 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:39.787506 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-clf55" event={"ID":"8985453b-f388-46b3-bdbc-51cf28a797f7","Type":"ContainerStarted","Data":"6cad7fdc0e30537721e27d66b668dc9450cc12643591c6317c42307f5065bf8e"} May 21 18:20:39.803680 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:39.803620 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-clf55" podStartSLOduration=3.887695888 podStartE2EDuration="21.803598987s" podCreationTimestamp="2026-05-21 18:20:18 +0000 UTC" firstStartedPulling="2026-05-21 18:20:20.303634296 +0000 UTC m=+3.175853172" lastFinishedPulling="2026-05-21 18:20:38.219537381 +0000 UTC m=+21.091756271" observedRunningTime="2026-05-21 18:20:39.803482597 +0000 UTC m=+22.675701497" watchObservedRunningTime="2026-05-21 18:20:39.803598987 +0000 UTC m=+22.675817883" May 21 18:20:40.693470 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:40.693441 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jkfk" May 21 18:20:40.693649 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:40.693557 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jkfk" podUID="cd76353a-e179-4a53-8e6d-5cd72be55da8" May 21 18:20:40.791797 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:40.791717 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97twf" event={"ID":"2230ed31-9307-4367-8e2d-3e62a2a9024e","Type":"ContainerStarted","Data":"f4e8cc52db89d636989b944a96cf478ebd2b0261c608e404df50165e7bf66488"} May 21 18:20:41.693649 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:41.693478 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdhhw" May 21 18:20:41.693823 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:41.693478 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t2w2" May 21 18:20:41.693823 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:41.693751 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdhhw" podUID="d926e5e1-fb8a-4636-b0f6-3894327080b2" May 21 18:20:41.693823 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:41.693798 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t2w2" podUID="fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2" May 21 18:20:41.796645 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:41.796613 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" event={"ID":"a443b811-896a-45da-a1c0-6fdea5e9465d","Type":"ContainerStarted","Data":"38214cb0c79b39be7bd2727b58c08c6ec79015065f3413d1232bed2255bbd433"} May 21 18:20:41.840395 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:41.840363 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-m7nqz" May 21 18:20:41.841044 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:41.841021 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-m7nqz" May 21 18:20:41.859444 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:41.859391 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97twf" podStartSLOduration=3.713318113 podStartE2EDuration="23.859372777s" podCreationTimestamp="2026-05-21 18:20:18 +0000 UTC" firstStartedPulling="2026-05-21 18:20:20.301626964 +0000 UTC m=+3.173845841" lastFinishedPulling="2026-05-21 18:20:40.447681626 +0000 UTC m=+23.319900505" observedRunningTime="2026-05-21 18:20:40.810247403 +0000 UTC m=+23.682466304" watchObservedRunningTime="2026-05-21 18:20:41.859372777 +0000 UTC m=+24.731591675" May 21 18:20:42.693192 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:42.693146 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jkfk" May 21 18:20:42.693381 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:42.693278 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jkfk" podUID="cd76353a-e179-4a53-8e6d-5cd72be55da8" May 21 18:20:43.050390 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:43.050359 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-m7nqz" May 21 18:20:43.051110 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:43.051092 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-m7nqz" May 21 18:20:43.693450 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:43.693212 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdhhw" May 21 18:20:43.693778 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:43.693227 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t2w2" May 21 18:20:43.693778 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:43.693568 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdhhw" podUID="d926e5e1-fb8a-4636-b0f6-3894327080b2" May 21 18:20:43.693778 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:43.693647 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t2w2" podUID="fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2" May 21 18:20:43.804265 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:43.804231 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" event={"ID":"a443b811-896a-45da-a1c0-6fdea5e9465d","Type":"ContainerStarted","Data":"3de9a6681e9131b605cfcdd41d5ea600f878539af8d89b19def4939fd20aab13"} May 21 18:20:43.831285 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:43.831240 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" podStartSLOduration=8.849761251 podStartE2EDuration="26.831222582s" podCreationTimestamp="2026-05-21 18:20:17 +0000 UTC" firstStartedPulling="2026-05-21 18:20:20.306677671 +0000 UTC m=+3.178896546" lastFinishedPulling="2026-05-21 18:20:38.288138987 +0000 UTC m=+21.160357877" observedRunningTime="2026-05-21 18:20:43.831001735 +0000 UTC m=+26.703220638" watchObservedRunningTime="2026-05-21 18:20:43.831222582 +0000 UTC m=+26.703441501" May 21 18:20:44.692664 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:44.692634 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jkfk" May 21 18:20:44.693137 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:44.692791 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jkfk" podUID="cd76353a-e179-4a53-8e6d-5cd72be55da8" May 21 18:20:44.806516 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:44.806473 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:44.806516 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:44.806515 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:44.806759 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:44.806556 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:44.822770 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:44.822729 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:44.823206 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:44.823184 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:20:45.150753 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:45.150722 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4jkfk"] May 21 18:20:45.150935 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:45.150853 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jkfk" May 21 18:20:45.151002 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:45.150954 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jkfk" podUID="cd76353a-e179-4a53-8e6d-5cd72be55da8" May 21 18:20:45.153657 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:45.153619 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qdhhw"] May 21 18:20:45.153793 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:45.153745 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdhhw" May 21 18:20:45.153873 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:45.153844 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdhhw" podUID="d926e5e1-fb8a-4636-b0f6-3894327080b2" May 21 18:20:45.156831 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:45.156808 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2t2w2"] May 21 18:20:45.156946 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:45.156914 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t2w2" May 21 18:20:45.157033 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:45.157014 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t2w2" podUID="fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2" May 21 18:20:45.809354 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:45.809274 2575 generic.go:358] "Generic (PLEG): container finished" podID="27f7f26f-c37c-4ead-85af-112a370e400e" containerID="6af52ca18b0445b2efe55b65b9ee1fcf725d85f8b0ce277de16a99cdfd579b73" exitCode=0 May 21 18:20:45.809754 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:45.809356 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t6hgn" event={"ID":"27f7f26f-c37c-4ead-85af-112a370e400e","Type":"ContainerDied","Data":"6af52ca18b0445b2efe55b65b9ee1fcf725d85f8b0ce277de16a99cdfd579b73"} May 21 18:20:46.692646 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:46.692619 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdhhw" May 21 18:20:46.692836 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:46.692726 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jkfk" May 21 18:20:46.692836 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:46.692730 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdhhw" podUID="d926e5e1-fb8a-4636-b0f6-3894327080b2" May 21 18:20:46.692836 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:46.692822 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jkfk" podUID="cd76353a-e179-4a53-8e6d-5cd72be55da8" May 21 18:20:46.692969 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:46.692866 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t2w2" May 21 18:20:46.692969 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:46.692932 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t2w2" podUID="fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2" May 21 18:20:47.814175 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:47.814007 2575 generic.go:358] "Generic (PLEG): container finished" podID="27f7f26f-c37c-4ead-85af-112a370e400e" containerID="1821bf79368085e6657da10d6388155cb4a22c9f63b103e80230c868b9d48ac7" exitCode=0 May 21 18:20:47.814175 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:47.814094 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t6hgn" event={"ID":"27f7f26f-c37c-4ead-85af-112a370e400e","Type":"ContainerDied","Data":"1821bf79368085e6657da10d6388155cb4a22c9f63b103e80230c868b9d48ac7"} May 21 18:20:48.693583 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:48.693552 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jkfk" May 21 18:20:48.693847 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:48.693555 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdhhw" May 21 18:20:48.693847 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:48.693672 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jkfk" podUID="cd76353a-e179-4a53-8e6d-5cd72be55da8" May 21 18:20:48.693847 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:48.693768 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdhhw" podUID="d926e5e1-fb8a-4636-b0f6-3894327080b2" May 21 18:20:48.693847 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:48.693555 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t2w2" May 21 18:20:48.694030 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:48.693908 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t2w2" podUID="fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2" May 21 18:20:49.819208 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:49.819172 2575 generic.go:358] "Generic (PLEG): container finished" podID="27f7f26f-c37c-4ead-85af-112a370e400e" containerID="fdd9b3bccd87c2de2e450a7dae3aec5ba44066c44fb21e091a6e87460ec98c59" exitCode=0 May 21 18:20:49.819645 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:49.819228 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t6hgn" event={"ID":"27f7f26f-c37c-4ead-85af-112a370e400e","Type":"ContainerDied","Data":"fdd9b3bccd87c2de2e450a7dae3aec5ba44066c44fb21e091a6e87460ec98c59"} May 21 18:20:50.692997 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:50.692964 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t2w2" May 21 18:20:50.693188 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:50.692964 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdhhw" May 21 18:20:50.693188 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:50.693108 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t2w2" podUID="fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2" May 21 18:20:50.693188 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:50.692964 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jkfk" May 21 18:20:50.693347 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:50.693143 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdhhw" podUID="d926e5e1-fb8a-4636-b0f6-3894327080b2" May 21 18:20:50.693347 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:50.693256 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jkfk" podUID="cd76353a-e179-4a53-8e6d-5cd72be55da8" May 21 18:20:50.934962 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:50.934931 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeReady" May 21 18:20:50.935478 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:50.935060 2575 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 21 18:20:50.969579 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:50.969504 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-zv4r9"] May 21 18:20:51.003218 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.003172 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-57d8c96475-qkmxn"] May 21 18:20:51.003843 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.003808 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-zv4r9" May 21 18:20:51.006863 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.006617 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-5s7jh\"" May 21 18:20:51.006863 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.006617 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" May 21 18:20:51.007040 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.007024 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" May 21 18:20:51.035280 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.035252 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-zv4r9"] May 21 18:20:51.035427 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.035290 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-969c65c8c-b8z45"] May 21 18:20:51.035427 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.035372 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57d8c96475-qkmxn" May 21 18:20:51.037995 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.037972 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 21 18:20:51.038385 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.038335 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 21 18:20:51.038474 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.038335 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-v98cm\"" May 21 18:20:51.038622 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.038607 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 21 18:20:51.047249 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.045518 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 21 18:20:51.061877 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.061852 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7ff7fdd444-cjf7n"] May 21 18:20:51.062029 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.062009 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-969c65c8c-b8z45" May 21 18:20:51.064548 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.064524 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" May 21 18:20:51.064662 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.064531 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" May 21 18:20:51.064662 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.064566 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" May 21 18:20:51.064863 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.064810 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" May 21 18:20:51.089778 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.089756 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675c46dc6d-7fl97"] May 21 18:20:51.089921 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.089893 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7ff7fdd444-cjf7n" May 21 18:20:51.092672 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.092653 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-4fp6j\"" May 21 18:20:51.092870 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.092778 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" May 21 18:20:51.117155 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.117123 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57d8c96475-qkmxn"] May 21 18:20:51.117281 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.117168 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hvz8j"] May 21 18:20:51.117338 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.117295 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675c46dc6d-7fl97" May 21 18:20:51.120231 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.120208 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" May 21 18:20:51.120345 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.120302 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" May 21 18:20:51.120607 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.120488 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" May 21 18:20:51.120607 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.120551 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" May 21 18:20:51.132320 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.132296 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5525e1f2-eb94-4f1d-a739-41de787d3bc9-ca-trust-extracted\") pod \"image-registry-57d8c96475-qkmxn\" (UID: \"5525e1f2-eb94-4f1d-a739-41de787d3bc9\") " pod="openshift-image-registry/image-registry-57d8c96475-qkmxn" May 21 18:20:51.132433 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.132328 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d77v5\" (UniqueName: \"kubernetes.io/projected/5525e1f2-eb94-4f1d-a739-41de787d3bc9-kube-api-access-d77v5\") pod \"image-registry-57d8c96475-qkmxn\" (UID: \"5525e1f2-eb94-4f1d-a739-41de787d3bc9\") " pod="openshift-image-registry/image-registry-57d8c96475-qkmxn" May 21 18:20:51.132433 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.132348 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5525e1f2-eb94-4f1d-a739-41de787d3bc9-registry-tls\") pod \"image-registry-57d8c96475-qkmxn\" (UID: \"5525e1f2-eb94-4f1d-a739-41de787d3bc9\") " pod="openshift-image-registry/image-registry-57d8c96475-qkmxn" May 21 18:20:51.132433 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.132376 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a6cc67ce-5941-49a0-bc77-5239759537ec-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-zv4r9\" (UID: \"a6cc67ce-5941-49a0-bc77-5239759537ec\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-zv4r9" May 21 18:20:51.132602 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.132436 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5525e1f2-eb94-4f1d-a739-41de787d3bc9-installation-pull-secrets\") pod \"image-registry-57d8c96475-qkmxn\" (UID: \"5525e1f2-eb94-4f1d-a739-41de787d3bc9\") " pod="openshift-image-registry/image-registry-57d8c96475-qkmxn" May 21 18:20:51.132602 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.132472 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a6cc67ce-5941-49a0-bc77-5239759537ec-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-zv4r9\" (UID: \"a6cc67ce-5941-49a0-bc77-5239759537ec\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-zv4r9" May 21 18:20:51.132602 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.132498 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5525e1f2-eb94-4f1d-a739-41de787d3bc9-trusted-ca\") pod \"image-registry-57d8c96475-qkmxn\" (UID: \"5525e1f2-eb94-4f1d-a739-41de787d3bc9\") " pod="openshift-image-registry/image-registry-57d8c96475-qkmxn" May 21 18:20:51.132602 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.132518 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5525e1f2-eb94-4f1d-a739-41de787d3bc9-registry-certificates\") pod \"image-registry-57d8c96475-qkmxn\" (UID: \"5525e1f2-eb94-4f1d-a739-41de787d3bc9\") " pod="openshift-image-registry/image-registry-57d8c96475-qkmxn" May 21 18:20:51.132602 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.132564 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5525e1f2-eb94-4f1d-a739-41de787d3bc9-image-registry-private-configuration\") pod \"image-registry-57d8c96475-qkmxn\" (UID: \"5525e1f2-eb94-4f1d-a739-41de787d3bc9\") " pod="openshift-image-registry/image-registry-57d8c96475-qkmxn" May 21 18:20:51.132797 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.132600 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5525e1f2-eb94-4f1d-a739-41de787d3bc9-bound-sa-token\") pod \"image-registry-57d8c96475-qkmxn\" (UID: \"5525e1f2-eb94-4f1d-a739-41de787d3bc9\") " pod="openshift-image-registry/image-registry-57d8c96475-qkmxn" May 21 18:20:51.145368 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.145344 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-r5jsq"] May 21 18:20:51.145472 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.145413 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hvz8j" May 21 18:20:51.148000 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.147980 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 21 18:20:51.148097 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.148028 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hpqft\"" May 21 18:20:51.148097 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.148038 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 21 18:20:51.168356 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.168144 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7ff7fdd444-cjf7n"] May 21 18:20:51.168356 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.168224 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-969c65c8c-b8z45"] May 21 18:20:51.168356 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.168239 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675c46dc6d-7fl97"] May 21 18:20:51.168356 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.168253 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r5jsq"] May 21 18:20:51.168356 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.168265 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hvz8j"] May 21 18:20:51.169206 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.168416 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r5jsq" May 21 18:20:51.170951 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.170925 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 21 18:20:51.171278 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.171162 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 21 18:20:51.171278 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.171171 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fn9qn\"" May 21 18:20:51.171278 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.171205 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 21 18:20:51.233813 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.233736 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5525e1f2-eb94-4f1d-a739-41de787d3bc9-registry-certificates\") pod \"image-registry-57d8c96475-qkmxn\" (UID: \"5525e1f2-eb94-4f1d-a739-41de787d3bc9\") " pod="openshift-image-registry/image-registry-57d8c96475-qkmxn" May 21 18:20:51.233813 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.233771 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3-tmp-dir\") pod \"dns-default-hvz8j\" (UID: \"f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3\") " pod="openshift-dns/dns-default-hvz8j" May 21 18:20:51.233813 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.233800 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/dd367223-ae83-4b83-baae-3061b3d042fd-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-675c46dc6d-7fl97\" (UID: \"dd367223-ae83-4b83-baae-3061b3d042fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675c46dc6d-7fl97" May 21 18:20:51.234098 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.233824 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/935aa599-dc2d-405c-bdb7-35f640292448-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7ff7fdd444-cjf7n\" (UID: \"935aa599-dc2d-405c-bdb7-35f640292448\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7ff7fdd444-cjf7n" May 21 18:20:51.234098 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.233979 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5525e1f2-eb94-4f1d-a739-41de787d3bc9-image-registry-private-configuration\") pod \"image-registry-57d8c96475-qkmxn\" (UID: \"5525e1f2-eb94-4f1d-a739-41de787d3bc9\") " pod="openshift-image-registry/image-registry-57d8c96475-qkmxn" May 21 18:20:51.234098 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.234011 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/dd367223-ae83-4b83-baae-3061b3d042fd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-675c46dc6d-7fl97\" (UID: \"dd367223-ae83-4b83-baae-3061b3d042fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675c46dc6d-7fl97" May 21 18:20:51.234098 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.234044 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d35335b3-9d55-4fbe-86b2-43f42a5a36cd-klusterlet-config\") pod \"klusterlet-addon-workmgr-969c65c8c-b8z45\" (UID: \"d35335b3-9d55-4fbe-86b2-43f42a5a36cd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-969c65c8c-b8z45" May 21 18:20:51.234271 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.234119 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5525e1f2-eb94-4f1d-a739-41de787d3bc9-bound-sa-token\") pod \"image-registry-57d8c96475-qkmxn\" (UID: \"5525e1f2-eb94-4f1d-a739-41de787d3bc9\") " pod="openshift-image-registry/image-registry-57d8c96475-qkmxn" May 21 18:20:51.234271 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.234147 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/dd367223-ae83-4b83-baae-3061b3d042fd-hub\") pod \"cluster-proxy-proxy-agent-675c46dc6d-7fl97\" (UID: \"dd367223-ae83-4b83-baae-3061b3d042fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675c46dc6d-7fl97" May 21 18:20:51.234271 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.234171 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/dd367223-ae83-4b83-baae-3061b3d042fd-ca\") pod \"cluster-proxy-proxy-agent-675c46dc6d-7fl97\" (UID: \"dd367223-ae83-4b83-baae-3061b3d042fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675c46dc6d-7fl97" May 21 18:20:51.234271 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.234195 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msbfx\" (UniqueName: \"kubernetes.io/projected/935aa599-dc2d-405c-bdb7-35f640292448-kube-api-access-msbfx\") pod \"managed-serviceaccount-addon-agent-7ff7fdd444-cjf7n\" (UID: \"935aa599-dc2d-405c-bdb7-35f640292448\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7ff7fdd444-cjf7n" May 21 18:20:51.234271 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.234235 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3-metrics-tls\") pod \"dns-default-hvz8j\" (UID: \"f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3\") " pod="openshift-dns/dns-default-hvz8j" May 21 18:20:51.234271 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.234270 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5525e1f2-eb94-4f1d-a739-41de787d3bc9-ca-trust-extracted\") pod \"image-registry-57d8c96475-qkmxn\" (UID: \"5525e1f2-eb94-4f1d-a739-41de787d3bc9\") " pod="openshift-image-registry/image-registry-57d8c96475-qkmxn" May 21 18:20:51.234555 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.234297 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d77v5\" (UniqueName: \"kubernetes.io/projected/5525e1f2-eb94-4f1d-a739-41de787d3bc9-kube-api-access-d77v5\") pod \"image-registry-57d8c96475-qkmxn\" (UID: \"5525e1f2-eb94-4f1d-a739-41de787d3bc9\") " pod="openshift-image-registry/image-registry-57d8c96475-qkmxn" May 21 18:20:51.234555 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.234321 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3-config-volume\") pod \"dns-default-hvz8j\" (UID: \"f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3\") " pod="openshift-dns/dns-default-hvz8j" May 21 18:20:51.234555 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.234335 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5525e1f2-eb94-4f1d-a739-41de787d3bc9-registry-certificates\") pod \"image-registry-57d8c96475-qkmxn\" (UID: \"5525e1f2-eb94-4f1d-a739-41de787d3bc9\") " pod="openshift-image-registry/image-registry-57d8c96475-qkmxn" May 21 18:20:51.234555 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.234350 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5525e1f2-eb94-4f1d-a739-41de787d3bc9-registry-tls\") pod \"image-registry-57d8c96475-qkmxn\" (UID: \"5525e1f2-eb94-4f1d-a739-41de787d3bc9\") " pod="openshift-image-registry/image-registry-57d8c96475-qkmxn" May 21 18:20:51.234555 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.234384 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a6cc67ce-5941-49a0-bc77-5239759537ec-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-zv4r9\" (UID: \"a6cc67ce-5941-49a0-bc77-5239759537ec\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-zv4r9" May 21 18:20:51.234555 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:51.234425 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 18:20:51.234555 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:51.234438 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57d8c96475-qkmxn: secret "image-registry-tls" not found May 21 18:20:51.234555 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:51.234486 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5525e1f2-eb94-4f1d-a739-41de787d3bc9-registry-tls podName:5525e1f2-eb94-4f1d-a739-41de787d3bc9 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:51.734469204 +0000 UTC m=+34.606688103 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5525e1f2-eb94-4f1d-a739-41de787d3bc9-registry-tls") pod "image-registry-57d8c96475-qkmxn" (UID: "5525e1f2-eb94-4f1d-a739-41de787d3bc9") : secret "image-registry-tls" not found May 21 18:20:51.234954 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:51.234691 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 18:20:51.234954 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.234427 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5525e1f2-eb94-4f1d-a739-41de787d3bc9-installation-pull-secrets\") pod \"image-registry-57d8c96475-qkmxn\" (UID: \"5525e1f2-eb94-4f1d-a739-41de787d3bc9\") " pod="openshift-image-registry/image-registry-57d8c96475-qkmxn" May 21 18:20:51.234954 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:51.234761 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6cc67ce-5941-49a0-bc77-5239759537ec-networking-console-plugin-cert podName:a6cc67ce-5941-49a0-bc77-5239759537ec nodeName:}" failed. No retries permitted until 2026-05-21 18:20:51.734744437 +0000 UTC m=+34.606963342 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a6cc67ce-5941-49a0-bc77-5239759537ec-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-zv4r9" (UID: "a6cc67ce-5941-49a0-bc77-5239759537ec") : secret "networking-console-plugin-cert" not found May 21 18:20:51.234954 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.234817 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2rjz\" (UniqueName: \"kubernetes.io/projected/dd367223-ae83-4b83-baae-3061b3d042fd-kube-api-access-m2rjz\") pod \"cluster-proxy-proxy-agent-675c46dc6d-7fl97\" (UID: \"dd367223-ae83-4b83-baae-3061b3d042fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675c46dc6d-7fl97" May 21 18:20:51.235137 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.234960 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a6cc67ce-5941-49a0-bc77-5239759537ec-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-zv4r9\" (UID: \"a6cc67ce-5941-49a0-bc77-5239759537ec\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-zv4r9" May 21 18:20:51.235137 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.235010 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5525e1f2-eb94-4f1d-a739-41de787d3bc9-ca-trust-extracted\") pod \"image-registry-57d8c96475-qkmxn\" (UID: \"5525e1f2-eb94-4f1d-a739-41de787d3bc9\") " pod="openshift-image-registry/image-registry-57d8c96475-qkmxn" May 21 18:20:51.235137 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.235018 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88c9s\" (UniqueName: \"kubernetes.io/projected/f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3-kube-api-access-88c9s\") pod \"dns-default-hvz8j\" (UID: \"f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3\") " pod="openshift-dns/dns-default-hvz8j" May 21 18:20:51.235137 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.235047 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dd367223-ae83-4b83-baae-3061b3d042fd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-675c46dc6d-7fl97\" (UID: \"dd367223-ae83-4b83-baae-3061b3d042fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675c46dc6d-7fl97" May 21 18:20:51.235137 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.235072 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2fzc\" (UniqueName: \"kubernetes.io/projected/d35335b3-9d55-4fbe-86b2-43f42a5a36cd-kube-api-access-v2fzc\") pod \"klusterlet-addon-workmgr-969c65c8c-b8z45\" (UID: \"d35335b3-9d55-4fbe-86b2-43f42a5a36cd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-969c65c8c-b8z45" May 21 18:20:51.235137 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.235128 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5525e1f2-eb94-4f1d-a739-41de787d3bc9-trusted-ca\") pod \"image-registry-57d8c96475-qkmxn\" (UID: \"5525e1f2-eb94-4f1d-a739-41de787d3bc9\") " pod="openshift-image-registry/image-registry-57d8c96475-qkmxn" May 21 18:20:51.235431 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.235176 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d35335b3-9d55-4fbe-86b2-43f42a5a36cd-tmp\") pod \"klusterlet-addon-workmgr-969c65c8c-b8z45\" (UID: \"d35335b3-9d55-4fbe-86b2-43f42a5a36cd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-969c65c8c-b8z45" May 21 18:20:51.235589 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.235567 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a6cc67ce-5941-49a0-bc77-5239759537ec-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-zv4r9\" (UID: \"a6cc67ce-5941-49a0-bc77-5239759537ec\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-zv4r9" May 21 18:20:51.236021 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.236003 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5525e1f2-eb94-4f1d-a739-41de787d3bc9-trusted-ca\") pod \"image-registry-57d8c96475-qkmxn\" (UID: \"5525e1f2-eb94-4f1d-a739-41de787d3bc9\") " pod="openshift-image-registry/image-registry-57d8c96475-qkmxn" May 21 18:20:51.239371 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.239349 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5525e1f2-eb94-4f1d-a739-41de787d3bc9-installation-pull-secrets\") pod \"image-registry-57d8c96475-qkmxn\" (UID: \"5525e1f2-eb94-4f1d-a739-41de787d3bc9\") " pod="openshift-image-registry/image-registry-57d8c96475-qkmxn" May 21 18:20:51.239469 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.239349 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5525e1f2-eb94-4f1d-a739-41de787d3bc9-image-registry-private-configuration\") pod \"image-registry-57d8c96475-qkmxn\" (UID: \"5525e1f2-eb94-4f1d-a739-41de787d3bc9\") " pod="openshift-image-registry/image-registry-57d8c96475-qkmxn" May 21 18:20:51.243567 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.243546 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5525e1f2-eb94-4f1d-a739-41de787d3bc9-bound-sa-token\") pod \"image-registry-57d8c96475-qkmxn\" (UID: \"5525e1f2-eb94-4f1d-a739-41de787d3bc9\") " pod="openshift-image-registry/image-registry-57d8c96475-qkmxn" May 21 18:20:51.243808 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.243791 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d77v5\" (UniqueName: \"kubernetes.io/projected/5525e1f2-eb94-4f1d-a739-41de787d3bc9-kube-api-access-d77v5\") pod \"image-registry-57d8c96475-qkmxn\" (UID: \"5525e1f2-eb94-4f1d-a739-41de787d3bc9\") " pod="openshift-image-registry/image-registry-57d8c96475-qkmxn" May 21 18:20:51.335991 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.335959 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02844de9-e521-48a2-98b7-b2147b0080b2-cert\") pod \"ingress-canary-r5jsq\" (UID: \"02844de9-e521-48a2-98b7-b2147b0080b2\") " pod="openshift-ingress-canary/ingress-canary-r5jsq" May 21 18:20:51.335991 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.336004 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d35335b3-9d55-4fbe-86b2-43f42a5a36cd-tmp\") pod \"klusterlet-addon-workmgr-969c65c8c-b8z45\" (UID: \"d35335b3-9d55-4fbe-86b2-43f42a5a36cd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-969c65c8c-b8z45" May 21 18:20:51.336230 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.336031 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsnqk\" (UniqueName: \"kubernetes.io/projected/02844de9-e521-48a2-98b7-b2147b0080b2-kube-api-access-qsnqk\") pod \"ingress-canary-r5jsq\" (UID: \"02844de9-e521-48a2-98b7-b2147b0080b2\") " pod="openshift-ingress-canary/ingress-canary-r5jsq" May 21 18:20:51.336230 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.336071 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-msbfx\" (UniqueName: \"kubernetes.io/projected/935aa599-dc2d-405c-bdb7-35f640292448-kube-api-access-msbfx\") pod \"managed-serviceaccount-addon-agent-7ff7fdd444-cjf7n\" (UID: \"935aa599-dc2d-405c-bdb7-35f640292448\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7ff7fdd444-cjf7n" May 21 18:20:51.336230 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.336093 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/dd367223-ae83-4b83-baae-3061b3d042fd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-675c46dc6d-7fl97\" (UID: \"dd367223-ae83-4b83-baae-3061b3d042fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675c46dc6d-7fl97" May 21 18:20:51.336230 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.336119 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2-metrics-certs\") pod \"network-metrics-daemon-2t2w2\" (UID: \"fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2\") " pod="openshift-multus/network-metrics-daemon-2t2w2" May 21 18:20:51.336230 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.336143 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/dd367223-ae83-4b83-baae-3061b3d042fd-hub\") pod \"cluster-proxy-proxy-agent-675c46dc6d-7fl97\" (UID: \"dd367223-ae83-4b83-baae-3061b3d042fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675c46dc6d-7fl97" May 21 18:20:51.336230 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.336181 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v2fzc\" (UniqueName: \"kubernetes.io/projected/d35335b3-9d55-4fbe-86b2-43f42a5a36cd-kube-api-access-v2fzc\") pod \"klusterlet-addon-workmgr-969c65c8c-b8z45\" (UID: \"d35335b3-9d55-4fbe-86b2-43f42a5a36cd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-969c65c8c-b8z45" May 21 18:20:51.336230 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.336208 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dd367223-ae83-4b83-baae-3061b3d042fd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-675c46dc6d-7fl97\" (UID: \"dd367223-ae83-4b83-baae-3061b3d042fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675c46dc6d-7fl97" May 21 18:20:51.336558 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:51.336241 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 18:20:51.336558 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.336270 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-88c9s\" (UniqueName: \"kubernetes.io/projected/f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3-kube-api-access-88c9s\") pod \"dns-default-hvz8j\" (UID: \"f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3\") " pod="openshift-dns/dns-default-hvz8j" May 21 18:20:51.336558 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:51.336310 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2-metrics-certs podName:fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2 nodeName:}" failed. No retries permitted until 2026-05-21 18:21:23.336290176 +0000 UTC m=+66.208509067 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2-metrics-certs") pod "network-metrics-daemon-2t2w2" (UID: "fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 18:20:51.336558 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.336349 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3-tmp-dir\") pod \"dns-default-hvz8j\" (UID: \"f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3\") " pod="openshift-dns/dns-default-hvz8j" May 21 18:20:51.336558 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.336378 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/dd367223-ae83-4b83-baae-3061b3d042fd-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-675c46dc6d-7fl97\" (UID: \"dd367223-ae83-4b83-baae-3061b3d042fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675c46dc6d-7fl97" May 21 18:20:51.336558 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.336418 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d35335b3-9d55-4fbe-86b2-43f42a5a36cd-klusterlet-config\") pod \"klusterlet-addon-workmgr-969c65c8c-b8z45\" (UID: \"d35335b3-9d55-4fbe-86b2-43f42a5a36cd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-969c65c8c-b8z45" May 21 18:20:51.336558 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.336420 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d35335b3-9d55-4fbe-86b2-43f42a5a36cd-tmp\") pod \"klusterlet-addon-workmgr-969c65c8c-b8z45\" (UID: \"d35335b3-9d55-4fbe-86b2-43f42a5a36cd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-969c65c8c-b8z45" May 21 18:20:51.336558 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.336448 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/dd367223-ae83-4b83-baae-3061b3d042fd-ca\") pod \"cluster-proxy-proxy-agent-675c46dc6d-7fl97\" (UID: \"dd367223-ae83-4b83-baae-3061b3d042fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675c46dc6d-7fl97" May 21 18:20:51.336558 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.336476 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3-metrics-tls\") pod \"dns-default-hvz8j\" (UID: \"f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3\") " pod="openshift-dns/dns-default-hvz8j" May 21 18:20:51.337013 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.336804 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3-tmp-dir\") pod \"dns-default-hvz8j\" (UID: \"f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3\") " pod="openshift-dns/dns-default-hvz8j" May 21 18:20:51.337013 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:51.336837 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 18:20:51.337013 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:51.336892 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3-metrics-tls podName:f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:51.836878266 +0000 UTC m=+34.709097142 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3-metrics-tls") pod "dns-default-hvz8j" (UID: "f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3") : secret "dns-default-metrics-tls" not found May 21 18:20:51.337013 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.336932 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3-config-volume\") pod \"dns-default-hvz8j\" (UID: \"f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3\") " pod="openshift-dns/dns-default-hvz8j" May 21 18:20:51.337013 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.336977 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m2rjz\" (UniqueName: \"kubernetes.io/projected/dd367223-ae83-4b83-baae-3061b3d042fd-kube-api-access-m2rjz\") pod \"cluster-proxy-proxy-agent-675c46dc6d-7fl97\" (UID: \"dd367223-ae83-4b83-baae-3061b3d042fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675c46dc6d-7fl97" May 21 18:20:51.337013 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.337013 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/935aa599-dc2d-405c-bdb7-35f640292448-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7ff7fdd444-cjf7n\" (UID: \"935aa599-dc2d-405c-bdb7-35f640292448\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7ff7fdd444-cjf7n" May 21 18:20:51.337306 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.337188 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/dd367223-ae83-4b83-baae-3061b3d042fd-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-675c46dc6d-7fl97\" (UID: \"dd367223-ae83-4b83-baae-3061b3d042fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675c46dc6d-7fl97" May 21 18:20:51.337691 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.337648 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3-config-volume\") pod \"dns-default-hvz8j\" (UID: \"f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3\") " pod="openshift-dns/dns-default-hvz8j" May 21 18:20:51.339293 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.339262 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/dd367223-ae83-4b83-baae-3061b3d042fd-ca\") pod \"cluster-proxy-proxy-agent-675c46dc6d-7fl97\" (UID: \"dd367223-ae83-4b83-baae-3061b3d042fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675c46dc6d-7fl97" May 21 18:20:51.339410 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.339398 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d35335b3-9d55-4fbe-86b2-43f42a5a36cd-klusterlet-config\") pod \"klusterlet-addon-workmgr-969c65c8c-b8z45\" (UID: \"d35335b3-9d55-4fbe-86b2-43f42a5a36cd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-969c65c8c-b8z45" May 21 18:20:51.339731 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.339694 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/dd367223-ae83-4b83-baae-3061b3d042fd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-675c46dc6d-7fl97\" (UID: \"dd367223-ae83-4b83-baae-3061b3d042fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675c46dc6d-7fl97" May 21 18:20:51.339820 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.339793 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/935aa599-dc2d-405c-bdb7-35f640292448-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7ff7fdd444-cjf7n\" (UID: \"935aa599-dc2d-405c-bdb7-35f640292448\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7ff7fdd444-cjf7n" May 21 18:20:51.339820 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.339807 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dd367223-ae83-4b83-baae-3061b3d042fd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-675c46dc6d-7fl97\" (UID: \"dd367223-ae83-4b83-baae-3061b3d042fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675c46dc6d-7fl97" May 21 18:20:51.340811 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.340787 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/dd367223-ae83-4b83-baae-3061b3d042fd-hub\") pod \"cluster-proxy-proxy-agent-675c46dc6d-7fl97\" (UID: \"dd367223-ae83-4b83-baae-3061b3d042fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675c46dc6d-7fl97" May 21 18:20:51.344566 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.344523 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-msbfx\" (UniqueName: \"kubernetes.io/projected/935aa599-dc2d-405c-bdb7-35f640292448-kube-api-access-msbfx\") pod \"managed-serviceaccount-addon-agent-7ff7fdd444-cjf7n\" (UID: \"935aa599-dc2d-405c-bdb7-35f640292448\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7ff7fdd444-cjf7n" May 21 18:20:51.345236 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.345212 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88c9s\" (UniqueName: \"kubernetes.io/projected/f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3-kube-api-access-88c9s\") pod \"dns-default-hvz8j\" (UID: \"f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3\") " pod="openshift-dns/dns-default-hvz8j" May 21 18:20:51.345341 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.345320 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2fzc\" (UniqueName: \"kubernetes.io/projected/d35335b3-9d55-4fbe-86b2-43f42a5a36cd-kube-api-access-v2fzc\") pod \"klusterlet-addon-workmgr-969c65c8c-b8z45\" (UID: \"d35335b3-9d55-4fbe-86b2-43f42a5a36cd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-969c65c8c-b8z45" May 21 18:20:51.345861 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.345842 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2rjz\" (UniqueName: \"kubernetes.io/projected/dd367223-ae83-4b83-baae-3061b3d042fd-kube-api-access-m2rjz\") pod \"cluster-proxy-proxy-agent-675c46dc6d-7fl97\" (UID: \"dd367223-ae83-4b83-baae-3061b3d042fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675c46dc6d-7fl97" May 21 18:20:51.371505 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.371482 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-969c65c8c-b8z45" May 21 18:20:51.407983 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.407947 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7ff7fdd444-cjf7n" May 21 18:20:51.428240 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.427812 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675c46dc6d-7fl97" May 21 18:20:51.438123 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.438044 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02844de9-e521-48a2-98b7-b2147b0080b2-cert\") pod \"ingress-canary-r5jsq\" (UID: \"02844de9-e521-48a2-98b7-b2147b0080b2\") " pod="openshift-ingress-canary/ingress-canary-r5jsq" May 21 18:20:51.438123 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.438091 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qsnqk\" (UniqueName: \"kubernetes.io/projected/02844de9-e521-48a2-98b7-b2147b0080b2-kube-api-access-qsnqk\") pod \"ingress-canary-r5jsq\" (UID: \"02844de9-e521-48a2-98b7-b2147b0080b2\") " pod="openshift-ingress-canary/ingress-canary-r5jsq" May 21 18:20:51.438123 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.438124 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t7lqt\" (UniqueName: \"kubernetes.io/projected/cd76353a-e179-4a53-8e6d-5cd72be55da8-kube-api-access-t7lqt\") pod \"network-check-target-4jkfk\" (UID: \"cd76353a-e179-4a53-8e6d-5cd72be55da8\") " pod="openshift-network-diagnostics/network-check-target-4jkfk" May 21 18:20:51.438342 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:51.438196 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 18:20:51.438342 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:51.438278 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02844de9-e521-48a2-98b7-b2147b0080b2-cert podName:02844de9-e521-48a2-98b7-b2147b0080b2 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:51.938261065 +0000 UTC m=+34.810479985 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/02844de9-e521-48a2-98b7-b2147b0080b2-cert") pod "ingress-canary-r5jsq" (UID: "02844de9-e521-48a2-98b7-b2147b0080b2") : secret "canary-serving-cert" not found May 21 18:20:51.438342 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:51.438291 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 18:20:51.438342 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:51.438309 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 18:20:51.438342 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:51.438324 2575 projected.go:194] Error preparing data for projected volume kube-api-access-t7lqt for pod openshift-network-diagnostics/network-check-target-4jkfk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 18:20:51.438567 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:51.438385 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd76353a-e179-4a53-8e6d-5cd72be55da8-kube-api-access-t7lqt podName:cd76353a-e179-4a53-8e6d-5cd72be55da8 nodeName:}" failed. No retries permitted until 2026-05-21 18:21:23.438367272 +0000 UTC m=+66.310586162 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-t7lqt" (UniqueName: "kubernetes.io/projected/cd76353a-e179-4a53-8e6d-5cd72be55da8-kube-api-access-t7lqt") pod "network-check-target-4jkfk" (UID: "cd76353a-e179-4a53-8e6d-5cd72be55da8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 18:20:51.450203 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.450139 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsnqk\" (UniqueName: \"kubernetes.io/projected/02844de9-e521-48a2-98b7-b2147b0080b2-kube-api-access-qsnqk\") pod \"ingress-canary-r5jsq\" (UID: \"02844de9-e521-48a2-98b7-b2147b0080b2\") " pod="openshift-ingress-canary/ingress-canary-r5jsq" May 21 18:20:51.565682 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.565482 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-969c65c8c-b8z45"] May 21 18:20:51.570322 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.570276 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7ff7fdd444-cjf7n"] May 21 18:20:51.570536 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:51.570325 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd35335b3_9d55_4fbe_86b2_43f42a5a36cd.slice/crio-da4a1a56fc732150ee3adb0ad88d9a8160dcc71810c10c51e2747e51c4b3cc1e WatchSource:0}: Error finding container da4a1a56fc732150ee3adb0ad88d9a8160dcc71810c10c51e2747e51c4b3cc1e: Status 404 returned error can't find the container with id da4a1a56fc732150ee3adb0ad88d9a8160dcc71810c10c51e2747e51c4b3cc1e May 21 18:20:51.615716 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.615657 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675c46dc6d-7fl97"] May 21 18:20:51.620975 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:20:51.620946 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd367223_ae83_4b83_baae_3061b3d042fd.slice/crio-09f08905cf839f470658562c28b1d21aba9db33c157d8e72cb2e512005ed8a4e WatchSource:0}: Error finding container 09f08905cf839f470658562c28b1d21aba9db33c157d8e72cb2e512005ed8a4e: Status 404 returned error can't find the container with id 09f08905cf839f470658562c28b1d21aba9db33c157d8e72cb2e512005ed8a4e May 21 18:20:51.741166 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.741129 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5525e1f2-eb94-4f1d-a739-41de787d3bc9-registry-tls\") pod \"image-registry-57d8c96475-qkmxn\" (UID: \"5525e1f2-eb94-4f1d-a739-41de787d3bc9\") " pod="openshift-image-registry/image-registry-57d8c96475-qkmxn" May 21 18:20:51.741337 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.741183 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a6cc67ce-5941-49a0-bc77-5239759537ec-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-zv4r9\" (UID: \"a6cc67ce-5941-49a0-bc77-5239759537ec\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-zv4r9" May 21 18:20:51.741337 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:51.741292 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 18:20:51.741337 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:51.741298 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 18:20:51.741337 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:51.741317 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57d8c96475-qkmxn: secret "image-registry-tls" not found May 21 18:20:51.741506 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:51.741367 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6cc67ce-5941-49a0-bc77-5239759537ec-networking-console-plugin-cert podName:a6cc67ce-5941-49a0-bc77-5239759537ec nodeName:}" failed. No retries permitted until 2026-05-21 18:20:52.741347398 +0000 UTC m=+35.613566318 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a6cc67ce-5941-49a0-bc77-5239759537ec-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-zv4r9" (UID: "a6cc67ce-5941-49a0-bc77-5239759537ec") : secret "networking-console-plugin-cert" not found May 21 18:20:51.741506 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:51.741383 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5525e1f2-eb94-4f1d-a739-41de787d3bc9-registry-tls podName:5525e1f2-eb94-4f1d-a739-41de787d3bc9 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:52.741375696 +0000 UTC m=+35.613594572 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5525e1f2-eb94-4f1d-a739-41de787d3bc9-registry-tls") pod "image-registry-57d8c96475-qkmxn" (UID: "5525e1f2-eb94-4f1d-a739-41de787d3bc9") : secret "image-registry-tls" not found May 21 18:20:51.824695 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.824584 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675c46dc6d-7fl97" event={"ID":"dd367223-ae83-4b83-baae-3061b3d042fd","Type":"ContainerStarted","Data":"09f08905cf839f470658562c28b1d21aba9db33c157d8e72cb2e512005ed8a4e"} May 21 18:20:51.825844 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.825816 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7ff7fdd444-cjf7n" event={"ID":"935aa599-dc2d-405c-bdb7-35f640292448","Type":"ContainerStarted","Data":"ef737c0f0cbe65d1269d83ee51bb08992f6dd571f9f2956f13583d9981552acb"} May 21 18:20:51.826941 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.826907 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-969c65c8c-b8z45" event={"ID":"d35335b3-9d55-4fbe-86b2-43f42a5a36cd","Type":"ContainerStarted","Data":"da4a1a56fc732150ee3adb0ad88d9a8160dcc71810c10c51e2747e51c4b3cc1e"} May 21 18:20:51.842553 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.842525 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d926e5e1-fb8a-4636-b0f6-3894327080b2-original-pull-secret\") pod \"global-pull-secret-syncer-qdhhw\" (UID: \"d926e5e1-fb8a-4636-b0f6-3894327080b2\") " pod="kube-system/global-pull-secret-syncer-qdhhw" May 21 18:20:51.842655 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.842571 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3-metrics-tls\") pod \"dns-default-hvz8j\" (UID: \"f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3\") " pod="openshift-dns/dns-default-hvz8j" May 21 18:20:51.842736 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:51.842688 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 18:20:51.842799 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:51.842761 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3-metrics-tls podName:f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:52.842745241 +0000 UTC m=+35.714964119 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3-metrics-tls") pod "dns-default-hvz8j" (UID: "f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3") : secret "dns-default-metrics-tls" not found May 21 18:20:51.842799 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:51.842772 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 18:20:51.842882 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:51.842826 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d926e5e1-fb8a-4636-b0f6-3894327080b2-original-pull-secret podName:d926e5e1-fb8a-4636-b0f6-3894327080b2 nodeName:}" failed. No retries permitted until 2026-05-21 18:21:23.842811656 +0000 UTC m=+66.715030545 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d926e5e1-fb8a-4636-b0f6-3894327080b2-original-pull-secret") pod "global-pull-secret-syncer-qdhhw" (UID: "d926e5e1-fb8a-4636-b0f6-3894327080b2") : object "kube-system"/"original-pull-secret" not registered May 21 18:20:51.943426 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:51.943391 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02844de9-e521-48a2-98b7-b2147b0080b2-cert\") pod \"ingress-canary-r5jsq\" (UID: \"02844de9-e521-48a2-98b7-b2147b0080b2\") " pod="openshift-ingress-canary/ingress-canary-r5jsq" May 21 18:20:51.943968 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:51.943564 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 18:20:51.943968 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:51.943644 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02844de9-e521-48a2-98b7-b2147b0080b2-cert podName:02844de9-e521-48a2-98b7-b2147b0080b2 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:52.943627372 +0000 UTC m=+35.815846284 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/02844de9-e521-48a2-98b7-b2147b0080b2-cert") pod "ingress-canary-r5jsq" (UID: "02844de9-e521-48a2-98b7-b2147b0080b2") : secret "canary-serving-cert" not found May 21 18:20:52.693242 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:52.692967 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t2w2" May 21 18:20:52.693408 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:52.693262 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdhhw" May 21 18:20:52.693483 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:52.693431 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jkfk" May 21 18:20:52.697690 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:52.697644 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pfxnj\"" May 21 18:20:52.697900 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:52.697650 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 18:20:52.697900 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:52.697758 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7dqz4\"" May 21 18:20:52.697900 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:52.697651 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 21 18:20:52.698237 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:52.697991 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 18:20:52.698237 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:52.698112 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 18:20:52.751818 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:52.751784 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5525e1f2-eb94-4f1d-a739-41de787d3bc9-registry-tls\") pod \"image-registry-57d8c96475-qkmxn\" (UID: \"5525e1f2-eb94-4f1d-a739-41de787d3bc9\") " pod="openshift-image-registry/image-registry-57d8c96475-qkmxn" May 21 18:20:52.751962 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:52.751840 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a6cc67ce-5941-49a0-bc77-5239759537ec-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-zv4r9\" (UID: \"a6cc67ce-5941-49a0-bc77-5239759537ec\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-zv4r9" May 21 18:20:52.751962 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:52.751918 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 18:20:52.751962 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:52.751937 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57d8c96475-qkmxn: secret "image-registry-tls" not found May 21 18:20:52.752139 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:52.751992 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 18:20:52.752139 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:52.751999 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5525e1f2-eb94-4f1d-a739-41de787d3bc9-registry-tls podName:5525e1f2-eb94-4f1d-a739-41de787d3bc9 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:54.751981015 +0000 UTC m=+37.624199915 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5525e1f2-eb94-4f1d-a739-41de787d3bc9-registry-tls") pod "image-registry-57d8c96475-qkmxn" (UID: "5525e1f2-eb94-4f1d-a739-41de787d3bc9") : secret "image-registry-tls" not found May 21 18:20:52.752139 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:52.752043 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6cc67ce-5941-49a0-bc77-5239759537ec-networking-console-plugin-cert podName:a6cc67ce-5941-49a0-bc77-5239759537ec nodeName:}" failed. No retries permitted until 2026-05-21 18:20:54.752032716 +0000 UTC m=+37.624251623 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a6cc67ce-5941-49a0-bc77-5239759537ec-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-zv4r9" (UID: "a6cc67ce-5941-49a0-bc77-5239759537ec") : secret "networking-console-plugin-cert" not found May 21 18:20:52.854031 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:52.853265 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3-metrics-tls\") pod \"dns-default-hvz8j\" (UID: \"f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3\") " pod="openshift-dns/dns-default-hvz8j" May 21 18:20:52.854031 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:52.853595 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 18:20:52.854031 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:52.853663 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3-metrics-tls podName:f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:54.853641965 +0000 UTC m=+37.725860861 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3-metrics-tls") pod "dns-default-hvz8j" (UID: "f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3") : secret "dns-default-metrics-tls" not found May 21 18:20:52.954158 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:52.954073 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02844de9-e521-48a2-98b7-b2147b0080b2-cert\") pod \"ingress-canary-r5jsq\" (UID: \"02844de9-e521-48a2-98b7-b2147b0080b2\") " pod="openshift-ingress-canary/ingress-canary-r5jsq" May 21 18:20:52.954596 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:52.954289 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 18:20:52.954596 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:52.954362 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02844de9-e521-48a2-98b7-b2147b0080b2-cert podName:02844de9-e521-48a2-98b7-b2147b0080b2 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:54.954342409 +0000 UTC m=+37.826561289 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/02844de9-e521-48a2-98b7-b2147b0080b2-cert") pod "ingress-canary-r5jsq" (UID: "02844de9-e521-48a2-98b7-b2147b0080b2") : secret "canary-serving-cert" not found May 21 18:20:54.773086 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:54.773006 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5525e1f2-eb94-4f1d-a739-41de787d3bc9-registry-tls\") pod \"image-registry-57d8c96475-qkmxn\" (UID: \"5525e1f2-eb94-4f1d-a739-41de787d3bc9\") " pod="openshift-image-registry/image-registry-57d8c96475-qkmxn" May 21 18:20:54.773086 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:54.773057 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a6cc67ce-5941-49a0-bc77-5239759537ec-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-zv4r9\" (UID: \"a6cc67ce-5941-49a0-bc77-5239759537ec\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-zv4r9" May 21 18:20:54.773582 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:54.773165 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 18:20:54.773582 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:54.773182 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57d8c96475-qkmxn: secret "image-registry-tls" not found May 21 18:20:54.773582 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:54.773242 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5525e1f2-eb94-4f1d-a739-41de787d3bc9-registry-tls podName:5525e1f2-eb94-4f1d-a739-41de787d3bc9 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:58.77322396 +0000 UTC m=+41.645442852 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5525e1f2-eb94-4f1d-a739-41de787d3bc9-registry-tls") pod "image-registry-57d8c96475-qkmxn" (UID: "5525e1f2-eb94-4f1d-a739-41de787d3bc9") : secret "image-registry-tls" not found May 21 18:20:54.773582 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:54.773250 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 18:20:54.773582 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:54.773321 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6cc67ce-5941-49a0-bc77-5239759537ec-networking-console-plugin-cert podName:a6cc67ce-5941-49a0-bc77-5239759537ec nodeName:}" failed. No retries permitted until 2026-05-21 18:20:58.773302974 +0000 UTC m=+41.645521880 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a6cc67ce-5941-49a0-bc77-5239759537ec-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-zv4r9" (UID: "a6cc67ce-5941-49a0-bc77-5239759537ec") : secret "networking-console-plugin-cert" not found May 21 18:20:54.874523 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:54.874483 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3-metrics-tls\") pod \"dns-default-hvz8j\" (UID: \"f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3\") " pod="openshift-dns/dns-default-hvz8j" May 21 18:20:54.874735 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:54.874644 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 18:20:54.874735 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:54.874735 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3-metrics-tls podName:f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:58.874716128 +0000 UTC m=+41.746935018 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3-metrics-tls") pod "dns-default-hvz8j" (UID: "f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3") : secret "dns-default-metrics-tls" not found May 21 18:20:54.975814 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:54.975778 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02844de9-e521-48a2-98b7-b2147b0080b2-cert\") pod \"ingress-canary-r5jsq\" (UID: \"02844de9-e521-48a2-98b7-b2147b0080b2\") " pod="openshift-ingress-canary/ingress-canary-r5jsq" May 21 18:20:54.975976 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:54.975929 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 18:20:54.976039 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:54.976005 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02844de9-e521-48a2-98b7-b2147b0080b2-cert podName:02844de9-e521-48a2-98b7-b2147b0080b2 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:58.975985417 +0000 UTC m=+41.848204315 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/02844de9-e521-48a2-98b7-b2147b0080b2-cert") pod "ingress-canary-r5jsq" (UID: "02844de9-e521-48a2-98b7-b2147b0080b2") : secret "canary-serving-cert" not found May 21 18:20:58.810044 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:58.810010 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5525e1f2-eb94-4f1d-a739-41de787d3bc9-registry-tls\") pod \"image-registry-57d8c96475-qkmxn\" (UID: \"5525e1f2-eb94-4f1d-a739-41de787d3bc9\") " pod="openshift-image-registry/image-registry-57d8c96475-qkmxn" May 21 18:20:58.810558 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:58.810059 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a6cc67ce-5941-49a0-bc77-5239759537ec-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-zv4r9\" (UID: \"a6cc67ce-5941-49a0-bc77-5239759537ec\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-zv4r9" May 21 18:20:58.810558 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:58.810165 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 18:20:58.810558 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:58.810182 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57d8c96475-qkmxn: secret "image-registry-tls" not found May 21 18:20:58.810558 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:58.810242 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5525e1f2-eb94-4f1d-a739-41de787d3bc9-registry-tls podName:5525e1f2-eb94-4f1d-a739-41de787d3bc9 nodeName:}" failed. No retries permitted until 2026-05-21 18:21:06.810222737 +0000 UTC m=+49.682441630 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5525e1f2-eb94-4f1d-a739-41de787d3bc9-registry-tls") pod "image-registry-57d8c96475-qkmxn" (UID: "5525e1f2-eb94-4f1d-a739-41de787d3bc9") : secret "image-registry-tls" not found May 21 18:20:58.810558 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:58.810273 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 18:20:58.810558 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:58.810339 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6cc67ce-5941-49a0-bc77-5239759537ec-networking-console-plugin-cert podName:a6cc67ce-5941-49a0-bc77-5239759537ec nodeName:}" failed. No retries permitted until 2026-05-21 18:21:06.810320615 +0000 UTC m=+49.682539510 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a6cc67ce-5941-49a0-bc77-5239759537ec-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-zv4r9" (UID: "a6cc67ce-5941-49a0-bc77-5239759537ec") : secret "networking-console-plugin-cert" not found May 21 18:20:58.910642 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:58.910606 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3-metrics-tls\") pod \"dns-default-hvz8j\" (UID: \"f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3\") " pod="openshift-dns/dns-default-hvz8j" May 21 18:20:58.910866 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:58.910770 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 18:20:58.910866 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:58.910832 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3-metrics-tls podName:f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3 nodeName:}" failed. No retries permitted until 2026-05-21 18:21:06.910813731 +0000 UTC m=+49.783032613 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3-metrics-tls") pod "dns-default-hvz8j" (UID: "f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3") : secret "dns-default-metrics-tls" not found May 21 18:20:59.011752 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:20:59.011719 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02844de9-e521-48a2-98b7-b2147b0080b2-cert\") pod \"ingress-canary-r5jsq\" (UID: \"02844de9-e521-48a2-98b7-b2147b0080b2\") " pod="openshift-ingress-canary/ingress-canary-r5jsq" May 21 18:20:59.011918 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:59.011876 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 18:20:59.011967 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:20:59.011944 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02844de9-e521-48a2-98b7-b2147b0080b2-cert podName:02844de9-e521-48a2-98b7-b2147b0080b2 nodeName:}" failed. No retries permitted until 2026-05-21 18:21:07.011929674 +0000 UTC m=+49.884148550 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/02844de9-e521-48a2-98b7-b2147b0080b2-cert") pod "ingress-canary-r5jsq" (UID: "02844de9-e521-48a2-98b7-b2147b0080b2") : secret "canary-serving-cert" not found May 21 18:21:01.850673 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:21:01.850585 2575 generic.go:358] "Generic (PLEG): container finished" podID="27f7f26f-c37c-4ead-85af-112a370e400e" containerID="c58ff696c22095a632e648a41b7cc84143877dd75a1c6845f6adfa1d73bed01a" exitCode=0 May 21 18:21:01.850673 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:21:01.850646 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t6hgn" event={"ID":"27f7f26f-c37c-4ead-85af-112a370e400e","Type":"ContainerDied","Data":"c58ff696c22095a632e648a41b7cc84143877dd75a1c6845f6adfa1d73bed01a"} May 21 18:21:01.851960 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:21:01.851937 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675c46dc6d-7fl97" event={"ID":"dd367223-ae83-4b83-baae-3061b3d042fd","Type":"ContainerStarted","Data":"bee6c45baea6c3e4768b160929f17e46550ff733fefabd7a623642a58e334998"} May 21 18:21:01.853243 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:21:01.853223 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7ff7fdd444-cjf7n" event={"ID":"935aa599-dc2d-405c-bdb7-35f640292448","Type":"ContainerStarted","Data":"4ef18569eaecd9bbe0d0ce930d1a1d68ae2c9738e8561cc0f70d759ffda6ae1d"} May 21 18:21:01.854500 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:21:01.854449 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-969c65c8c-b8z45" event={"ID":"d35335b3-9d55-4fbe-86b2-43f42a5a36cd","Type":"ContainerStarted","Data":"92150d499bbc5984dfc084aeedb7d35b7a3c3b25411061f0c0a6454cdf93e7dc"} May 21 18:21:01.854692 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:21:01.854674 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-969c65c8c-b8z45" May 21 18:21:01.856443 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:21:01.856425 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-969c65c8c-b8z45" May 21 18:21:01.922874 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:21:01.922827 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-969c65c8c-b8z45" podStartSLOduration=12.964224724 podStartE2EDuration="22.922814106s" podCreationTimestamp="2026-05-21 18:20:39 +0000 UTC" firstStartedPulling="2026-05-21 18:20:51.572664957 +0000 UTC m=+34.444883845" lastFinishedPulling="2026-05-21 18:21:01.53125435 +0000 UTC m=+44.403473227" observedRunningTime="2026-05-21 18:21:01.921245912 +0000 UTC m=+44.793464810" watchObservedRunningTime="2026-05-21 18:21:01.922814106 +0000 UTC m=+44.795033021" May 21 18:21:01.938337 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:21:01.938296 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7ff7fdd444-cjf7n" podStartSLOduration=13.002482076 podStartE2EDuration="22.938282642s" podCreationTimestamp="2026-05-21 18:20:39 +0000 UTC" firstStartedPulling="2026-05-21 18:20:51.576518817 +0000 UTC m=+34.448737697" lastFinishedPulling="2026-05-21 18:21:01.512319366 +0000 UTC m=+44.384538263" observedRunningTime="2026-05-21 18:21:01.938151497 +0000 UTC m=+44.810370397" watchObservedRunningTime="2026-05-21 18:21:01.938282642 +0000 UTC m=+44.810501540" May 21 18:21:02.859287 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:21:02.859195 2575 generic.go:358] "Generic (PLEG): container finished" podID="27f7f26f-c37c-4ead-85af-112a370e400e" containerID="a62ab664344f771d247b8c37b261209e23d065e900143e6a63fe96932f44a45c" exitCode=0 May 21 18:21:02.859287 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:21:02.859243 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t6hgn" event={"ID":"27f7f26f-c37c-4ead-85af-112a370e400e","Type":"ContainerDied","Data":"a62ab664344f771d247b8c37b261209e23d065e900143e6a63fe96932f44a45c"} May 21 18:21:03.864498 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:21:03.864445 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t6hgn" event={"ID":"27f7f26f-c37c-4ead-85af-112a370e400e","Type":"ContainerStarted","Data":"7d17e4c15cf42d362cc803410a9e8646f4a3229f1e34da2ce8ca5b082e7f0be3"} May 21 18:21:04.867877 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:21:04.867837 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675c46dc6d-7fl97" event={"ID":"dd367223-ae83-4b83-baae-3061b3d042fd","Type":"ContainerStarted","Data":"e93c80e7127d8d58c79f3fe255a9fe48cc234c544bf9e2103dc7b95acce0b709"} May 21 18:21:04.867877 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:21:04.867879 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675c46dc6d-7fl97" event={"ID":"dd367223-ae83-4b83-baae-3061b3d042fd","Type":"ContainerStarted","Data":"905ca66eb32aa291b3a38fd85cafd42fd3d11fa1fc13b63007e4fdcd1808b4f4"} May 21 18:21:04.887690 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:21:04.887640 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-t6hgn" podStartSLOduration=6.679806968 podStartE2EDuration="47.887625092s" podCreationTimestamp="2026-05-21 18:20:17 +0000 UTC" firstStartedPulling="2026-05-21 18:20:20.304505638 +0000 UTC m=+3.176724514" lastFinishedPulling="2026-05-21 18:21:01.51232375 +0000 UTC m=+44.384542638" observedRunningTime="2026-05-21 18:21:03.888382917 +0000 UTC m=+46.760601828" watchObservedRunningTime="2026-05-21 18:21:04.887625092 +0000 UTC m=+47.759843995" May 21 18:21:04.888180 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:21:04.888156 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675c46dc6d-7fl97" podStartSLOduration=13.462046707 podStartE2EDuration="25.888150123s" podCreationTimestamp="2026-05-21 18:20:39 +0000 UTC" firstStartedPulling="2026-05-21 18:20:51.62348569 +0000 UTC m=+34.495704569" lastFinishedPulling="2026-05-21 18:21:04.049589103 +0000 UTC m=+46.921807985" observedRunningTime="2026-05-21 18:21:04.886112484 +0000 UTC m=+47.758331382" watchObservedRunningTime="2026-05-21 18:21:04.888150123 +0000 UTC m=+47.760369020" May 21 18:21:06.877380 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:21:06.877346 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5525e1f2-eb94-4f1d-a739-41de787d3bc9-registry-tls\") pod \"image-registry-57d8c96475-qkmxn\" (UID: \"5525e1f2-eb94-4f1d-a739-41de787d3bc9\") " pod="openshift-image-registry/image-registry-57d8c96475-qkmxn" May 21 18:21:06.877380 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:21:06.877385 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a6cc67ce-5941-49a0-bc77-5239759537ec-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-zv4r9\" (UID: \"a6cc67ce-5941-49a0-bc77-5239759537ec\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-zv4r9" May 21 18:21:06.877846 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:21:06.877497 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 18:21:06.877846 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:21:06.877515 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57d8c96475-qkmxn: secret "image-registry-tls" not found May 21 18:21:06.877846 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:21:06.877530 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 18:21:06.877846 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:21:06.877569 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5525e1f2-eb94-4f1d-a739-41de787d3bc9-registry-tls podName:5525e1f2-eb94-4f1d-a739-41de787d3bc9 nodeName:}" failed. No retries permitted until 2026-05-21 18:21:22.87755354 +0000 UTC m=+65.749772416 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5525e1f2-eb94-4f1d-a739-41de787d3bc9-registry-tls") pod "image-registry-57d8c96475-qkmxn" (UID: "5525e1f2-eb94-4f1d-a739-41de787d3bc9") : secret "image-registry-tls" not found May 21 18:21:06.877846 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:21:06.877581 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6cc67ce-5941-49a0-bc77-5239759537ec-networking-console-plugin-cert podName:a6cc67ce-5941-49a0-bc77-5239759537ec nodeName:}" failed. No retries permitted until 2026-05-21 18:21:22.877575422 +0000 UTC m=+65.749794298 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a6cc67ce-5941-49a0-bc77-5239759537ec-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-zv4r9" (UID: "a6cc67ce-5941-49a0-bc77-5239759537ec") : secret "networking-console-plugin-cert" not found May 21 18:21:06.977734 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:21:06.977683 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3-metrics-tls\") pod \"dns-default-hvz8j\" (UID: \"f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3\") " pod="openshift-dns/dns-default-hvz8j" May 21 18:21:06.977937 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:21:06.977851 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 18:21:06.977937 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:21:06.977936 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3-metrics-tls podName:f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3 nodeName:}" failed. No retries permitted until 2026-05-21 18:21:22.977911373 +0000 UTC m=+65.850130267 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3-metrics-tls") pod "dns-default-hvz8j" (UID: "f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3") : secret "dns-default-metrics-tls" not found May 21 18:21:07.078604 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:21:07.078565 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02844de9-e521-48a2-98b7-b2147b0080b2-cert\") pod \"ingress-canary-r5jsq\" (UID: \"02844de9-e521-48a2-98b7-b2147b0080b2\") " pod="openshift-ingress-canary/ingress-canary-r5jsq" May 21 18:21:07.078768 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:21:07.078737 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 18:21:07.078832 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:21:07.078811 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02844de9-e521-48a2-98b7-b2147b0080b2-cert podName:02844de9-e521-48a2-98b7-b2147b0080b2 nodeName:}" failed. No retries permitted until 2026-05-21 18:21:23.078791757 +0000 UTC m=+65.951010651 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/02844de9-e521-48a2-98b7-b2147b0080b2-cert") pod "ingress-canary-r5jsq" (UID: "02844de9-e521-48a2-98b7-b2147b0080b2") : secret "canary-serving-cert" not found May 21 18:21:16.829334 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:21:16.829307 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n4lmv" May 21 18:21:22.910287 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:21:22.910248 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5525e1f2-eb94-4f1d-a739-41de787d3bc9-registry-tls\") pod \"image-registry-57d8c96475-qkmxn\" (UID: \"5525e1f2-eb94-4f1d-a739-41de787d3bc9\") " pod="openshift-image-registry/image-registry-57d8c96475-qkmxn" May 21 18:21:22.910287 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:21:22.910289 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a6cc67ce-5941-49a0-bc77-5239759537ec-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-zv4r9\" (UID: \"a6cc67ce-5941-49a0-bc77-5239759537ec\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-zv4r9" May 21 18:21:22.910733 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:21:22.910404 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 18:21:22.910733 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:21:22.910423 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57d8c96475-qkmxn: secret "image-registry-tls" not found May 21 18:21:22.910733 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:21:22.910425 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 18:21:22.910733 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:21:22.910483 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5525e1f2-eb94-4f1d-a739-41de787d3bc9-registry-tls podName:5525e1f2-eb94-4f1d-a739-41de787d3bc9 nodeName:}" failed. No retries permitted until 2026-05-21 18:21:54.910462758 +0000 UTC m=+97.782681656 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5525e1f2-eb94-4f1d-a739-41de787d3bc9-registry-tls") pod "image-registry-57d8c96475-qkmxn" (UID: "5525e1f2-eb94-4f1d-a739-41de787d3bc9") : secret "image-registry-tls" not found May 21 18:21:22.910733 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:21:22.910503 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6cc67ce-5941-49a0-bc77-5239759537ec-networking-console-plugin-cert podName:a6cc67ce-5941-49a0-bc77-5239759537ec nodeName:}" failed. No retries permitted until 2026-05-21 18:21:54.910493976 +0000 UTC m=+97.782712891 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a6cc67ce-5941-49a0-bc77-5239759537ec-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-zv4r9" (UID: "a6cc67ce-5941-49a0-bc77-5239759537ec") : secret "networking-console-plugin-cert" not found May 21 18:21:23.010974 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:21:23.010942 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3-metrics-tls\") pod \"dns-default-hvz8j\" (UID: \"f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3\") " pod="openshift-dns/dns-default-hvz8j" May 21 18:21:23.011121 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:21:23.011101 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 18:21:23.011195 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:21:23.011184 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3-metrics-tls podName:f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3 nodeName:}" failed. No retries permitted until 2026-05-21 18:21:55.011167312 +0000 UTC m=+97.883386188 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3-metrics-tls") pod "dns-default-hvz8j" (UID: "f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3") : secret "dns-default-metrics-tls" not found May 21 18:21:23.111596 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:21:23.111555 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02844de9-e521-48a2-98b7-b2147b0080b2-cert\") pod \"ingress-canary-r5jsq\" (UID: \"02844de9-e521-48a2-98b7-b2147b0080b2\") " pod="openshift-ingress-canary/ingress-canary-r5jsq" May 21 18:21:23.111821 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:21:23.111733 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 18:21:23.111821 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:21:23.111809 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02844de9-e521-48a2-98b7-b2147b0080b2-cert podName:02844de9-e521-48a2-98b7-b2147b0080b2 nodeName:}" failed. No retries permitted until 2026-05-21 18:21:55.111789904 +0000 UTC m=+97.984008792 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/02844de9-e521-48a2-98b7-b2147b0080b2-cert") pod "ingress-canary-r5jsq" (UID: "02844de9-e521-48a2-98b7-b2147b0080b2") : secret "canary-serving-cert" not found May 21 18:21:23.414556 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:21:23.414521 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2-metrics-certs\") pod \"network-metrics-daemon-2t2w2\" (UID: \"fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2\") " pod="openshift-multus/network-metrics-daemon-2t2w2" May 21 18:21:23.417444 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:21:23.417428 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 18:21:23.424990 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:21:23.424971 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 18:21:23.425051 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:21:23.425024 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2-metrics-certs podName:fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2 nodeName:}" failed. No retries permitted until 2026-05-21 18:22:27.425009845 +0000 UTC m=+130.297228721 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2-metrics-certs") pod "network-metrics-daemon-2t2w2" (UID: "fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2") : secret "metrics-daemon-secret" not found May 21 18:21:23.515893 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:21:23.515859 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t7lqt\" (UniqueName: \"kubernetes.io/projected/cd76353a-e179-4a53-8e6d-5cd72be55da8-kube-api-access-t7lqt\") pod \"network-check-target-4jkfk\" (UID: \"cd76353a-e179-4a53-8e6d-5cd72be55da8\") " pod="openshift-network-diagnostics/network-check-target-4jkfk" May 21 18:21:23.518957 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:21:23.518936 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 18:21:23.528669 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:21:23.528654 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 18:21:23.540312 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:21:23.540284 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7lqt\" (UniqueName: \"kubernetes.io/projected/cd76353a-e179-4a53-8e6d-5cd72be55da8-kube-api-access-t7lqt\") pod \"network-check-target-4jkfk\" (UID: \"cd76353a-e179-4a53-8e6d-5cd72be55da8\") " pod="openshift-network-diagnostics/network-check-target-4jkfk" May 21 18:21:23.631146 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:21:23.631117 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pfxnj\"" May 21 18:21:23.638501 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:21:23.638480 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jkfk" May 21 18:21:23.758459 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:21:23.758428 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4jkfk"] May 21 18:21:23.761841 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:21:23.761807 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd76353a_e179_4a53_8e6d_5cd72be55da8.slice/crio-b8dfbb0ee1ba0d2350129876d19df1ba83a0d88c22771a0943af6c150d98ca99 WatchSource:0}: Error finding container b8dfbb0ee1ba0d2350129876d19df1ba83a0d88c22771a0943af6c150d98ca99: Status 404 returned error can't find the container with id b8dfbb0ee1ba0d2350129876d19df1ba83a0d88c22771a0943af6c150d98ca99 May 21 18:21:23.908273 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:21:23.908232 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4jkfk" event={"ID":"cd76353a-e179-4a53-8e6d-5cd72be55da8","Type":"ContainerStarted","Data":"b8dfbb0ee1ba0d2350129876d19df1ba83a0d88c22771a0943af6c150d98ca99"} May 21 18:21:23.920817 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:21:23.920785 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d926e5e1-fb8a-4636-b0f6-3894327080b2-original-pull-secret\") pod \"global-pull-secret-syncer-qdhhw\" (UID: \"d926e5e1-fb8a-4636-b0f6-3894327080b2\") " pod="kube-system/global-pull-secret-syncer-qdhhw" May 21 18:21:23.924096 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:21:23.924080 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 21 18:21:23.933583 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:21:23.933518 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d926e5e1-fb8a-4636-b0f6-3894327080b2-original-pull-secret\") pod \"global-pull-secret-syncer-qdhhw\" (UID: \"d926e5e1-fb8a-4636-b0f6-3894327080b2\") " pod="kube-system/global-pull-secret-syncer-qdhhw" May 21 18:21:24.220312 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:21:24.220234 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdhhw" May 21 18:21:24.360211 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:21:24.360172 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qdhhw"] May 21 18:21:24.364720 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:21:24.364672 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd926e5e1_fb8a_4636_b0f6_3894327080b2.slice/crio-d0a911ff981041833283a59214a5273989798367e392c36364127decc298ae48 WatchSource:0}: Error finding container d0a911ff981041833283a59214a5273989798367e392c36364127decc298ae48: Status 404 returned error can't find the container with id d0a911ff981041833283a59214a5273989798367e392c36364127decc298ae48 May 21 18:21:24.912240 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:21:24.912188 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qdhhw" event={"ID":"d926e5e1-fb8a-4636-b0f6-3894327080b2","Type":"ContainerStarted","Data":"d0a911ff981041833283a59214a5273989798367e392c36364127decc298ae48"} May 21 18:21:27.920825 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:21:27.920782 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4jkfk" event={"ID":"cd76353a-e179-4a53-8e6d-5cd72be55da8","Type":"ContainerStarted","Data":"d83481887a11d6daf6aa242b854e668b12d314cf1f481d197b063058ae48cbf1"} May 21 18:21:27.921405 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:21:27.920957 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4jkfk" May 21 18:21:27.938015 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:21:27.937964 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4jkfk" podStartSLOduration=67.828523159 podStartE2EDuration="1m10.937950321s" podCreationTimestamp="2026-05-21 18:20:17 +0000 UTC" firstStartedPulling="2026-05-21 18:21:23.763635164 +0000 UTC m=+66.635854040" lastFinishedPulling="2026-05-21 18:21:26.873062324 +0000 UTC m=+69.745281202" observedRunningTime="2026-05-21 18:21:27.936730453 +0000 UTC m=+70.808949352" watchObservedRunningTime="2026-05-21 18:21:27.937950321 +0000 UTC m=+70.810169220" May 21 18:21:28.924372 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:21:28.924330 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qdhhw" event={"ID":"d926e5e1-fb8a-4636-b0f6-3894327080b2","Type":"ContainerStarted","Data":"53a23046c26d031db832d6cadca059147af4db6f33b495c578cde8451ac9deb6"} May 21 18:21:28.945158 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:21:28.945116 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qdhhw" podStartSLOduration=66.03199245 podStartE2EDuration="1m9.945101674s" podCreationTimestamp="2026-05-21 18:20:19 +0000 UTC" firstStartedPulling="2026-05-21 18:21:24.366869755 +0000 UTC m=+67.239088631" lastFinishedPulling="2026-05-21 18:21:28.279978976 +0000 UTC m=+71.152197855" observedRunningTime="2026-05-21 18:21:28.944847031 +0000 UTC m=+71.817065954" watchObservedRunningTime="2026-05-21 18:21:28.945101674 +0000 UTC m=+71.817320571" May 21 18:21:54.962433 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:21:54.962394 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5525e1f2-eb94-4f1d-a739-41de787d3bc9-registry-tls\") pod \"image-registry-57d8c96475-qkmxn\" (UID: \"5525e1f2-eb94-4f1d-a739-41de787d3bc9\") " pod="openshift-image-registry/image-registry-57d8c96475-qkmxn" May 21 18:21:54.962433 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:21:54.962437 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a6cc67ce-5941-49a0-bc77-5239759537ec-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-zv4r9\" (UID: \"a6cc67ce-5941-49a0-bc77-5239759537ec\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-zv4r9" May 21 18:21:54.962895 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:21:54.962526 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 18:21:54.962895 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:21:54.962530 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 18:21:54.962895 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:21:54.962548 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57d8c96475-qkmxn: secret "image-registry-tls" not found May 21 18:21:54.962895 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:21:54.962596 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6cc67ce-5941-49a0-bc77-5239759537ec-networking-console-plugin-cert podName:a6cc67ce-5941-49a0-bc77-5239759537ec nodeName:}" failed. No retries permitted until 2026-05-21 18:22:58.962577375 +0000 UTC m=+161.834796264 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a6cc67ce-5941-49a0-bc77-5239759537ec-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-zv4r9" (UID: "a6cc67ce-5941-49a0-bc77-5239759537ec") : secret "networking-console-plugin-cert" not found May 21 18:21:54.962895 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:21:54.962616 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5525e1f2-eb94-4f1d-a739-41de787d3bc9-registry-tls podName:5525e1f2-eb94-4f1d-a739-41de787d3bc9 nodeName:}" failed. No retries permitted until 2026-05-21 18:22:58.962601011 +0000 UTC m=+161.834819887 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5525e1f2-eb94-4f1d-a739-41de787d3bc9-registry-tls") pod "image-registry-57d8c96475-qkmxn" (UID: "5525e1f2-eb94-4f1d-a739-41de787d3bc9") : secret "image-registry-tls" not found May 21 18:21:55.063244 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:21:55.063203 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3-metrics-tls\") pod \"dns-default-hvz8j\" (UID: \"f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3\") " pod="openshift-dns/dns-default-hvz8j" May 21 18:21:55.063421 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:21:55.063357 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 18:21:55.063421 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:21:55.063420 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3-metrics-tls podName:f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3 nodeName:}" failed. No retries permitted until 2026-05-21 18:22:59.063404878 +0000 UTC m=+161.935623759 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3-metrics-tls") pod "dns-default-hvz8j" (UID: "f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3") : secret "dns-default-metrics-tls" not found May 21 18:21:55.164263 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:21:55.164231 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02844de9-e521-48a2-98b7-b2147b0080b2-cert\") pod \"ingress-canary-r5jsq\" (UID: \"02844de9-e521-48a2-98b7-b2147b0080b2\") " pod="openshift-ingress-canary/ingress-canary-r5jsq" May 21 18:21:55.164396 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:21:55.164376 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 18:21:55.164468 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:21:55.164458 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02844de9-e521-48a2-98b7-b2147b0080b2-cert podName:02844de9-e521-48a2-98b7-b2147b0080b2 nodeName:}" failed. No retries permitted until 2026-05-21 18:22:59.164443427 +0000 UTC m=+162.036662303 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/02844de9-e521-48a2-98b7-b2147b0080b2-cert") pod "ingress-canary-r5jsq" (UID: "02844de9-e521-48a2-98b7-b2147b0080b2") : secret "canary-serving-cert" not found May 21 18:21:58.926813 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:21:58.926783 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4jkfk" May 21 18:22:27.509779 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:22:27.509727 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2-metrics-certs\") pod \"network-metrics-daemon-2t2w2\" (UID: \"fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2\") " pod="openshift-multus/network-metrics-daemon-2t2w2" May 21 18:22:27.510282 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:22:27.509865 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 18:22:27.510282 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:22:27.509931 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2-metrics-certs podName:fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2 nodeName:}" failed. No retries permitted until 2026-05-21 18:24:29.509914969 +0000 UTC m=+252.382133846 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2-metrics-certs") pod "network-metrics-daemon-2t2w2" (UID: "fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2") : secret "metrics-daemon-secret" not found May 21 18:22:41.863957 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:22:41.863927 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wdw4s_71b45bd9-d908-47c0-b612-7db98e5a6fe7/dns-node-resolver/0.log" May 21 18:22:42.866089 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:22:42.866060 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nbg9h_42a0c0b9-f647-485a-90a7-84cb93415e1b/node-ca/0.log" May 21 18:22:54.016481 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:22:54.016428 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-zv4r9" podUID="a6cc67ce-5941-49a0-bc77-5239759537ec" May 21 18:22:54.048754 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:22:54.048718 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-57d8c96475-qkmxn" podUID="5525e1f2-eb94-4f1d-a739-41de787d3bc9" May 21 18:22:54.119804 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:22:54.119775 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57d8c96475-qkmxn" May 21 18:22:54.119942 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:22:54.119818 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-zv4r9" May 21 18:22:54.173042 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:22:54.173003 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hvz8j" podUID="f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3" May 21 18:22:54.180130 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:22:54.180101 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-r5jsq" podUID="02844de9-e521-48a2-98b7-b2147b0080b2" May 21 18:22:55.122752 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:22:55.122723 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hvz8j" May 21 18:22:55.709931 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:22:55.709894 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-2t2w2" podUID="fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2" May 21 18:22:59.054096 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:22:59.054053 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a6cc67ce-5941-49a0-bc77-5239759537ec-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-zv4r9\" (UID: \"a6cc67ce-5941-49a0-bc77-5239759537ec\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-zv4r9" May 21 18:22:59.054612 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:22:59.054272 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5525e1f2-eb94-4f1d-a739-41de787d3bc9-registry-tls\") pod \"image-registry-57d8c96475-qkmxn\" (UID: \"5525e1f2-eb94-4f1d-a739-41de787d3bc9\") " pod="openshift-image-registry/image-registry-57d8c96475-qkmxn" May 21 18:22:59.056552 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:22:59.056527 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5525e1f2-eb94-4f1d-a739-41de787d3bc9-registry-tls\") pod \"image-registry-57d8c96475-qkmxn\" (UID: \"5525e1f2-eb94-4f1d-a739-41de787d3bc9\") " pod="openshift-image-registry/image-registry-57d8c96475-qkmxn" May 21 18:22:59.056655 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:22:59.056527 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a6cc67ce-5941-49a0-bc77-5239759537ec-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-zv4r9\" (UID: \"a6cc67ce-5941-49a0-bc77-5239759537ec\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-zv4r9" May 21 18:22:59.155225 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:22:59.155185 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3-metrics-tls\") pod \"dns-default-hvz8j\" (UID: \"f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3\") " pod="openshift-dns/dns-default-hvz8j" May 21 18:22:59.157470 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:22:59.157444 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3-metrics-tls\") pod \"dns-default-hvz8j\" (UID: \"f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3\") " pod="openshift-dns/dns-default-hvz8j" May 21 18:22:59.226729 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:22:59.224249 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-v98cm\"" May 21 18:22:59.226729 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:22:59.224802 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-5s7jh\"" May 21 18:22:59.231385 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:22:59.231357 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-zv4r9" May 21 18:22:59.231529 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:22:59.231365 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57d8c96475-qkmxn" May 21 18:22:59.256003 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:22:59.255967 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02844de9-e521-48a2-98b7-b2147b0080b2-cert\") pod \"ingress-canary-r5jsq\" (UID: \"02844de9-e521-48a2-98b7-b2147b0080b2\") " pod="openshift-ingress-canary/ingress-canary-r5jsq" May 21 18:22:59.258493 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:22:59.258463 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02844de9-e521-48a2-98b7-b2147b0080b2-cert\") pod \"ingress-canary-r5jsq\" (UID: \"02844de9-e521-48a2-98b7-b2147b0080b2\") " pod="openshift-ingress-canary/ingress-canary-r5jsq" May 21 18:22:59.327840 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:22:59.327811 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hpqft\"" May 21 18:22:59.334098 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:22:59.334067 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hvz8j" May 21 18:22:59.361345 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:22:59.361173 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-zv4r9"] May 21 18:22:59.363995 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:22:59.363968 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6cc67ce_5941_49a0_bc77_5239759537ec.slice/crio-f17933f94f1044707e4346890c32d71a2b0073e7ffad7961627c1cbaaece0c2a WatchSource:0}: Error finding container f17933f94f1044707e4346890c32d71a2b0073e7ffad7961627c1cbaaece0c2a: Status 404 returned error can't find the container with id f17933f94f1044707e4346890c32d71a2b0073e7ffad7961627c1cbaaece0c2a May 21 18:22:59.378768 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:22:59.378743 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57d8c96475-qkmxn"] May 21 18:22:59.387232 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:22:59.387205 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5525e1f2_eb94_4f1d_a739_41de787d3bc9.slice/crio-b20ac74b68ca24596f3c36fc6428b3dc83b6a72a2745d061cc12ac10df874091 WatchSource:0}: Error finding container b20ac74b68ca24596f3c36fc6428b3dc83b6a72a2745d061cc12ac10df874091: Status 404 returned error can't find the container with id b20ac74b68ca24596f3c36fc6428b3dc83b6a72a2745d061cc12ac10df874091 May 21 18:22:59.474908 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:22:59.474879 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hvz8j"] May 21 18:22:59.478509 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:22:59.478483 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf02fc31f_d1e5_40c3_a539_c9fdf62d1ba3.slice/crio-acf51595c1548b17095f5b235451c136ce5eb1028bed5aab6a2dedb65d2a3972 WatchSource:0}: Error finding container acf51595c1548b17095f5b235451c136ce5eb1028bed5aab6a2dedb65d2a3972: Status 404 returned error can't find the container with id acf51595c1548b17095f5b235451c136ce5eb1028bed5aab6a2dedb65d2a3972 May 21 18:23:00.134088 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:00.134046 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-zv4r9" event={"ID":"a6cc67ce-5941-49a0-bc77-5239759537ec","Type":"ContainerStarted","Data":"f17933f94f1044707e4346890c32d71a2b0073e7ffad7961627c1cbaaece0c2a"} May 21 18:23:00.135016 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:00.134991 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hvz8j" event={"ID":"f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3","Type":"ContainerStarted","Data":"acf51595c1548b17095f5b235451c136ce5eb1028bed5aab6a2dedb65d2a3972"} May 21 18:23:00.136211 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:00.136190 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57d8c96475-qkmxn" event={"ID":"5525e1f2-eb94-4f1d-a739-41de787d3bc9","Type":"ContainerStarted","Data":"d1ab347ab2ecc30f8144e5c7487e43638d13fffd77a4985f630112da904a9b9f"} May 21 18:23:00.136288 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:00.136217 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57d8c96475-qkmxn" event={"ID":"5525e1f2-eb94-4f1d-a739-41de787d3bc9","Type":"ContainerStarted","Data":"b20ac74b68ca24596f3c36fc6428b3dc83b6a72a2745d061cc12ac10df874091"} May 21 18:23:00.136333 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:00.136326 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-57d8c96475-qkmxn" May 21 18:23:00.158430 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:00.158374 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-57d8c96475-qkmxn" podStartSLOduration=162.158357487 podStartE2EDuration="2m42.158357487s" podCreationTimestamp="2026-05-21 18:20:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:23:00.157498558 +0000 UTC m=+163.029717485" watchObservedRunningTime="2026-05-21 18:23:00.158357487 +0000 UTC m=+163.030576413" May 21 18:23:01.140503 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:01.140460 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-zv4r9" event={"ID":"a6cc67ce-5941-49a0-bc77-5239759537ec","Type":"ContainerStarted","Data":"c6d66505cb26af827ec4106e6e10422d1de4003d32888cdc2f9c04d003b60853"} May 21 18:23:01.158640 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:01.158578 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-zv4r9" podStartSLOduration=153.781869538 podStartE2EDuration="2m35.158560195s" podCreationTimestamp="2026-05-21 18:20:26 +0000 UTC" firstStartedPulling="2026-05-21 18:22:59.36591236 +0000 UTC m=+162.238131236" lastFinishedPulling="2026-05-21 18:23:00.742603015 +0000 UTC m=+163.614821893" observedRunningTime="2026-05-21 18:23:01.15847935 +0000 UTC m=+164.030698249" watchObservedRunningTime="2026-05-21 18:23:01.158560195 +0000 UTC m=+164.030779093" May 21 18:23:01.855533 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:01.855478 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-969c65c8c-b8z45" podUID="d35335b3-9d55-4fbe-86b2-43f42a5a36cd" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.8:8000/readyz\": dial tcp 10.132.0.8:8000: connect: connection refused" May 21 18:23:02.144508 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:02.144475 2575 generic.go:358] "Generic (PLEG): container finished" podID="935aa599-dc2d-405c-bdb7-35f640292448" containerID="4ef18569eaecd9bbe0d0ce930d1a1d68ae2c9738e8561cc0f70d759ffda6ae1d" exitCode=255 May 21 18:23:02.144908 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:02.144543 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7ff7fdd444-cjf7n" event={"ID":"935aa599-dc2d-405c-bdb7-35f640292448","Type":"ContainerDied","Data":"4ef18569eaecd9bbe0d0ce930d1a1d68ae2c9738e8561cc0f70d759ffda6ae1d"} May 21 18:23:02.144908 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:02.144854 2575 scope.go:117] "RemoveContainer" containerID="4ef18569eaecd9bbe0d0ce930d1a1d68ae2c9738e8561cc0f70d759ffda6ae1d" May 21 18:23:02.145827 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:02.145801 2575 generic.go:358] "Generic (PLEG): container finished" podID="d35335b3-9d55-4fbe-86b2-43f42a5a36cd" containerID="92150d499bbc5984dfc084aeedb7d35b7a3c3b25411061f0c0a6454cdf93e7dc" exitCode=1 May 21 18:23:02.145899 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:02.145886 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-969c65c8c-b8z45" event={"ID":"d35335b3-9d55-4fbe-86b2-43f42a5a36cd","Type":"ContainerDied","Data":"92150d499bbc5984dfc084aeedb7d35b7a3c3b25411061f0c0a6454cdf93e7dc"} May 21 18:23:02.146259 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:02.146159 2575 scope.go:117] "RemoveContainer" containerID="92150d499bbc5984dfc084aeedb7d35b7a3c3b25411061f0c0a6454cdf93e7dc" May 21 18:23:02.147563 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:02.147541 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hvz8j" event={"ID":"f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3","Type":"ContainerStarted","Data":"1d0772dbaddcb7d59c8f92ad4fda6ad3e733a4590e74ef797813fc0c55c41b93"} May 21 18:23:02.147654 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:02.147572 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hvz8j" event={"ID":"f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3","Type":"ContainerStarted","Data":"ce5dd71f883d7dc3e79a62bb403c3a614037222922364c72457b579c58fae200"} May 21 18:23:02.147841 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:02.147824 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hvz8j" May 21 18:23:02.202340 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:02.198631 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-hvz8j" podStartSLOduration=130.475673786 podStartE2EDuration="2m12.198611745s" podCreationTimestamp="2026-05-21 18:20:50 +0000 UTC" firstStartedPulling="2026-05-21 18:22:59.480219234 +0000 UTC m=+162.352438113" lastFinishedPulling="2026-05-21 18:23:01.203157196 +0000 UTC m=+164.075376072" observedRunningTime="2026-05-21 18:23:02.197746611 +0000 UTC m=+165.069965509" watchObservedRunningTime="2026-05-21 18:23:02.198611745 +0000 UTC m=+165.070830643" May 21 18:23:03.151799 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:03.151763 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7ff7fdd444-cjf7n" event={"ID":"935aa599-dc2d-405c-bdb7-35f640292448","Type":"ContainerStarted","Data":"23d66d461d18ab8a2564fd69744f22ea2a9e45e50c0dc48af2a4e31783ab03e4"} May 21 18:23:03.153264 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:03.153237 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-969c65c8c-b8z45" event={"ID":"d35335b3-9d55-4fbe-86b2-43f42a5a36cd","Type":"ContainerStarted","Data":"8f4ced5b7fd72f13455770d2f71e9986a357b5e44af00d30ac597df636afc9f4"} May 21 18:23:03.153622 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:03.153604 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-969c65c8c-b8z45" May 21 18:23:03.154222 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:03.154206 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-969c65c8c-b8z45" May 21 18:23:06.692814 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:06.692771 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r5jsq" May 21 18:23:06.695801 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:06.695783 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fn9qn\"" May 21 18:23:06.703298 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:06.703278 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r5jsq" May 21 18:23:06.827380 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:06.827345 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r5jsq"] May 21 18:23:06.830729 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:23:06.830682 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02844de9_e521_48a2_98b7_b2147b0080b2.slice/crio-4cd852df44223ae54371a78e8a6bb9c880b287584e44e2075cf3f88c2a27d7ec WatchSource:0}: Error finding container 4cd852df44223ae54371a78e8a6bb9c880b287584e44e2075cf3f88c2a27d7ec: Status 404 returned error can't find the container with id 4cd852df44223ae54371a78e8a6bb9c880b287584e44e2075cf3f88c2a27d7ec May 21 18:23:07.164500 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:07.164463 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r5jsq" event={"ID":"02844de9-e521-48a2-98b7-b2147b0080b2","Type":"ContainerStarted","Data":"4cd852df44223ae54371a78e8a6bb9c880b287584e44e2075cf3f88c2a27d7ec"} May 21 18:23:08.364514 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:08.364484 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-tcspb"] May 21 18:23:08.366941 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:08.366920 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tcspb" May 21 18:23:08.370841 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:08.370787 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 21 18:23:08.370841 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:08.370805 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 21 18:23:08.371040 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:08.370787 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 21 18:23:08.371117 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:08.371092 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 21 18:23:08.371220 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:08.371154 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-khvvx\"" May 21 18:23:08.377275 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:08.377247 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tcspb"] May 21 18:23:08.526349 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:08.526308 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc6592f5-db5f-4c58-8572-e390e2d4ef80-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tcspb\" (UID: \"fc6592f5-db5f-4c58-8572-e390e2d4ef80\") " pod="openshift-insights/insights-runtime-extractor-tcspb" May 21 18:23:08.526498 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:08.526375 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc6592f5-db5f-4c58-8572-e390e2d4ef80-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tcspb\" (UID: \"fc6592f5-db5f-4c58-8572-e390e2d4ef80\") " pod="openshift-insights/insights-runtime-extractor-tcspb" May 21 18:23:08.526498 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:08.526454 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fc6592f5-db5f-4c58-8572-e390e2d4ef80-crio-socket\") pod \"insights-runtime-extractor-tcspb\" (UID: \"fc6592f5-db5f-4c58-8572-e390e2d4ef80\") " pod="openshift-insights/insights-runtime-extractor-tcspb" May 21 18:23:08.526610 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:08.526526 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6bmb\" (UniqueName: \"kubernetes.io/projected/fc6592f5-db5f-4c58-8572-e390e2d4ef80-kube-api-access-l6bmb\") pod \"insights-runtime-extractor-tcspb\" (UID: \"fc6592f5-db5f-4c58-8572-e390e2d4ef80\") " pod="openshift-insights/insights-runtime-extractor-tcspb" May 21 18:23:08.526610 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:08.526576 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc6592f5-db5f-4c58-8572-e390e2d4ef80-data-volume\") pod \"insights-runtime-extractor-tcspb\" (UID: \"fc6592f5-db5f-4c58-8572-e390e2d4ef80\") " pod="openshift-insights/insights-runtime-extractor-tcspb" May 21 18:23:08.627471 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:08.627433 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc6592f5-db5f-4c58-8572-e390e2d4ef80-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tcspb\" (UID: \"fc6592f5-db5f-4c58-8572-e390e2d4ef80\") " pod="openshift-insights/insights-runtime-extractor-tcspb" May 21 18:23:08.627471 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:08.627478 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fc6592f5-db5f-4c58-8572-e390e2d4ef80-crio-socket\") pod \"insights-runtime-extractor-tcspb\" (UID: \"fc6592f5-db5f-4c58-8572-e390e2d4ef80\") " pod="openshift-insights/insights-runtime-extractor-tcspb" May 21 18:23:08.627761 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:08.627651 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l6bmb\" (UniqueName: \"kubernetes.io/projected/fc6592f5-db5f-4c58-8572-e390e2d4ef80-kube-api-access-l6bmb\") pod \"insights-runtime-extractor-tcspb\" (UID: \"fc6592f5-db5f-4c58-8572-e390e2d4ef80\") " pod="openshift-insights/insights-runtime-extractor-tcspb" May 21 18:23:08.627761 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:08.627723 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fc6592f5-db5f-4c58-8572-e390e2d4ef80-crio-socket\") pod \"insights-runtime-extractor-tcspb\" (UID: \"fc6592f5-db5f-4c58-8572-e390e2d4ef80\") " pod="openshift-insights/insights-runtime-extractor-tcspb" May 21 18:23:08.627761 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:08.627747 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc6592f5-db5f-4c58-8572-e390e2d4ef80-data-volume\") pod \"insights-runtime-extractor-tcspb\" (UID: \"fc6592f5-db5f-4c58-8572-e390e2d4ef80\") " pod="openshift-insights/insights-runtime-extractor-tcspb" May 21 18:23:08.627913 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:08.627786 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc6592f5-db5f-4c58-8572-e390e2d4ef80-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tcspb\" (UID: \"fc6592f5-db5f-4c58-8572-e390e2d4ef80\") " pod="openshift-insights/insights-runtime-extractor-tcspb" May 21 18:23:08.627985 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:08.627969 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc6592f5-db5f-4c58-8572-e390e2d4ef80-data-volume\") pod \"insights-runtime-extractor-tcspb\" (UID: \"fc6592f5-db5f-4c58-8572-e390e2d4ef80\") " pod="openshift-insights/insights-runtime-extractor-tcspb" May 21 18:23:08.628089 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:08.628071 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc6592f5-db5f-4c58-8572-e390e2d4ef80-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tcspb\" (UID: \"fc6592f5-db5f-4c58-8572-e390e2d4ef80\") " pod="openshift-insights/insights-runtime-extractor-tcspb" May 21 18:23:08.630340 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:08.630319 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc6592f5-db5f-4c58-8572-e390e2d4ef80-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tcspb\" (UID: \"fc6592f5-db5f-4c58-8572-e390e2d4ef80\") " pod="openshift-insights/insights-runtime-extractor-tcspb" May 21 18:23:08.637772 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:08.637749 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6bmb\" (UniqueName: \"kubernetes.io/projected/fc6592f5-db5f-4c58-8572-e390e2d4ef80-kube-api-access-l6bmb\") pod \"insights-runtime-extractor-tcspb\" (UID: \"fc6592f5-db5f-4c58-8572-e390e2d4ef80\") " pod="openshift-insights/insights-runtime-extractor-tcspb" May 21 18:23:08.679120 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:08.679084 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tcspb" May 21 18:23:09.024498 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:09.024465 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tcspb"] May 21 18:23:09.028777 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:23:09.028746 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc6592f5_db5f_4c58_8572_e390e2d4ef80.slice/crio-2efbb26639066710bc0b56a4aaa3a1e27e383b2b5e78948cc91ca8f45fe4ff20 WatchSource:0}: Error finding container 2efbb26639066710bc0b56a4aaa3a1e27e383b2b5e78948cc91ca8f45fe4ff20: Status 404 returned error can't find the container with id 2efbb26639066710bc0b56a4aaa3a1e27e383b2b5e78948cc91ca8f45fe4ff20 May 21 18:23:09.171430 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:09.171341 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r5jsq" event={"ID":"02844de9-e521-48a2-98b7-b2147b0080b2","Type":"ContainerStarted","Data":"ab118d3738dad6ac7b04d74f5d13817026368f95c85030eb4378b6e25887bcbc"} May 21 18:23:09.172610 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:09.172584 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tcspb" event={"ID":"fc6592f5-db5f-4c58-8572-e390e2d4ef80","Type":"ContainerStarted","Data":"e48ea5eaaf4ce8bb4e8245c4d42929867b9ab66ec99f0f904e875d8b4754e82f"} May 21 18:23:09.172719 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:09.172614 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tcspb" event={"ID":"fc6592f5-db5f-4c58-8572-e390e2d4ef80","Type":"ContainerStarted","Data":"2efbb26639066710bc0b56a4aaa3a1e27e383b2b5e78948cc91ca8f45fe4ff20"} May 21 18:23:09.188172 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:09.188126 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-r5jsq" podStartSLOduration=137.092541494 podStartE2EDuration="2m19.188112758s" podCreationTimestamp="2026-05-21 18:20:50 +0000 UTC" firstStartedPulling="2026-05-21 18:23:06.832577669 +0000 UTC m=+169.704796549" lastFinishedPulling="2026-05-21 18:23:08.928148929 +0000 UTC m=+171.800367813" observedRunningTime="2026-05-21 18:23:09.187694249 +0000 UTC m=+172.059913149" watchObservedRunningTime="2026-05-21 18:23:09.188112758 +0000 UTC m=+172.060331655" May 21 18:23:09.696747 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:09.696720 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t2w2" May 21 18:23:10.179898 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:10.179856 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tcspb" event={"ID":"fc6592f5-db5f-4c58-8572-e390e2d4ef80","Type":"ContainerStarted","Data":"3681f61b8d5c872b9e7f0c8dff4805aa799f3f0984264ea0061c06d5002ed176"} May 21 18:23:12.155572 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:12.155542 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hvz8j" May 21 18:23:12.187421 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:12.187376 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tcspb" event={"ID":"fc6592f5-db5f-4c58-8572-e390e2d4ef80","Type":"ContainerStarted","Data":"4386dd7883627dc240a2f6fec781d3aaabc96da04fa7b55a3bcdc2b967fd0bc9"} May 21 18:23:12.208254 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:12.208206 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-tcspb" podStartSLOduration=2.0981334130000002 podStartE2EDuration="4.208191711s" podCreationTimestamp="2026-05-21 18:23:08 +0000 UTC" firstStartedPulling="2026-05-21 18:23:09.08901032 +0000 UTC m=+171.961229199" lastFinishedPulling="2026-05-21 18:23:11.199068622 +0000 UTC m=+174.071287497" observedRunningTime="2026-05-21 18:23:12.207345804 +0000 UTC m=+175.079564702" watchObservedRunningTime="2026-05-21 18:23:12.208191711 +0000 UTC m=+175.080410610" May 21 18:23:19.236130 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:19.236096 2575 patch_prober.go:28] interesting pod/image-registry-57d8c96475-qkmxn container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 21 18:23:19.236566 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:19.236149 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-57d8c96475-qkmxn" podUID="5525e1f2-eb94-4f1d-a739-41de787d3bc9" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 21 18:23:21.145122 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:21.145096 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-57d8c96475-qkmxn" May 21 18:23:22.018696 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:22.018658 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rxm9c"] May 21 18:23:22.021113 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:22.021094 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rxm9c" May 21 18:23:22.024194 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:22.024168 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 21 18:23:22.024194 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:22.024168 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 21 18:23:22.024445 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:22.024431 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 21 18:23:22.024502 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:22.024455 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 21 18:23:22.024584 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:22.024568 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 21 18:23:22.024640 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:22.024607 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 21 18:23:22.024694 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:22.024614 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8h69f\"" May 21 18:23:22.033676 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:22.033649 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8bf493cb-6c77-4f34-98ed-e1f40369cc10-node-exporter-tls\") pod \"node-exporter-rxm9c\" (UID: \"8bf493cb-6c77-4f34-98ed-e1f40369cc10\") " pod="openshift-monitoring/node-exporter-rxm9c" May 21 18:23:22.033836 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:22.033681 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8bf493cb-6c77-4f34-98ed-e1f40369cc10-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rxm9c\" (UID: \"8bf493cb-6c77-4f34-98ed-e1f40369cc10\") " pod="openshift-monitoring/node-exporter-rxm9c" May 21 18:23:22.033836 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:22.033725 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8bf493cb-6c77-4f34-98ed-e1f40369cc10-node-exporter-wtmp\") pod \"node-exporter-rxm9c\" (UID: \"8bf493cb-6c77-4f34-98ed-e1f40369cc10\") " pod="openshift-monitoring/node-exporter-rxm9c" May 21 18:23:22.033836 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:22.033803 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8bf493cb-6c77-4f34-98ed-e1f40369cc10-node-exporter-accelerators-collector-config\") pod \"node-exporter-rxm9c\" (UID: \"8bf493cb-6c77-4f34-98ed-e1f40369cc10\") " pod="openshift-monitoring/node-exporter-rxm9c" May 21 18:23:22.033965 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:22.033841 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bf493cb-6c77-4f34-98ed-e1f40369cc10-metrics-client-ca\") pod \"node-exporter-rxm9c\" (UID: \"8bf493cb-6c77-4f34-98ed-e1f40369cc10\") " pod="openshift-monitoring/node-exporter-rxm9c" May 21 18:23:22.033965 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:22.033872 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxgqd\" (UniqueName: \"kubernetes.io/projected/8bf493cb-6c77-4f34-98ed-e1f40369cc10-kube-api-access-hxgqd\") pod \"node-exporter-rxm9c\" (UID: \"8bf493cb-6c77-4f34-98ed-e1f40369cc10\") " pod="openshift-monitoring/node-exporter-rxm9c" May 21 18:23:22.033965 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:22.033914 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8bf493cb-6c77-4f34-98ed-e1f40369cc10-root\") pod \"node-exporter-rxm9c\" (UID: \"8bf493cb-6c77-4f34-98ed-e1f40369cc10\") " pod="openshift-monitoring/node-exporter-rxm9c" May 21 18:23:22.033965 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:22.033945 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8bf493cb-6c77-4f34-98ed-e1f40369cc10-node-exporter-textfile\") pod \"node-exporter-rxm9c\" (UID: \"8bf493cb-6c77-4f34-98ed-e1f40369cc10\") " pod="openshift-monitoring/node-exporter-rxm9c" May 21 18:23:22.033965 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:22.033963 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8bf493cb-6c77-4f34-98ed-e1f40369cc10-sys\") pod \"node-exporter-rxm9c\" (UID: \"8bf493cb-6c77-4f34-98ed-e1f40369cc10\") " pod="openshift-monitoring/node-exporter-rxm9c" May 21 18:23:22.134978 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:22.134941 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8bf493cb-6c77-4f34-98ed-e1f40369cc10-node-exporter-tls\") pod \"node-exporter-rxm9c\" (UID: \"8bf493cb-6c77-4f34-98ed-e1f40369cc10\") " pod="openshift-monitoring/node-exporter-rxm9c" May 21 18:23:22.134978 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:22.134984 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8bf493cb-6c77-4f34-98ed-e1f40369cc10-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rxm9c\" (UID: \"8bf493cb-6c77-4f34-98ed-e1f40369cc10\") " pod="openshift-monitoring/node-exporter-rxm9c" May 21 18:23:22.135236 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:23:22.135093 2575 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found May 21 18:23:22.135236 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:22.135121 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8bf493cb-6c77-4f34-98ed-e1f40369cc10-node-exporter-wtmp\") pod \"node-exporter-rxm9c\" (UID: \"8bf493cb-6c77-4f34-98ed-e1f40369cc10\") " pod="openshift-monitoring/node-exporter-rxm9c" May 21 18:23:22.135236 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:23:22.135164 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bf493cb-6c77-4f34-98ed-e1f40369cc10-node-exporter-tls podName:8bf493cb-6c77-4f34-98ed-e1f40369cc10 nodeName:}" failed. No retries permitted until 2026-05-21 18:23:22.635144932 +0000 UTC m=+185.507363829 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/8bf493cb-6c77-4f34-98ed-e1f40369cc10-node-exporter-tls") pod "node-exporter-rxm9c" (UID: "8bf493cb-6c77-4f34-98ed-e1f40369cc10") : secret "node-exporter-tls" not found May 21 18:23:22.135236 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:22.135202 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8bf493cb-6c77-4f34-98ed-e1f40369cc10-node-exporter-accelerators-collector-config\") pod \"node-exporter-rxm9c\" (UID: \"8bf493cb-6c77-4f34-98ed-e1f40369cc10\") " pod="openshift-monitoring/node-exporter-rxm9c" May 21 18:23:22.135236 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:22.135230 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bf493cb-6c77-4f34-98ed-e1f40369cc10-metrics-client-ca\") pod \"node-exporter-rxm9c\" (UID: \"8bf493cb-6c77-4f34-98ed-e1f40369cc10\") " pod="openshift-monitoring/node-exporter-rxm9c" May 21 18:23:22.135474 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:22.135239 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8bf493cb-6c77-4f34-98ed-e1f40369cc10-node-exporter-wtmp\") pod \"node-exporter-rxm9c\" (UID: \"8bf493cb-6c77-4f34-98ed-e1f40369cc10\") " pod="openshift-monitoring/node-exporter-rxm9c" May 21 18:23:22.135474 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:22.135267 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hxgqd\" (UniqueName: \"kubernetes.io/projected/8bf493cb-6c77-4f34-98ed-e1f40369cc10-kube-api-access-hxgqd\") pod \"node-exporter-rxm9c\" (UID: \"8bf493cb-6c77-4f34-98ed-e1f40369cc10\") " pod="openshift-monitoring/node-exporter-rxm9c" May 21 18:23:22.135474 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:22.135315 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8bf493cb-6c77-4f34-98ed-e1f40369cc10-root\") pod \"node-exporter-rxm9c\" (UID: \"8bf493cb-6c77-4f34-98ed-e1f40369cc10\") " pod="openshift-monitoring/node-exporter-rxm9c" May 21 18:23:22.135474 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:22.135337 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8bf493cb-6c77-4f34-98ed-e1f40369cc10-node-exporter-textfile\") pod \"node-exporter-rxm9c\" (UID: \"8bf493cb-6c77-4f34-98ed-e1f40369cc10\") " pod="openshift-monitoring/node-exporter-rxm9c" May 21 18:23:22.135474 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:22.135362 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8bf493cb-6c77-4f34-98ed-e1f40369cc10-sys\") pod \"node-exporter-rxm9c\" (UID: \"8bf493cb-6c77-4f34-98ed-e1f40369cc10\") " pod="openshift-monitoring/node-exporter-rxm9c" May 21 18:23:22.135474 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:22.135373 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8bf493cb-6c77-4f34-98ed-e1f40369cc10-root\") pod \"node-exporter-rxm9c\" (UID: \"8bf493cb-6c77-4f34-98ed-e1f40369cc10\") " pod="openshift-monitoring/node-exporter-rxm9c" May 21 18:23:22.135474 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:22.135450 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8bf493cb-6c77-4f34-98ed-e1f40369cc10-sys\") pod \"node-exporter-rxm9c\" (UID: \"8bf493cb-6c77-4f34-98ed-e1f40369cc10\") " pod="openshift-monitoring/node-exporter-rxm9c" May 21 18:23:22.135775 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:22.135662 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8bf493cb-6c77-4f34-98ed-e1f40369cc10-node-exporter-textfile\") pod \"node-exporter-rxm9c\" (UID: \"8bf493cb-6c77-4f34-98ed-e1f40369cc10\") " pod="openshift-monitoring/node-exporter-rxm9c" May 21 18:23:22.135856 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:22.135839 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bf493cb-6c77-4f34-98ed-e1f40369cc10-metrics-client-ca\") pod \"node-exporter-rxm9c\" (UID: \"8bf493cb-6c77-4f34-98ed-e1f40369cc10\") " pod="openshift-monitoring/node-exporter-rxm9c" May 21 18:23:22.135897 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:22.135876 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8bf493cb-6c77-4f34-98ed-e1f40369cc10-node-exporter-accelerators-collector-config\") pod \"node-exporter-rxm9c\" (UID: \"8bf493cb-6c77-4f34-98ed-e1f40369cc10\") " pod="openshift-monitoring/node-exporter-rxm9c" May 21 18:23:22.137473 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:22.137456 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8bf493cb-6c77-4f34-98ed-e1f40369cc10-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rxm9c\" (UID: \"8bf493cb-6c77-4f34-98ed-e1f40369cc10\") " pod="openshift-monitoring/node-exporter-rxm9c" May 21 18:23:22.146355 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:22.146321 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxgqd\" (UniqueName: \"kubernetes.io/projected/8bf493cb-6c77-4f34-98ed-e1f40369cc10-kube-api-access-hxgqd\") pod \"node-exporter-rxm9c\" (UID: \"8bf493cb-6c77-4f34-98ed-e1f40369cc10\") " pod="openshift-monitoring/node-exporter-rxm9c" May 21 18:23:22.640121 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:22.640079 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8bf493cb-6c77-4f34-98ed-e1f40369cc10-node-exporter-tls\") pod \"node-exporter-rxm9c\" (UID: \"8bf493cb-6c77-4f34-98ed-e1f40369cc10\") " pod="openshift-monitoring/node-exporter-rxm9c" May 21 18:23:22.642478 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:22.642455 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8bf493cb-6c77-4f34-98ed-e1f40369cc10-node-exporter-tls\") pod \"node-exporter-rxm9c\" (UID: \"8bf493cb-6c77-4f34-98ed-e1f40369cc10\") " pod="openshift-monitoring/node-exporter-rxm9c" May 21 18:23:22.930115 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:22.930029 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rxm9c" May 21 18:23:22.937571 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:23:22.937546 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bf493cb_6c77_4f34_98ed_e1f40369cc10.slice/crio-2c551b98c3c12e5831969ac766e6872f4ab9722429f0be15c351d9990a863ffd WatchSource:0}: Error finding container 2c551b98c3c12e5831969ac766e6872f4ab9722429f0be15c351d9990a863ffd: Status 404 returned error can't find the container with id 2c551b98c3c12e5831969ac766e6872f4ab9722429f0be15c351d9990a863ffd May 21 18:23:23.218589 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:23.218493 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rxm9c" event={"ID":"8bf493cb-6c77-4f34-98ed-e1f40369cc10","Type":"ContainerStarted","Data":"2c551b98c3c12e5831969ac766e6872f4ab9722429f0be15c351d9990a863ffd"} May 21 18:23:24.222870 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:24.222780 2575 generic.go:358] "Generic (PLEG): container finished" podID="8bf493cb-6c77-4f34-98ed-e1f40369cc10" containerID="6b5e0d91da6512d445384212daf34faa05ba7b7bb44daf951c98e9340e76a5d1" exitCode=0 May 21 18:23:24.223200 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:24.222871 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rxm9c" event={"ID":"8bf493cb-6c77-4f34-98ed-e1f40369cc10","Type":"ContainerDied","Data":"6b5e0d91da6512d445384212daf34faa05ba7b7bb44daf951c98e9340e76a5d1"} May 21 18:23:25.226934 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:25.226897 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rxm9c" event={"ID":"8bf493cb-6c77-4f34-98ed-e1f40369cc10","Type":"ContainerStarted","Data":"3c5fb094a86e0eee60557f4d064173022dcc6bfd6dd22a480d634397bd2b340b"} May 21 18:23:25.226934 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:25.226932 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rxm9c" event={"ID":"8bf493cb-6c77-4f34-98ed-e1f40369cc10","Type":"ContainerStarted","Data":"d1f52c0ab4b96828d0fda93b92497072992e23cad8021fbec7b228929e1ccc1d"} May 21 18:23:25.262758 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:25.262687 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rxm9c" podStartSLOduration=2.244984299 podStartE2EDuration="3.262671311s" podCreationTimestamp="2026-05-21 18:23:22 +0000 UTC" firstStartedPulling="2026-05-21 18:23:22.939175281 +0000 UTC m=+185.811394159" lastFinishedPulling="2026-05-21 18:23:23.956862292 +0000 UTC m=+186.829081171" observedRunningTime="2026-05-21 18:23:25.261039798 +0000 UTC m=+188.133258707" watchObservedRunningTime="2026-05-21 18:23:25.262671311 +0000 UTC m=+188.134890209" May 21 18:23:30.375200 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:30.375169 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-57d8c96475-qkmxn"] May 21 18:23:55.393742 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:55.393656 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-57d8c96475-qkmxn" podUID="5525e1f2-eb94-4f1d-a739-41de787d3bc9" containerName="registry" containerID="cri-o://d1ab347ab2ecc30f8144e5c7487e43638d13fffd77a4985f630112da904a9b9f" gracePeriod=30 May 21 18:23:55.648413 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:55.648360 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57d8c96475-qkmxn" May 21 18:23:55.820111 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:55.820075 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5525e1f2-eb94-4f1d-a739-41de787d3bc9-registry-certificates\") pod \"5525e1f2-eb94-4f1d-a739-41de787d3bc9\" (UID: \"5525e1f2-eb94-4f1d-a739-41de787d3bc9\") " May 21 18:23:55.820285 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:55.820120 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d77v5\" (UniqueName: \"kubernetes.io/projected/5525e1f2-eb94-4f1d-a739-41de787d3bc9-kube-api-access-d77v5\") pod \"5525e1f2-eb94-4f1d-a739-41de787d3bc9\" (UID: \"5525e1f2-eb94-4f1d-a739-41de787d3bc9\") " May 21 18:23:55.820285 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:55.820149 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5525e1f2-eb94-4f1d-a739-41de787d3bc9-ca-trust-extracted\") pod \"5525e1f2-eb94-4f1d-a739-41de787d3bc9\" (UID: \"5525e1f2-eb94-4f1d-a739-41de787d3bc9\") " May 21 18:23:55.820285 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:55.820185 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5525e1f2-eb94-4f1d-a739-41de787d3bc9-registry-tls\") pod \"5525e1f2-eb94-4f1d-a739-41de787d3bc9\" (UID: \"5525e1f2-eb94-4f1d-a739-41de787d3bc9\") " May 21 18:23:55.820285 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:55.820202 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5525e1f2-eb94-4f1d-a739-41de787d3bc9-trusted-ca\") pod \"5525e1f2-eb94-4f1d-a739-41de787d3bc9\" (UID: \"5525e1f2-eb94-4f1d-a739-41de787d3bc9\") " May 21 18:23:55.820285 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:55.820223 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5525e1f2-eb94-4f1d-a739-41de787d3bc9-installation-pull-secrets\") pod \"5525e1f2-eb94-4f1d-a739-41de787d3bc9\" (UID: \"5525e1f2-eb94-4f1d-a739-41de787d3bc9\") " May 21 18:23:55.820285 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:55.820245 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5525e1f2-eb94-4f1d-a739-41de787d3bc9-bound-sa-token\") pod \"5525e1f2-eb94-4f1d-a739-41de787d3bc9\" (UID: \"5525e1f2-eb94-4f1d-a739-41de787d3bc9\") " May 21 18:23:55.820589 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:55.820295 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5525e1f2-eb94-4f1d-a739-41de787d3bc9-image-registry-private-configuration\") pod \"5525e1f2-eb94-4f1d-a739-41de787d3bc9\" (UID: \"5525e1f2-eb94-4f1d-a739-41de787d3bc9\") " May 21 18:23:55.820671 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:55.820634 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5525e1f2-eb94-4f1d-a739-41de787d3bc9-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "5525e1f2-eb94-4f1d-a739-41de787d3bc9" (UID: "5525e1f2-eb94-4f1d-a739-41de787d3bc9"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 18:23:55.820824 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:55.820751 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5525e1f2-eb94-4f1d-a739-41de787d3bc9-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "5525e1f2-eb94-4f1d-a739-41de787d3bc9" (UID: "5525e1f2-eb94-4f1d-a739-41de787d3bc9"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 18:23:55.823041 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:55.823012 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5525e1f2-eb94-4f1d-a739-41de787d3bc9-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "5525e1f2-eb94-4f1d-a739-41de787d3bc9" (UID: "5525e1f2-eb94-4f1d-a739-41de787d3bc9"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 18:23:55.823152 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:55.823014 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5525e1f2-eb94-4f1d-a739-41de787d3bc9-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "5525e1f2-eb94-4f1d-a739-41de787d3bc9" (UID: "5525e1f2-eb94-4f1d-a739-41de787d3bc9"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 18:23:55.823338 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:55.823320 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5525e1f2-eb94-4f1d-a739-41de787d3bc9-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5525e1f2-eb94-4f1d-a739-41de787d3bc9" (UID: "5525e1f2-eb94-4f1d-a739-41de787d3bc9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 18:23:55.823411 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:55.823339 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5525e1f2-eb94-4f1d-a739-41de787d3bc9-kube-api-access-d77v5" (OuterVolumeSpecName: "kube-api-access-d77v5") pod "5525e1f2-eb94-4f1d-a739-41de787d3bc9" (UID: "5525e1f2-eb94-4f1d-a739-41de787d3bc9"). InnerVolumeSpecName "kube-api-access-d77v5". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 18:23:55.823518 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:55.823498 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5525e1f2-eb94-4f1d-a739-41de787d3bc9-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "5525e1f2-eb94-4f1d-a739-41de787d3bc9" (UID: "5525e1f2-eb94-4f1d-a739-41de787d3bc9"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 18:23:55.829444 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:55.829422 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5525e1f2-eb94-4f1d-a739-41de787d3bc9-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "5525e1f2-eb94-4f1d-a739-41de787d3bc9" (UID: "5525e1f2-eb94-4f1d-a739-41de787d3bc9"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 18:23:55.921766 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:55.921660 2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5525e1f2-eb94-4f1d-a739-41de787d3bc9-image-registry-private-configuration\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" May 21 18:23:55.921766 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:55.921717 2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5525e1f2-eb94-4f1d-a739-41de787d3bc9-registry-certificates\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" May 21 18:23:55.921766 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:55.921728 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d77v5\" (UniqueName: \"kubernetes.io/projected/5525e1f2-eb94-4f1d-a739-41de787d3bc9-kube-api-access-d77v5\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" May 21 18:23:55.921766 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:55.921737 2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5525e1f2-eb94-4f1d-a739-41de787d3bc9-ca-trust-extracted\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" May 21 18:23:55.921766 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:55.921748 2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5525e1f2-eb94-4f1d-a739-41de787d3bc9-registry-tls\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" May 21 18:23:55.921766 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:55.921758 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5525e1f2-eb94-4f1d-a739-41de787d3bc9-trusted-ca\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" May 21 18:23:55.921766 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:55.921766 2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5525e1f2-eb94-4f1d-a739-41de787d3bc9-installation-pull-secrets\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" May 21 18:23:55.921766 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:55.921775 2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5525e1f2-eb94-4f1d-a739-41de787d3bc9-bound-sa-token\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" May 21 18:23:56.302524 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:56.302425 2575 generic.go:358] "Generic (PLEG): container finished" podID="5525e1f2-eb94-4f1d-a739-41de787d3bc9" containerID="d1ab347ab2ecc30f8144e5c7487e43638d13fffd77a4985f630112da904a9b9f" exitCode=0 May 21 18:23:56.302524 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:56.302494 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57d8c96475-qkmxn" May 21 18:23:56.302524 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:56.302506 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57d8c96475-qkmxn" event={"ID":"5525e1f2-eb94-4f1d-a739-41de787d3bc9","Type":"ContainerDied","Data":"d1ab347ab2ecc30f8144e5c7487e43638d13fffd77a4985f630112da904a9b9f"} May 21 18:23:56.302763 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:56.302546 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57d8c96475-qkmxn" event={"ID":"5525e1f2-eb94-4f1d-a739-41de787d3bc9","Type":"ContainerDied","Data":"b20ac74b68ca24596f3c36fc6428b3dc83b6a72a2745d061cc12ac10df874091"} May 21 18:23:56.302763 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:56.302572 2575 scope.go:117] "RemoveContainer" containerID="d1ab347ab2ecc30f8144e5c7487e43638d13fffd77a4985f630112da904a9b9f" May 21 18:23:56.310656 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:56.310639 2575 scope.go:117] "RemoveContainer" containerID="d1ab347ab2ecc30f8144e5c7487e43638d13fffd77a4985f630112da904a9b9f" May 21 18:23:56.310956 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:23:56.310931 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1ab347ab2ecc30f8144e5c7487e43638d13fffd77a4985f630112da904a9b9f\": container with ID starting with d1ab347ab2ecc30f8144e5c7487e43638d13fffd77a4985f630112da904a9b9f not found: ID does not exist" containerID="d1ab347ab2ecc30f8144e5c7487e43638d13fffd77a4985f630112da904a9b9f" May 21 18:23:56.311087 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:56.310963 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1ab347ab2ecc30f8144e5c7487e43638d13fffd77a4985f630112da904a9b9f"} err="failed to get container status \"d1ab347ab2ecc30f8144e5c7487e43638d13fffd77a4985f630112da904a9b9f\": rpc error: code = NotFound desc = could not find container \"d1ab347ab2ecc30f8144e5c7487e43638d13fffd77a4985f630112da904a9b9f\": container with ID starting with d1ab347ab2ecc30f8144e5c7487e43638d13fffd77a4985f630112da904a9b9f not found: ID does not exist" May 21 18:23:56.329012 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:56.328985 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-57d8c96475-qkmxn"] May 21 18:23:56.345651 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:56.344022 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-57d8c96475-qkmxn"] May 21 18:23:57.697209 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:23:57.697177 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5525e1f2-eb94-4f1d-a739-41de787d3bc9" path="/var/lib/kubelet/pods/5525e1f2-eb94-4f1d-a739-41de787d3bc9/volumes" May 21 18:24:01.429898 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:24:01.429855 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675c46dc6d-7fl97" podUID="dd367223-ae83-4b83-baae-3061b3d042fd" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 21 18:24:11.429304 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:24:11.429259 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675c46dc6d-7fl97" podUID="dd367223-ae83-4b83-baae-3061b3d042fd" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 21 18:24:21.430091 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:24:21.430045 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675c46dc6d-7fl97" podUID="dd367223-ae83-4b83-baae-3061b3d042fd" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 21 18:24:21.430581 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:24:21.430133 2575 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675c46dc6d-7fl97" May 21 18:24:21.430749 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:24:21.430727 2575 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"e93c80e7127d8d58c79f3fe255a9fe48cc234c544bf9e2103dc7b95acce0b709"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675c46dc6d-7fl97" containerMessage="Container service-proxy failed liveness probe, will be restarted" May 21 18:24:21.430833 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:24:21.430774 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675c46dc6d-7fl97" podUID="dd367223-ae83-4b83-baae-3061b3d042fd" containerName="service-proxy" containerID="cri-o://e93c80e7127d8d58c79f3fe255a9fe48cc234c544bf9e2103dc7b95acce0b709" gracePeriod=30 May 21 18:24:22.368686 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:24:22.368651 2575 generic.go:358] "Generic (PLEG): container finished" podID="dd367223-ae83-4b83-baae-3061b3d042fd" containerID="e93c80e7127d8d58c79f3fe255a9fe48cc234c544bf9e2103dc7b95acce0b709" exitCode=2 May 21 18:24:22.368873 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:24:22.368727 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675c46dc6d-7fl97" event={"ID":"dd367223-ae83-4b83-baae-3061b3d042fd","Type":"ContainerDied","Data":"e93c80e7127d8d58c79f3fe255a9fe48cc234c544bf9e2103dc7b95acce0b709"} May 21 18:24:22.368873 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:24:22.368766 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675c46dc6d-7fl97" event={"ID":"dd367223-ae83-4b83-baae-3061b3d042fd","Type":"ContainerStarted","Data":"9fd4f0b65c9df8e2a78389ccfc61e0714427dd82a2230ae6fa5a0bdd7bcd78b0"} May 21 18:24:29.565021 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:24:29.564960 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2-metrics-certs\") pod \"network-metrics-daemon-2t2w2\" (UID: \"fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2\") " pod="openshift-multus/network-metrics-daemon-2t2w2" May 21 18:24:29.567339 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:24:29.567313 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2-metrics-certs\") pod \"network-metrics-daemon-2t2w2\" (UID: \"fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2\") " pod="openshift-multus/network-metrics-daemon-2t2w2" May 21 18:24:29.800747 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:24:29.800714 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7dqz4\"" May 21 18:24:29.808174 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:24:29.808137 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t2w2" May 21 18:24:29.933108 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:24:29.933075 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2t2w2"] May 21 18:24:29.936428 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:24:29.936397 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfabcd2fd_028c_4a4d_86aa_95ec5fa44fd2.slice/crio-5c0162ee5877be64798d567c7d39e058663e77d2498047b03a89ef112e2f757a WatchSource:0}: Error finding container 5c0162ee5877be64798d567c7d39e058663e77d2498047b03a89ef112e2f757a: Status 404 returned error can't find the container with id 5c0162ee5877be64798d567c7d39e058663e77d2498047b03a89ef112e2f757a May 21 18:24:30.391387 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:24:30.391349 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2t2w2" event={"ID":"fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2","Type":"ContainerStarted","Data":"5c0162ee5877be64798d567c7d39e058663e77d2498047b03a89ef112e2f757a"} May 21 18:24:31.396008 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:24:31.395968 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2t2w2" event={"ID":"fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2","Type":"ContainerStarted","Data":"cd2c2a962baf549d2489c4a9423230efbeeaaf86fdaac8281cab9f1aaabb0b41"} May 21 18:24:31.396008 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:24:31.396009 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2t2w2" event={"ID":"fabcd2fd-028c-4a4d-86aa-95ec5fa44fd2","Type":"ContainerStarted","Data":"fdce5d16350b0638a93c543696b0f95de3ca3529b6ecdc5b067f4d6252b0a2a6"} May 21 18:24:31.414196 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:24:31.414147 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2t2w2" podStartSLOduration=253.325948281 podStartE2EDuration="4m14.414131984s" podCreationTimestamp="2026-05-21 18:20:17 +0000 UTC" firstStartedPulling="2026-05-21 18:24:29.938083666 +0000 UTC m=+252.810302542" lastFinishedPulling="2026-05-21 18:24:31.026267366 +0000 UTC m=+253.898486245" observedRunningTime="2026-05-21 18:24:31.414003322 +0000 UTC m=+254.286222222" watchObservedRunningTime="2026-05-21 18:24:31.414131984 +0000 UTC m=+254.286350882" May 21 18:25:17.583136 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:25:17.583096 2575 kubelet.go:1628] "Image garbage collection succeeded" May 21 18:26:45.073609 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:26:45.073532 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-kzv4q"] May 21 18:26:45.074089 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:26:45.073814 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5525e1f2-eb94-4f1d-a739-41de787d3bc9" containerName="registry" May 21 18:26:45.074089 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:26:45.073826 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5525e1f2-eb94-4f1d-a739-41de787d3bc9" containerName="registry" May 21 18:26:45.074089 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:26:45.073873 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="5525e1f2-eb94-4f1d-a739-41de787d3bc9" containerName="registry" May 21 18:26:45.076483 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:26:45.076466 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-kzv4q" May 21 18:26:45.079227 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:26:45.079206 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 21 18:26:45.080208 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:26:45.080190 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-g4fcg\"" May 21 18:26:45.080296 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:26:45.080232 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 21 18:26:45.083304 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:26:45.083047 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-kzv4q"] May 21 18:26:45.191517 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:26:45.191481 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk7tt\" (UniqueName: \"kubernetes.io/projected/6143e97c-17c9-4ad5-885f-da8aeebea691-kube-api-access-rk7tt\") pod \"cert-manager-cainjector-68b757865b-kzv4q\" (UID: \"6143e97c-17c9-4ad5-885f-da8aeebea691\") " pod="cert-manager/cert-manager-cainjector-68b757865b-kzv4q" May 21 18:26:45.191517 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:26:45.191518 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6143e97c-17c9-4ad5-885f-da8aeebea691-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-kzv4q\" (UID: \"6143e97c-17c9-4ad5-885f-da8aeebea691\") " pod="cert-manager/cert-manager-cainjector-68b757865b-kzv4q" May 21 18:26:45.292326 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:26:45.292291 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rk7tt\" (UniqueName: \"kubernetes.io/projected/6143e97c-17c9-4ad5-885f-da8aeebea691-kube-api-access-rk7tt\") pod \"cert-manager-cainjector-68b757865b-kzv4q\" (UID: \"6143e97c-17c9-4ad5-885f-da8aeebea691\") " pod="cert-manager/cert-manager-cainjector-68b757865b-kzv4q" May 21 18:26:45.292482 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:26:45.292336 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6143e97c-17c9-4ad5-885f-da8aeebea691-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-kzv4q\" (UID: \"6143e97c-17c9-4ad5-885f-da8aeebea691\") " pod="cert-manager/cert-manager-cainjector-68b757865b-kzv4q" May 21 18:26:45.300996 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:26:45.300968 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk7tt\" (UniqueName: \"kubernetes.io/projected/6143e97c-17c9-4ad5-885f-da8aeebea691-kube-api-access-rk7tt\") pod \"cert-manager-cainjector-68b757865b-kzv4q\" (UID: \"6143e97c-17c9-4ad5-885f-da8aeebea691\") " pod="cert-manager/cert-manager-cainjector-68b757865b-kzv4q" May 21 18:26:45.301101 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:26:45.301002 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6143e97c-17c9-4ad5-885f-da8aeebea691-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-kzv4q\" (UID: \"6143e97c-17c9-4ad5-885f-da8aeebea691\") " pod="cert-manager/cert-manager-cainjector-68b757865b-kzv4q" May 21 18:26:45.385756 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:26:45.385725 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-kzv4q" May 21 18:26:45.506283 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:26:45.506253 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-kzv4q"] May 21 18:26:45.509617 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:26:45.509592 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6143e97c_17c9_4ad5_885f_da8aeebea691.slice/crio-81050b921223c60740bf15f5631c0ffcdd23a5c52418932a58385af7cf9a2679 WatchSource:0}: Error finding container 81050b921223c60740bf15f5631c0ffcdd23a5c52418932a58385af7cf9a2679: Status 404 returned error can't find the container with id 81050b921223c60740bf15f5631c0ffcdd23a5c52418932a58385af7cf9a2679 May 21 18:26:45.511373 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:26:45.511359 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 18:26:45.732544 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:26:45.732464 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-kzv4q" event={"ID":"6143e97c-17c9-4ad5-885f-da8aeebea691","Type":"ContainerStarted","Data":"81050b921223c60740bf15f5631c0ffcdd23a5c52418932a58385af7cf9a2679"} May 21 18:26:48.742661 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:26:48.742623 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-kzv4q" event={"ID":"6143e97c-17c9-4ad5-885f-da8aeebea691","Type":"ContainerStarted","Data":"0283e0c0210c7e9e5efd7ab5fd5fcfe26f9440cd477a291ab96b61f14a490fb0"} May 21 18:26:48.767200 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:26:48.767142 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-kzv4q" podStartSLOduration=1.279952217 podStartE2EDuration="3.767127136s" podCreationTimestamp="2026-05-21 18:26:45 +0000 UTC" firstStartedPulling="2026-05-21 18:26:45.511482299 +0000 UTC m=+388.383701174" lastFinishedPulling="2026-05-21 18:26:47.998657215 +0000 UTC m=+390.870876093" observedRunningTime="2026-05-21 18:26:48.766105887 +0000 UTC m=+391.638324786" watchObservedRunningTime="2026-05-21 18:26:48.767127136 +0000 UTC m=+391.639346034" May 21 18:27:20.090615 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:20.090578 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67595b8579-867zd"] May 21 18:27:20.093572 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:20.093555 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67595b8579-867zd" May 21 18:27:20.096552 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:20.096529 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 21 18:27:20.096822 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:20.096804 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gnvp9\"" May 21 18:27:20.096908 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:20.096832 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 21 18:27:20.096908 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:20.096806 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 21 18:27:20.097183 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:20.097170 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 21 18:27:20.109278 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:20.109254 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67595b8579-867zd"] May 21 18:27:20.140491 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:20.140458 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a6408fc3-43ad-433b-ae99-90bd16844e16-webhook-cert\") pod \"opendatahub-operator-controller-manager-67595b8579-867zd\" (UID: \"a6408fc3-43ad-433b-ae99-90bd16844e16\") " pod="opendatahub/opendatahub-operator-controller-manager-67595b8579-867zd" May 21 18:27:20.140643 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:20.140509 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-855ff\" (UniqueName: \"kubernetes.io/projected/a6408fc3-43ad-433b-ae99-90bd16844e16-kube-api-access-855ff\") pod \"opendatahub-operator-controller-manager-67595b8579-867zd\" (UID: \"a6408fc3-43ad-433b-ae99-90bd16844e16\") " pod="opendatahub/opendatahub-operator-controller-manager-67595b8579-867zd" May 21 18:27:20.140643 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:20.140610 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a6408fc3-43ad-433b-ae99-90bd16844e16-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67595b8579-867zd\" (UID: \"a6408fc3-43ad-433b-ae99-90bd16844e16\") " pod="opendatahub/opendatahub-operator-controller-manager-67595b8579-867zd" May 21 18:27:20.241636 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:20.241599 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a6408fc3-43ad-433b-ae99-90bd16844e16-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67595b8579-867zd\" (UID: \"a6408fc3-43ad-433b-ae99-90bd16844e16\") " pod="opendatahub/opendatahub-operator-controller-manager-67595b8579-867zd" May 21 18:27:20.241831 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:20.241657 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a6408fc3-43ad-433b-ae99-90bd16844e16-webhook-cert\") pod \"opendatahub-operator-controller-manager-67595b8579-867zd\" (UID: \"a6408fc3-43ad-433b-ae99-90bd16844e16\") " pod="opendatahub/opendatahub-operator-controller-manager-67595b8579-867zd" May 21 18:27:20.241831 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:20.241687 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-855ff\" (UniqueName: \"kubernetes.io/projected/a6408fc3-43ad-433b-ae99-90bd16844e16-kube-api-access-855ff\") pod \"opendatahub-operator-controller-manager-67595b8579-867zd\" (UID: \"a6408fc3-43ad-433b-ae99-90bd16844e16\") " pod="opendatahub/opendatahub-operator-controller-manager-67595b8579-867zd" May 21 18:27:20.244222 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:20.244187 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a6408fc3-43ad-433b-ae99-90bd16844e16-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67595b8579-867zd\" (UID: \"a6408fc3-43ad-433b-ae99-90bd16844e16\") " pod="opendatahub/opendatahub-operator-controller-manager-67595b8579-867zd" May 21 18:27:20.244345 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:20.244187 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a6408fc3-43ad-433b-ae99-90bd16844e16-webhook-cert\") pod \"opendatahub-operator-controller-manager-67595b8579-867zd\" (UID: \"a6408fc3-43ad-433b-ae99-90bd16844e16\") " pod="opendatahub/opendatahub-operator-controller-manager-67595b8579-867zd" May 21 18:27:20.250321 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:20.250298 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-855ff\" (UniqueName: \"kubernetes.io/projected/a6408fc3-43ad-433b-ae99-90bd16844e16-kube-api-access-855ff\") pod \"opendatahub-operator-controller-manager-67595b8579-867zd\" (UID: \"a6408fc3-43ad-433b-ae99-90bd16844e16\") " pod="opendatahub/opendatahub-operator-controller-manager-67595b8579-867zd" May 21 18:27:20.404071 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:20.404038 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67595b8579-867zd" May 21 18:27:20.546834 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:20.546808 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67595b8579-867zd"] May 21 18:27:20.548385 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:27:20.548359 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6408fc3_43ad_433b_ae99_90bd16844e16.slice/crio-cc33bddcb33d3b9e44065cc38c7453a8c9528bd3407d1b91490b050a7a86f5ca WatchSource:0}: Error finding container cc33bddcb33d3b9e44065cc38c7453a8c9528bd3407d1b91490b050a7a86f5ca: Status 404 returned error can't find the container with id cc33bddcb33d3b9e44065cc38c7453a8c9528bd3407d1b91490b050a7a86f5ca May 21 18:27:20.822793 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:20.822693 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67595b8579-867zd" event={"ID":"a6408fc3-43ad-433b-ae99-90bd16844e16","Type":"ContainerStarted","Data":"cc33bddcb33d3b9e44065cc38c7453a8c9528bd3407d1b91490b050a7a86f5ca"} May 21 18:27:23.832496 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:23.832464 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67595b8579-867zd" event={"ID":"a6408fc3-43ad-433b-ae99-90bd16844e16","Type":"ContainerStarted","Data":"2f065629d6ee9df8af4ad7f0f8f97fb1f20bf347b7abef148b6f481481b09330"} May 21 18:27:23.832945 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:23.832566 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-67595b8579-867zd" May 21 18:27:23.855494 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:23.855441 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-67595b8579-867zd" podStartSLOduration=1.162826352 podStartE2EDuration="3.855427261s" podCreationTimestamp="2026-05-21 18:27:20 +0000 UTC" firstStartedPulling="2026-05-21 18:27:20.5500542 +0000 UTC m=+423.422273081" lastFinishedPulling="2026-05-21 18:27:23.242655111 +0000 UTC m=+426.114873990" observedRunningTime="2026-05-21 18:27:23.853505457 +0000 UTC m=+426.725724352" watchObservedRunningTime="2026-05-21 18:27:23.855427261 +0000 UTC m=+426.727646158" May 21 18:27:26.990065 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:26.990028 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-59996fdc5c-4dhw6"] May 21 18:27:26.993259 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:26.993243 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-59996fdc5c-4dhw6" May 21 18:27:26.996142 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:26.996116 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 21 18:27:26.996142 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:26.996129 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 21 18:27:26.996142 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:26.996141 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-mnvks\"" May 21 18:27:26.996377 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:26.996186 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 21 18:27:26.996377 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:26.996236 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 21 18:27:26.996467 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:26.996453 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 21 18:27:27.002855 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:27.002835 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-59996fdc5c-4dhw6"] May 21 18:27:27.094612 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:27.094579 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/04c87fd8-2ccb-4490-a5f8-6cf40a20ef6f-manager-config\") pod \"lws-controller-manager-59996fdc5c-4dhw6\" (UID: \"04c87fd8-2ccb-4490-a5f8-6cf40a20ef6f\") " pod="openshift-lws-operator/lws-controller-manager-59996fdc5c-4dhw6" May 21 18:27:27.094810 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:27.094635 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsgqh\" (UniqueName: \"kubernetes.io/projected/04c87fd8-2ccb-4490-a5f8-6cf40a20ef6f-kube-api-access-lsgqh\") pod \"lws-controller-manager-59996fdc5c-4dhw6\" (UID: \"04c87fd8-2ccb-4490-a5f8-6cf40a20ef6f\") " pod="openshift-lws-operator/lws-controller-manager-59996fdc5c-4dhw6" May 21 18:27:27.094810 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:27.094682 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/04c87fd8-2ccb-4490-a5f8-6cf40a20ef6f-metrics-cert\") pod \"lws-controller-manager-59996fdc5c-4dhw6\" (UID: \"04c87fd8-2ccb-4490-a5f8-6cf40a20ef6f\") " pod="openshift-lws-operator/lws-controller-manager-59996fdc5c-4dhw6" May 21 18:27:27.094810 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:27.094735 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/04c87fd8-2ccb-4490-a5f8-6cf40a20ef6f-cert\") pod \"lws-controller-manager-59996fdc5c-4dhw6\" (UID: \"04c87fd8-2ccb-4490-a5f8-6cf40a20ef6f\") " pod="openshift-lws-operator/lws-controller-manager-59996fdc5c-4dhw6" May 21 18:27:27.195649 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:27.195610 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/04c87fd8-2ccb-4490-a5f8-6cf40a20ef6f-metrics-cert\") pod \"lws-controller-manager-59996fdc5c-4dhw6\" (UID: \"04c87fd8-2ccb-4490-a5f8-6cf40a20ef6f\") " pod="openshift-lws-operator/lws-controller-manager-59996fdc5c-4dhw6" May 21 18:27:27.195649 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:27.195649 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/04c87fd8-2ccb-4490-a5f8-6cf40a20ef6f-cert\") pod \"lws-controller-manager-59996fdc5c-4dhw6\" (UID: \"04c87fd8-2ccb-4490-a5f8-6cf40a20ef6f\") " pod="openshift-lws-operator/lws-controller-manager-59996fdc5c-4dhw6" May 21 18:27:27.195875 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:27.195695 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/04c87fd8-2ccb-4490-a5f8-6cf40a20ef6f-manager-config\") pod \"lws-controller-manager-59996fdc5c-4dhw6\" (UID: \"04c87fd8-2ccb-4490-a5f8-6cf40a20ef6f\") " pod="openshift-lws-operator/lws-controller-manager-59996fdc5c-4dhw6" May 21 18:27:27.195875 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:27.195746 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lsgqh\" (UniqueName: \"kubernetes.io/projected/04c87fd8-2ccb-4490-a5f8-6cf40a20ef6f-kube-api-access-lsgqh\") pod \"lws-controller-manager-59996fdc5c-4dhw6\" (UID: \"04c87fd8-2ccb-4490-a5f8-6cf40a20ef6f\") " pod="openshift-lws-operator/lws-controller-manager-59996fdc5c-4dhw6" May 21 18:27:27.196441 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:27.196420 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/04c87fd8-2ccb-4490-a5f8-6cf40a20ef6f-manager-config\") pod \"lws-controller-manager-59996fdc5c-4dhw6\" (UID: \"04c87fd8-2ccb-4490-a5f8-6cf40a20ef6f\") " pod="openshift-lws-operator/lws-controller-manager-59996fdc5c-4dhw6" May 21 18:27:27.198196 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:27.198172 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/04c87fd8-2ccb-4490-a5f8-6cf40a20ef6f-cert\") pod \"lws-controller-manager-59996fdc5c-4dhw6\" (UID: \"04c87fd8-2ccb-4490-a5f8-6cf40a20ef6f\") " pod="openshift-lws-operator/lws-controller-manager-59996fdc5c-4dhw6" May 21 18:27:27.198330 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:27.198313 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/04c87fd8-2ccb-4490-a5f8-6cf40a20ef6f-metrics-cert\") pod \"lws-controller-manager-59996fdc5c-4dhw6\" (UID: \"04c87fd8-2ccb-4490-a5f8-6cf40a20ef6f\") " pod="openshift-lws-operator/lws-controller-manager-59996fdc5c-4dhw6" May 21 18:27:27.205566 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:27.205538 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsgqh\" (UniqueName: \"kubernetes.io/projected/04c87fd8-2ccb-4490-a5f8-6cf40a20ef6f-kube-api-access-lsgqh\") pod \"lws-controller-manager-59996fdc5c-4dhw6\" (UID: \"04c87fd8-2ccb-4490-a5f8-6cf40a20ef6f\") " pod="openshift-lws-operator/lws-controller-manager-59996fdc5c-4dhw6" May 21 18:27:27.303764 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:27.303634 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-59996fdc5c-4dhw6" May 21 18:27:27.434197 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:27.434163 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-59996fdc5c-4dhw6"] May 21 18:27:27.438134 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:27:27.438101 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04c87fd8_2ccb_4490_a5f8_6cf40a20ef6f.slice/crio-31ea5b15e37db362bbe6566b41546bcba0224b585216aea4cffecf751e5f4c79 WatchSource:0}: Error finding container 31ea5b15e37db362bbe6566b41546bcba0224b585216aea4cffecf751e5f4c79: Status 404 returned error can't find the container with id 31ea5b15e37db362bbe6566b41546bcba0224b585216aea4cffecf751e5f4c79 May 21 18:27:27.843810 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:27.843763 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-59996fdc5c-4dhw6" event={"ID":"04c87fd8-2ccb-4490-a5f8-6cf40a20ef6f","Type":"ContainerStarted","Data":"31ea5b15e37db362bbe6566b41546bcba0224b585216aea4cffecf751e5f4c79"} May 21 18:27:30.853292 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:30.853253 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-59996fdc5c-4dhw6" event={"ID":"04c87fd8-2ccb-4490-a5f8-6cf40a20ef6f","Type":"ContainerStarted","Data":"e114f7b3c032fd3962e65cf4c255a813784658f241b7ae8da52a416599215229"} May 21 18:27:30.853657 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:30.853386 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-59996fdc5c-4dhw6" May 21 18:27:30.874473 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:30.874427 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-59996fdc5c-4dhw6" podStartSLOduration=2.187017304 podStartE2EDuration="4.874415415s" podCreationTimestamp="2026-05-21 18:27:26 +0000 UTC" firstStartedPulling="2026-05-21 18:27:27.439997947 +0000 UTC m=+430.312216827" lastFinishedPulling="2026-05-21 18:27:30.127396057 +0000 UTC m=+432.999614938" observedRunningTime="2026-05-21 18:27:30.873912508 +0000 UTC m=+433.746131407" watchObservedRunningTime="2026-05-21 18:27:30.874415415 +0000 UTC m=+433.746634312" May 21 18:27:34.838175 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:34.838105 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-67595b8579-867zd" May 21 18:27:41.857868 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:27:41.857833 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-59996fdc5c-4dhw6" May 21 18:28:08.260790 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:08.260758 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p"] May 21 18:28:08.265376 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:08.265352 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p" May 21 18:28:08.268864 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:08.268838 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 21 18:28:08.268982 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:08.268846 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 21 18:28:08.268982 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:08.268957 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-gjp2p\"" May 21 18:28:08.269149 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:08.269128 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 21 18:28:08.278337 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:08.278313 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p"] May 21 18:28:08.304894 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:08.304857 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdfqk\" (UniqueName: \"kubernetes.io/projected/57764465-9125-4073-9b63-2681280ced07-kube-api-access-mdfqk\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p\" (UID: \"57764465-9125-4073-9b63-2681280ced07\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p" May 21 18:28:08.305091 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:08.304902 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57764465-9125-4073-9b63-2681280ced07-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p\" (UID: \"57764465-9125-4073-9b63-2681280ced07\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p" May 21 18:28:08.305091 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:08.304932 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57764465-9125-4073-9b63-2681280ced07-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p\" (UID: \"57764465-9125-4073-9b63-2681280ced07\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p" May 21 18:28:08.305091 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:08.304988 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57764465-9125-4073-9b63-2681280ced07-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p\" (UID: \"57764465-9125-4073-9b63-2681280ced07\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p" May 21 18:28:08.305091 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:08.305014 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57764465-9125-4073-9b63-2681280ced07-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p\" (UID: \"57764465-9125-4073-9b63-2681280ced07\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p" May 21 18:28:08.305091 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:08.305056 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57764465-9125-4073-9b63-2681280ced07-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p\" (UID: \"57764465-9125-4073-9b63-2681280ced07\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p" May 21 18:28:08.305091 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:08.305081 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57764465-9125-4073-9b63-2681280ced07-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p\" (UID: \"57764465-9125-4073-9b63-2681280ced07\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p" May 21 18:28:08.305328 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:08.305118 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57764465-9125-4073-9b63-2681280ced07-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p\" (UID: \"57764465-9125-4073-9b63-2681280ced07\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p" May 21 18:28:08.305328 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:08.305158 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57764465-9125-4073-9b63-2681280ced07-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p\" (UID: \"57764465-9125-4073-9b63-2681280ced07\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p" May 21 18:28:08.409425 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:08.409181 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57764465-9125-4073-9b63-2681280ced07-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p\" (UID: \"57764465-9125-4073-9b63-2681280ced07\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p" May 21 18:28:08.409425 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:08.409244 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57764465-9125-4073-9b63-2681280ced07-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p\" (UID: \"57764465-9125-4073-9b63-2681280ced07\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p" May 21 18:28:08.409425 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:08.409302 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57764465-9125-4073-9b63-2681280ced07-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p\" (UID: \"57764465-9125-4073-9b63-2681280ced07\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p" May 21 18:28:08.409425 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:08.409351 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57764465-9125-4073-9b63-2681280ced07-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p\" (UID: \"57764465-9125-4073-9b63-2681280ced07\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p" May 21 18:28:08.409425 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:08.409390 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mdfqk\" (UniqueName: \"kubernetes.io/projected/57764465-9125-4073-9b63-2681280ced07-kube-api-access-mdfqk\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p\" (UID: \"57764465-9125-4073-9b63-2681280ced07\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p" May 21 18:28:08.409425 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:08.409434 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57764465-9125-4073-9b63-2681280ced07-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p\" (UID: \"57764465-9125-4073-9b63-2681280ced07\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p" May 21 18:28:08.410293 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:08.409466 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57764465-9125-4073-9b63-2681280ced07-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p\" (UID: \"57764465-9125-4073-9b63-2681280ced07\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p" May 21 18:28:08.410293 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:08.409510 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57764465-9125-4073-9b63-2681280ced07-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p\" (UID: \"57764465-9125-4073-9b63-2681280ced07\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p" May 21 18:28:08.410293 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:08.409575 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57764465-9125-4073-9b63-2681280ced07-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p\" (UID: \"57764465-9125-4073-9b63-2681280ced07\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p" May 21 18:28:08.410817 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:08.410691 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57764465-9125-4073-9b63-2681280ced07-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p\" (UID: \"57764465-9125-4073-9b63-2681280ced07\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p" May 21 18:28:08.411219 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:08.411195 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57764465-9125-4073-9b63-2681280ced07-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p\" (UID: \"57764465-9125-4073-9b63-2681280ced07\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p" May 21 18:28:08.411326 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:08.411236 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57764465-9125-4073-9b63-2681280ced07-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p\" (UID: \"57764465-9125-4073-9b63-2681280ced07\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p" May 21 18:28:08.411417 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:08.411398 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57764465-9125-4073-9b63-2681280ced07-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p\" (UID: \"57764465-9125-4073-9b63-2681280ced07\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p" May 21 18:28:08.411498 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:08.411480 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57764465-9125-4073-9b63-2681280ced07-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p\" (UID: \"57764465-9125-4073-9b63-2681280ced07\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p" May 21 18:28:08.413149 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:08.413130 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57764465-9125-4073-9b63-2681280ced07-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p\" (UID: \"57764465-9125-4073-9b63-2681280ced07\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p" May 21 18:28:08.413409 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:08.413391 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57764465-9125-4073-9b63-2681280ced07-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p\" (UID: \"57764465-9125-4073-9b63-2681280ced07\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p" May 21 18:28:08.421444 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:08.421421 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdfqk\" (UniqueName: \"kubernetes.io/projected/57764465-9125-4073-9b63-2681280ced07-kube-api-access-mdfqk\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p\" (UID: \"57764465-9125-4073-9b63-2681280ced07\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p" May 21 18:28:08.422687 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:08.422665 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57764465-9125-4073-9b63-2681280ced07-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p\" (UID: \"57764465-9125-4073-9b63-2681280ced07\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p" May 21 18:28:08.575691 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:08.575606 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p" May 21 18:28:08.728733 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:08.728689 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p"] May 21 18:28:08.741666 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:28:08.741640 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57764465_9125_4073_9b63_2681280ced07.slice/crio-f824e7008c46b80713a85e6dcf13ebeaa8d3b6adff2b4fc847c2b8e5eea9b3f6 WatchSource:0}: Error finding container f824e7008c46b80713a85e6dcf13ebeaa8d3b6adff2b4fc847c2b8e5eea9b3f6: Status 404 returned error can't find the container with id f824e7008c46b80713a85e6dcf13ebeaa8d3b6adff2b4fc847c2b8e5eea9b3f6 May 21 18:28:08.953813 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:08.953770 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p" event={"ID":"57764465-9125-4073-9b63-2681280ced07","Type":"ContainerStarted","Data":"f824e7008c46b80713a85e6dcf13ebeaa8d3b6adff2b4fc847c2b8e5eea9b3f6"} May 21 18:28:11.342455 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:11.342416 2575 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} May 21 18:28:11.342785 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:11.342495 2575 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} May 21 18:28:11.342785 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:11.342522 2575 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} May 21 18:28:11.962624 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:11.962587 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p" event={"ID":"57764465-9125-4073-9b63-2681280ced07","Type":"ContainerStarted","Data":"c5d1c43b4afb18ea5269beba564fcb6c32422ed2635e552a2256de992de46606"} May 21 18:28:11.984644 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:11.984590 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p" podStartSLOduration=1.385711034 podStartE2EDuration="3.984575211s" podCreationTimestamp="2026-05-21 18:28:08 +0000 UTC" firstStartedPulling="2026-05-21 18:28:08.743318085 +0000 UTC m=+471.615536960" lastFinishedPulling="2026-05-21 18:28:11.342182254 +0000 UTC m=+474.214401137" observedRunningTime="2026-05-21 18:28:11.982943355 +0000 UTC m=+474.855162256" watchObservedRunningTime="2026-05-21 18:28:11.984575211 +0000 UTC m=+474.856794109" May 21 18:28:12.576409 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:12.576366 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p" May 21 18:28:12.580823 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:12.580797 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p" May 21 18:28:12.965085 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:12.965054 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p" May 21 18:28:12.966071 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:12.966048 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p" May 21 18:28:38.475638 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:38.475602 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bnxdm"] May 21 18:28:38.478637 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:38.478618 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bnxdm" May 21 18:28:38.481468 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:38.481452 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 21 18:28:38.482546 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:38.482530 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 21 18:28:38.482606 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:38.482534 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-8srnr\"" May 21 18:28:38.490400 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:38.490376 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bnxdm"] May 21 18:28:38.544152 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:38.544120 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kddft\" (UniqueName: \"kubernetes.io/projected/9feced93-9a36-48a2-8004-5f5a0d8b20f5-kube-api-access-kddft\") pod \"kuadrant-operator-catalog-bnxdm\" (UID: \"9feced93-9a36-48a2-8004-5f5a0d8b20f5\") " pod="kuadrant-system/kuadrant-operator-catalog-bnxdm" May 21 18:28:38.644797 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:38.644763 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kddft\" (UniqueName: \"kubernetes.io/projected/9feced93-9a36-48a2-8004-5f5a0d8b20f5-kube-api-access-kddft\") pod \"kuadrant-operator-catalog-bnxdm\" (UID: \"9feced93-9a36-48a2-8004-5f5a0d8b20f5\") " pod="kuadrant-system/kuadrant-operator-catalog-bnxdm" May 21 18:28:38.656810 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:38.656776 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kddft\" (UniqueName: \"kubernetes.io/projected/9feced93-9a36-48a2-8004-5f5a0d8b20f5-kube-api-access-kddft\") pod \"kuadrant-operator-catalog-bnxdm\" (UID: \"9feced93-9a36-48a2-8004-5f5a0d8b20f5\") " pod="kuadrant-system/kuadrant-operator-catalog-bnxdm" May 21 18:28:38.787693 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:38.787615 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bnxdm" May 21 18:28:38.839607 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:38.839576 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bnxdm"] May 21 18:28:38.912220 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:38.912181 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bnxdm"] May 21 18:28:38.916104 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:28:38.916077 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9feced93_9a36_48a2_8004_5f5a0d8b20f5.slice/crio-3ae56ba69966e71c1522b95b7816ac85ec94bb5cb13e00df3f1c0eeb535da63e WatchSource:0}: Error finding container 3ae56ba69966e71c1522b95b7816ac85ec94bb5cb13e00df3f1c0eeb535da63e: Status 404 returned error can't find the container with id 3ae56ba69966e71c1522b95b7816ac85ec94bb5cb13e00df3f1c0eeb535da63e May 21 18:28:39.032234 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:39.032197 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bnxdm" event={"ID":"9feced93-9a36-48a2-8004-5f5a0d8b20f5","Type":"ContainerStarted","Data":"3ae56ba69966e71c1522b95b7816ac85ec94bb5cb13e00df3f1c0eeb535da63e"} May 21 18:28:39.050235 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:39.050153 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-z4f2l"] May 21 18:28:39.054275 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:39.054253 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-z4f2l" May 21 18:28:39.060785 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:39.060758 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-z4f2l"] May 21 18:28:39.149507 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:39.149463 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k59kq\" (UniqueName: \"kubernetes.io/projected/13d20793-57d7-42c5-b4a7-e693216c7609-kube-api-access-k59kq\") pod \"kuadrant-operator-catalog-z4f2l\" (UID: \"13d20793-57d7-42c5-b4a7-e693216c7609\") " pod="kuadrant-system/kuadrant-operator-catalog-z4f2l" May 21 18:28:39.250549 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:39.250517 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k59kq\" (UniqueName: \"kubernetes.io/projected/13d20793-57d7-42c5-b4a7-e693216c7609-kube-api-access-k59kq\") pod \"kuadrant-operator-catalog-z4f2l\" (UID: \"13d20793-57d7-42c5-b4a7-e693216c7609\") " pod="kuadrant-system/kuadrant-operator-catalog-z4f2l" May 21 18:28:39.259355 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:39.259331 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k59kq\" (UniqueName: \"kubernetes.io/projected/13d20793-57d7-42c5-b4a7-e693216c7609-kube-api-access-k59kq\") pod \"kuadrant-operator-catalog-z4f2l\" (UID: \"13d20793-57d7-42c5-b4a7-e693216c7609\") " pod="kuadrant-system/kuadrant-operator-catalog-z4f2l" May 21 18:28:39.364035 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:39.363950 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-z4f2l" May 21 18:28:39.491267 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:39.491241 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-z4f2l"] May 21 18:28:39.493610 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:28:39.493580 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13d20793_57d7_42c5_b4a7_e693216c7609.slice/crio-c63f8bb6da014669a31a5c724d0dbcb2398cfd460fe512ed73aa3a5cddff6844 WatchSource:0}: Error finding container c63f8bb6da014669a31a5c724d0dbcb2398cfd460fe512ed73aa3a5cddff6844: Status 404 returned error can't find the container with id c63f8bb6da014669a31a5c724d0dbcb2398cfd460fe512ed73aa3a5cddff6844 May 21 18:28:40.038105 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:40.038064 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-z4f2l" event={"ID":"13d20793-57d7-42c5-b4a7-e693216c7609","Type":"ContainerStarted","Data":"c63f8bb6da014669a31a5c724d0dbcb2398cfd460fe512ed73aa3a5cddff6844"} May 21 18:28:42.045573 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:42.045539 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bnxdm" event={"ID":"9feced93-9a36-48a2-8004-5f5a0d8b20f5","Type":"ContainerStarted","Data":"7e230306746485a84c931d0cf2a121539fb35167311e80509df30ac09d035115"} May 21 18:28:42.046073 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:42.045622 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-bnxdm" podUID="9feced93-9a36-48a2-8004-5f5a0d8b20f5" containerName="registry-server" containerID="cri-o://7e230306746485a84c931d0cf2a121539fb35167311e80509df30ac09d035115" gracePeriod=2 May 21 18:28:42.046958 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:42.046934 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-z4f2l" event={"ID":"13d20793-57d7-42c5-b4a7-e693216c7609","Type":"ContainerStarted","Data":"5ed9c89bafe8ab2bc37aa84f48d9ed31e024de8e1276dcdfa16b6cdc3245e2b3"} May 21 18:28:42.063115 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:42.063073 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-bnxdm" podStartSLOduration=1.884417058 podStartE2EDuration="4.063058825s" podCreationTimestamp="2026-05-21 18:28:38 +0000 UTC" firstStartedPulling="2026-05-21 18:28:38.917425413 +0000 UTC m=+501.789644292" lastFinishedPulling="2026-05-21 18:28:41.096067176 +0000 UTC m=+503.968286059" observedRunningTime="2026-05-21 18:28:42.061822629 +0000 UTC m=+504.934041528" watchObservedRunningTime="2026-05-21 18:28:42.063058825 +0000 UTC m=+504.935277722" May 21 18:28:42.080048 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:42.080006 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-z4f2l" podStartSLOduration=1.478151347 podStartE2EDuration="3.079992829s" podCreationTimestamp="2026-05-21 18:28:39 +0000 UTC" firstStartedPulling="2026-05-21 18:28:39.494995083 +0000 UTC m=+502.367213960" lastFinishedPulling="2026-05-21 18:28:41.09683656 +0000 UTC m=+503.969055442" observedRunningTime="2026-05-21 18:28:42.079034169 +0000 UTC m=+504.951253068" watchObservedRunningTime="2026-05-21 18:28:42.079992829 +0000 UTC m=+504.952211727" May 21 18:28:42.285783 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:42.285755 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bnxdm" May 21 18:28:42.374925 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:42.374894 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kddft\" (UniqueName: \"kubernetes.io/projected/9feced93-9a36-48a2-8004-5f5a0d8b20f5-kube-api-access-kddft\") pod \"9feced93-9a36-48a2-8004-5f5a0d8b20f5\" (UID: \"9feced93-9a36-48a2-8004-5f5a0d8b20f5\") " May 21 18:28:42.377053 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:42.377028 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9feced93-9a36-48a2-8004-5f5a0d8b20f5-kube-api-access-kddft" (OuterVolumeSpecName: "kube-api-access-kddft") pod "9feced93-9a36-48a2-8004-5f5a0d8b20f5" (UID: "9feced93-9a36-48a2-8004-5f5a0d8b20f5"). InnerVolumeSpecName "kube-api-access-kddft". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 18:28:42.475780 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:42.475740 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kddft\" (UniqueName: \"kubernetes.io/projected/9feced93-9a36-48a2-8004-5f5a0d8b20f5-kube-api-access-kddft\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" May 21 18:28:43.050578 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:43.050542 2575 generic.go:358] "Generic (PLEG): container finished" podID="9feced93-9a36-48a2-8004-5f5a0d8b20f5" containerID="7e230306746485a84c931d0cf2a121539fb35167311e80509df30ac09d035115" exitCode=0 May 21 18:28:43.050982 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:43.050609 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bnxdm" May 21 18:28:43.050982 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:43.050630 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bnxdm" event={"ID":"9feced93-9a36-48a2-8004-5f5a0d8b20f5","Type":"ContainerDied","Data":"7e230306746485a84c931d0cf2a121539fb35167311e80509df30ac09d035115"} May 21 18:28:43.050982 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:43.050674 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bnxdm" event={"ID":"9feced93-9a36-48a2-8004-5f5a0d8b20f5","Type":"ContainerDied","Data":"3ae56ba69966e71c1522b95b7816ac85ec94bb5cb13e00df3f1c0eeb535da63e"} May 21 18:28:43.050982 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:43.050695 2575 scope.go:117] "RemoveContainer" containerID="7e230306746485a84c931d0cf2a121539fb35167311e80509df30ac09d035115" May 21 18:28:43.058753 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:43.058735 2575 scope.go:117] "RemoveContainer" containerID="7e230306746485a84c931d0cf2a121539fb35167311e80509df30ac09d035115" May 21 18:28:43.058996 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:28:43.058977 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e230306746485a84c931d0cf2a121539fb35167311e80509df30ac09d035115\": container with ID starting with 7e230306746485a84c931d0cf2a121539fb35167311e80509df30ac09d035115 not found: ID does not exist" containerID="7e230306746485a84c931d0cf2a121539fb35167311e80509df30ac09d035115" May 21 18:28:43.059043 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:43.059004 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e230306746485a84c931d0cf2a121539fb35167311e80509df30ac09d035115"} err="failed to get container status \"7e230306746485a84c931d0cf2a121539fb35167311e80509df30ac09d035115\": rpc error: code = NotFound desc = could not find container \"7e230306746485a84c931d0cf2a121539fb35167311e80509df30ac09d035115\": container with ID starting with 7e230306746485a84c931d0cf2a121539fb35167311e80509df30ac09d035115 not found: ID does not exist" May 21 18:28:43.071372 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:43.071346 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bnxdm"] May 21 18:28:43.075892 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:43.075872 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bnxdm"] May 21 18:28:43.697307 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:43.697274 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9feced93-9a36-48a2-8004-5f5a0d8b20f5" path="/var/lib/kubelet/pods/9feced93-9a36-48a2-8004-5f5a0d8b20f5/volumes" May 21 18:28:49.364270 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:49.364229 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-z4f2l" May 21 18:28:49.364761 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:49.364322 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-z4f2l" May 21 18:28:49.384928 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:49.384902 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-z4f2l" May 21 18:28:50.094919 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:28:50.094892 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-z4f2l" May 21 18:29:13.624480 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:13.624392 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lthcn"] May 21 18:29:13.624939 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:13.624669 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9feced93-9a36-48a2-8004-5f5a0d8b20f5" containerName="registry-server" May 21 18:29:13.624939 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:13.624680 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9feced93-9a36-48a2-8004-5f5a0d8b20f5" containerName="registry-server" May 21 18:29:13.624939 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:13.624745 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="9feced93-9a36-48a2-8004-5f5a0d8b20f5" containerName="registry-server" May 21 18:29:13.631277 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:13.631254 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lthcn" May 21 18:29:13.637393 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:13.637039 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-vvhll\"" May 21 18:29:13.651604 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:13.651575 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lthcn"] May 21 18:29:13.820157 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:13.820115 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72cvq\" (UniqueName: \"kubernetes.io/projected/a4748470-0029-45bb-9576-a2bad3668c33-kube-api-access-72cvq\") pod \"limitador-operator-controller-manager-85c4996f8c-lthcn\" (UID: \"a4748470-0029-45bb-9576-a2bad3668c33\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lthcn" May 21 18:29:13.921241 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:13.921142 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-72cvq\" (UniqueName: \"kubernetes.io/projected/a4748470-0029-45bb-9576-a2bad3668c33-kube-api-access-72cvq\") pod \"limitador-operator-controller-manager-85c4996f8c-lthcn\" (UID: \"a4748470-0029-45bb-9576-a2bad3668c33\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lthcn" May 21 18:29:13.939621 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:13.939589 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72cvq\" (UniqueName: \"kubernetes.io/projected/a4748470-0029-45bb-9576-a2bad3668c33-kube-api-access-72cvq\") pod \"limitador-operator-controller-manager-85c4996f8c-lthcn\" (UID: \"a4748470-0029-45bb-9576-a2bad3668c33\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lthcn" May 21 18:29:13.940308 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:13.940289 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lthcn" May 21 18:29:14.071194 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:14.071169 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lthcn"] May 21 18:29:14.073910 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:29:14.073879 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4748470_0029_45bb_9576_a2bad3668c33.slice/crio-788ffc25f77c593529caa3fe0a7bd2d927e4ff3e078ae27b052c68e61ee63ed9 WatchSource:0}: Error finding container 788ffc25f77c593529caa3fe0a7bd2d927e4ff3e078ae27b052c68e61ee63ed9: Status 404 returned error can't find the container with id 788ffc25f77c593529caa3fe0a7bd2d927e4ff3e078ae27b052c68e61ee63ed9 May 21 18:29:14.145842 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:14.145801 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lthcn" event={"ID":"a4748470-0029-45bb-9576-a2bad3668c33","Type":"ContainerStarted","Data":"788ffc25f77c593529caa3fe0a7bd2d927e4ff3e078ae27b052c68e61ee63ed9"} May 21 18:29:16.153642 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:16.153612 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lthcn" event={"ID":"a4748470-0029-45bb-9576-a2bad3668c33","Type":"ContainerStarted","Data":"1f876f97e9dbb6b41d4478b29fe3975652fa6146858109c112988e681dd76e55"} May 21 18:29:16.154094 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:16.153731 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lthcn" May 21 18:29:16.196478 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:16.196426 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lthcn" podStartSLOduration=1.517771066 podStartE2EDuration="3.19640991s" podCreationTimestamp="2026-05-21 18:29:13 +0000 UTC" firstStartedPulling="2026-05-21 18:29:14.075753751 +0000 UTC m=+536.947972628" lastFinishedPulling="2026-05-21 18:29:15.754392593 +0000 UTC m=+538.626611472" observedRunningTime="2026-05-21 18:29:16.196363955 +0000 UTC m=+539.068582852" watchObservedRunningTime="2026-05-21 18:29:16.19640991 +0000 UTC m=+539.068628808" May 21 18:29:20.189559 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:20.189523 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-wbqkn"] May 21 18:29:20.194658 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:20.194641 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-wbqkn" May 21 18:29:20.197295 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:20.197274 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-cj62p\"" May 21 18:29:20.206019 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:20.205994 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-wbqkn"] May 21 18:29:20.267676 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:20.267635 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9pqb\" (UniqueName: \"kubernetes.io/projected/31f6e33e-187c-49df-9413-a1bc4f075380-kube-api-access-b9pqb\") pod \"authorino-operator-657f44b778-wbqkn\" (UID: \"31f6e33e-187c-49df-9413-a1bc4f075380\") " pod="kuadrant-system/authorino-operator-657f44b778-wbqkn" May 21 18:29:20.368695 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:20.368662 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b9pqb\" (UniqueName: \"kubernetes.io/projected/31f6e33e-187c-49df-9413-a1bc4f075380-kube-api-access-b9pqb\") pod \"authorino-operator-657f44b778-wbqkn\" (UID: \"31f6e33e-187c-49df-9413-a1bc4f075380\") " pod="kuadrant-system/authorino-operator-657f44b778-wbqkn" May 21 18:29:20.385520 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:20.385487 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9pqb\" (UniqueName: \"kubernetes.io/projected/31f6e33e-187c-49df-9413-a1bc4f075380-kube-api-access-b9pqb\") pod \"authorino-operator-657f44b778-wbqkn\" (UID: \"31f6e33e-187c-49df-9413-a1bc4f075380\") " pod="kuadrant-system/authorino-operator-657f44b778-wbqkn" May 21 18:29:20.504643 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:20.504551 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-wbqkn" May 21 18:29:20.639800 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:20.639772 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-wbqkn"] May 21 18:29:20.642243 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:29:20.642213 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31f6e33e_187c_49df_9413_a1bc4f075380.slice/crio-47a98e155572b91668620933ec1d22c5b5982b3eeb25aad21ff4c512db4f1197 WatchSource:0}: Error finding container 47a98e155572b91668620933ec1d22c5b5982b3eeb25aad21ff4c512db4f1197: Status 404 returned error can't find the container with id 47a98e155572b91668620933ec1d22c5b5982b3eeb25aad21ff4c512db4f1197 May 21 18:29:21.170995 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:21.170961 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-wbqkn" event={"ID":"31f6e33e-187c-49df-9413-a1bc4f075380","Type":"ContainerStarted","Data":"47a98e155572b91668620933ec1d22c5b5982b3eeb25aad21ff4c512db4f1197"} May 21 18:29:23.179804 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:23.179717 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-wbqkn" event={"ID":"31f6e33e-187c-49df-9413-a1bc4f075380","Type":"ContainerStarted","Data":"4e9431112899ab56a64b8754cb9df076c028abb05abd763ef707a6c87fff9f47"} May 21 18:29:23.180214 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:23.179856 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-wbqkn" May 21 18:29:23.199094 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:23.199045 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-wbqkn" podStartSLOduration=0.95620368 podStartE2EDuration="3.199030314s" podCreationTimestamp="2026-05-21 18:29:20 +0000 UTC" firstStartedPulling="2026-05-21 18:29:20.644730538 +0000 UTC m=+543.516949417" lastFinishedPulling="2026-05-21 18:29:22.887557174 +0000 UTC m=+545.759776051" observedRunningTime="2026-05-21 18:29:23.197171298 +0000 UTC m=+546.069390199" watchObservedRunningTime="2026-05-21 18:29:23.199030314 +0000 UTC m=+546.071249213" May 21 18:29:27.160124 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:27.160093 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lthcn" May 21 18:29:31.556573 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:31.556420 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lthcn"] May 21 18:29:31.556972 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:31.556746 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lthcn" podUID="a4748470-0029-45bb-9576-a2bad3668c33" containerName="manager" containerID="cri-o://1f876f97e9dbb6b41d4478b29fe3975652fa6146858109c112988e681dd76e55" gracePeriod=2 May 21 18:29:31.577790 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:31.577759 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lthcn"] May 21 18:29:31.594516 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:31.594487 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b2xn2"] May 21 18:29:31.594823 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:31.594807 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4748470-0029-45bb-9576-a2bad3668c33" containerName="manager" May 21 18:29:31.594909 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:31.594827 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4748470-0029-45bb-9576-a2bad3668c33" containerName="manager" May 21 18:29:31.594961 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:31.594922 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="a4748470-0029-45bb-9576-a2bad3668c33" containerName="manager" May 21 18:29:31.597767 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:31.597745 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b2xn2" May 21 18:29:31.611041 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:31.611011 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b2xn2"] May 21 18:29:31.673211 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:31.673182 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfs2m\" (UniqueName: \"kubernetes.io/projected/521cb54c-a40a-40b6-bd1b-6e36d6153c6e-kube-api-access-nfs2m\") pod \"limitador-operator-controller-manager-85c4996f8c-b2xn2\" (UID: \"521cb54c-a40a-40b6-bd1b-6e36d6153c6e\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b2xn2" May 21 18:29:31.774385 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:31.774345 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nfs2m\" (UniqueName: \"kubernetes.io/projected/521cb54c-a40a-40b6-bd1b-6e36d6153c6e-kube-api-access-nfs2m\") pod \"limitador-operator-controller-manager-85c4996f8c-b2xn2\" (UID: \"521cb54c-a40a-40b6-bd1b-6e36d6153c6e\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b2xn2" May 21 18:29:31.794270 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:31.794246 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lthcn" May 21 18:29:31.797291 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:31.797268 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfs2m\" (UniqueName: \"kubernetes.io/projected/521cb54c-a40a-40b6-bd1b-6e36d6153c6e-kube-api-access-nfs2m\") pod \"limitador-operator-controller-manager-85c4996f8c-b2xn2\" (UID: \"521cb54c-a40a-40b6-bd1b-6e36d6153c6e\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b2xn2" May 21 18:29:31.874991 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:31.874960 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-72cvq\" (UniqueName: \"kubernetes.io/projected/a4748470-0029-45bb-9576-a2bad3668c33-kube-api-access-72cvq\") pod \"a4748470-0029-45bb-9576-a2bad3668c33\" (UID: \"a4748470-0029-45bb-9576-a2bad3668c33\") " May 21 18:29:31.876981 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:31.876958 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4748470-0029-45bb-9576-a2bad3668c33-kube-api-access-72cvq" (OuterVolumeSpecName: "kube-api-access-72cvq") pod "a4748470-0029-45bb-9576-a2bad3668c33" (UID: "a4748470-0029-45bb-9576-a2bad3668c33"). InnerVolumeSpecName "kube-api-access-72cvq". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 18:29:31.930192 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:31.930143 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b2xn2" May 21 18:29:31.975955 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:31.975760 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72cvq\" (UniqueName: \"kubernetes.io/projected/a4748470-0029-45bb-9576-a2bad3668c33-kube-api-access-72cvq\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" May 21 18:29:32.075525 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:32.075497 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b2xn2"] May 21 18:29:32.077577 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:29:32.077549 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod521cb54c_a40a_40b6_bd1b_6e36d6153c6e.slice/crio-60fa5aa5379e4754890d3d0e9f4547bc6fc04c8199aca8f51c5100f807670928 WatchSource:0}: Error finding container 60fa5aa5379e4754890d3d0e9f4547bc6fc04c8199aca8f51c5100f807670928: Status 404 returned error can't find the container with id 60fa5aa5379e4754890d3d0e9f4547bc6fc04c8199aca8f51c5100f807670928 May 21 18:29:32.207830 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:32.207786 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b2xn2" event={"ID":"521cb54c-a40a-40b6-bd1b-6e36d6153c6e","Type":"ContainerStarted","Data":"377b656961a9ddc81e37ab009c98d34d01fb8d266b01f4da8fbeaebc56e9b685"} May 21 18:29:32.207830 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:32.207835 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b2xn2" event={"ID":"521cb54c-a40a-40b6-bd1b-6e36d6153c6e","Type":"ContainerStarted","Data":"60fa5aa5379e4754890d3d0e9f4547bc6fc04c8199aca8f51c5100f807670928"} May 21 18:29:32.208218 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:32.207883 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b2xn2" May 21 18:29:32.208859 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:32.208836 2575 generic.go:358] "Generic (PLEG): container finished" podID="a4748470-0029-45bb-9576-a2bad3668c33" containerID="1f876f97e9dbb6b41d4478b29fe3975652fa6146858109c112988e681dd76e55" exitCode=0 May 21 18:29:32.208941 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:32.208874 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lthcn" May 21 18:29:32.208941 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:32.208915 2575 scope.go:117] "RemoveContainer" containerID="1f876f97e9dbb6b41d4478b29fe3975652fa6146858109c112988e681dd76e55" May 21 18:29:32.216419 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:32.216402 2575 scope.go:117] "RemoveContainer" containerID="1f876f97e9dbb6b41d4478b29fe3975652fa6146858109c112988e681dd76e55" May 21 18:29:32.216744 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:29:32.216719 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f876f97e9dbb6b41d4478b29fe3975652fa6146858109c112988e681dd76e55\": container with ID starting with 1f876f97e9dbb6b41d4478b29fe3975652fa6146858109c112988e681dd76e55 not found: ID does not exist" containerID="1f876f97e9dbb6b41d4478b29fe3975652fa6146858109c112988e681dd76e55" May 21 18:29:32.216829 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:32.216753 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f876f97e9dbb6b41d4478b29fe3975652fa6146858109c112988e681dd76e55"} err="failed to get container status \"1f876f97e9dbb6b41d4478b29fe3975652fa6146858109c112988e681dd76e55\": rpc error: code = NotFound desc = could not find container \"1f876f97e9dbb6b41d4478b29fe3975652fa6146858109c112988e681dd76e55\": container with ID starting with 1f876f97e9dbb6b41d4478b29fe3975652fa6146858109c112988e681dd76e55 not found: ID does not exist" May 21 18:29:32.231625 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:32.231584 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b2xn2" podStartSLOduration=1.231572471 podStartE2EDuration="1.231572471s" podCreationTimestamp="2026-05-21 18:29:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:29:32.229752787 +0000 UTC m=+555.101971685" watchObservedRunningTime="2026-05-21 18:29:32.231572471 +0000 UTC m=+555.103791406" May 21 18:29:33.697458 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:33.697427 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4748470-0029-45bb-9576-a2bad3668c33" path="/var/lib/kubelet/pods/a4748470-0029-45bb-9576-a2bad3668c33/volumes" May 21 18:29:34.185258 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:34.185229 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-wbqkn" May 21 18:29:43.215025 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:29:43.214996 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b2xn2" May 21 18:30:09.172501 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:09.172466 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-bdd4w"] May 21 18:30:09.174514 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:09.174489 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-bdd4w" May 21 18:30:09.177038 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:09.177021 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-pswmb\"" May 21 18:30:09.181853 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:09.181727 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-bdd4w"] May 21 18:30:09.264910 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:09.264874 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gnhs\" (UniqueName: \"kubernetes.io/projected/1b218721-e791-4af0-b680-327a2d53425c-kube-api-access-6gnhs\") pod \"authorino-f99f4b5cd-bdd4w\" (UID: \"1b218721-e791-4af0-b680-327a2d53425c\") " pod="kuadrant-system/authorino-f99f4b5cd-bdd4w" May 21 18:30:09.365309 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:09.365275 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6gnhs\" (UniqueName: \"kubernetes.io/projected/1b218721-e791-4af0-b680-327a2d53425c-kube-api-access-6gnhs\") pod \"authorino-f99f4b5cd-bdd4w\" (UID: \"1b218721-e791-4af0-b680-327a2d53425c\") " pod="kuadrant-system/authorino-f99f4b5cd-bdd4w" May 21 18:30:09.379810 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:09.379669 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gnhs\" (UniqueName: \"kubernetes.io/projected/1b218721-e791-4af0-b680-327a2d53425c-kube-api-access-6gnhs\") pod \"authorino-f99f4b5cd-bdd4w\" (UID: \"1b218721-e791-4af0-b680-327a2d53425c\") " pod="kuadrant-system/authorino-f99f4b5cd-bdd4w" May 21 18:30:09.402597 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:09.402567 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-8tbdn"] May 21 18:30:09.404575 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:09.404556 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-8tbdn" May 21 18:30:09.416427 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:09.416397 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-8tbdn"] May 21 18:30:09.466513 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:09.466432 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4x8fn\" (UniqueName: \"kubernetes.io/projected/d602d6c5-b1f4-4329-a96c-a631beaf0da2-kube-api-access-4x8fn\") pod \"authorino-7498df8756-8tbdn\" (UID: \"d602d6c5-b1f4-4329-a96c-a631beaf0da2\") " pod="kuadrant-system/authorino-7498df8756-8tbdn" May 21 18:30:09.484399 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:09.484363 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-bdd4w" May 21 18:30:09.567116 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:09.567087 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4x8fn\" (UniqueName: \"kubernetes.io/projected/d602d6c5-b1f4-4329-a96c-a631beaf0da2-kube-api-access-4x8fn\") pod \"authorino-7498df8756-8tbdn\" (UID: \"d602d6c5-b1f4-4329-a96c-a631beaf0da2\") " pod="kuadrant-system/authorino-7498df8756-8tbdn" May 21 18:30:09.575810 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:09.575780 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4x8fn\" (UniqueName: \"kubernetes.io/projected/d602d6c5-b1f4-4329-a96c-a631beaf0da2-kube-api-access-4x8fn\") pod \"authorino-7498df8756-8tbdn\" (UID: \"d602d6c5-b1f4-4329-a96c-a631beaf0da2\") " pod="kuadrant-system/authorino-7498df8756-8tbdn" May 21 18:30:09.616789 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:09.616754 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-bdd4w"] May 21 18:30:09.620108 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:30:09.620078 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b218721_e791_4af0_b680_327a2d53425c.slice/crio-f09ef88c34a17ba05621202ace1f26f50f6eae3ca3fccee4061eecdd810e1456 WatchSource:0}: Error finding container f09ef88c34a17ba05621202ace1f26f50f6eae3ca3fccee4061eecdd810e1456: Status 404 returned error can't find the container with id f09ef88c34a17ba05621202ace1f26f50f6eae3ca3fccee4061eecdd810e1456 May 21 18:30:09.713442 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:09.713405 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-8tbdn" May 21 18:30:09.836986 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:09.836900 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-8tbdn"] May 21 18:30:09.839524 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:30:09.839495 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd602d6c5_b1f4_4329_a96c_a631beaf0da2.slice/crio-99665983769f10ccd195176cf31f6e4e4b23dadfbbebfd5da70679035b9d1a97 WatchSource:0}: Error finding container 99665983769f10ccd195176cf31f6e4e4b23dadfbbebfd5da70679035b9d1a97: Status 404 returned error can't find the container with id 99665983769f10ccd195176cf31f6e4e4b23dadfbbebfd5da70679035b9d1a97 May 21 18:30:10.331884 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:10.331826 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-8tbdn" event={"ID":"d602d6c5-b1f4-4329-a96c-a631beaf0da2","Type":"ContainerStarted","Data":"99665983769f10ccd195176cf31f6e4e4b23dadfbbebfd5da70679035b9d1a97"} May 21 18:30:10.334061 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:10.334005 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-bdd4w" event={"ID":"1b218721-e791-4af0-b680-327a2d53425c","Type":"ContainerStarted","Data":"f09ef88c34a17ba05621202ace1f26f50f6eae3ca3fccee4061eecdd810e1456"} May 21 18:30:13.346660 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:13.346619 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-8tbdn" event={"ID":"d602d6c5-b1f4-4329-a96c-a631beaf0da2","Type":"ContainerStarted","Data":"1e8f080fb1467c4981745d6b371ee14b1a7be4a7632fe35b300e268e42191db2"} May 21 18:30:13.347935 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:13.347907 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-bdd4w" event={"ID":"1b218721-e791-4af0-b680-327a2d53425c","Type":"ContainerStarted","Data":"80742abe594c2bb227b3a4d7e8a0ae4b488812d1d54391014d8ebb46e742d686"} May 21 18:30:13.379084 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:13.379025 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-8tbdn" podStartSLOduration=1.050348503 podStartE2EDuration="4.379010003s" podCreationTimestamp="2026-05-21 18:30:09 +0000 UTC" firstStartedPulling="2026-05-21 18:30:09.840816273 +0000 UTC m=+592.713035152" lastFinishedPulling="2026-05-21 18:30:13.169477774 +0000 UTC m=+596.041696652" observedRunningTime="2026-05-21 18:30:13.364769303 +0000 UTC m=+596.236988214" watchObservedRunningTime="2026-05-21 18:30:13.379010003 +0000 UTC m=+596.251228915" May 21 18:30:13.380197 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:13.380161 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-bdd4w" podStartSLOduration=0.842595315 podStartE2EDuration="4.380151394s" podCreationTimestamp="2026-05-21 18:30:09 +0000 UTC" firstStartedPulling="2026-05-21 18:30:09.621635022 +0000 UTC m=+592.493853898" lastFinishedPulling="2026-05-21 18:30:13.159191084 +0000 UTC m=+596.031409977" observedRunningTime="2026-05-21 18:30:13.378739726 +0000 UTC m=+596.250958625" watchObservedRunningTime="2026-05-21 18:30:13.380151394 +0000 UTC m=+596.252370322" May 21 18:30:13.406781 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:13.406740 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-bdd4w"] May 21 18:30:15.354040 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:15.353977 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-bdd4w" podUID="1b218721-e791-4af0-b680-327a2d53425c" containerName="authorino" containerID="cri-o://80742abe594c2bb227b3a4d7e8a0ae4b488812d1d54391014d8ebb46e742d686" gracePeriod=30 May 21 18:30:15.605845 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:15.605772 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-bdd4w" May 21 18:30:15.725452 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:15.725412 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6gnhs\" (UniqueName: \"kubernetes.io/projected/1b218721-e791-4af0-b680-327a2d53425c-kube-api-access-6gnhs\") pod \"1b218721-e791-4af0-b680-327a2d53425c\" (UID: \"1b218721-e791-4af0-b680-327a2d53425c\") " May 21 18:30:15.727468 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:15.727436 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b218721-e791-4af0-b680-327a2d53425c-kube-api-access-6gnhs" (OuterVolumeSpecName: "kube-api-access-6gnhs") pod "1b218721-e791-4af0-b680-327a2d53425c" (UID: "1b218721-e791-4af0-b680-327a2d53425c"). InnerVolumeSpecName "kube-api-access-6gnhs". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 18:30:15.826868 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:15.826823 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6gnhs\" (UniqueName: \"kubernetes.io/projected/1b218721-e791-4af0-b680-327a2d53425c-kube-api-access-6gnhs\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" May 21 18:30:16.358271 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:16.358233 2575 generic.go:358] "Generic (PLEG): container finished" podID="1b218721-e791-4af0-b680-327a2d53425c" containerID="80742abe594c2bb227b3a4d7e8a0ae4b488812d1d54391014d8ebb46e742d686" exitCode=0 May 21 18:30:16.358729 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:16.358299 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-bdd4w" May 21 18:30:16.358729 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:16.358321 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-bdd4w" event={"ID":"1b218721-e791-4af0-b680-327a2d53425c","Type":"ContainerDied","Data":"80742abe594c2bb227b3a4d7e8a0ae4b488812d1d54391014d8ebb46e742d686"} May 21 18:30:16.358729 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:16.358364 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-bdd4w" event={"ID":"1b218721-e791-4af0-b680-327a2d53425c","Type":"ContainerDied","Data":"f09ef88c34a17ba05621202ace1f26f50f6eae3ca3fccee4061eecdd810e1456"} May 21 18:30:16.358729 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:16.358384 2575 scope.go:117] "RemoveContainer" containerID="80742abe594c2bb227b3a4d7e8a0ae4b488812d1d54391014d8ebb46e742d686" May 21 18:30:16.366524 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:16.366505 2575 scope.go:117] "RemoveContainer" containerID="80742abe594c2bb227b3a4d7e8a0ae4b488812d1d54391014d8ebb46e742d686" May 21 18:30:16.366835 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:30:16.366816 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80742abe594c2bb227b3a4d7e8a0ae4b488812d1d54391014d8ebb46e742d686\": container with ID starting with 80742abe594c2bb227b3a4d7e8a0ae4b488812d1d54391014d8ebb46e742d686 not found: ID does not exist" containerID="80742abe594c2bb227b3a4d7e8a0ae4b488812d1d54391014d8ebb46e742d686" May 21 18:30:16.366905 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:16.366843 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80742abe594c2bb227b3a4d7e8a0ae4b488812d1d54391014d8ebb46e742d686"} err="failed to get container status \"80742abe594c2bb227b3a4d7e8a0ae4b488812d1d54391014d8ebb46e742d686\": rpc error: code = NotFound desc = could not find container \"80742abe594c2bb227b3a4d7e8a0ae4b488812d1d54391014d8ebb46e742d686\": container with ID starting with 80742abe594c2bb227b3a4d7e8a0ae4b488812d1d54391014d8ebb46e742d686 not found: ID does not exist" May 21 18:30:16.379231 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:16.379203 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-bdd4w"] May 21 18:30:16.382831 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:16.382809 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-bdd4w"] May 21 18:30:17.698215 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:17.698185 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b218721-e791-4af0-b680-327a2d53425c" path="/var/lib/kubelet/pods/1b218721-e791-4af0-b680-327a2d53425c/volumes" May 21 18:30:37.663014 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:37.662937 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-dfcb8"] May 21 18:30:37.663446 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:37.663214 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b218721-e791-4af0-b680-327a2d53425c" containerName="authorino" May 21 18:30:37.663446 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:37.663224 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b218721-e791-4af0-b680-327a2d53425c" containerName="authorino" May 21 18:30:37.663446 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:37.663266 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="1b218721-e791-4af0-b680-327a2d53425c" containerName="authorino" May 21 18:30:37.665572 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:37.665554 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-dfcb8" May 21 18:30:37.685418 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:37.685391 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-dfcb8"] May 21 18:30:37.703560 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:37.703522 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk9g6\" (UniqueName: \"kubernetes.io/projected/11b74f1e-2ff9-4300-9ce7-e57e90659c0c-kube-api-access-nk9g6\") pod \"authorino-8b475cf9f-dfcb8\" (UID: \"11b74f1e-2ff9-4300-9ce7-e57e90659c0c\") " pod="kuadrant-system/authorino-8b475cf9f-dfcb8" May 21 18:30:37.803968 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:37.803930 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nk9g6\" (UniqueName: \"kubernetes.io/projected/11b74f1e-2ff9-4300-9ce7-e57e90659c0c-kube-api-access-nk9g6\") pod \"authorino-8b475cf9f-dfcb8\" (UID: \"11b74f1e-2ff9-4300-9ce7-e57e90659c0c\") " pod="kuadrant-system/authorino-8b475cf9f-dfcb8" May 21 18:30:37.814681 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:37.814659 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk9g6\" (UniqueName: \"kubernetes.io/projected/11b74f1e-2ff9-4300-9ce7-e57e90659c0c-kube-api-access-nk9g6\") pod \"authorino-8b475cf9f-dfcb8\" (UID: \"11b74f1e-2ff9-4300-9ce7-e57e90659c0c\") " pod="kuadrant-system/authorino-8b475cf9f-dfcb8" May 21 18:30:37.910043 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:37.910009 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-dfcb8"] May 21 18:30:37.910226 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:37.910214 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-dfcb8" May 21 18:30:37.944079 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:37.944039 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5f58fcc858-tg8ng"] May 21 18:30:37.948618 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:37.948593 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f58fcc858-tg8ng" May 21 18:30:37.952830 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:37.952801 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5f58fcc858-tg8ng"] May 21 18:30:38.005301 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:38.005270 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qngs\" (UniqueName: \"kubernetes.io/projected/623bbc3a-5c68-44a7-aa63-b0f000fd4574-kube-api-access-5qngs\") pod \"authorino-5f58fcc858-tg8ng\" (UID: \"623bbc3a-5c68-44a7-aa63-b0f000fd4574\") " pod="kuadrant-system/authorino-5f58fcc858-tg8ng" May 21 18:30:38.016562 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:38.016535 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5f58fcc858-tg8ng"] May 21 18:30:38.016822 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:30:38.016795 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-5qngs], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5f58fcc858-tg8ng" podUID="623bbc3a-5c68-44a7-aa63-b0f000fd4574" May 21 18:30:38.046250 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:38.046218 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-dfcb8"] May 21 18:30:38.050122 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:38.050098 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5548b8c8bb-l7qg6"] May 21 18:30:38.050591 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:30:38.050558 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod11b74f1e_2ff9_4300_9ce7_e57e90659c0c.slice/crio-d59e3c07de94f7d73be7fc89521df8cfe564c91f0e36bef19124c2f487a28e69 WatchSource:0}: Error finding container d59e3c07de94f7d73be7fc89521df8cfe564c91f0e36bef19124c2f487a28e69: Status 404 returned error can't find the container with id d59e3c07de94f7d73be7fc89521df8cfe564c91f0e36bef19124c2f487a28e69 May 21 18:30:38.053274 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:38.053256 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5548b8c8bb-l7qg6" May 21 18:30:38.055874 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:38.055851 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" May 21 18:30:38.060392 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:38.060371 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5548b8c8bb-l7qg6"] May 21 18:30:38.106016 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:38.105984 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7059c5e8-cb2e-4eb8-b41d-a1cb6bae7316-tls-cert\") pod \"authorino-5548b8c8bb-l7qg6\" (UID: \"7059c5e8-cb2e-4eb8-b41d-a1cb6bae7316\") " pod="kuadrant-system/authorino-5548b8c8bb-l7qg6" May 21 18:30:38.106179 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:38.106041 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z54cs\" (UniqueName: \"kubernetes.io/projected/7059c5e8-cb2e-4eb8-b41d-a1cb6bae7316-kube-api-access-z54cs\") pod \"authorino-5548b8c8bb-l7qg6\" (UID: \"7059c5e8-cb2e-4eb8-b41d-a1cb6bae7316\") " pod="kuadrant-system/authorino-5548b8c8bb-l7qg6" May 21 18:30:38.106179 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:38.106085 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5qngs\" (UniqueName: \"kubernetes.io/projected/623bbc3a-5c68-44a7-aa63-b0f000fd4574-kube-api-access-5qngs\") pod \"authorino-5f58fcc858-tg8ng\" (UID: \"623bbc3a-5c68-44a7-aa63-b0f000fd4574\") " pod="kuadrant-system/authorino-5f58fcc858-tg8ng" May 21 18:30:38.115438 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:38.115417 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qngs\" (UniqueName: \"kubernetes.io/projected/623bbc3a-5c68-44a7-aa63-b0f000fd4574-kube-api-access-5qngs\") pod \"authorino-5f58fcc858-tg8ng\" (UID: \"623bbc3a-5c68-44a7-aa63-b0f000fd4574\") " pod="kuadrant-system/authorino-5f58fcc858-tg8ng" May 21 18:30:38.207289 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:38.207202 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7059c5e8-cb2e-4eb8-b41d-a1cb6bae7316-tls-cert\") pod \"authorino-5548b8c8bb-l7qg6\" (UID: \"7059c5e8-cb2e-4eb8-b41d-a1cb6bae7316\") " pod="kuadrant-system/authorino-5548b8c8bb-l7qg6" May 21 18:30:38.207289 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:38.207260 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z54cs\" (UniqueName: \"kubernetes.io/projected/7059c5e8-cb2e-4eb8-b41d-a1cb6bae7316-kube-api-access-z54cs\") pod \"authorino-5548b8c8bb-l7qg6\" (UID: \"7059c5e8-cb2e-4eb8-b41d-a1cb6bae7316\") " pod="kuadrant-system/authorino-5548b8c8bb-l7qg6" May 21 18:30:38.209550 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:38.209531 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7059c5e8-cb2e-4eb8-b41d-a1cb6bae7316-tls-cert\") pod \"authorino-5548b8c8bb-l7qg6\" (UID: \"7059c5e8-cb2e-4eb8-b41d-a1cb6bae7316\") " pod="kuadrant-system/authorino-5548b8c8bb-l7qg6" May 21 18:30:38.216237 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:38.216217 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z54cs\" (UniqueName: \"kubernetes.io/projected/7059c5e8-cb2e-4eb8-b41d-a1cb6bae7316-kube-api-access-z54cs\") pod \"authorino-5548b8c8bb-l7qg6\" (UID: \"7059c5e8-cb2e-4eb8-b41d-a1cb6bae7316\") " pod="kuadrant-system/authorino-5548b8c8bb-l7qg6" May 21 18:30:38.365077 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:38.365040 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5548b8c8bb-l7qg6" May 21 18:30:38.430101 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:38.430052 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-dfcb8" event={"ID":"11b74f1e-2ff9-4300-9ce7-e57e90659c0c","Type":"ContainerStarted","Data":"d59e3c07de94f7d73be7fc89521df8cfe564c91f0e36bef19124c2f487a28e69"} May 21 18:30:38.430101 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:38.430086 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f58fcc858-tg8ng" May 21 18:30:38.434997 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:38.434942 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f58fcc858-tg8ng" May 21 18:30:38.505817 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:38.505670 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5548b8c8bb-l7qg6"] May 21 18:30:38.509012 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:38.508986 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qngs\" (UniqueName: \"kubernetes.io/projected/623bbc3a-5c68-44a7-aa63-b0f000fd4574-kube-api-access-5qngs\") pod \"623bbc3a-5c68-44a7-aa63-b0f000fd4574\" (UID: \"623bbc3a-5c68-44a7-aa63-b0f000fd4574\") " May 21 18:30:38.509012 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:30:38.509004 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7059c5e8_cb2e_4eb8_b41d_a1cb6bae7316.slice/crio-c82ab1fe81e405819f4cf17fb06e8d8dae0d274ab5f2371f2cd4f352e9d04119 WatchSource:0}: Error finding container c82ab1fe81e405819f4cf17fb06e8d8dae0d274ab5f2371f2cd4f352e9d04119: Status 404 returned error can't find the container with id c82ab1fe81e405819f4cf17fb06e8d8dae0d274ab5f2371f2cd4f352e9d04119 May 21 18:30:38.511305 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:38.511255 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/623bbc3a-5c68-44a7-aa63-b0f000fd4574-kube-api-access-5qngs" (OuterVolumeSpecName: "kube-api-access-5qngs") pod "623bbc3a-5c68-44a7-aa63-b0f000fd4574" (UID: "623bbc3a-5c68-44a7-aa63-b0f000fd4574"). InnerVolumeSpecName "kube-api-access-5qngs". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 18:30:38.610047 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:38.610013 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qngs\" (UniqueName: \"kubernetes.io/projected/623bbc3a-5c68-44a7-aa63-b0f000fd4574-kube-api-access-5qngs\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" May 21 18:30:39.434994 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:39.434955 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-dfcb8" event={"ID":"11b74f1e-2ff9-4300-9ce7-e57e90659c0c","Type":"ContainerStarted","Data":"820ea081f02f13ba99a27246157da438b522491c19fff69b6b28ef883129c6bc"} May 21 18:30:39.435456 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:39.435023 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-8b475cf9f-dfcb8" podUID="11b74f1e-2ff9-4300-9ce7-e57e90659c0c" containerName="authorino" containerID="cri-o://820ea081f02f13ba99a27246157da438b522491c19fff69b6b28ef883129c6bc" gracePeriod=30 May 21 18:30:39.436249 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:39.436226 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5548b8c8bb-l7qg6" event={"ID":"7059c5e8-cb2e-4eb8-b41d-a1cb6bae7316","Type":"ContainerStarted","Data":"dba1a3062b4093904caa3f03352d7398e8dc21946310b6ee5afed241402b6039"} May 21 18:30:39.436383 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:39.436256 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5548b8c8bb-l7qg6" event={"ID":"7059c5e8-cb2e-4eb8-b41d-a1cb6bae7316","Type":"ContainerStarted","Data":"c82ab1fe81e405819f4cf17fb06e8d8dae0d274ab5f2371f2cd4f352e9d04119"} May 21 18:30:39.436383 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:39.436279 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f58fcc858-tg8ng" May 21 18:30:39.451287 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:39.451248 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-8b475cf9f-dfcb8" podStartSLOduration=2.129648918 podStartE2EDuration="2.45123489s" podCreationTimestamp="2026-05-21 18:30:37 +0000 UTC" firstStartedPulling="2026-05-21 18:30:38.052204046 +0000 UTC m=+620.924422924" lastFinishedPulling="2026-05-21 18:30:38.373790017 +0000 UTC m=+621.246008896" observedRunningTime="2026-05-21 18:30:39.451089804 +0000 UTC m=+622.323308698" watchObservedRunningTime="2026-05-21 18:30:39.45123489 +0000 UTC m=+622.323453789" May 21 18:30:39.480685 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:39.480654 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5f58fcc858-tg8ng"] May 21 18:30:39.488199 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:39.488171 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5f58fcc858-tg8ng"] May 21 18:30:39.505281 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:39.505232 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-5548b8c8bb-l7qg6" podStartSLOduration=1.03319531 podStartE2EDuration="1.505217932s" podCreationTimestamp="2026-05-21 18:30:38 +0000 UTC" firstStartedPulling="2026-05-21 18:30:38.510914191 +0000 UTC m=+621.383133067" lastFinishedPulling="2026-05-21 18:30:38.98293681 +0000 UTC m=+621.855155689" observedRunningTime="2026-05-21 18:30:39.505033338 +0000 UTC m=+622.377252237" watchObservedRunningTime="2026-05-21 18:30:39.505217932 +0000 UTC m=+622.377436829" May 21 18:30:39.538625 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:39.538588 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-8tbdn"] May 21 18:30:39.538898 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:39.538864 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-8tbdn" podUID="d602d6c5-b1f4-4329-a96c-a631beaf0da2" containerName="authorino" containerID="cri-o://1e8f080fb1467c4981745d6b371ee14b1a7be4a7632fe35b300e268e42191db2" gracePeriod=30 May 21 18:30:39.672548 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:39.672515 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-dfcb8" May 21 18:30:39.698662 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:39.698583 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="623bbc3a-5c68-44a7-aa63-b0f000fd4574" path="/var/lib/kubelet/pods/623bbc3a-5c68-44a7-aa63-b0f000fd4574/volumes" May 21 18:30:39.777733 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:39.777712 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-8tbdn" May 21 18:30:39.826969 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:39.826940 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4x8fn\" (UniqueName: \"kubernetes.io/projected/d602d6c5-b1f4-4329-a96c-a631beaf0da2-kube-api-access-4x8fn\") pod \"d602d6c5-b1f4-4329-a96c-a631beaf0da2\" (UID: \"d602d6c5-b1f4-4329-a96c-a631beaf0da2\") " May 21 18:30:39.827108 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:39.826981 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nk9g6\" (UniqueName: \"kubernetes.io/projected/11b74f1e-2ff9-4300-9ce7-e57e90659c0c-kube-api-access-nk9g6\") pod \"11b74f1e-2ff9-4300-9ce7-e57e90659c0c\" (UID: \"11b74f1e-2ff9-4300-9ce7-e57e90659c0c\") " May 21 18:30:39.829148 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:39.829115 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d602d6c5-b1f4-4329-a96c-a631beaf0da2-kube-api-access-4x8fn" (OuterVolumeSpecName: "kube-api-access-4x8fn") pod "d602d6c5-b1f4-4329-a96c-a631beaf0da2" (UID: "d602d6c5-b1f4-4329-a96c-a631beaf0da2"). InnerVolumeSpecName "kube-api-access-4x8fn". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 18:30:39.829272 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:39.829252 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11b74f1e-2ff9-4300-9ce7-e57e90659c0c-kube-api-access-nk9g6" (OuterVolumeSpecName: "kube-api-access-nk9g6") pod "11b74f1e-2ff9-4300-9ce7-e57e90659c0c" (UID: "11b74f1e-2ff9-4300-9ce7-e57e90659c0c"). InnerVolumeSpecName "kube-api-access-nk9g6". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 18:30:39.927857 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:39.927823 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4x8fn\" (UniqueName: \"kubernetes.io/projected/d602d6c5-b1f4-4329-a96c-a631beaf0da2-kube-api-access-4x8fn\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" May 21 18:30:39.927857 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:39.927853 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nk9g6\" (UniqueName: \"kubernetes.io/projected/11b74f1e-2ff9-4300-9ce7-e57e90659c0c-kube-api-access-nk9g6\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" May 21 18:30:40.440792 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:40.440752 2575 generic.go:358] "Generic (PLEG): container finished" podID="d602d6c5-b1f4-4329-a96c-a631beaf0da2" containerID="1e8f080fb1467c4981745d6b371ee14b1a7be4a7632fe35b300e268e42191db2" exitCode=0 May 21 18:30:40.441257 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:40.440804 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-8tbdn" May 21 18:30:40.441257 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:40.440837 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-8tbdn" event={"ID":"d602d6c5-b1f4-4329-a96c-a631beaf0da2","Type":"ContainerDied","Data":"1e8f080fb1467c4981745d6b371ee14b1a7be4a7632fe35b300e268e42191db2"} May 21 18:30:40.441257 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:40.440876 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-8tbdn" event={"ID":"d602d6c5-b1f4-4329-a96c-a631beaf0da2","Type":"ContainerDied","Data":"99665983769f10ccd195176cf31f6e4e4b23dadfbbebfd5da70679035b9d1a97"} May 21 18:30:40.441257 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:40.440892 2575 scope.go:117] "RemoveContainer" containerID="1e8f080fb1467c4981745d6b371ee14b1a7be4a7632fe35b300e268e42191db2" May 21 18:30:40.442043 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:40.442022 2575 generic.go:358] "Generic (PLEG): container finished" podID="11b74f1e-2ff9-4300-9ce7-e57e90659c0c" containerID="820ea081f02f13ba99a27246157da438b522491c19fff69b6b28ef883129c6bc" exitCode=0 May 21 18:30:40.442115 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:40.442068 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-dfcb8" event={"ID":"11b74f1e-2ff9-4300-9ce7-e57e90659c0c","Type":"ContainerDied","Data":"820ea081f02f13ba99a27246157da438b522491c19fff69b6b28ef883129c6bc"} May 21 18:30:40.442115 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:40.442106 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-dfcb8" event={"ID":"11b74f1e-2ff9-4300-9ce7-e57e90659c0c","Type":"ContainerDied","Data":"d59e3c07de94f7d73be7fc89521df8cfe564c91f0e36bef19124c2f487a28e69"} May 21 18:30:40.442216 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:40.442080 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-dfcb8" May 21 18:30:40.450364 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:40.450348 2575 scope.go:117] "RemoveContainer" containerID="1e8f080fb1467c4981745d6b371ee14b1a7be4a7632fe35b300e268e42191db2" May 21 18:30:40.450653 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:30:40.450636 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e8f080fb1467c4981745d6b371ee14b1a7be4a7632fe35b300e268e42191db2\": container with ID starting with 1e8f080fb1467c4981745d6b371ee14b1a7be4a7632fe35b300e268e42191db2 not found: ID does not exist" containerID="1e8f080fb1467c4981745d6b371ee14b1a7be4a7632fe35b300e268e42191db2" May 21 18:30:40.450740 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:40.450661 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e8f080fb1467c4981745d6b371ee14b1a7be4a7632fe35b300e268e42191db2"} err="failed to get container status \"1e8f080fb1467c4981745d6b371ee14b1a7be4a7632fe35b300e268e42191db2\": rpc error: code = NotFound desc = could not find container \"1e8f080fb1467c4981745d6b371ee14b1a7be4a7632fe35b300e268e42191db2\": container with ID starting with 1e8f080fb1467c4981745d6b371ee14b1a7be4a7632fe35b300e268e42191db2 not found: ID does not exist" May 21 18:30:40.450740 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:40.450679 2575 scope.go:117] "RemoveContainer" containerID="820ea081f02f13ba99a27246157da438b522491c19fff69b6b28ef883129c6bc" May 21 18:30:40.458078 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:40.458058 2575 scope.go:117] "RemoveContainer" containerID="820ea081f02f13ba99a27246157da438b522491c19fff69b6b28ef883129c6bc" May 21 18:30:40.458339 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:30:40.458321 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"820ea081f02f13ba99a27246157da438b522491c19fff69b6b28ef883129c6bc\": container with ID starting with 820ea081f02f13ba99a27246157da438b522491c19fff69b6b28ef883129c6bc not found: ID does not exist" containerID="820ea081f02f13ba99a27246157da438b522491c19fff69b6b28ef883129c6bc" May 21 18:30:40.458402 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:40.458345 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"820ea081f02f13ba99a27246157da438b522491c19fff69b6b28ef883129c6bc"} err="failed to get container status \"820ea081f02f13ba99a27246157da438b522491c19fff69b6b28ef883129c6bc\": rpc error: code = NotFound desc = could not find container \"820ea081f02f13ba99a27246157da438b522491c19fff69b6b28ef883129c6bc\": container with ID starting with 820ea081f02f13ba99a27246157da438b522491c19fff69b6b28ef883129c6bc not found: ID does not exist" May 21 18:30:40.469482 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:40.469457 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-dfcb8"] May 21 18:30:40.473175 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:40.473154 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-dfcb8"] May 21 18:30:40.483553 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:40.483532 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-8tbdn"] May 21 18:30:40.488533 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:40.488512 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-8tbdn"] May 21 18:30:41.701923 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:41.701891 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11b74f1e-2ff9-4300-9ce7-e57e90659c0c" path="/var/lib/kubelet/pods/11b74f1e-2ff9-4300-9ce7-e57e90659c0c/volumes" May 21 18:30:41.702294 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:41.702185 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d602d6c5-b1f4-4329-a96c-a631beaf0da2" path="/var/lib/kubelet/pods/d602d6c5-b1f4-4329-a96c-a631beaf0da2/volumes" May 21 18:30:42.954192 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:42.954153 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7465f9c457-4lt7g"] May 21 18:30:42.954636 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:42.954536 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d602d6c5-b1f4-4329-a96c-a631beaf0da2" containerName="authorino" May 21 18:30:42.954636 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:42.954553 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d602d6c5-b1f4-4329-a96c-a631beaf0da2" containerName="authorino" May 21 18:30:42.954636 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:42.954567 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11b74f1e-2ff9-4300-9ce7-e57e90659c0c" containerName="authorino" May 21 18:30:42.954636 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:42.954577 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="11b74f1e-2ff9-4300-9ce7-e57e90659c0c" containerName="authorino" May 21 18:30:42.954910 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:42.954654 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="11b74f1e-2ff9-4300-9ce7-e57e90659c0c" containerName="authorino" May 21 18:30:42.954910 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:42.954669 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="d602d6c5-b1f4-4329-a96c-a631beaf0da2" containerName="authorino" May 21 18:30:42.959200 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:42.959177 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7465f9c457-4lt7g" May 21 18:30:42.962893 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:42.962872 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-8qxg7\"" May 21 18:30:42.963146 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:42.963131 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 21 18:30:42.967400 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:42.967380 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7465f9c457-4lt7g"] May 21 18:30:43.048245 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:43.048194 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mqf2\" (UniqueName: \"kubernetes.io/projected/d57e9024-e46a-4c82-8bda-88ee16de2831-kube-api-access-7mqf2\") pod \"maas-controller-7465f9c457-4lt7g\" (UID: \"d57e9024-e46a-4c82-8bda-88ee16de2831\") " pod="opendatahub/maas-controller-7465f9c457-4lt7g" May 21 18:30:43.112330 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:43.112281 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6df46cd767-ncnfc"] May 21 18:30:43.115286 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:43.115270 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6df46cd767-ncnfc" May 21 18:30:43.125004 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:43.124976 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6df46cd767-ncnfc"] May 21 18:30:43.149388 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:43.149351 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7mqf2\" (UniqueName: \"kubernetes.io/projected/d57e9024-e46a-4c82-8bda-88ee16de2831-kube-api-access-7mqf2\") pod \"maas-controller-7465f9c457-4lt7g\" (UID: \"d57e9024-e46a-4c82-8bda-88ee16de2831\") " pod="opendatahub/maas-controller-7465f9c457-4lt7g" May 21 18:30:43.149543 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:43.149468 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf2gb\" (UniqueName: \"kubernetes.io/projected/80201978-7520-4b2f-b9e4-a4dffd650d8b-kube-api-access-bf2gb\") pod \"maas-controller-6df46cd767-ncnfc\" (UID: \"80201978-7520-4b2f-b9e4-a4dffd650d8b\") " pod="opendatahub/maas-controller-6df46cd767-ncnfc" May 21 18:30:43.157975 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:43.157951 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mqf2\" (UniqueName: \"kubernetes.io/projected/d57e9024-e46a-4c82-8bda-88ee16de2831-kube-api-access-7mqf2\") pod \"maas-controller-7465f9c457-4lt7g\" (UID: \"d57e9024-e46a-4c82-8bda-88ee16de2831\") " pod="opendatahub/maas-controller-7465f9c457-4lt7g" May 21 18:30:43.250492 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:43.250403 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bf2gb\" (UniqueName: \"kubernetes.io/projected/80201978-7520-4b2f-b9e4-a4dffd650d8b-kube-api-access-bf2gb\") pod \"maas-controller-6df46cd767-ncnfc\" (UID: \"80201978-7520-4b2f-b9e4-a4dffd650d8b\") " pod="opendatahub/maas-controller-6df46cd767-ncnfc" May 21 18:30:43.255756 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:43.255730 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7465f9c457-4lt7g"] May 21 18:30:43.255963 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:43.255950 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7465f9c457-4lt7g" May 21 18:30:43.258910 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:43.258889 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf2gb\" (UniqueName: \"kubernetes.io/projected/80201978-7520-4b2f-b9e4-a4dffd650d8b-kube-api-access-bf2gb\") pod \"maas-controller-6df46cd767-ncnfc\" (UID: \"80201978-7520-4b2f-b9e4-a4dffd650d8b\") " pod="opendatahub/maas-controller-6df46cd767-ncnfc" May 21 18:30:43.385254 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:43.385227 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7465f9c457-4lt7g"] May 21 18:30:43.387648 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:30:43.387621 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd57e9024_e46a_4c82_8bda_88ee16de2831.slice/crio-dc203b76d6aef0f4ff41f80509e9314ab1f9a18a8131e12eda7307c57729bde6 WatchSource:0}: Error finding container dc203b76d6aef0f4ff41f80509e9314ab1f9a18a8131e12eda7307c57729bde6: Status 404 returned error can't find the container with id dc203b76d6aef0f4ff41f80509e9314ab1f9a18a8131e12eda7307c57729bde6 May 21 18:30:43.428899 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:43.428855 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6df46cd767-ncnfc" May 21 18:30:43.453325 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:43.453288 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7465f9c457-4lt7g" event={"ID":"d57e9024-e46a-4c82-8bda-88ee16de2831","Type":"ContainerStarted","Data":"dc203b76d6aef0f4ff41f80509e9314ab1f9a18a8131e12eda7307c57729bde6"} May 21 18:30:43.555334 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:43.555302 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6df46cd767-ncnfc"] May 21 18:30:43.558045 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:30:43.558019 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80201978_7520_4b2f_b9e4_a4dffd650d8b.slice/crio-3d628d12f7a17dceeba01d581cf8d9b3803b26eb8b24e26a468d53f8a4198acc WatchSource:0}: Error finding container 3d628d12f7a17dceeba01d581cf8d9b3803b26eb8b24e26a468d53f8a4198acc: Status 404 returned error can't find the container with id 3d628d12f7a17dceeba01d581cf8d9b3803b26eb8b24e26a468d53f8a4198acc May 21 18:30:44.460644 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:44.460589 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6df46cd767-ncnfc" event={"ID":"80201978-7520-4b2f-b9e4-a4dffd650d8b","Type":"ContainerStarted","Data":"3d628d12f7a17dceeba01d581cf8d9b3803b26eb8b24e26a468d53f8a4198acc"} May 21 18:30:47.472038 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:47.472005 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7465f9c457-4lt7g" event={"ID":"d57e9024-e46a-4c82-8bda-88ee16de2831","Type":"ContainerStarted","Data":"632af2ff9e7f19ea4114e8bc166a251df481ae83a9afbfb490ab45e8ba8ebae2"} May 21 18:30:47.472519 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:47.472101 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-7465f9c457-4lt7g" podUID="d57e9024-e46a-4c82-8bda-88ee16de2831" containerName="manager" containerID="cri-o://632af2ff9e7f19ea4114e8bc166a251df481ae83a9afbfb490ab45e8ba8ebae2" gracePeriod=30 May 21 18:30:47.472519 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:47.472168 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7465f9c457-4lt7g" May 21 18:30:47.473357 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:47.473337 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6df46cd767-ncnfc" event={"ID":"80201978-7520-4b2f-b9e4-a4dffd650d8b","Type":"ContainerStarted","Data":"8cf0bed9c312768666f60da6bd7c07f89741036b62560ecaf2da7ee5a3d48978"} May 21 18:30:47.473510 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:47.473497 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6df46cd767-ncnfc" May 21 18:30:47.495766 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:47.495692 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-7465f9c457-4lt7g" podStartSLOduration=1.9070081700000001 podStartE2EDuration="5.495673079s" podCreationTimestamp="2026-05-21 18:30:42 +0000 UTC" firstStartedPulling="2026-05-21 18:30:43.388952611 +0000 UTC m=+626.261171486" lastFinishedPulling="2026-05-21 18:30:46.977617516 +0000 UTC m=+629.849836395" observedRunningTime="2026-05-21 18:30:47.494946025 +0000 UTC m=+630.367164924" watchObservedRunningTime="2026-05-21 18:30:47.495673079 +0000 UTC m=+630.367891977" May 21 18:30:47.514060 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:47.514013 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-6df46cd767-ncnfc" podStartSLOduration=1.093804631 podStartE2EDuration="4.513999129s" podCreationTimestamp="2026-05-21 18:30:43 +0000 UTC" firstStartedPulling="2026-05-21 18:30:43.559391577 +0000 UTC m=+626.431610453" lastFinishedPulling="2026-05-21 18:30:46.979586075 +0000 UTC m=+629.851804951" observedRunningTime="2026-05-21 18:30:47.513014853 +0000 UTC m=+630.385233757" watchObservedRunningTime="2026-05-21 18:30:47.513999129 +0000 UTC m=+630.386218027" May 21 18:30:47.707223 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:47.707198 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7465f9c457-4lt7g" May 21 18:30:47.781480 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:47.781394 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mqf2\" (UniqueName: \"kubernetes.io/projected/d57e9024-e46a-4c82-8bda-88ee16de2831-kube-api-access-7mqf2\") pod \"d57e9024-e46a-4c82-8bda-88ee16de2831\" (UID: \"d57e9024-e46a-4c82-8bda-88ee16de2831\") " May 21 18:30:47.783507 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:47.783476 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d57e9024-e46a-4c82-8bda-88ee16de2831-kube-api-access-7mqf2" (OuterVolumeSpecName: "kube-api-access-7mqf2") pod "d57e9024-e46a-4c82-8bda-88ee16de2831" (UID: "d57e9024-e46a-4c82-8bda-88ee16de2831"). InnerVolumeSpecName "kube-api-access-7mqf2". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 18:30:47.882012 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:47.881970 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7mqf2\" (UniqueName: \"kubernetes.io/projected/d57e9024-e46a-4c82-8bda-88ee16de2831-kube-api-access-7mqf2\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" May 21 18:30:48.478292 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:48.478257 2575 generic.go:358] "Generic (PLEG): container finished" podID="d57e9024-e46a-4c82-8bda-88ee16de2831" containerID="632af2ff9e7f19ea4114e8bc166a251df481ae83a9afbfb490ab45e8ba8ebae2" exitCode=0 May 21 18:30:48.478787 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:48.478325 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7465f9c457-4lt7g" May 21 18:30:48.478787 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:48.478341 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7465f9c457-4lt7g" event={"ID":"d57e9024-e46a-4c82-8bda-88ee16de2831","Type":"ContainerDied","Data":"632af2ff9e7f19ea4114e8bc166a251df481ae83a9afbfb490ab45e8ba8ebae2"} May 21 18:30:48.478787 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:48.478378 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7465f9c457-4lt7g" event={"ID":"d57e9024-e46a-4c82-8bda-88ee16de2831","Type":"ContainerDied","Data":"dc203b76d6aef0f4ff41f80509e9314ab1f9a18a8131e12eda7307c57729bde6"} May 21 18:30:48.478787 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:48.478398 2575 scope.go:117] "RemoveContainer" containerID="632af2ff9e7f19ea4114e8bc166a251df481ae83a9afbfb490ab45e8ba8ebae2" May 21 18:30:48.486277 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:48.486259 2575 scope.go:117] "RemoveContainer" containerID="632af2ff9e7f19ea4114e8bc166a251df481ae83a9afbfb490ab45e8ba8ebae2" May 21 18:30:48.486559 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:30:48.486539 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"632af2ff9e7f19ea4114e8bc166a251df481ae83a9afbfb490ab45e8ba8ebae2\": container with ID starting with 632af2ff9e7f19ea4114e8bc166a251df481ae83a9afbfb490ab45e8ba8ebae2 not found: ID does not exist" containerID="632af2ff9e7f19ea4114e8bc166a251df481ae83a9afbfb490ab45e8ba8ebae2" May 21 18:30:48.486647 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:48.486566 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"632af2ff9e7f19ea4114e8bc166a251df481ae83a9afbfb490ab45e8ba8ebae2"} err="failed to get container status \"632af2ff9e7f19ea4114e8bc166a251df481ae83a9afbfb490ab45e8ba8ebae2\": rpc error: code = NotFound desc = could not find container \"632af2ff9e7f19ea4114e8bc166a251df481ae83a9afbfb490ab45e8ba8ebae2\": container with ID starting with 632af2ff9e7f19ea4114e8bc166a251df481ae83a9afbfb490ab45e8ba8ebae2 not found: ID does not exist" May 21 18:30:48.501181 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:48.501156 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7465f9c457-4lt7g"] May 21 18:30:48.506857 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:48.506834 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7465f9c457-4lt7g"] May 21 18:30:49.697024 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:49.696990 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d57e9024-e46a-4c82-8bda-88ee16de2831" path="/var/lib/kubelet/pods/d57e9024-e46a-4c82-8bda-88ee16de2831/volumes" May 21 18:30:58.163516 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:58.163480 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6df46cd767-ncnfc"] May 21 18:30:58.163988 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:58.163748 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-6df46cd767-ncnfc" podUID="80201978-7520-4b2f-b9e4-a4dffd650d8b" containerName="manager" containerID="cri-o://8cf0bed9c312768666f60da6bd7c07f89741036b62560ecaf2da7ee5a3d48978" gracePeriod=30 May 21 18:30:58.173450 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:58.173423 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6df46cd767-ncnfc" May 21 18:30:58.377973 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:58.377941 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-768fd7d946-xzhcw"] May 21 18:30:58.378257 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:58.378246 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d57e9024-e46a-4c82-8bda-88ee16de2831" containerName="manager" May 21 18:30:58.378301 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:58.378259 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d57e9024-e46a-4c82-8bda-88ee16de2831" containerName="manager" May 21 18:30:58.378335 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:58.378314 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="d57e9024-e46a-4c82-8bda-88ee16de2831" containerName="manager" May 21 18:30:58.381360 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:58.381340 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-768fd7d946-xzhcw" May 21 18:30:58.389888 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:58.389863 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-768fd7d946-xzhcw"] May 21 18:30:58.407281 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:58.407252 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6df46cd767-ncnfc" May 21 18:30:58.457674 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:58.457568 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bf2gb\" (UniqueName: \"kubernetes.io/projected/80201978-7520-4b2f-b9e4-a4dffd650d8b-kube-api-access-bf2gb\") pod \"80201978-7520-4b2f-b9e4-a4dffd650d8b\" (UID: \"80201978-7520-4b2f-b9e4-a4dffd650d8b\") " May 21 18:30:58.457864 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:58.457764 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gc7l8\" (UniqueName: \"kubernetes.io/projected/e37a674e-4392-4f0c-a6e9-73fcbc6f575c-kube-api-access-gc7l8\") pod \"maas-controller-768fd7d946-xzhcw\" (UID: \"e37a674e-4392-4f0c-a6e9-73fcbc6f575c\") " pod="opendatahub/maas-controller-768fd7d946-xzhcw" May 21 18:30:58.459643 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:58.459619 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80201978-7520-4b2f-b9e4-a4dffd650d8b-kube-api-access-bf2gb" (OuterVolumeSpecName: "kube-api-access-bf2gb") pod "80201978-7520-4b2f-b9e4-a4dffd650d8b" (UID: "80201978-7520-4b2f-b9e4-a4dffd650d8b"). InnerVolumeSpecName "kube-api-access-bf2gb". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 18:30:58.519248 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:58.519210 2575 generic.go:358] "Generic (PLEG): container finished" podID="80201978-7520-4b2f-b9e4-a4dffd650d8b" containerID="8cf0bed9c312768666f60da6bd7c07f89741036b62560ecaf2da7ee5a3d48978" exitCode=0 May 21 18:30:58.519405 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:58.519292 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6df46cd767-ncnfc" event={"ID":"80201978-7520-4b2f-b9e4-a4dffd650d8b","Type":"ContainerDied","Data":"8cf0bed9c312768666f60da6bd7c07f89741036b62560ecaf2da7ee5a3d48978"} May 21 18:30:58.519405 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:58.519331 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6df46cd767-ncnfc" event={"ID":"80201978-7520-4b2f-b9e4-a4dffd650d8b","Type":"ContainerDied","Data":"3d628d12f7a17dceeba01d581cf8d9b3803b26eb8b24e26a468d53f8a4198acc"} May 21 18:30:58.519405 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:58.519346 2575 scope.go:117] "RemoveContainer" containerID="8cf0bed9c312768666f60da6bd7c07f89741036b62560ecaf2da7ee5a3d48978" May 21 18:30:58.519405 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:58.519303 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6df46cd767-ncnfc" May 21 18:30:58.526784 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:58.526752 2575 scope.go:117] "RemoveContainer" containerID="8cf0bed9c312768666f60da6bd7c07f89741036b62560ecaf2da7ee5a3d48978" May 21 18:30:58.527107 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:30:58.527035 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8cf0bed9c312768666f60da6bd7c07f89741036b62560ecaf2da7ee5a3d48978\": container with ID starting with 8cf0bed9c312768666f60da6bd7c07f89741036b62560ecaf2da7ee5a3d48978 not found: ID does not exist" containerID="8cf0bed9c312768666f60da6bd7c07f89741036b62560ecaf2da7ee5a3d48978" May 21 18:30:58.527107 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:58.527080 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cf0bed9c312768666f60da6bd7c07f89741036b62560ecaf2da7ee5a3d48978"} err="failed to get container status \"8cf0bed9c312768666f60da6bd7c07f89741036b62560ecaf2da7ee5a3d48978\": rpc error: code = NotFound desc = could not find container \"8cf0bed9c312768666f60da6bd7c07f89741036b62560ecaf2da7ee5a3d48978\": container with ID starting with 8cf0bed9c312768666f60da6bd7c07f89741036b62560ecaf2da7ee5a3d48978 not found: ID does not exist" May 21 18:30:58.542212 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:58.542177 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6df46cd767-ncnfc"] May 21 18:30:58.546474 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:58.546448 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6df46cd767-ncnfc"] May 21 18:30:58.558334 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:58.558310 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gc7l8\" (UniqueName: \"kubernetes.io/projected/e37a674e-4392-4f0c-a6e9-73fcbc6f575c-kube-api-access-gc7l8\") pod \"maas-controller-768fd7d946-xzhcw\" (UID: \"e37a674e-4392-4f0c-a6e9-73fcbc6f575c\") " pod="opendatahub/maas-controller-768fd7d946-xzhcw" May 21 18:30:58.558409 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:58.558382 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bf2gb\" (UniqueName: \"kubernetes.io/projected/80201978-7520-4b2f-b9e4-a4dffd650d8b-kube-api-access-bf2gb\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" May 21 18:30:58.567453 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:58.567424 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gc7l8\" (UniqueName: \"kubernetes.io/projected/e37a674e-4392-4f0c-a6e9-73fcbc6f575c-kube-api-access-gc7l8\") pod \"maas-controller-768fd7d946-xzhcw\" (UID: \"e37a674e-4392-4f0c-a6e9-73fcbc6f575c\") " pod="opendatahub/maas-controller-768fd7d946-xzhcw" May 21 18:30:58.692277 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:58.692239 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-768fd7d946-xzhcw" May 21 18:30:58.824476 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:58.824447 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-768fd7d946-xzhcw"] May 21 18:30:58.827599 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:30:58.827572 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode37a674e_4392_4f0c_a6e9_73fcbc6f575c.slice/crio-1f6afb0481c8ad8b62cca72463e439db826db1de52e30a7593ba56c044479644 WatchSource:0}: Error finding container 1f6afb0481c8ad8b62cca72463e439db826db1de52e30a7593ba56c044479644: Status 404 returned error can't find the container with id 1f6afb0481c8ad8b62cca72463e439db826db1de52e30a7593ba56c044479644 May 21 18:30:59.523676 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:59.523575 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-768fd7d946-xzhcw" event={"ID":"e37a674e-4392-4f0c-a6e9-73fcbc6f575c","Type":"ContainerStarted","Data":"879049c9fb0e54ae4e419cca5939dd065c08cb1cf7efacb0c37178e55b563121"} May 21 18:30:59.523676 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:59.523612 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-768fd7d946-xzhcw" event={"ID":"e37a674e-4392-4f0c-a6e9-73fcbc6f575c","Type":"ContainerStarted","Data":"1f6afb0481c8ad8b62cca72463e439db826db1de52e30a7593ba56c044479644"} May 21 18:30:59.523676 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:59.523659 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-768fd7d946-xzhcw" May 21 18:30:59.541472 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:59.541422 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-768fd7d946-xzhcw" podStartSLOduration=1.239646049 podStartE2EDuration="1.541407178s" podCreationTimestamp="2026-05-21 18:30:58 +0000 UTC" firstStartedPulling="2026-05-21 18:30:58.829004367 +0000 UTC m=+641.701223243" lastFinishedPulling="2026-05-21 18:30:59.130765487 +0000 UTC m=+642.002984372" observedRunningTime="2026-05-21 18:30:59.540962328 +0000 UTC m=+642.413181226" watchObservedRunningTime="2026-05-21 18:30:59.541407178 +0000 UTC m=+642.413626076" May 21 18:30:59.697871 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:30:59.697834 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80201978-7520-4b2f-b9e4-a4dffd650d8b" path="/var/lib/kubelet/pods/80201978-7520-4b2f-b9e4-a4dffd650d8b/volumes" May 21 18:31:10.536368 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:31:10.536333 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-768fd7d946-xzhcw" May 21 18:31:54.983556 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:31:54.983522 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-bwhnc"] May 21 18:31:54.983983 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:31:54.983811 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80201978-7520-4b2f-b9e4-a4dffd650d8b" containerName="manager" May 21 18:31:54.983983 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:31:54.983823 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="80201978-7520-4b2f-b9e4-a4dffd650d8b" containerName="manager" May 21 18:31:54.983983 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:31:54.983881 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="80201978-7520-4b2f-b9e4-a4dffd650d8b" containerName="manager" May 21 18:31:54.985955 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:31:54.985931 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bwhnc" May 21 18:31:54.990736 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:31:54.990692 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-884sp\"" May 21 18:31:54.990845 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:31:54.990748 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" May 21 18:31:54.990990 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:31:54.990975 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 21 18:31:54.991046 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:31:54.991006 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 21 18:31:54.997767 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:31:54.997747 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-bwhnc"] May 21 18:31:55.112093 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:31:55.112055 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1277ac64-121c-4aaa-b955-4a1f9dc39651-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-bwhnc\" (UID: \"1277ac64-121c-4aaa-b955-4a1f9dc39651\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bwhnc" May 21 18:31:55.112264 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:31:55.112119 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1277ac64-121c-4aaa-b955-4a1f9dc39651-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-bwhnc\" (UID: \"1277ac64-121c-4aaa-b955-4a1f9dc39651\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bwhnc" May 21 18:31:55.112264 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:31:55.112145 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1277ac64-121c-4aaa-b955-4a1f9dc39651-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-bwhnc\" (UID: \"1277ac64-121c-4aaa-b955-4a1f9dc39651\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bwhnc" May 21 18:31:55.112264 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:31:55.112167 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsfjf\" (UniqueName: \"kubernetes.io/projected/1277ac64-121c-4aaa-b955-4a1f9dc39651-kube-api-access-fsfjf\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-bwhnc\" (UID: \"1277ac64-121c-4aaa-b955-4a1f9dc39651\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bwhnc" May 21 18:31:55.112264 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:31:55.112183 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1277ac64-121c-4aaa-b955-4a1f9dc39651-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-bwhnc\" (UID: \"1277ac64-121c-4aaa-b955-4a1f9dc39651\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bwhnc" May 21 18:31:55.112264 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:31:55.112252 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1277ac64-121c-4aaa-b955-4a1f9dc39651-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-bwhnc\" (UID: \"1277ac64-121c-4aaa-b955-4a1f9dc39651\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bwhnc" May 21 18:31:55.213422 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:31:55.213382 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1277ac64-121c-4aaa-b955-4a1f9dc39651-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-bwhnc\" (UID: \"1277ac64-121c-4aaa-b955-4a1f9dc39651\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bwhnc" May 21 18:31:55.213653 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:31:55.213433 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1277ac64-121c-4aaa-b955-4a1f9dc39651-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-bwhnc\" (UID: \"1277ac64-121c-4aaa-b955-4a1f9dc39651\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bwhnc" May 21 18:31:55.213653 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:31:55.213470 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1277ac64-121c-4aaa-b955-4a1f9dc39651-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-bwhnc\" (UID: \"1277ac64-121c-4aaa-b955-4a1f9dc39651\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bwhnc" May 21 18:31:55.213653 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:31:55.213487 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1277ac64-121c-4aaa-b955-4a1f9dc39651-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-bwhnc\" (UID: \"1277ac64-121c-4aaa-b955-4a1f9dc39651\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bwhnc" May 21 18:31:55.213653 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:31:55.213508 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fsfjf\" (UniqueName: \"kubernetes.io/projected/1277ac64-121c-4aaa-b955-4a1f9dc39651-kube-api-access-fsfjf\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-bwhnc\" (UID: \"1277ac64-121c-4aaa-b955-4a1f9dc39651\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bwhnc" May 21 18:31:55.213653 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:31:55.213526 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1277ac64-121c-4aaa-b955-4a1f9dc39651-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-bwhnc\" (UID: \"1277ac64-121c-4aaa-b955-4a1f9dc39651\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bwhnc" May 21 18:31:55.214019 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:31:55.213937 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1277ac64-121c-4aaa-b955-4a1f9dc39651-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-bwhnc\" (UID: \"1277ac64-121c-4aaa-b955-4a1f9dc39651\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bwhnc" May 21 18:31:55.214019 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:31:55.213968 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1277ac64-121c-4aaa-b955-4a1f9dc39651-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-bwhnc\" (UID: \"1277ac64-121c-4aaa-b955-4a1f9dc39651\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bwhnc" May 21 18:31:55.214088 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:31:55.214028 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1277ac64-121c-4aaa-b955-4a1f9dc39651-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-bwhnc\" (UID: \"1277ac64-121c-4aaa-b955-4a1f9dc39651\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bwhnc" May 21 18:31:55.215738 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:31:55.215722 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1277ac64-121c-4aaa-b955-4a1f9dc39651-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-bwhnc\" (UID: \"1277ac64-121c-4aaa-b955-4a1f9dc39651\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bwhnc" May 21 18:31:55.216155 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:31:55.216141 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1277ac64-121c-4aaa-b955-4a1f9dc39651-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-bwhnc\" (UID: \"1277ac64-121c-4aaa-b955-4a1f9dc39651\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bwhnc" May 21 18:31:55.242628 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:31:55.242565 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsfjf\" (UniqueName: \"kubernetes.io/projected/1277ac64-121c-4aaa-b955-4a1f9dc39651-kube-api-access-fsfjf\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-bwhnc\" (UID: \"1277ac64-121c-4aaa-b955-4a1f9dc39651\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bwhnc" May 21 18:31:55.296211 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:31:55.296182 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bwhnc" May 21 18:31:55.425709 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:31:55.425674 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-bwhnc"] May 21 18:31:55.428232 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:31:55.428207 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1277ac64_121c_4aaa_b955_4a1f9dc39651.slice/crio-1ef65771f2a138bcd605bcdcadc02c4ad1d8f36d0a17d71a714fabf9f7f61e21 WatchSource:0}: Error finding container 1ef65771f2a138bcd605bcdcadc02c4ad1d8f36d0a17d71a714fabf9f7f61e21: Status 404 returned error can't find the container with id 1ef65771f2a138bcd605bcdcadc02c4ad1d8f36d0a17d71a714fabf9f7f61e21 May 21 18:31:55.429947 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:31:55.429923 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 18:31:55.698412 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:31:55.698380 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bwhnc" event={"ID":"1277ac64-121c-4aaa-b955-4a1f9dc39651","Type":"ContainerStarted","Data":"1ef65771f2a138bcd605bcdcadc02c4ad1d8f36d0a17d71a714fabf9f7f61e21"} May 21 18:32:01.718130 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:01.718087 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bwhnc" event={"ID":"1277ac64-121c-4aaa-b955-4a1f9dc39651","Type":"ContainerStarted","Data":"803104c74729ccac48f2996e41c204a8321d98ce1f66b5d68cc0c7932e8c1d75"} May 21 18:32:07.738261 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:07.738224 2575 generic.go:358] "Generic (PLEG): container finished" podID="1277ac64-121c-4aaa-b955-4a1f9dc39651" containerID="803104c74729ccac48f2996e41c204a8321d98ce1f66b5d68cc0c7932e8c1d75" exitCode=0 May 21 18:32:07.738744 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:07.738299 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bwhnc" event={"ID":"1277ac64-121c-4aaa-b955-4a1f9dc39651","Type":"ContainerDied","Data":"803104c74729ccac48f2996e41c204a8321d98ce1f66b5d68cc0c7932e8c1d75"} May 21 18:32:09.746360 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:09.746326 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bwhnc" event={"ID":"1277ac64-121c-4aaa-b955-4a1f9dc39651","Type":"ContainerStarted","Data":"264684bf8671928e95fc54413d922f6d8d3b20930e7862b330ed41e773752607"} May 21 18:32:09.746826 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:09.746549 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bwhnc" May 21 18:32:09.773932 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:09.773882 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bwhnc" podStartSLOduration=2.265279524 podStartE2EDuration="15.773868116s" podCreationTimestamp="2026-05-21 18:31:54 +0000 UTC" firstStartedPulling="2026-05-21 18:31:55.430048029 +0000 UTC m=+698.302266909" lastFinishedPulling="2026-05-21 18:32:08.938636625 +0000 UTC m=+711.810855501" observedRunningTime="2026-05-21 18:32:09.771361443 +0000 UTC m=+712.643580343" watchObservedRunningTime="2026-05-21 18:32:09.773868116 +0000 UTC m=+712.646087014" May 21 18:32:20.762558 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:20.762519 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bwhnc" May 21 18:32:22.782003 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:22.781968 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc652tb"] May 21 18:32:22.966797 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:22.966756 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc652tb"] May 21 18:32:22.966952 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:22.966902 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc652tb" May 21 18:32:22.976398 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:22.976375 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" May 21 18:32:23.017278 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:23.017241 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/995f611a-9e37-4233-b7fe-5da6563ba766-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc652tb\" (UID: \"995f611a-9e37-4233-b7fe-5da6563ba766\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc652tb" May 21 18:32:23.017278 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:23.017283 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmnb7\" (UniqueName: \"kubernetes.io/projected/995f611a-9e37-4233-b7fe-5da6563ba766-kube-api-access-hmnb7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc652tb\" (UID: \"995f611a-9e37-4233-b7fe-5da6563ba766\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc652tb" May 21 18:32:23.017509 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:23.017304 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/995f611a-9e37-4233-b7fe-5da6563ba766-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc652tb\" (UID: \"995f611a-9e37-4233-b7fe-5da6563ba766\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc652tb" May 21 18:32:23.017509 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:23.017384 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/995f611a-9e37-4233-b7fe-5da6563ba766-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc652tb\" (UID: \"995f611a-9e37-4233-b7fe-5da6563ba766\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc652tb" May 21 18:32:23.017509 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:23.017423 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/995f611a-9e37-4233-b7fe-5da6563ba766-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc652tb\" (UID: \"995f611a-9e37-4233-b7fe-5da6563ba766\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc652tb" May 21 18:32:23.017509 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:23.017447 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/995f611a-9e37-4233-b7fe-5da6563ba766-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc652tb\" (UID: \"995f611a-9e37-4233-b7fe-5da6563ba766\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc652tb" May 21 18:32:23.118104 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:23.118010 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/995f611a-9e37-4233-b7fe-5da6563ba766-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc652tb\" (UID: \"995f611a-9e37-4233-b7fe-5da6563ba766\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc652tb" May 21 18:32:23.118104 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:23.118057 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/995f611a-9e37-4233-b7fe-5da6563ba766-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc652tb\" (UID: \"995f611a-9e37-4233-b7fe-5da6563ba766\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc652tb" May 21 18:32:23.118104 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:23.118090 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/995f611a-9e37-4233-b7fe-5da6563ba766-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc652tb\" (UID: \"995f611a-9e37-4233-b7fe-5da6563ba766\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc652tb" May 21 18:32:23.118343 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:23.118110 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hmnb7\" (UniqueName: \"kubernetes.io/projected/995f611a-9e37-4233-b7fe-5da6563ba766-kube-api-access-hmnb7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc652tb\" (UID: \"995f611a-9e37-4233-b7fe-5da6563ba766\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc652tb" May 21 18:32:23.118343 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:23.118129 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/995f611a-9e37-4233-b7fe-5da6563ba766-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc652tb\" (UID: \"995f611a-9e37-4233-b7fe-5da6563ba766\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc652tb" May 21 18:32:23.118343 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:23.118158 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/995f611a-9e37-4233-b7fe-5da6563ba766-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc652tb\" (UID: \"995f611a-9e37-4233-b7fe-5da6563ba766\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc652tb" May 21 18:32:23.118538 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:23.118516 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/995f611a-9e37-4233-b7fe-5da6563ba766-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc652tb\" (UID: \"995f611a-9e37-4233-b7fe-5da6563ba766\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc652tb" May 21 18:32:23.118538 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:23.118523 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/995f611a-9e37-4233-b7fe-5da6563ba766-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc652tb\" (UID: \"995f611a-9e37-4233-b7fe-5da6563ba766\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc652tb" May 21 18:32:23.118615 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:23.118543 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/995f611a-9e37-4233-b7fe-5da6563ba766-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc652tb\" (UID: \"995f611a-9e37-4233-b7fe-5da6563ba766\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc652tb" May 21 18:32:23.120540 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:23.120518 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/995f611a-9e37-4233-b7fe-5da6563ba766-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc652tb\" (UID: \"995f611a-9e37-4233-b7fe-5da6563ba766\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc652tb" May 21 18:32:23.120770 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:23.120749 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/995f611a-9e37-4233-b7fe-5da6563ba766-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc652tb\" (UID: \"995f611a-9e37-4233-b7fe-5da6563ba766\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc652tb" May 21 18:32:23.141007 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:23.140972 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmnb7\" (UniqueName: \"kubernetes.io/projected/995f611a-9e37-4233-b7fe-5da6563ba766-kube-api-access-hmnb7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc652tb\" (UID: \"995f611a-9e37-4233-b7fe-5da6563ba766\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc652tb" May 21 18:32:23.277228 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:23.277185 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc652tb" May 21 18:32:23.415745 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:23.415689 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc652tb"] May 21 18:32:23.419022 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:32:23.418994 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod995f611a_9e37_4233_b7fe_5da6563ba766.slice/crio-497fd8a5ceb4ec13305072979c8d86eaea8a270091717394bc588866dad49646 WatchSource:0}: Error finding container 497fd8a5ceb4ec13305072979c8d86eaea8a270091717394bc588866dad49646: Status 404 returned error can't find the container with id 497fd8a5ceb4ec13305072979c8d86eaea8a270091717394bc588866dad49646 May 21 18:32:23.795533 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:23.795450 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc652tb" event={"ID":"995f611a-9e37-4233-b7fe-5da6563ba766","Type":"ContainerStarted","Data":"f8dcf4ce993cafd588f513d5a6d377894d133314bae97756091279a06743ad0c"} May 21 18:32:23.795533 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:23.795487 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc652tb" event={"ID":"995f611a-9e37-4233-b7fe-5da6563ba766","Type":"ContainerStarted","Data":"497fd8a5ceb4ec13305072979c8d86eaea8a270091717394bc588866dad49646"} May 21 18:32:24.276564 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:24.276534 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z8fkw"] May 21 18:32:24.278947 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:24.278925 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z8fkw" May 21 18:32:24.282174 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:24.282155 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" May 21 18:32:24.292852 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:24.292823 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z8fkw"] May 21 18:32:24.326371 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:24.326333 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78zcj\" (UniqueName: \"kubernetes.io/projected/4e242a78-6649-4e55-b076-4892e1a71a15-kube-api-access-78zcj\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-z8fkw\" (UID: \"4e242a78-6649-4e55-b076-4892e1a71a15\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z8fkw" May 21 18:32:24.326371 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:24.326373 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e242a78-6649-4e55-b076-4892e1a71a15-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-z8fkw\" (UID: \"4e242a78-6649-4e55-b076-4892e1a71a15\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z8fkw" May 21 18:32:24.326582 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:24.326483 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e242a78-6649-4e55-b076-4892e1a71a15-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-z8fkw\" (UID: \"4e242a78-6649-4e55-b076-4892e1a71a15\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z8fkw" May 21 18:32:24.326582 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:24.326521 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e242a78-6649-4e55-b076-4892e1a71a15-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-z8fkw\" (UID: \"4e242a78-6649-4e55-b076-4892e1a71a15\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z8fkw" May 21 18:32:24.326582 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:24.326576 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e242a78-6649-4e55-b076-4892e1a71a15-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-z8fkw\" (UID: \"4e242a78-6649-4e55-b076-4892e1a71a15\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z8fkw" May 21 18:32:24.326693 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:24.326606 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4e242a78-6649-4e55-b076-4892e1a71a15-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-z8fkw\" (UID: \"4e242a78-6649-4e55-b076-4892e1a71a15\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z8fkw" May 21 18:32:24.427748 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:24.427678 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-78zcj\" (UniqueName: \"kubernetes.io/projected/4e242a78-6649-4e55-b076-4892e1a71a15-kube-api-access-78zcj\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-z8fkw\" (UID: \"4e242a78-6649-4e55-b076-4892e1a71a15\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z8fkw" May 21 18:32:24.427748 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:24.427754 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e242a78-6649-4e55-b076-4892e1a71a15-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-z8fkw\" (UID: \"4e242a78-6649-4e55-b076-4892e1a71a15\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z8fkw" May 21 18:32:24.428000 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:24.427918 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e242a78-6649-4e55-b076-4892e1a71a15-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-z8fkw\" (UID: \"4e242a78-6649-4e55-b076-4892e1a71a15\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z8fkw" May 21 18:32:24.428000 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:24.427955 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e242a78-6649-4e55-b076-4892e1a71a15-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-z8fkw\" (UID: \"4e242a78-6649-4e55-b076-4892e1a71a15\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z8fkw" May 21 18:32:24.428000 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:24.427981 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e242a78-6649-4e55-b076-4892e1a71a15-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-z8fkw\" (UID: \"4e242a78-6649-4e55-b076-4892e1a71a15\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z8fkw" May 21 18:32:24.428153 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:24.428001 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4e242a78-6649-4e55-b076-4892e1a71a15-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-z8fkw\" (UID: \"4e242a78-6649-4e55-b076-4892e1a71a15\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z8fkw" May 21 18:32:24.428392 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:24.428362 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e242a78-6649-4e55-b076-4892e1a71a15-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-z8fkw\" (UID: \"4e242a78-6649-4e55-b076-4892e1a71a15\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z8fkw" May 21 18:32:24.428540 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:24.428421 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e242a78-6649-4e55-b076-4892e1a71a15-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-z8fkw\" (UID: \"4e242a78-6649-4e55-b076-4892e1a71a15\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z8fkw" May 21 18:32:24.428540 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:24.428479 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4e242a78-6649-4e55-b076-4892e1a71a15-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-z8fkw\" (UID: \"4e242a78-6649-4e55-b076-4892e1a71a15\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z8fkw" May 21 18:32:24.430169 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:24.430136 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e242a78-6649-4e55-b076-4892e1a71a15-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-z8fkw\" (UID: \"4e242a78-6649-4e55-b076-4892e1a71a15\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z8fkw" May 21 18:32:24.430295 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:24.430275 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e242a78-6649-4e55-b076-4892e1a71a15-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-z8fkw\" (UID: \"4e242a78-6649-4e55-b076-4892e1a71a15\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z8fkw" May 21 18:32:24.446380 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:24.446351 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78zcj\" (UniqueName: \"kubernetes.io/projected/4e242a78-6649-4e55-b076-4892e1a71a15-kube-api-access-78zcj\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-z8fkw\" (UID: \"4e242a78-6649-4e55-b076-4892e1a71a15\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z8fkw" May 21 18:32:24.590679 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:24.590597 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z8fkw" May 21 18:32:24.752835 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:24.752787 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z8fkw"] May 21 18:32:24.761809 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:32:24.761774 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e242a78_6649_4e55_b076_4892e1a71a15.slice/crio-8dd5acf4f20a62be2769c1797dabfdb5ba871719f6ec0acc19badd5668d2f4b8 WatchSource:0}: Error finding container 8dd5acf4f20a62be2769c1797dabfdb5ba871719f6ec0acc19badd5668d2f4b8: Status 404 returned error can't find the container with id 8dd5acf4f20a62be2769c1797dabfdb5ba871719f6ec0acc19badd5668d2f4b8 May 21 18:32:24.800490 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:24.800382 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z8fkw" event={"ID":"4e242a78-6649-4e55-b076-4892e1a71a15","Type":"ContainerStarted","Data":"8dd5acf4f20a62be2769c1797dabfdb5ba871719f6ec0acc19badd5668d2f4b8"} May 21 18:32:25.805797 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:25.805754 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z8fkw" event={"ID":"4e242a78-6649-4e55-b076-4892e1a71a15","Type":"ContainerStarted","Data":"a742a8d86900352f25f3e6be6bac02ccfa5752d626a5b2b226f6ff5404275b99"} May 21 18:32:29.819377 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:29.819336 2575 generic.go:358] "Generic (PLEG): container finished" podID="995f611a-9e37-4233-b7fe-5da6563ba766" containerID="f8dcf4ce993cafd588f513d5a6d377894d133314bae97756091279a06743ad0c" exitCode=0 May 21 18:32:29.819816 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:29.819410 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc652tb" event={"ID":"995f611a-9e37-4233-b7fe-5da6563ba766","Type":"ContainerDied","Data":"f8dcf4ce993cafd588f513d5a6d377894d133314bae97756091279a06743ad0c"} May 21 18:32:30.827300 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:30.827262 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc652tb" event={"ID":"995f611a-9e37-4233-b7fe-5da6563ba766","Type":"ContainerStarted","Data":"7070efef8f1fb0c2030c1461b391ef8f5feb8843f3e1e7cb31faacbb479e5099"} May 21 18:32:30.827754 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:30.827484 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc652tb" May 21 18:32:30.828605 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:30.828583 2575 generic.go:358] "Generic (PLEG): container finished" podID="4e242a78-6649-4e55-b076-4892e1a71a15" containerID="a742a8d86900352f25f3e6be6bac02ccfa5752d626a5b2b226f6ff5404275b99" exitCode=0 May 21 18:32:30.828695 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:30.828651 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z8fkw" event={"ID":"4e242a78-6649-4e55-b076-4892e1a71a15","Type":"ContainerDied","Data":"a742a8d86900352f25f3e6be6bac02ccfa5752d626a5b2b226f6ff5404275b99"} May 21 18:32:30.906870 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:30.906769 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc652tb" podStartSLOduration=8.643751465 podStartE2EDuration="8.906751522s" podCreationTimestamp="2026-05-21 18:32:22 +0000 UTC" firstStartedPulling="2026-05-21 18:32:29.820060826 +0000 UTC m=+732.692279703" lastFinishedPulling="2026-05-21 18:32:30.083060884 +0000 UTC m=+732.955279760" observedRunningTime="2026-05-21 18:32:30.875155101 +0000 UTC m=+733.747373998" watchObservedRunningTime="2026-05-21 18:32:30.906751522 +0000 UTC m=+733.778970444" May 21 18:32:31.833955 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:31.833918 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z8fkw" event={"ID":"4e242a78-6649-4e55-b076-4892e1a71a15","Type":"ContainerStarted","Data":"974d6ed86da429b1ac4c27d4b2914bc80bc8c27ec781e6f3ed31e85496cf5952"} May 21 18:32:31.834429 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:31.834202 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z8fkw" May 21 18:32:31.855833 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:31.855788 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z8fkw" podStartSLOduration=7.624581749 podStartE2EDuration="7.855771582s" podCreationTimestamp="2026-05-21 18:32:24 +0000 UTC" firstStartedPulling="2026-05-21 18:32:30.829236606 +0000 UTC m=+733.701455481" lastFinishedPulling="2026-05-21 18:32:31.060426438 +0000 UTC m=+733.932645314" observedRunningTime="2026-05-21 18:32:31.854340903 +0000 UTC m=+734.726559801" watchObservedRunningTime="2026-05-21 18:32:31.855771582 +0000 UTC m=+734.727990480" May 21 18:32:36.967775 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:36.967737 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qpdv"] May 21 18:32:36.971051 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:36.971027 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qpdv" May 21 18:32:36.975971 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:36.975947 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" May 21 18:32:36.995721 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:36.994956 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qpdv"] May 21 18:32:37.038442 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:37.038403 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a20a5ac-11c1-4988-9aba-d4e7b33d2bc8-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2qpdv\" (UID: \"0a20a5ac-11c1-4988-9aba-d4e7b33d2bc8\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qpdv" May 21 18:32:37.038442 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:37.038442 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0a20a5ac-11c1-4988-9aba-d4e7b33d2bc8-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2qpdv\" (UID: \"0a20a5ac-11c1-4988-9aba-d4e7b33d2bc8\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qpdv" May 21 18:32:37.038639 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:37.038508 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a20a5ac-11c1-4988-9aba-d4e7b33d2bc8-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2qpdv\" (UID: \"0a20a5ac-11c1-4988-9aba-d4e7b33d2bc8\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qpdv" May 21 18:32:37.038639 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:37.038556 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a20a5ac-11c1-4988-9aba-d4e7b33d2bc8-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2qpdv\" (UID: \"0a20a5ac-11c1-4988-9aba-d4e7b33d2bc8\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qpdv" May 21 18:32:37.038639 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:37.038590 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a20a5ac-11c1-4988-9aba-d4e7b33d2bc8-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2qpdv\" (UID: \"0a20a5ac-11c1-4988-9aba-d4e7b33d2bc8\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qpdv" May 21 18:32:37.038639 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:37.038609 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-td7tc\" (UniqueName: \"kubernetes.io/projected/0a20a5ac-11c1-4988-9aba-d4e7b33d2bc8-kube-api-access-td7tc\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2qpdv\" (UID: \"0a20a5ac-11c1-4988-9aba-d4e7b33d2bc8\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qpdv" May 21 18:32:37.139567 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:37.139534 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a20a5ac-11c1-4988-9aba-d4e7b33d2bc8-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2qpdv\" (UID: \"0a20a5ac-11c1-4988-9aba-d4e7b33d2bc8\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qpdv" May 21 18:32:37.139772 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:37.139575 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-td7tc\" (UniqueName: \"kubernetes.io/projected/0a20a5ac-11c1-4988-9aba-d4e7b33d2bc8-kube-api-access-td7tc\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2qpdv\" (UID: \"0a20a5ac-11c1-4988-9aba-d4e7b33d2bc8\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qpdv" May 21 18:32:37.139772 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:37.139626 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a20a5ac-11c1-4988-9aba-d4e7b33d2bc8-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2qpdv\" (UID: \"0a20a5ac-11c1-4988-9aba-d4e7b33d2bc8\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qpdv" May 21 18:32:37.139772 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:37.139643 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0a20a5ac-11c1-4988-9aba-d4e7b33d2bc8-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2qpdv\" (UID: \"0a20a5ac-11c1-4988-9aba-d4e7b33d2bc8\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qpdv" May 21 18:32:37.139772 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:37.139674 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a20a5ac-11c1-4988-9aba-d4e7b33d2bc8-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2qpdv\" (UID: \"0a20a5ac-11c1-4988-9aba-d4e7b33d2bc8\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qpdv" May 21 18:32:37.140031 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:37.139803 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a20a5ac-11c1-4988-9aba-d4e7b33d2bc8-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2qpdv\" (UID: \"0a20a5ac-11c1-4988-9aba-d4e7b33d2bc8\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qpdv" May 21 18:32:37.140115 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:37.140086 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0a20a5ac-11c1-4988-9aba-d4e7b33d2bc8-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2qpdv\" (UID: \"0a20a5ac-11c1-4988-9aba-d4e7b33d2bc8\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qpdv" May 21 18:32:37.140303 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:37.140277 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a20a5ac-11c1-4988-9aba-d4e7b33d2bc8-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2qpdv\" (UID: \"0a20a5ac-11c1-4988-9aba-d4e7b33d2bc8\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qpdv" May 21 18:32:37.140393 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:37.140312 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a20a5ac-11c1-4988-9aba-d4e7b33d2bc8-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2qpdv\" (UID: \"0a20a5ac-11c1-4988-9aba-d4e7b33d2bc8\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qpdv" May 21 18:32:37.141994 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:37.141969 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a20a5ac-11c1-4988-9aba-d4e7b33d2bc8-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2qpdv\" (UID: \"0a20a5ac-11c1-4988-9aba-d4e7b33d2bc8\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qpdv" May 21 18:32:37.142375 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:37.142354 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a20a5ac-11c1-4988-9aba-d4e7b33d2bc8-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2qpdv\" (UID: \"0a20a5ac-11c1-4988-9aba-d4e7b33d2bc8\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qpdv" May 21 18:32:37.156015 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:37.155987 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-td7tc\" (UniqueName: \"kubernetes.io/projected/0a20a5ac-11c1-4988-9aba-d4e7b33d2bc8-kube-api-access-td7tc\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-2qpdv\" (UID: \"0a20a5ac-11c1-4988-9aba-d4e7b33d2bc8\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qpdv" May 21 18:32:37.292611 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:37.292526 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qpdv" May 21 18:32:37.440197 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:37.440163 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qpdv"] May 21 18:32:37.443036 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:32:37.443010 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a20a5ac_11c1_4988_9aba_d4e7b33d2bc8.slice/crio-d7af2c16b2867418ba826f0b4b232be52d32edf31a3e288599675b8569362ce8 WatchSource:0}: Error finding container d7af2c16b2867418ba826f0b4b232be52d32edf31a3e288599675b8569362ce8: Status 404 returned error can't find the container with id d7af2c16b2867418ba826f0b4b232be52d32edf31a3e288599675b8569362ce8 May 21 18:32:37.854082 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:37.854044 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qpdv" event={"ID":"0a20a5ac-11c1-4988-9aba-d4e7b33d2bc8","Type":"ContainerStarted","Data":"b36be8337c0a1a9dffe61931f8ec48f1084b47473b4337b702c70821be36755d"} May 21 18:32:37.854082 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:37.854082 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qpdv" event={"ID":"0a20a5ac-11c1-4988-9aba-d4e7b33d2bc8","Type":"ContainerStarted","Data":"d7af2c16b2867418ba826f0b4b232be52d32edf31a3e288599675b8569362ce8"} May 21 18:32:41.847176 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:41.847139 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc652tb" May 21 18:32:42.850852 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:42.850826 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-z8fkw" May 21 18:32:43.873808 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:43.873772 2575 generic.go:358] "Generic (PLEG): container finished" podID="0a20a5ac-11c1-4988-9aba-d4e7b33d2bc8" containerID="b36be8337c0a1a9dffe61931f8ec48f1084b47473b4337b702c70821be36755d" exitCode=0 May 21 18:32:43.874231 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:43.873841 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qpdv" event={"ID":"0a20a5ac-11c1-4988-9aba-d4e7b33d2bc8","Type":"ContainerDied","Data":"b36be8337c0a1a9dffe61931f8ec48f1084b47473b4337b702c70821be36755d"} May 21 18:32:44.879268 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:44.879231 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qpdv" event={"ID":"0a20a5ac-11c1-4988-9aba-d4e7b33d2bc8","Type":"ContainerStarted","Data":"ae84078ffc3ec475901e4ac539af84b3d6f0ee78b0b2e0bfd2b2f14bb00930cc"} May 21 18:32:44.879765 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:44.879460 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qpdv" May 21 18:32:44.914239 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:44.914187 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qpdv" podStartSLOduration=8.691994595 podStartE2EDuration="8.914173407s" podCreationTimestamp="2026-05-21 18:32:36 +0000 UTC" firstStartedPulling="2026-05-21 18:32:43.874438597 +0000 UTC m=+746.746657474" lastFinishedPulling="2026-05-21 18:32:44.09661741 +0000 UTC m=+746.968836286" observedRunningTime="2026-05-21 18:32:44.913300875 +0000 UTC m=+747.785519774" watchObservedRunningTime="2026-05-21 18:32:44.914173407 +0000 UTC m=+747.786392305" May 21 18:32:55.894241 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:32:55.894213 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-2qpdv" May 21 18:33:27.838097 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:33:27.838065 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-69c8f4dbf9-7qxqw"] May 21 18:33:27.841766 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:33:27.841744 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69c8f4dbf9-7qxqw" May 21 18:33:27.850987 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:33:27.850960 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-69c8f4dbf9-7qxqw"] May 21 18:33:27.981608 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:33:27.981556 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqc29\" (UniqueName: \"kubernetes.io/projected/884afe7e-9176-4dc4-a5e3-ee2eb3f7d342-kube-api-access-hqc29\") pod \"authorino-69c8f4dbf9-7qxqw\" (UID: \"884afe7e-9176-4dc4-a5e3-ee2eb3f7d342\") " pod="kuadrant-system/authorino-69c8f4dbf9-7qxqw" May 21 18:33:27.981608 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:33:27.981615 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/884afe7e-9176-4dc4-a5e3-ee2eb3f7d342-tls-cert\") pod \"authorino-69c8f4dbf9-7qxqw\" (UID: \"884afe7e-9176-4dc4-a5e3-ee2eb3f7d342\") " pod="kuadrant-system/authorino-69c8f4dbf9-7qxqw" May 21 18:33:28.082789 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:33:28.082751 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/884afe7e-9176-4dc4-a5e3-ee2eb3f7d342-tls-cert\") pod \"authorino-69c8f4dbf9-7qxqw\" (UID: \"884afe7e-9176-4dc4-a5e3-ee2eb3f7d342\") " pod="kuadrant-system/authorino-69c8f4dbf9-7qxqw" May 21 18:33:28.082959 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:33:28.082838 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hqc29\" (UniqueName: \"kubernetes.io/projected/884afe7e-9176-4dc4-a5e3-ee2eb3f7d342-kube-api-access-hqc29\") pod \"authorino-69c8f4dbf9-7qxqw\" (UID: \"884afe7e-9176-4dc4-a5e3-ee2eb3f7d342\") " pod="kuadrant-system/authorino-69c8f4dbf9-7qxqw" May 21 18:33:28.085167 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:33:28.085135 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/884afe7e-9176-4dc4-a5e3-ee2eb3f7d342-tls-cert\") pod \"authorino-69c8f4dbf9-7qxqw\" (UID: \"884afe7e-9176-4dc4-a5e3-ee2eb3f7d342\") " pod="kuadrant-system/authorino-69c8f4dbf9-7qxqw" May 21 18:33:28.092632 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:33:28.092580 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqc29\" (UniqueName: \"kubernetes.io/projected/884afe7e-9176-4dc4-a5e3-ee2eb3f7d342-kube-api-access-hqc29\") pod \"authorino-69c8f4dbf9-7qxqw\" (UID: \"884afe7e-9176-4dc4-a5e3-ee2eb3f7d342\") " pod="kuadrant-system/authorino-69c8f4dbf9-7qxqw" May 21 18:33:28.151978 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:33:28.151943 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69c8f4dbf9-7qxqw" May 21 18:33:28.277761 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:33:28.277585 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-69c8f4dbf9-7qxqw"] May 21 18:33:28.280400 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:33:28.280362 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod884afe7e_9176_4dc4_a5e3_ee2eb3f7d342.slice/crio-b4891c47e37787e26b9327eb557b88137bf603b3a39b6c06014e43d2e1347bd0 WatchSource:0}: Error finding container b4891c47e37787e26b9327eb557b88137bf603b3a39b6c06014e43d2e1347bd0: Status 404 returned error can't find the container with id b4891c47e37787e26b9327eb557b88137bf603b3a39b6c06014e43d2e1347bd0 May 21 18:33:29.021532 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:33:29.021496 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69c8f4dbf9-7qxqw" event={"ID":"884afe7e-9176-4dc4-a5e3-ee2eb3f7d342","Type":"ContainerStarted","Data":"5e784dbfba21337db79b24657ae33596304cb84ede9cdeabc3916bc49cf992c9"} May 21 18:33:29.021532 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:33:29.021536 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69c8f4dbf9-7qxqw" event={"ID":"884afe7e-9176-4dc4-a5e3-ee2eb3f7d342","Type":"ContainerStarted","Data":"b4891c47e37787e26b9327eb557b88137bf603b3a39b6c06014e43d2e1347bd0"} May 21 18:33:29.043505 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:33:29.043438 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-69c8f4dbf9-7qxqw" podStartSLOduration=1.5131174729999999 podStartE2EDuration="2.043418097s" podCreationTimestamp="2026-05-21 18:33:27 +0000 UTC" firstStartedPulling="2026-05-21 18:33:28.281785305 +0000 UTC m=+791.154004194" lastFinishedPulling="2026-05-21 18:33:28.812085942 +0000 UTC m=+791.684304818" observedRunningTime="2026-05-21 18:33:29.042359904 +0000 UTC m=+791.914578804" watchObservedRunningTime="2026-05-21 18:33:29.043418097 +0000 UTC m=+791.915636997" May 21 18:33:29.071542 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:33:29.071452 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5548b8c8bb-l7qg6"] May 21 18:33:29.071792 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:33:29.071754 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-5548b8c8bb-l7qg6" podUID="7059c5e8-cb2e-4eb8-b41d-a1cb6bae7316" containerName="authorino" containerID="cri-o://dba1a3062b4093904caa3f03352d7398e8dc21946310b6ee5afed241402b6039" gracePeriod=30 May 21 18:33:29.325227 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:33:29.325158 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5548b8c8bb-l7qg6" May 21 18:33:29.393260 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:33:29.393224 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7059c5e8-cb2e-4eb8-b41d-a1cb6bae7316-tls-cert\") pod \"7059c5e8-cb2e-4eb8-b41d-a1cb6bae7316\" (UID: \"7059c5e8-cb2e-4eb8-b41d-a1cb6bae7316\") " May 21 18:33:29.393437 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:33:29.393308 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z54cs\" (UniqueName: \"kubernetes.io/projected/7059c5e8-cb2e-4eb8-b41d-a1cb6bae7316-kube-api-access-z54cs\") pod \"7059c5e8-cb2e-4eb8-b41d-a1cb6bae7316\" (UID: \"7059c5e8-cb2e-4eb8-b41d-a1cb6bae7316\") " May 21 18:33:29.395514 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:33:29.395475 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7059c5e8-cb2e-4eb8-b41d-a1cb6bae7316-kube-api-access-z54cs" (OuterVolumeSpecName: "kube-api-access-z54cs") pod "7059c5e8-cb2e-4eb8-b41d-a1cb6bae7316" (UID: "7059c5e8-cb2e-4eb8-b41d-a1cb6bae7316"). InnerVolumeSpecName "kube-api-access-z54cs". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 18:33:29.402732 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:33:29.402693 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7059c5e8-cb2e-4eb8-b41d-a1cb6bae7316-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "7059c5e8-cb2e-4eb8-b41d-a1cb6bae7316" (UID: "7059c5e8-cb2e-4eb8-b41d-a1cb6bae7316"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 18:33:29.494437 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:33:29.494396 2575 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7059c5e8-cb2e-4eb8-b41d-a1cb6bae7316-tls-cert\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" May 21 18:33:29.494437 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:33:29.494439 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z54cs\" (UniqueName: \"kubernetes.io/projected/7059c5e8-cb2e-4eb8-b41d-a1cb6bae7316-kube-api-access-z54cs\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" May 21 18:33:30.025693 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:33:30.025597 2575 generic.go:358] "Generic (PLEG): container finished" podID="7059c5e8-cb2e-4eb8-b41d-a1cb6bae7316" containerID="dba1a3062b4093904caa3f03352d7398e8dc21946310b6ee5afed241402b6039" exitCode=0 May 21 18:33:30.025693 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:33:30.025677 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5548b8c8bb-l7qg6" May 21 18:33:30.025693 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:33:30.025677 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5548b8c8bb-l7qg6" event={"ID":"7059c5e8-cb2e-4eb8-b41d-a1cb6bae7316","Type":"ContainerDied","Data":"dba1a3062b4093904caa3f03352d7398e8dc21946310b6ee5afed241402b6039"} May 21 18:33:30.026235 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:33:30.025732 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5548b8c8bb-l7qg6" event={"ID":"7059c5e8-cb2e-4eb8-b41d-a1cb6bae7316","Type":"ContainerDied","Data":"c82ab1fe81e405819f4cf17fb06e8d8dae0d274ab5f2371f2cd4f352e9d04119"} May 21 18:33:30.026235 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:33:30.025751 2575 scope.go:117] "RemoveContainer" containerID="dba1a3062b4093904caa3f03352d7398e8dc21946310b6ee5afed241402b6039" May 21 18:33:30.035314 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:33:30.035266 2575 scope.go:117] "RemoveContainer" containerID="dba1a3062b4093904caa3f03352d7398e8dc21946310b6ee5afed241402b6039" May 21 18:33:30.035525 ip-10-0-142-242 kubenswrapper[2575]: E0521 18:33:30.035508 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dba1a3062b4093904caa3f03352d7398e8dc21946310b6ee5afed241402b6039\": container with ID starting with dba1a3062b4093904caa3f03352d7398e8dc21946310b6ee5afed241402b6039 not found: ID does not exist" containerID="dba1a3062b4093904caa3f03352d7398e8dc21946310b6ee5afed241402b6039" May 21 18:33:30.035569 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:33:30.035533 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dba1a3062b4093904caa3f03352d7398e8dc21946310b6ee5afed241402b6039"} err="failed to get container status \"dba1a3062b4093904caa3f03352d7398e8dc21946310b6ee5afed241402b6039\": rpc error: code = NotFound desc = could not find container \"dba1a3062b4093904caa3f03352d7398e8dc21946310b6ee5afed241402b6039\": container with ID starting with dba1a3062b4093904caa3f03352d7398e8dc21946310b6ee5afed241402b6039 not found: ID does not exist" May 21 18:33:30.044985 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:33:30.044961 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5548b8c8bb-l7qg6"] May 21 18:33:30.047395 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:33:30.047368 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5548b8c8bb-l7qg6"] May 21 18:33:31.698933 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:33:31.698898 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7059c5e8-cb2e-4eb8-b41d-a1cb6bae7316" path="/var/lib/kubelet/pods/7059c5e8-cb2e-4eb8-b41d-a1cb6bae7316/volumes" May 21 18:34:55.138230 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:34:55.138199 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-768fd7d946-xzhcw"] May 21 18:34:55.138739 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:34:55.138408 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-768fd7d946-xzhcw" podUID="e37a674e-4392-4f0c-a6e9-73fcbc6f575c" containerName="manager" containerID="cri-o://879049c9fb0e54ae4e419cca5939dd065c08cb1cf7efacb0c37178e55b563121" gracePeriod=30 May 21 18:34:55.319781 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:34:55.319752 2575 generic.go:358] "Generic (PLEG): container finished" podID="e37a674e-4392-4f0c-a6e9-73fcbc6f575c" containerID="879049c9fb0e54ae4e419cca5939dd065c08cb1cf7efacb0c37178e55b563121" exitCode=0 May 21 18:34:55.319914 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:34:55.319822 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-768fd7d946-xzhcw" event={"ID":"e37a674e-4392-4f0c-a6e9-73fcbc6f575c","Type":"ContainerDied","Data":"879049c9fb0e54ae4e419cca5939dd065c08cb1cf7efacb0c37178e55b563121"} May 21 18:34:55.383958 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:34:55.383936 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-768fd7d946-xzhcw" May 21 18:34:55.425469 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:34:55.425398 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gc7l8\" (UniqueName: \"kubernetes.io/projected/e37a674e-4392-4f0c-a6e9-73fcbc6f575c-kube-api-access-gc7l8\") pod \"e37a674e-4392-4f0c-a6e9-73fcbc6f575c\" (UID: \"e37a674e-4392-4f0c-a6e9-73fcbc6f575c\") " May 21 18:34:55.427406 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:34:55.427379 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e37a674e-4392-4f0c-a6e9-73fcbc6f575c-kube-api-access-gc7l8" (OuterVolumeSpecName: "kube-api-access-gc7l8") pod "e37a674e-4392-4f0c-a6e9-73fcbc6f575c" (UID: "e37a674e-4392-4f0c-a6e9-73fcbc6f575c"). InnerVolumeSpecName "kube-api-access-gc7l8". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 18:34:55.526432 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:34:55.526387 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gc7l8\" (UniqueName: \"kubernetes.io/projected/e37a674e-4392-4f0c-a6e9-73fcbc6f575c-kube-api-access-gc7l8\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" May 21 18:34:56.324327 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:34:56.324300 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-768fd7d946-xzhcw" event={"ID":"e37a674e-4392-4f0c-a6e9-73fcbc6f575c","Type":"ContainerDied","Data":"1f6afb0481c8ad8b62cca72463e439db826db1de52e30a7593ba56c044479644"} May 21 18:34:56.324805 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:34:56.324341 2575 scope.go:117] "RemoveContainer" containerID="879049c9fb0e54ae4e419cca5939dd065c08cb1cf7efacb0c37178e55b563121" May 21 18:34:56.324805 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:34:56.324347 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-768fd7d946-xzhcw" May 21 18:34:56.345927 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:34:56.345847 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-768fd7d946-xzhcw"] May 21 18:34:56.346112 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:34:56.346098 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-768fd7d946-xzhcw"] May 21 18:34:57.697869 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:34:57.697829 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e37a674e-4392-4f0c-a6e9-73fcbc6f575c" path="/var/lib/kubelet/pods/e37a674e-4392-4f0c-a6e9-73fcbc6f575c/volumes" May 21 18:56:07.341684 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:07.341604 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-69c8f4dbf9-7qxqw_884afe7e-9176-4dc4-a5e3-ee2eb3f7d342/authorino/0.log" May 21 18:56:12.855689 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:12.855657 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67595b8579-867zd_a6408fc3-43ad-433b-ae99-90bd16844e16/manager/0.log" May 21 18:56:14.305837 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:14.305801 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-69c8f4dbf9-7qxqw_884afe7e-9176-4dc4-a5e3-ee2eb3f7d342/authorino/0.log" May 21 18:56:14.425442 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:14.425411 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-wbqkn_31f6e33e-187c-49df-9413-a1bc4f075380/manager/0.log" May 21 18:56:14.771444 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:14.771413 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-z4f2l_13d20793-57d7-42c5-b4a7-e693216c7609/registry-server/0.log" May 21 18:56:15.121888 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:15.121859 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-b2xn2_521cb54c-a40a-40b6-bd1b-6e36d6153c6e/manager/0.log" May 21 18:56:15.476802 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:15.476730 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p_57764465-9125-4073-9b63-2681280ced07/istio-proxy/0.log" May 21 18:56:16.618133 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:16.618105 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-z8fkw_4e242a78-6649-4e55-b076-4892e1a71a15/storage-initializer/0.log" May 21 18:56:16.626657 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:16.626633 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-z8fkw_4e242a78-6649-4e55-b076-4892e1a71a15/main/0.log" May 21 18:56:16.739339 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:16.739312 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-bwhnc_1277ac64-121c-4aaa-b955-4a1f9dc39651/storage-initializer/0.log" May 21 18:56:16.747690 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:16.747670 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-bwhnc_1277ac64-121c-4aaa-b955-4a1f9dc39651/main/0.log" May 21 18:56:16.856191 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:16.856163 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc652tb_995f611a-9e37-4233-b7fe-5da6563ba766/storage-initializer/0.log" May 21 18:56:16.863766 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:16.863743 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc652tb_995f611a-9e37-4233-b7fe-5da6563ba766/main/0.log" May 21 18:56:16.975784 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:16.975758 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-2qpdv_0a20a5ac-11c1-4988-9aba-d4e7b33d2bc8/storage-initializer/0.log" May 21 18:56:16.983492 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:16.983470 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-2qpdv_0a20a5ac-11c1-4988-9aba-d4e7b33d2bc8/main/0.log" May 21 18:56:24.794386 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:24.794358 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qdhhw_d926e5e1-fb8a-4636-b0f6-3894327080b2/global-pull-secret-syncer/0.log" May 21 18:56:24.992651 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:24.992616 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-m7nqz_a6d06917-90d7-4b14-bd75-be7260a75d7e/konnectivity-agent/0.log" May 21 18:56:25.177760 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:25.177733 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-242.ec2.internal_2c23003bb529fbcd873744269cc9dc4a/haproxy/0.log" May 21 18:56:29.626830 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:29.626798 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-69c8f4dbf9-7qxqw_884afe7e-9176-4dc4-a5e3-ee2eb3f7d342/authorino/0.log" May 21 18:56:29.710336 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:29.710310 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-wbqkn_31f6e33e-187c-49df-9413-a1bc4f075380/manager/0.log" May 21 18:56:29.939832 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:29.939752 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-z4f2l_13d20793-57d7-42c5-b4a7-e693216c7609/registry-server/0.log" May 21 18:56:30.197049 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:30.196982 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-b2xn2_521cb54c-a40a-40b6-bd1b-6e36d6153c6e/manager/0.log" May 21 18:56:32.101015 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:32.100983 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rxm9c_8bf493cb-6c77-4f34-98ed-e1f40369cc10/node-exporter/0.log" May 21 18:56:32.125817 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:32.125786 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rxm9c_8bf493cb-6c77-4f34-98ed-e1f40369cc10/kube-rbac-proxy/0.log" May 21 18:56:32.158466 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:32.158444 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rxm9c_8bf493cb-6c77-4f34-98ed-e1f40369cc10/init-textfile/0.log" May 21 18:56:32.901770 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:32.901741 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kg6zt/perf-node-gather-daemonset-jd885"] May 21 18:56:32.902114 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:32.902097 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e37a674e-4392-4f0c-a6e9-73fcbc6f575c" containerName="manager" May 21 18:56:32.902199 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:32.902116 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e37a674e-4392-4f0c-a6e9-73fcbc6f575c" containerName="manager" May 21 18:56:32.902199 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:32.902129 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7059c5e8-cb2e-4eb8-b41d-a1cb6bae7316" containerName="authorino" May 21 18:56:32.902199 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:32.902137 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7059c5e8-cb2e-4eb8-b41d-a1cb6bae7316" containerName="authorino" May 21 18:56:32.902348 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:32.902227 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="7059c5e8-cb2e-4eb8-b41d-a1cb6bae7316" containerName="authorino" May 21 18:56:32.902348 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:32.902243 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="e37a674e-4392-4f0c-a6e9-73fcbc6f575c" containerName="manager" May 21 18:56:32.905338 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:32.905317 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-jd885" May 21 18:56:32.908519 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:32.908501 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kg6zt\"/\"kube-root-ca.crt\"" May 21 18:56:32.909474 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:32.909456 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kg6zt\"/\"openshift-service-ca.crt\"" May 21 18:56:32.909570 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:32.909457 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kg6zt\"/\"default-dockercfg-qjd9n\"" May 21 18:56:32.931630 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:32.931603 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kg6zt/perf-node-gather-daemonset-jd885"] May 21 18:56:33.006050 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:33.006011 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/18877d37-9339-47b0-a57d-88100f1b6383-proc\") pod \"perf-node-gather-daemonset-jd885\" (UID: \"18877d37-9339-47b0-a57d-88100f1b6383\") " pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-jd885" May 21 18:56:33.006220 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:33.006071 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/18877d37-9339-47b0-a57d-88100f1b6383-lib-modules\") pod \"perf-node-gather-daemonset-jd885\" (UID: \"18877d37-9339-47b0-a57d-88100f1b6383\") " pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-jd885" May 21 18:56:33.006220 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:33.006151 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgbkb\" (UniqueName: \"kubernetes.io/projected/18877d37-9339-47b0-a57d-88100f1b6383-kube-api-access-bgbkb\") pod \"perf-node-gather-daemonset-jd885\" (UID: \"18877d37-9339-47b0-a57d-88100f1b6383\") " pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-jd885" May 21 18:56:33.006220 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:33.006191 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/18877d37-9339-47b0-a57d-88100f1b6383-sys\") pod \"perf-node-gather-daemonset-jd885\" (UID: \"18877d37-9339-47b0-a57d-88100f1b6383\") " pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-jd885" May 21 18:56:33.006220 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:33.006213 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/18877d37-9339-47b0-a57d-88100f1b6383-podres\") pod \"perf-node-gather-daemonset-jd885\" (UID: \"18877d37-9339-47b0-a57d-88100f1b6383\") " pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-jd885" May 21 18:56:33.106980 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:33.106931 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/18877d37-9339-47b0-a57d-88100f1b6383-sys\") pod \"perf-node-gather-daemonset-jd885\" (UID: \"18877d37-9339-47b0-a57d-88100f1b6383\") " pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-jd885" May 21 18:56:33.106980 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:33.106986 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/18877d37-9339-47b0-a57d-88100f1b6383-podres\") pod \"perf-node-gather-daemonset-jd885\" (UID: \"18877d37-9339-47b0-a57d-88100f1b6383\") " pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-jd885" May 21 18:56:33.107402 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:33.107020 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/18877d37-9339-47b0-a57d-88100f1b6383-proc\") pod \"perf-node-gather-daemonset-jd885\" (UID: \"18877d37-9339-47b0-a57d-88100f1b6383\") " pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-jd885" May 21 18:56:33.107402 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:33.107054 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/18877d37-9339-47b0-a57d-88100f1b6383-lib-modules\") pod \"perf-node-gather-daemonset-jd885\" (UID: \"18877d37-9339-47b0-a57d-88100f1b6383\") " pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-jd885" May 21 18:56:33.107402 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:33.107067 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/18877d37-9339-47b0-a57d-88100f1b6383-sys\") pod \"perf-node-gather-daemonset-jd885\" (UID: \"18877d37-9339-47b0-a57d-88100f1b6383\") " pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-jd885" May 21 18:56:33.107402 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:33.107087 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bgbkb\" (UniqueName: \"kubernetes.io/projected/18877d37-9339-47b0-a57d-88100f1b6383-kube-api-access-bgbkb\") pod \"perf-node-gather-daemonset-jd885\" (UID: \"18877d37-9339-47b0-a57d-88100f1b6383\") " pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-jd885" May 21 18:56:33.107402 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:33.107124 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/18877d37-9339-47b0-a57d-88100f1b6383-proc\") pod \"perf-node-gather-daemonset-jd885\" (UID: \"18877d37-9339-47b0-a57d-88100f1b6383\") " pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-jd885" May 21 18:56:33.107402 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:33.107187 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/18877d37-9339-47b0-a57d-88100f1b6383-podres\") pod \"perf-node-gather-daemonset-jd885\" (UID: \"18877d37-9339-47b0-a57d-88100f1b6383\") " pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-jd885" May 21 18:56:33.107402 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:33.107203 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/18877d37-9339-47b0-a57d-88100f1b6383-lib-modules\") pod \"perf-node-gather-daemonset-jd885\" (UID: \"18877d37-9339-47b0-a57d-88100f1b6383\") " pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-jd885" May 21 18:56:33.117205 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:33.117176 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgbkb\" (UniqueName: \"kubernetes.io/projected/18877d37-9339-47b0-a57d-88100f1b6383-kube-api-access-bgbkb\") pod \"perf-node-gather-daemonset-jd885\" (UID: \"18877d37-9339-47b0-a57d-88100f1b6383\") " pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-jd885" May 21 18:56:33.214895 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:33.214817 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-jd885" May 21 18:56:33.346599 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:33.346559 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kg6zt/perf-node-gather-daemonset-jd885"] May 21 18:56:33.351095 ip-10-0-142-242 kubenswrapper[2575]: W0521 18:56:33.351068 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod18877d37_9339_47b0_a57d_88100f1b6383.slice/crio-cc3848f4bf04789dd3da7bb5d7a09be2b6629ce2fce904c6556466e098702fb8 WatchSource:0}: Error finding container cc3848f4bf04789dd3da7bb5d7a09be2b6629ce2fce904c6556466e098702fb8: Status 404 returned error can't find the container with id cc3848f4bf04789dd3da7bb5d7a09be2b6629ce2fce904c6556466e098702fb8 May 21 18:56:33.352728 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:33.352685 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 18:56:33.432288 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:33.432252 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-jd885" event={"ID":"18877d37-9339-47b0-a57d-88100f1b6383","Type":"ContainerStarted","Data":"cc3848f4bf04789dd3da7bb5d7a09be2b6629ce2fce904c6556466e098702fb8"} May 21 18:56:33.895952 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:33.895920 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-zv4r9_a6cc67ce-5941-49a0-bc77-5239759537ec/networking-console-plugin/0.log" May 21 18:56:34.436321 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:34.436284 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-jd885" event={"ID":"18877d37-9339-47b0-a57d-88100f1b6383","Type":"ContainerStarted","Data":"529481b7da711e0a418b045b4447d88a1691a028fdaf9820cf996b3c9404ffac"} May 21 18:56:34.436758 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:34.436407 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-jd885" May 21 18:56:34.464024 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:34.463967 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-jd885" podStartSLOduration=2.463952979 podStartE2EDuration="2.463952979s" podCreationTimestamp="2026-05-21 18:56:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:56:34.461661607 +0000 UTC m=+2177.333880504" watchObservedRunningTime="2026-05-21 18:56:34.463952979 +0000 UTC m=+2177.336171876" May 21 18:56:36.611279 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:36.611251 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hvz8j_f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3/dns/0.log" May 21 18:56:36.662365 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:36.662334 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hvz8j_f02fc31f-d1e5-40c3-a539-c9fdf62d1ba3/kube-rbac-proxy/0.log" May 21 18:56:36.895198 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:36.895160 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wdw4s_71b45bd9-d908-47c0-b612-7db98e5a6fe7/dns-node-resolver/0.log" May 21 18:56:37.671125 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:37.671100 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nbg9h_42a0c0b9-f647-485a-90a7-84cb93415e1b/node-ca/0.log" May 21 18:56:38.774459 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:38.774431 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bgkd5p_57764465-9125-4073-9b63-2681280ced07/istio-proxy/0.log" May 21 18:56:39.940624 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:39.940593 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r5jsq_02844de9-e521-48a2-98b7-b2147b0080b2/serve-healthcheck-canary/0.log" May 21 18:56:40.448860 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:40.448827 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-jd885" May 21 18:56:41.129416 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:41.129388 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tcspb_fc6592f5-db5f-4c58-8572-e390e2d4ef80/kube-rbac-proxy/0.log" May 21 18:56:41.210583 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:41.210551 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tcspb_fc6592f5-db5f-4c58-8572-e390e2d4ef80/exporter/0.log" May 21 18:56:41.266176 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:41.266147 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tcspb_fc6592f5-db5f-4c58-8572-e390e2d4ef80/extractor/0.log" May 21 18:56:44.191416 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:44.191386 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67595b8579-867zd_a6408fc3-43ad-433b-ae99-90bd16844e16/manager/0.log" May 21 18:56:45.713957 ip-10-0-142-242 kubenswrapper[2575]: I0521 18:56:45.713928 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-59996fdc5c-4dhw6_04c87fd8-2ccb-4490-a5f8-6cf40a20ef6f/manager/0.log"