May 27 19:29:49.536799 ip-10-0-139-51 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 27 19:29:49.536811 ip-10-0-139-51 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 27 19:29:49.536818 ip-10-0-139-51 systemd[1]: kubelet.service: Failed with result 'resources'. May 27 19:29:49.537060 ip-10-0-139-51 systemd[1]: Failed to start Kubernetes Kubelet. May 27 19:30:01.015532 ip-10-0-139-51 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 27 19:30:01.015548 ip-10-0-139-51 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 8c3b3f17d1624661ac1ec6f53a8b5f5f -- May 27 19:32:04.830565 ip-10-0-139-51 systemd[1]: Starting Kubernetes Kubelet... May 27 19:32:05.334639 ip-10-0-139-51 kubenswrapper[2555]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 27 19:32:05.334639 ip-10-0-139-51 kubenswrapper[2555]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 27 19:32:05.334639 ip-10-0-139-51 kubenswrapper[2555]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 27 19:32:05.334639 ip-10-0-139-51 kubenswrapper[2555]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 27 19:32:05.334639 ip-10-0-139-51 kubenswrapper[2555]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 27 19:32:05.338134 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.337939 2555 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 27 19:32:05.340990 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.340972 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 19:32:05.340990 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.340990 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 19:32:05.341055 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.340994 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 19:32:05.341055 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.340998 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 19:32:05.341055 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341001 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 19:32:05.341055 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341004 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 19:32:05.341055 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341007 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 19:32:05.341055 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341010 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 19:32:05.341055 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341012 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 19:32:05.341055 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341015 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 19:32:05.341055 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341018 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 19:32:05.341055 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341020 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 19:32:05.341055 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341023 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 19:32:05.341055 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341025 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 19:32:05.341055 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341028 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 19:32:05.341055 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341031 2555 feature_gate.go:328] unrecognized feature gate: Example May 27 19:32:05.341055 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341033 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 19:32:05.341055 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341036 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 19:32:05.341055 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341039 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 19:32:05.341055 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341047 2555 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 19:32:05.341055 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341050 2555 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 19:32:05.341055 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341053 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 19:32:05.341556 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341055 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 19:32:05.341556 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341058 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 19:32:05.341556 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341061 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 19:32:05.341556 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341065 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 19:32:05.341556 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341069 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 19:32:05.341556 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341071 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 19:32:05.341556 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341074 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 19:32:05.341556 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341076 2555 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 19:32:05.341556 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341079 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 19:32:05.341556 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341082 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 19:32:05.341556 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341085 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 19:32:05.341556 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341087 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 19:32:05.341556 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341090 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 19:32:05.341556 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341092 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 19:32:05.341556 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341095 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 19:32:05.341556 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341098 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 19:32:05.341556 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341100 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 19:32:05.341556 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341102 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 19:32:05.341556 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341105 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 19:32:05.341556 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341110 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 19:32:05.342043 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341113 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 19:32:05.342043 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341116 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 19:32:05.342043 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341119 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 19:32:05.342043 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341122 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 19:32:05.342043 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341125 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 19:32:05.342043 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341128 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 19:32:05.342043 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341131 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 19:32:05.342043 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341133 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 19:32:05.342043 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341136 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 19:32:05.342043 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341139 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 19:32:05.342043 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341141 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 19:32:05.342043 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341144 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 19:32:05.342043 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341147 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 19:32:05.342043 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341151 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 19:32:05.342043 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341154 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 19:32:05.342043 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341157 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 19:32:05.342043 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341160 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 19:32:05.342043 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341162 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 19:32:05.342043 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341165 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 19:32:05.342043 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341168 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 19:32:05.342555 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341171 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 19:32:05.342555 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341174 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 19:32:05.342555 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341177 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 19:32:05.342555 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341180 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 19:32:05.342555 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341184 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 19:32:05.342555 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341187 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 19:32:05.342555 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341189 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 19:32:05.342555 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341192 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 19:32:05.342555 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341194 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 19:32:05.342555 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341197 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 19:32:05.342555 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341200 2555 feature_gate.go:328] unrecognized feature gate: Example2 May 27 19:32:05.342555 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341202 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 19:32:05.342555 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341205 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 19:32:05.342555 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341207 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 19:32:05.342555 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341210 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 19:32:05.342555 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341213 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 19:32:05.342555 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341217 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 19:32:05.342555 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341220 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 19:32:05.342555 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341223 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 19:32:05.343027 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341225 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 19:32:05.343027 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341228 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 19:32:05.343027 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341232 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 19:32:05.343027 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341235 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 19:32:05.343027 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341238 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 19:32:05.343027 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341682 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 19:32:05.343027 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341688 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 19:32:05.343027 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341692 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 19:32:05.343027 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341695 2555 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 19:32:05.343027 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341697 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 19:32:05.343027 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341700 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 19:32:05.343027 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341703 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 19:32:05.343027 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341706 2555 feature_gate.go:328] unrecognized feature gate: Example May 27 19:32:05.343027 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341708 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 19:32:05.343027 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341711 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 19:32:05.343027 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341714 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 19:32:05.343027 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341716 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 19:32:05.343027 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341720 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 19:32:05.343027 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341722 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 19:32:05.343027 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341725 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 19:32:05.343618 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341728 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 19:32:05.343618 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341731 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 19:32:05.343618 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341733 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 19:32:05.343618 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341736 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 19:32:05.343618 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341738 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 19:32:05.343618 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341741 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 19:32:05.343618 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341743 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 19:32:05.343618 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341745 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 19:32:05.343618 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341748 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 19:32:05.343618 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341750 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 19:32:05.343618 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341753 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 19:32:05.343618 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341755 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 19:32:05.343618 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341758 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 19:32:05.343618 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341760 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 19:32:05.343618 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341763 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 19:32:05.343618 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341766 2555 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 19:32:05.343618 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341768 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 19:32:05.343618 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341771 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 19:32:05.343618 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341774 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 19:32:05.343618 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341777 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 19:32:05.344116 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341780 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 19:32:05.344116 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341782 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 19:32:05.344116 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341785 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 19:32:05.344116 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341787 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 19:32:05.344116 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341790 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 19:32:05.344116 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341792 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 19:32:05.344116 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341795 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 19:32:05.344116 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341797 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 19:32:05.344116 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341799 2555 feature_gate.go:328] unrecognized feature gate: Example2 May 27 19:32:05.344116 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341811 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 19:32:05.344116 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341815 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 19:32:05.344116 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341817 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 19:32:05.344116 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341820 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 19:32:05.344116 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341823 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 19:32:05.344116 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341825 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 19:32:05.344116 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341828 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 19:32:05.344116 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341831 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 19:32:05.344116 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341833 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 19:32:05.344116 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341836 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 19:32:05.344116 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341838 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 19:32:05.344620 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341841 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 19:32:05.344620 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341843 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 19:32:05.344620 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341846 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 19:32:05.344620 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341848 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 19:32:05.344620 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341852 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 19:32:05.344620 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341854 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 19:32:05.344620 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341857 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 19:32:05.344620 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341860 2555 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 19:32:05.344620 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341863 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 19:32:05.344620 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341865 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 19:32:05.344620 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341868 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 19:32:05.344620 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341871 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 19:32:05.344620 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341875 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 19:32:05.344620 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341877 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 19:32:05.344620 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341880 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 19:32:05.344620 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341882 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 19:32:05.344620 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341885 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 19:32:05.344620 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341887 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 19:32:05.344620 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341890 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 19:32:05.345083 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341893 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 19:32:05.345083 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341895 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 19:32:05.345083 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341898 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 19:32:05.345083 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341902 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 19:32:05.345083 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341905 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 19:32:05.345083 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341908 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 19:32:05.345083 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341911 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 19:32:05.345083 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341913 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 19:32:05.345083 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341917 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 19:32:05.345083 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341920 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 19:32:05.345083 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341924 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 19:32:05.345083 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.341927 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 19:32:05.345083 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342619 2555 flags.go:64] FLAG: --address="0.0.0.0" May 27 19:32:05.345083 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342629 2555 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 27 19:32:05.345083 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342636 2555 flags.go:64] FLAG: --anonymous-auth="true" May 27 19:32:05.345083 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342640 2555 flags.go:64] FLAG: --application-metrics-count-limit="100" May 27 19:32:05.345083 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342645 2555 flags.go:64] FLAG: --authentication-token-webhook="false" May 27 19:32:05.345083 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342650 2555 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 27 19:32:05.345083 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342654 2555 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 27 19:32:05.345083 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342662 2555 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 27 19:32:05.345616 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342666 2555 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 27 19:32:05.345616 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342669 2555 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 27 19:32:05.345616 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342673 2555 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 27 19:32:05.345616 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342676 2555 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 27 19:32:05.345616 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342679 2555 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 27 19:32:05.345616 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342682 2555 flags.go:64] FLAG: --cgroup-root="" May 27 19:32:05.345616 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342685 2555 flags.go:64] FLAG: --cgroups-per-qos="true" May 27 19:32:05.345616 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342689 2555 flags.go:64] FLAG: --client-ca-file="" May 27 19:32:05.345616 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342691 2555 flags.go:64] FLAG: --cloud-config="" May 27 19:32:05.345616 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342694 2555 flags.go:64] FLAG: --cloud-provider="external" May 27 19:32:05.345616 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342697 2555 flags.go:64] FLAG: --cluster-dns="[]" May 27 19:32:05.345616 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342703 2555 flags.go:64] FLAG: --cluster-domain="" May 27 19:32:05.345616 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342707 2555 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 27 19:32:05.345616 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342710 2555 flags.go:64] FLAG: --config-dir="" May 27 19:32:05.345616 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342713 2555 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 27 19:32:05.345616 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342717 2555 flags.go:64] FLAG: --container-log-max-files="5" May 27 19:32:05.345616 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342721 2555 flags.go:64] FLAG: --container-log-max-size="10Mi" May 27 19:32:05.345616 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342724 2555 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 27 19:32:05.345616 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342728 2555 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 27 19:32:05.345616 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342732 2555 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 27 19:32:05.345616 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342735 2555 flags.go:64] FLAG: --contention-profiling="false" May 27 19:32:05.345616 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342738 2555 flags.go:64] FLAG: --cpu-cfs-quota="true" May 27 19:32:05.345616 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342741 2555 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 27 19:32:05.345616 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342744 2555 flags.go:64] FLAG: --cpu-manager-policy="none" May 27 19:32:05.345616 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342747 2555 flags.go:64] FLAG: --cpu-manager-policy-options="" May 27 19:32:05.346221 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342751 2555 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 27 19:32:05.346221 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342754 2555 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 27 19:32:05.346221 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342757 2555 flags.go:64] FLAG: --enable-debugging-handlers="true" May 27 19:32:05.346221 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342760 2555 flags.go:64] FLAG: --enable-load-reader="false" May 27 19:32:05.346221 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342763 2555 flags.go:64] FLAG: --enable-server="true" May 27 19:32:05.346221 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342766 2555 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 27 19:32:05.346221 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342774 2555 flags.go:64] FLAG: --event-burst="100" May 27 19:32:05.346221 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342777 2555 flags.go:64] FLAG: --event-qps="50" May 27 19:32:05.346221 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342780 2555 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 27 19:32:05.346221 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342784 2555 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 27 19:32:05.346221 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342787 2555 flags.go:64] FLAG: --eviction-hard="" May 27 19:32:05.346221 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342790 2555 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 27 19:32:05.346221 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342793 2555 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 27 19:32:05.346221 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342797 2555 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 27 19:32:05.346221 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342800 2555 flags.go:64] FLAG: --eviction-soft="" May 27 19:32:05.346221 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342803 2555 flags.go:64] FLAG: --eviction-soft-grace-period="" May 27 19:32:05.346221 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342806 2555 flags.go:64] FLAG: --exit-on-lock-contention="false" May 27 19:32:05.346221 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342809 2555 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 27 19:32:05.346221 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342813 2555 flags.go:64] FLAG: --experimental-mounter-path="" May 27 19:32:05.346221 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342816 2555 flags.go:64] FLAG: --fail-cgroupv1="false" May 27 19:32:05.346221 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342819 2555 flags.go:64] FLAG: --fail-swap-on="true" May 27 19:32:05.346221 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342822 2555 flags.go:64] FLAG: --feature-gates="" May 27 19:32:05.346221 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342826 2555 flags.go:64] FLAG: --file-check-frequency="20s" May 27 19:32:05.346221 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342830 2555 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 27 19:32:05.346221 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342833 2555 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 27 19:32:05.346894 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342837 2555 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 27 19:32:05.346894 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342840 2555 flags.go:64] FLAG: --healthz-port="10248" May 27 19:32:05.346894 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342843 2555 flags.go:64] FLAG: --help="false" May 27 19:32:05.346894 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342846 2555 flags.go:64] FLAG: --hostname-override="ip-10-0-139-51.ec2.internal" May 27 19:32:05.346894 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342849 2555 flags.go:64] FLAG: --housekeeping-interval="10s" May 27 19:32:05.346894 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342852 2555 flags.go:64] FLAG: --http-check-frequency="20s" May 27 19:32:05.346894 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342855 2555 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 27 19:32:05.346894 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342859 2555 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 27 19:32:05.346894 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342862 2555 flags.go:64] FLAG: --image-gc-high-threshold="85" May 27 19:32:05.346894 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342865 2555 flags.go:64] FLAG: --image-gc-low-threshold="80" May 27 19:32:05.346894 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342868 2555 flags.go:64] FLAG: --image-service-endpoint="" May 27 19:32:05.346894 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342870 2555 flags.go:64] FLAG: --kernel-memcg-notification="false" May 27 19:32:05.346894 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342873 2555 flags.go:64] FLAG: --kube-api-burst="100" May 27 19:32:05.346894 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342877 2555 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 27 19:32:05.346894 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342881 2555 flags.go:64] FLAG: --kube-api-qps="50" May 27 19:32:05.346894 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342883 2555 flags.go:64] FLAG: --kube-reserved="" May 27 19:32:05.346894 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342887 2555 flags.go:64] FLAG: --kube-reserved-cgroup="" May 27 19:32:05.346894 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342890 2555 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 27 19:32:05.346894 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342893 2555 flags.go:64] FLAG: --kubelet-cgroups="" May 27 19:32:05.346894 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342895 2555 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 27 19:32:05.346894 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342898 2555 flags.go:64] FLAG: --lock-file="" May 27 19:32:05.346894 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342901 2555 flags.go:64] FLAG: --log-cadvisor-usage="false" May 27 19:32:05.346894 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342904 2555 flags.go:64] FLAG: --log-flush-frequency="5s" May 27 19:32:05.346894 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342907 2555 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 27 19:32:05.347496 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342913 2555 flags.go:64] FLAG: --log-json-split-stream="false" May 27 19:32:05.347496 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342916 2555 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 27 19:32:05.347496 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342919 2555 flags.go:64] FLAG: --log-text-split-stream="false" May 27 19:32:05.347496 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342922 2555 flags.go:64] FLAG: --logging-format="text" May 27 19:32:05.347496 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342925 2555 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 27 19:32:05.347496 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342928 2555 flags.go:64] FLAG: --make-iptables-util-chains="true" May 27 19:32:05.347496 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342931 2555 flags.go:64] FLAG: --manifest-url="" May 27 19:32:05.347496 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342934 2555 flags.go:64] FLAG: --manifest-url-header="" May 27 19:32:05.347496 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342939 2555 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 27 19:32:05.347496 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342943 2555 flags.go:64] FLAG: --max-open-files="1000000" May 27 19:32:05.347496 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342947 2555 flags.go:64] FLAG: --max-pods="110" May 27 19:32:05.347496 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342951 2555 flags.go:64] FLAG: --maximum-dead-containers="-1" May 27 19:32:05.347496 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342954 2555 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 27 19:32:05.347496 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342956 2555 flags.go:64] FLAG: --memory-manager-policy="None" May 27 19:32:05.347496 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342959 2555 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 27 19:32:05.347496 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342962 2555 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 27 19:32:05.347496 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342965 2555 flags.go:64] FLAG: --node-ip="0.0.0.0" May 27 19:32:05.347496 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342969 2555 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 27 19:32:05.347496 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342976 2555 flags.go:64] FLAG: --node-status-max-images="50" May 27 19:32:05.347496 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342979 2555 flags.go:64] FLAG: --node-status-update-frequency="10s" May 27 19:32:05.347496 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342982 2555 flags.go:64] FLAG: --oom-score-adj="-999" May 27 19:32:05.347496 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342987 2555 flags.go:64] FLAG: --pod-cidr="" May 27 19:32:05.347496 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342990 2555 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 27 19:32:05.348062 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.342997 2555 flags.go:64] FLAG: --pod-manifest-path="" May 27 19:32:05.348062 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.343000 2555 flags.go:64] FLAG: --pod-max-pids="-1" May 27 19:32:05.348062 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.343003 2555 flags.go:64] FLAG: --pods-per-core="0" May 27 19:32:05.348062 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.343006 2555 flags.go:64] FLAG: --port="10250" May 27 19:32:05.348062 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.343009 2555 flags.go:64] FLAG: --protect-kernel-defaults="false" May 27 19:32:05.348062 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.343012 2555 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-093270dd0bc914a8c" May 27 19:32:05.348062 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.343016 2555 flags.go:64] FLAG: --qos-reserved="" May 27 19:32:05.348062 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.343019 2555 flags.go:64] FLAG: --read-only-port="10255" May 27 19:32:05.348062 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.343022 2555 flags.go:64] FLAG: --register-node="true" May 27 19:32:05.348062 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.343026 2555 flags.go:64] FLAG: --register-schedulable="true" May 27 19:32:05.348062 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.343030 2555 flags.go:64] FLAG: --register-with-taints="" May 27 19:32:05.348062 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.343034 2555 flags.go:64] FLAG: --registry-burst="10" May 27 19:32:05.348062 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.343038 2555 flags.go:64] FLAG: --registry-qps="5" May 27 19:32:05.348062 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.343041 2555 flags.go:64] FLAG: --reserved-cpus="" May 27 19:32:05.348062 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.343044 2555 flags.go:64] FLAG: --reserved-memory="" May 27 19:32:05.348062 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.343048 2555 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 27 19:32:05.348062 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.343051 2555 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 27 19:32:05.348062 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.343054 2555 flags.go:64] FLAG: --rotate-certificates="false" May 27 19:32:05.348062 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.343058 2555 flags.go:64] FLAG: --rotate-server-certificates="false" May 27 19:32:05.348062 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.343062 2555 flags.go:64] FLAG: --runonce="false" May 27 19:32:05.348062 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.343065 2555 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 27 19:32:05.348062 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.343068 2555 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 27 19:32:05.348062 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.343071 2555 flags.go:64] FLAG: --seccomp-default="false" May 27 19:32:05.348062 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.343074 2555 flags.go:64] FLAG: --serialize-image-pulls="true" May 27 19:32:05.348062 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.343077 2555 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 27 19:32:05.348062 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.343080 2555 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 27 19:32:05.348731 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.343083 2555 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 27 19:32:05.348731 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.343086 2555 flags.go:64] FLAG: --storage-driver-password="root" May 27 19:32:05.348731 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.343089 2555 flags.go:64] FLAG: --storage-driver-secure="false" May 27 19:32:05.348731 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.343092 2555 flags.go:64] FLAG: --storage-driver-table="stats" May 27 19:32:05.348731 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.343095 2555 flags.go:64] FLAG: --storage-driver-user="root" May 27 19:32:05.348731 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.343098 2555 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 27 19:32:05.348731 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.343101 2555 flags.go:64] FLAG: --sync-frequency="1m0s" May 27 19:32:05.348731 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.343105 2555 flags.go:64] FLAG: --system-cgroups="" May 27 19:32:05.348731 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.343108 2555 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 27 19:32:05.348731 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.343114 2555 flags.go:64] FLAG: --system-reserved-cgroup="" May 27 19:32:05.348731 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.343117 2555 flags.go:64] FLAG: --tls-cert-file="" May 27 19:32:05.348731 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.343120 2555 flags.go:64] FLAG: --tls-cipher-suites="[]" May 27 19:32:05.348731 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.343124 2555 flags.go:64] FLAG: --tls-min-version="" May 27 19:32:05.348731 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.343127 2555 flags.go:64] FLAG: --tls-private-key-file="" May 27 19:32:05.348731 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.343130 2555 flags.go:64] FLAG: --topology-manager-policy="none" May 27 19:32:05.348731 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.343133 2555 flags.go:64] FLAG: --topology-manager-policy-options="" May 27 19:32:05.348731 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.343136 2555 flags.go:64] FLAG: --topology-manager-scope="container" May 27 19:32:05.348731 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.343139 2555 flags.go:64] FLAG: --v="2" May 27 19:32:05.348731 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.343143 2555 flags.go:64] FLAG: --version="false" May 27 19:32:05.348731 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.343148 2555 flags.go:64] FLAG: --vmodule="" May 27 19:32:05.348731 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.343152 2555 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 27 19:32:05.348731 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.343155 2555 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 27 19:32:05.348731 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343255 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 19:32:05.348731 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343258 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 19:32:05.349356 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343262 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 19:32:05.349356 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343276 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 19:32:05.349356 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343280 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 19:32:05.349356 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343283 2555 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 19:32:05.349356 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343286 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 19:32:05.349356 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343288 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 19:32:05.349356 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343291 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 19:32:05.349356 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343294 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 19:32:05.349356 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343296 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 19:32:05.349356 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343299 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 19:32:05.349356 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343301 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 19:32:05.349356 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343304 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 19:32:05.349356 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343306 2555 feature_gate.go:328] unrecognized feature gate: Example May 27 19:32:05.349356 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343309 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 19:32:05.349356 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343312 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 19:32:05.349356 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343315 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 19:32:05.349356 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343317 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 19:32:05.349356 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343320 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 19:32:05.349356 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343323 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 19:32:05.349356 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343325 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 19:32:05.349872 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343328 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 19:32:05.349872 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343331 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 19:32:05.349872 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343334 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 19:32:05.349872 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343336 2555 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 19:32:05.349872 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343339 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 19:32:05.349872 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343343 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 19:32:05.349872 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343347 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 19:32:05.349872 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343350 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 19:32:05.349872 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343353 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 19:32:05.349872 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343356 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 19:32:05.349872 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343360 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 19:32:05.349872 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343364 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 19:32:05.349872 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343367 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 19:32:05.349872 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343369 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 19:32:05.349872 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343372 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 19:32:05.349872 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343376 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 19:32:05.349872 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343378 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 19:32:05.349872 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343381 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 19:32:05.349872 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343383 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 19:32:05.350361 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343386 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 19:32:05.350361 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343388 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 19:32:05.350361 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343391 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 19:32:05.350361 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343393 2555 feature_gate.go:328] unrecognized feature gate: Example2 May 27 19:32:05.350361 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343396 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 19:32:05.350361 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343399 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 19:32:05.350361 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343402 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 19:32:05.350361 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343405 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 19:32:05.350361 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343407 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 19:32:05.350361 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343410 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 19:32:05.350361 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343413 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 19:32:05.350361 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343415 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 19:32:05.350361 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343418 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 19:32:05.350361 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343421 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 19:32:05.350361 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343424 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 19:32:05.350361 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343427 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 19:32:05.350361 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343430 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 19:32:05.350361 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343433 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 19:32:05.350361 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343436 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 19:32:05.350361 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343438 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 19:32:05.350859 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343441 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 19:32:05.350859 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343443 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 19:32:05.350859 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343446 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 19:32:05.350859 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343449 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 19:32:05.350859 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343452 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 19:32:05.350859 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343454 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 19:32:05.350859 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343457 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 19:32:05.350859 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343459 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 19:32:05.350859 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343462 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 19:32:05.350859 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343465 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 19:32:05.350859 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343467 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 19:32:05.350859 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343470 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 19:32:05.350859 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343472 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 19:32:05.350859 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343475 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 19:32:05.350859 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343478 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 19:32:05.350859 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343480 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 19:32:05.350859 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343483 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 19:32:05.350859 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343486 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 19:32:05.350859 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343488 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 19:32:05.350859 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343491 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 19:32:05.351373 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343494 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 19:32:05.351373 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343496 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 19:32:05.351373 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343499 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 19:32:05.351373 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343502 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 19:32:05.351373 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.343504 2555 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 19:32:05.351373 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.343510 2555 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 27 19:32:05.352610 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.352586 2555 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 27 19:32:05.352647 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.352611 2555 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 27 19:32:05.352679 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352665 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 19:32:05.352679 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352671 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 19:32:05.352679 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352675 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 19:32:05.352679 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352678 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 19:32:05.352679 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352681 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 19:32:05.352838 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352684 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 19:32:05.352838 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352687 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 19:32:05.352838 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352689 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 19:32:05.352838 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352692 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 19:32:05.352838 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352695 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 19:32:05.352838 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352698 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 19:32:05.352838 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352701 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 19:32:05.352838 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352704 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 19:32:05.352838 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352706 2555 feature_gate.go:328] unrecognized feature gate: Example May 27 19:32:05.352838 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352709 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 19:32:05.352838 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352712 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 19:32:05.352838 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352714 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 19:32:05.352838 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352717 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 19:32:05.352838 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352719 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 19:32:05.352838 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352723 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 19:32:05.352838 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352729 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 19:32:05.352838 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352731 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 19:32:05.352838 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352734 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 19:32:05.352838 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352737 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 19:32:05.353331 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352740 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 19:32:05.353331 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352743 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 19:32:05.353331 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352746 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 19:32:05.353331 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352749 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 19:32:05.353331 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352752 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 19:32:05.353331 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352755 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 19:32:05.353331 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352758 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 19:32:05.353331 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352762 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 19:32:05.353331 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352765 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 19:32:05.353331 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352768 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 19:32:05.353331 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352771 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 19:32:05.353331 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352773 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 19:32:05.353331 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352776 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 19:32:05.353331 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352778 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 19:32:05.353331 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352782 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 19:32:05.353331 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352786 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 19:32:05.353331 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352788 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 19:32:05.353331 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352791 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 19:32:05.353331 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352794 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 19:32:05.353331 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352797 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 19:32:05.353832 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352799 2555 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 19:32:05.353832 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352801 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 19:32:05.353832 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352804 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 19:32:05.353832 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352808 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 19:32:05.353832 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352811 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 19:32:05.353832 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352814 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 19:32:05.353832 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352817 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 19:32:05.353832 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352819 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 19:32:05.353832 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352822 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 19:32:05.353832 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352825 2555 feature_gate.go:328] unrecognized feature gate: Example2 May 27 19:32:05.353832 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352827 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 19:32:05.353832 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352830 2555 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 19:32:05.353832 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352833 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 19:32:05.353832 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352835 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 19:32:05.353832 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352838 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 19:32:05.353832 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352841 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 19:32:05.353832 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352843 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 19:32:05.353832 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352846 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 19:32:05.353832 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352850 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 19:32:05.353832 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352852 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 19:32:05.354343 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352856 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 19:32:05.354343 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352858 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 19:32:05.354343 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352861 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 19:32:05.354343 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352863 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 19:32:05.354343 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352866 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 19:32:05.354343 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352868 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 19:32:05.354343 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352872 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 19:32:05.354343 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352875 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 19:32:05.354343 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352877 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 19:32:05.354343 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352881 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 19:32:05.354343 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352883 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 19:32:05.354343 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352886 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 19:32:05.354343 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352889 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 19:32:05.354343 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352891 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 19:32:05.354343 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352894 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 19:32:05.354343 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352896 2555 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 19:32:05.354343 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352899 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 19:32:05.354343 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352902 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 19:32:05.354343 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352904 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 19:32:05.354343 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352907 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 19:32:05.354821 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352910 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 19:32:05.354821 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.352912 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 19:32:05.354821 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.352918 2555 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 27 19:32:05.354821 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353026 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 19:32:05.354821 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353031 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 19:32:05.354821 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353034 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 19:32:05.354821 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353037 2555 feature_gate.go:328] unrecognized feature gate: Example2 May 27 19:32:05.354821 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353040 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 19:32:05.354821 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353044 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 19:32:05.354821 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353049 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 19:32:05.354821 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353052 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 19:32:05.354821 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353054 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 19:32:05.354821 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353057 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 19:32:05.354821 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353060 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 19:32:05.354821 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353063 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 19:32:05.355199 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353066 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 19:32:05.355199 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353068 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 19:32:05.355199 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353071 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 19:32:05.355199 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353074 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 19:32:05.355199 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353078 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 19:32:05.355199 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353081 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 19:32:05.355199 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353084 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 19:32:05.355199 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353086 2555 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 19:32:05.355199 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353089 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 19:32:05.355199 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353092 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 19:32:05.355199 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353095 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 19:32:05.355199 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353097 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 19:32:05.355199 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353100 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 19:32:05.355199 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353103 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 19:32:05.355199 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353106 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 19:32:05.355199 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353109 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 19:32:05.355199 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353112 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 19:32:05.355199 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353114 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 19:32:05.355199 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353118 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 19:32:05.355199 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353120 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 19:32:05.355711 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353124 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 19:32:05.355711 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353126 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 19:32:05.355711 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353129 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 19:32:05.355711 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353131 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 19:32:05.355711 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353134 2555 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 19:32:05.355711 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353137 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 19:32:05.355711 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353139 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 19:32:05.355711 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353142 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 19:32:05.355711 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353144 2555 feature_gate.go:328] unrecognized feature gate: Example May 27 19:32:05.355711 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353147 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 19:32:05.355711 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353149 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 19:32:05.355711 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353152 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 19:32:05.355711 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353155 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 19:32:05.355711 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353158 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 19:32:05.355711 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353162 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 19:32:05.355711 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353165 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 19:32:05.355711 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353169 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 19:32:05.355711 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353172 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 19:32:05.355711 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353175 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 19:32:05.355711 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353178 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 19:32:05.356557 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353180 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 19:32:05.356557 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353183 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 19:32:05.356557 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353185 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 19:32:05.356557 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353188 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 19:32:05.356557 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353191 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 19:32:05.356557 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353193 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 19:32:05.356557 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353196 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 19:32:05.356557 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353199 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 19:32:05.356557 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353201 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 19:32:05.356557 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353204 2555 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 19:32:05.356557 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353206 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 19:32:05.356557 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353209 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 19:32:05.356557 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353211 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 19:32:05.356557 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353214 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 19:32:05.356557 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353216 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 19:32:05.356557 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353219 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 19:32:05.356557 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353221 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 19:32:05.356557 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353224 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 19:32:05.356557 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353227 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 19:32:05.356557 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353229 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 19:32:05.357249 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353231 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 19:32:05.357249 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353234 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 19:32:05.357249 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353236 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 19:32:05.357249 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353239 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 19:32:05.357249 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353242 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 19:32:05.357249 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353244 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 19:32:05.357249 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353247 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 19:32:05.357249 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353250 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 19:32:05.357249 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353253 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 19:32:05.357249 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353255 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 19:32:05.357249 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353258 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 19:32:05.357249 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353260 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 19:32:05.357249 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353278 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 19:32:05.357249 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:05.353283 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 19:32:05.357249 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.353288 2555 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 27 19:32:05.357668 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.354573 2555 server.go:962] "Client rotation is on, will bootstrap in background" May 27 19:32:05.359377 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.359358 2555 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 27 19:32:05.360421 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.360409 2555 server.go:1019] "Starting client certificate rotation" May 27 19:32:05.360524 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.360505 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 27 19:32:05.360556 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.360548 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 27 19:32:05.389563 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.389536 2555 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 27 19:32:05.393579 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.393559 2555 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 27 19:32:05.410555 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.410525 2555 log.go:25] "Validated CRI v1 runtime API" May 27 19:32:05.417225 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.417200 2555 log.go:25] "Validated CRI v1 image API" May 27 19:32:05.419126 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.419108 2555 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 27 19:32:05.423235 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.423213 2555 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 27 19:32:05.424226 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.424195 2555 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a6e40033-6615-44e3-8642-7141b4c3724c:/dev/nvme0n1p4 e2da531f-7595-4908-b6de-fc5902440203:/dev/nvme0n1p3] May 27 19:32:05.424331 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.424222 2555 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 27 19:32:05.430081 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.429872 2555 manager.go:217] Machine: {Timestamp:2026-05-27 19:32:05.428961108 +0000 UTC m=+0.465587797 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3095122 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b1be765f95270353eb3b5428c5e2b SystemUUID:ec2b1be7-65f9-5270-353e-b3b5428c5e2b BootID:8c3b3f17-d162-4661-ac1e-c6f53a8b5f5f Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c4:b0:27:d3:5f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c4:b0:27:d3:5f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9a:d4:55:b8:7d:8a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 27 19:32:05.430943 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.430912 2555 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 27 19:32:05.431193 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.431174 2555 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 27 19:32:05.435090 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.435056 2555 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 27 19:32:05.435242 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.435093 2555 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-51.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 27 19:32:05.435313 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.435251 2555 topology_manager.go:138] "Creating topology manager with none policy" May 27 19:32:05.435313 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.435259 2555 container_manager_linux.go:306] "Creating device plugin manager" May 27 19:32:05.435313 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.435281 2555 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 27 19:32:05.435804 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.435792 2555 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 27 19:32:05.437496 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.437481 2555 state_mem.go:36] "Initialized new in-memory state store" May 27 19:32:05.437618 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.437609 2555 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 27 19:32:05.440354 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.440341 2555 kubelet.go:491] "Attempting to sync node with API server" May 27 19:32:05.440402 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.440358 2555 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 27 19:32:05.440402 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.440372 2555 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 27 19:32:05.440402 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.440383 2555 kubelet.go:397] "Adding apiserver pod source" May 27 19:32:05.440402 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.440392 2555 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 27 19:32:05.441663 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.441649 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 27 19:32:05.441712 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.441670 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 27 19:32:05.444923 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.444895 2555 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 27 19:32:05.446883 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.446869 2555 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 27 19:32:05.447757 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.447746 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 27 19:32:05.447797 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.447762 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 27 19:32:05.447797 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.447774 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 27 19:32:05.447797 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.447780 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 27 19:32:05.447797 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.447788 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 27 19:32:05.447797 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.447795 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 27 19:32:05.447926 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.447802 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 27 19:32:05.447926 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.447811 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 27 19:32:05.447926 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.447821 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 27 19:32:05.447926 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.447830 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 27 19:32:05.447926 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.447840 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 27 19:32:05.448523 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.448513 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 27 19:32:05.449825 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.449797 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 27 19:32:05.449825 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.449819 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 27 19:32:05.452187 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:05.452164 2555 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-51.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 27 19:32:05.452279 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:05.452163 2555 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 27 19:32:05.453167 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.453153 2555 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 27 19:32:05.453223 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.453192 2555 server.go:1295] "Started kubelet" May 27 19:32:05.453333 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.453287 2555 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 27 19:32:05.453394 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.453299 2555 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 27 19:32:05.453447 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.453373 2555 server_v1.go:47] "podresources" method="list" useActivePods=true May 27 19:32:05.453958 ip-10-0-139-51 systemd[1]: Started Kubernetes Kubelet. May 27 19:32:05.454621 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.454606 2555 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 27 19:32:05.456629 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.456614 2555 server.go:317] "Adding debug handlers to kubelet server" May 27 19:32:05.462648 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.462620 2555 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-51.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 27 19:32:05.462943 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.462927 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 27 19:32:05.463429 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:05.463361 2555 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 27 19:32:05.463897 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:05.462723 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-51.ec2.internal.18b38302b8af98c3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-51.ec2.internal,UID:ip-10-0-139-51.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-51.ec2.internal,},FirstTimestamp:2026-05-27 19:32:05.453166787 +0000 UTC m=+0.489793465,LastTimestamp:2026-05-27 19:32:05.453166787 +0000 UTC m=+0.489793465,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-51.ec2.internal,}" May 27 19:32:05.464159 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.464143 2555 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 27 19:32:05.464246 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.464231 2555 volume_manager.go:295] "The desired_state_of_world populator starts" May 27 19:32:05.464309 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.464247 2555 volume_manager.go:297] "Starting Kubelet Volume Manager" May 27 19:32:05.464405 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.464389 2555 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 27 19:32:05.464487 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.464438 2555 reconstruct.go:97] "Volume reconstruction finished" May 27 19:32:05.464487 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.464449 2555 reconciler.go:26] "Reconciler: start to sync state" May 27 19:32:05.465004 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.464985 2555 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 27 19:32:05.465004 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.465004 2555 factory.go:55] Registering systemd factory May 27 19:32:05.465164 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.465013 2555 factory.go:223] Registration of the systemd container factory successfully May 27 19:32:05.465243 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:05.465208 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-51.ec2.internal\" not found" May 27 19:32:05.465243 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.465238 2555 factory.go:153] Registering CRI-O factory May 27 19:32:05.465243 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.465253 2555 factory.go:223] Registration of the crio container factory successfully May 27 19:32:05.465425 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.465286 2555 factory.go:103] Registering Raw factory May 27 19:32:05.465425 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.465302 2555 manager.go:1196] Started watching for new ooms in manager May 27 19:32:05.465783 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.465769 2555 manager.go:319] Starting recovery of all containers May 27 19:32:05.466072 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:05.466047 2555 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-51.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" May 27 19:32:05.466262 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:05.466235 2555 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 27 19:32:05.472709 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.472683 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5d9sw" May 27 19:32:05.473846 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.473792 2555 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 27 19:32:05.477506 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.477489 2555 manager.go:324] Recovery completed May 27 19:32:05.480978 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.480962 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5d9sw" May 27 19:32:05.481836 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.481823 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 19:32:05.487175 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.487159 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-51.ec2.internal" event="NodeHasSufficientMemory" May 27 19:32:05.487263 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.487193 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-51.ec2.internal" event="NodeHasNoDiskPressure" May 27 19:32:05.487263 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.487207 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-51.ec2.internal" event="NodeHasSufficientPID" May 27 19:32:05.487810 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.487798 2555 cpu_manager.go:222] "Starting CPU manager" policy="none" May 27 19:32:05.487810 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.487809 2555 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 27 19:32:05.487923 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.487833 2555 state_mem.go:36] "Initialized new in-memory state store" May 27 19:32:05.491168 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.491156 2555 policy_none.go:49] "None policy: Start" May 27 19:32:05.491233 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.491173 2555 memory_manager.go:186] "Starting memorymanager" policy="None" May 27 19:32:05.491233 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.491183 2555 state_mem.go:35] "Initializing new in-memory state store" May 27 19:32:05.546949 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.546818 2555 manager.go:341] "Starting Device Plugin manager" May 27 19:32:05.557348 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:05.546966 2555 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 27 19:32:05.557348 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.546977 2555 server.go:85] "Starting device plugin registration server" May 27 19:32:05.557348 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.547168 2555 eviction_manager.go:189] "Eviction manager: starting control loop" May 27 19:32:05.557348 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.547178 2555 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 27 19:32:05.557348 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.547336 2555 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 27 19:32:05.557348 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.547639 2555 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 27 19:32:05.557348 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.547656 2555 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 27 19:32:05.557348 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:05.547918 2555 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 27 19:32:05.557348 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:05.547959 2555 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-51.ec2.internal\" not found" May 27 19:32:05.572308 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.572287 2555 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 27 19:32:05.572390 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.572314 2555 status_manager.go:230] "Starting to sync pod status with apiserver" May 27 19:32:05.572390 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.572331 2555 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 27 19:32:05.572390 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.572338 2555 kubelet.go:2451] "Starting kubelet main sync loop" May 27 19:32:05.572390 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:05.572372 2555 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 27 19:32:05.575033 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.575017 2555 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 27 19:32:05.648086 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.647983 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 19:32:05.649101 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.649087 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-51.ec2.internal" event="NodeHasSufficientMemory" May 27 19:32:05.649165 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.649117 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-51.ec2.internal" event="NodeHasNoDiskPressure" May 27 19:32:05.649165 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.649144 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-51.ec2.internal" event="NodeHasSufficientPID" May 27 19:32:05.649230 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.649168 2555 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-51.ec2.internal" May 27 19:32:05.661116 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.661094 2555 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-51.ec2.internal" May 27 19:32:05.661205 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:05.661119 2555 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-51.ec2.internal\": node \"ip-10-0-139-51.ec2.internal\" not found" May 27 19:32:05.672631 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.672603 2555 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-51.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-51.ec2.internal"] May 27 19:32:05.672724 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.672666 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 19:32:05.673467 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.673452 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-51.ec2.internal" event="NodeHasSufficientMemory" May 27 19:32:05.673537 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.673480 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-51.ec2.internal" event="NodeHasNoDiskPressure" May 27 19:32:05.673537 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.673496 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-51.ec2.internal" event="NodeHasSufficientPID" May 27 19:32:05.674615 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.674603 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 19:32:05.674750 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.674736 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-51.ec2.internal" May 27 19:32:05.674788 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.674769 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 19:32:05.675486 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.675471 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-51.ec2.internal" event="NodeHasSufficientMemory" May 27 19:32:05.675486 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.675482 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-51.ec2.internal" event="NodeHasSufficientMemory" May 27 19:32:05.675595 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.675501 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-51.ec2.internal" event="NodeHasNoDiskPressure" May 27 19:32:05.675595 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.675504 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-51.ec2.internal" event="NodeHasNoDiskPressure" May 27 19:32:05.675595 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.675513 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-51.ec2.internal" event="NodeHasSufficientPID" May 27 19:32:05.675595 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.675516 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-51.ec2.internal" event="NodeHasSufficientPID" May 27 19:32:05.676582 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.676569 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-51.ec2.internal" May 27 19:32:05.676634 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.676592 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 19:32:05.677297 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.677282 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-51.ec2.internal" event="NodeHasSufficientMemory" May 27 19:32:05.677356 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.677307 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-51.ec2.internal" event="NodeHasNoDiskPressure" May 27 19:32:05.677356 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.677316 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-51.ec2.internal" event="NodeHasSufficientPID" May 27 19:32:05.686663 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:05.686647 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-51.ec2.internal\" not found" May 27 19:32:05.704853 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:05.704829 2555 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-51.ec2.internal\" not found" node="ip-10-0-139-51.ec2.internal" May 27 19:32:05.709224 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:05.709208 2555 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-51.ec2.internal\" not found" node="ip-10-0-139-51.ec2.internal" May 27 19:32:05.765631 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.765600 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/474a050b831840f986e5ea7c3b5dfc5b-config\") pod \"kube-apiserver-proxy-ip-10-0-139-51.ec2.internal\" (UID: \"474a050b831840f986e5ea7c3b5dfc5b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-51.ec2.internal" May 27 19:32:05.765631 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.765632 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d9ce5379620ec9459777df2f25374e23-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-51.ec2.internal\" (UID: \"d9ce5379620ec9459777df2f25374e23\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-51.ec2.internal" May 27 19:32:05.765838 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.765660 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d9ce5379620ec9459777df2f25374e23-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-51.ec2.internal\" (UID: \"d9ce5379620ec9459777df2f25374e23\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-51.ec2.internal" May 27 19:32:05.786930 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:05.786907 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-51.ec2.internal\" not found" May 27 19:32:05.865879 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.865838 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d9ce5379620ec9459777df2f25374e23-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-51.ec2.internal\" (UID: \"d9ce5379620ec9459777df2f25374e23\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-51.ec2.internal" May 27 19:32:05.866023 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.865891 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d9ce5379620ec9459777df2f25374e23-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-51.ec2.internal\" (UID: \"d9ce5379620ec9459777df2f25374e23\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-51.ec2.internal" May 27 19:32:05.866023 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.865917 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/474a050b831840f986e5ea7c3b5dfc5b-config\") pod \"kube-apiserver-proxy-ip-10-0-139-51.ec2.internal\" (UID: \"474a050b831840f986e5ea7c3b5dfc5b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-51.ec2.internal" May 27 19:32:05.866023 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.865935 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d9ce5379620ec9459777df2f25374e23-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-51.ec2.internal\" (UID: \"d9ce5379620ec9459777df2f25374e23\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-51.ec2.internal" May 27 19:32:05.866023 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.865947 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/474a050b831840f986e5ea7c3b5dfc5b-config\") pod \"kube-apiserver-proxy-ip-10-0-139-51.ec2.internal\" (UID: \"474a050b831840f986e5ea7c3b5dfc5b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-51.ec2.internal" May 27 19:32:05.866023 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:05.865973 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d9ce5379620ec9459777df2f25374e23-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-51.ec2.internal\" (UID: \"d9ce5379620ec9459777df2f25374e23\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-51.ec2.internal" May 27 19:32:05.887952 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:05.887930 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-51.ec2.internal\" not found" May 27 19:32:05.988557 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:05.988506 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-51.ec2.internal\" not found" May 27 19:32:06.007673 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:06.007656 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-51.ec2.internal" May 27 19:32:06.012408 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:06.012391 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-51.ec2.internal" May 27 19:32:06.089243 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:06.089208 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-51.ec2.internal\" not found" May 27 19:32:06.189701 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:06.189672 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-51.ec2.internal\" not found" May 27 19:32:06.290188 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:06.290115 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-51.ec2.internal\" not found" May 27 19:32:06.360332 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:06.360302 2555 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 27 19:32:06.360757 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:06.360481 2555 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 27 19:32:06.390311 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:06.390291 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-51.ec2.internal\" not found" May 27 19:32:06.392558 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:06.391404 2555 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 27 19:32:06.463034 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:06.462999 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 27 19:32:06.473200 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:06.473170 2555 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 27 19:32:06.482692 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:06.482655 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-26 19:27:05 +0000 UTC" deadline="2028-02-04 17:17:31.190911746 +0000 UTC" May 27 19:32:06.482692 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:06.482690 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14829h45m24.70822485s" May 27 19:32:06.490848 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:06.490819 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-51.ec2.internal\" not found" May 27 19:32:06.524170 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:06.524145 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-s6v8r" May 27 19:32:06.525994 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:06.525968 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9ce5379620ec9459777df2f25374e23.slice/crio-532213fb2ba690ae79577903b267320884d6a9bab3f700f519ff30354faeb052 WatchSource:0}: Error finding container 532213fb2ba690ae79577903b267320884d6a9bab3f700f519ff30354faeb052: Status 404 returned error can't find the container with id 532213fb2ba690ae79577903b267320884d6a9bab3f700f519ff30354faeb052 May 27 19:32:06.526308 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:06.526288 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod474a050b831840f986e5ea7c3b5dfc5b.slice/crio-171a5e26761d1542001e438fe94565225b22d7326790278520fad69b784ff3b0 WatchSource:0}: Error finding container 171a5e26761d1542001e438fe94565225b22d7326790278520fad69b784ff3b0: Status 404 returned error can't find the container with id 171a5e26761d1542001e438fe94565225b22d7326790278520fad69b784ff3b0 May 27 19:32:06.529847 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:06.529831 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 19:32:06.532689 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:06.532670 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-s6v8r" May 27 19:32:06.575480 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:06.575438 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-51.ec2.internal" event={"ID":"474a050b831840f986e5ea7c3b5dfc5b","Type":"ContainerStarted","Data":"171a5e26761d1542001e438fe94565225b22d7326790278520fad69b784ff3b0"} May 27 19:32:06.576197 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:06.576174 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-51.ec2.internal" event={"ID":"d9ce5379620ec9459777df2f25374e23","Type":"ContainerStarted","Data":"532213fb2ba690ae79577903b267320884d6a9bab3f700f519ff30354faeb052"} May 27 19:32:06.591333 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:06.591316 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-51.ec2.internal\" not found" May 27 19:32:06.691755 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:06.691715 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-51.ec2.internal\" not found" May 27 19:32:06.792222 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:06.792183 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-51.ec2.internal\" not found" May 27 19:32:06.892873 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:06.892793 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-51.ec2.internal\" not found" May 27 19:32:06.993471 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:06.993434 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-51.ec2.internal\" not found" May 27 19:32:06.998935 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:06.998910 2555 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 27 19:32:07.009083 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.009060 2555 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 27 19:32:07.064905 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.064874 2555 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-51.ec2.internal" May 27 19:32:07.076627 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.076595 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 27 19:32:07.077776 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.077747 2555 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-51.ec2.internal" May 27 19:32:07.089696 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.089666 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 27 19:32:07.244066 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.243976 2555 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 27 19:32:07.441527 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.441495 2555 apiserver.go:52] "Watching apiserver" May 27 19:32:07.453063 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.453029 2555 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 27 19:32:07.453502 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.453477 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-kcxhv","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkw25","openshift-cluster-node-tuning-operator/tuned-246q2","openshift-image-registry/node-ca-l6kn5","openshift-network-diagnostics/network-check-target-6lzrp","openshift-ovn-kubernetes/ovnkube-node-pth57","kube-system/global-pull-secret-syncer-lknm5","kube-system/kube-apiserver-proxy-ip-10-0-139-51.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-51.ec2.internal","openshift-multus/multus-2bgsc","openshift-multus/multus-additional-cni-plugins-jmfgh","openshift-multus/network-metrics-daemon-nf6f5","openshift-network-operator/iptables-alerter-c8slr"] May 27 19:32:07.456230 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.456205 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2bgsc" May 27 19:32:07.458423 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.458397 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkw25" May 27 19:32:07.458856 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.458801 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 27 19:32:07.458951 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.458860 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 27 19:32:07.458951 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.458906 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bs9j2\"" May 27 19:32:07.459035 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.458985 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 27 19:32:07.459228 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.459211 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 27 19:32:07.460387 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.460365 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-246q2" May 27 19:32:07.461215 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.460730 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 27 19:32:07.461215 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.461067 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 27 19:32:07.461215 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.461128 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 27 19:32:07.461785 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.461664 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-khm89\"" May 27 19:32:07.462145 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.462124 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 27 19:32:07.462479 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.462460 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-l6kn5" May 27 19:32:07.462886 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.462865 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qmwx9\"" May 27 19:32:07.463181 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.462866 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 27 19:32:07.465317 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.464496 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 27 19:32:07.465317 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.464743 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 27 19:32:07.465317 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.464942 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4t7fz\"" May 27 19:32:07.465317 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.465160 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 27 19:32:07.466965 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.466947 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6lzrp" May 27 19:32:07.467058 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:07.467033 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6lzrp" podUID="1829aad5-1f6d-4bf4-9da6-15027f679994" May 27 19:32:07.467177 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.467150 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.469335 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.469317 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kcxhv" May 27 19:32:07.469841 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.469819 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 27 19:32:07.471191 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.470718 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 27 19:32:07.471191 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.470738 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 27 19:32:07.471191 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.470771 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 27 19:32:07.471191 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.471174 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pjdl5\"" May 27 19:32:07.472562 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.472543 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 27 19:32:07.472807 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.472787 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 27 19:32:07.472874 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.472832 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-87b9h\"" May 27 19:32:07.472874 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.472845 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 27 19:32:07.473159 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.473141 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 27 19:32:07.474437 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.474389 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d14eff58-e510-4dc2-a0ac-fb3ba83923bc-multus-cni-dir\") pod \"multus-2bgsc\" (UID: \"d14eff58-e510-4dc2-a0ac-fb3ba83923bc\") " pod="openshift-multus/multus-2bgsc" May 27 19:32:07.474437 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.474420 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d14eff58-e510-4dc2-a0ac-fb3ba83923bc-host-run-multus-certs\") pod \"multus-2bgsc\" (UID: \"d14eff58-e510-4dc2-a0ac-fb3ba83923bc\") " pod="openshift-multus/multus-2bgsc" May 27 19:32:07.474579 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.474448 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cf469379-5081-4986-b3d4-92cc9119a3a2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gkw25\" (UID: \"cf469379-5081-4986-b3d4-92cc9119a3a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkw25" May 27 19:32:07.474579 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.474478 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cf469379-5081-4986-b3d4-92cc9119a3a2-device-dir\") pod \"aws-ebs-csi-driver-node-gkw25\" (UID: \"cf469379-5081-4986-b3d4-92cc9119a3a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkw25" May 27 19:32:07.474579 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.474517 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv4sh\" (UniqueName: \"kubernetes.io/projected/cf469379-5081-4986-b3d4-92cc9119a3a2-kube-api-access-xv4sh\") pod \"aws-ebs-csi-driver-node-gkw25\" (UID: \"cf469379-5081-4986-b3d4-92cc9119a3a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkw25" May 27 19:32:07.474579 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.474563 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6b52\" (UniqueName: \"kubernetes.io/projected/bf52ea50-d810-4b2b-bde4-f58f4cb97288-kube-api-access-l6b52\") pod \"node-ca-l6kn5\" (UID: \"bf52ea50-d810-4b2b-bde4-f58f4cb97288\") " pod="openshift-image-registry/node-ca-l6kn5" May 27 19:32:07.475215 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.474944 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jmfgh" May 27 19:32:07.475215 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.475115 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nf6f5" May 27 19:32:07.475825 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.474603 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/546d5521-7b50-46d6-829d-cbbe35bf130a-host-kubelet\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.475941 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.475896 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f2decf54-fe75-4756-9550-5f9dbf380937-etc-sysconfig\") pod \"tuned-246q2\" (UID: \"f2decf54-fe75-4756-9550-5f9dbf380937\") " pod="openshift-cluster-node-tuning-operator/tuned-246q2" May 27 19:32:07.476000 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.475976 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f2decf54-fe75-4756-9550-5f9dbf380937-etc-tuned\") pod \"tuned-246q2\" (UID: \"f2decf54-fe75-4756-9550-5f9dbf380937\") " pod="openshift-cluster-node-tuning-operator/tuned-246q2" May 27 19:32:07.476053 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:07.475992 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nf6f5" podUID="34c87eb0-84f0-4f4c-b319-b6486fd20f52" May 27 19:32:07.476053 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.476016 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/546d5521-7b50-46d6-829d-cbbe35bf130a-etc-openvswitch\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.476148 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.476049 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/546d5521-7b50-46d6-829d-cbbe35bf130a-host-cni-bin\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.476148 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.476080 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d14eff58-e510-4dc2-a0ac-fb3ba83923bc-host-var-lib-kubelet\") pod \"multus-2bgsc\" (UID: \"d14eff58-e510-4dc2-a0ac-fb3ba83923bc\") " pod="openshift-multus/multus-2bgsc" May 27 19:32:07.476148 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.476114 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d14eff58-e510-4dc2-a0ac-fb3ba83923bc-multus-conf-dir\") pod \"multus-2bgsc\" (UID: \"d14eff58-e510-4dc2-a0ac-fb3ba83923bc\") " pod="openshift-multus/multus-2bgsc" May 27 19:32:07.476148 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.476133 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d14eff58-e510-4dc2-a0ac-fb3ba83923bc-multus-daemon-config\") pod \"multus-2bgsc\" (UID: \"d14eff58-e510-4dc2-a0ac-fb3ba83923bc\") " pod="openshift-multus/multus-2bgsc" May 27 19:32:07.476429 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.476152 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d14eff58-e510-4dc2-a0ac-fb3ba83923bc-etc-kubernetes\") pod \"multus-2bgsc\" (UID: \"d14eff58-e510-4dc2-a0ac-fb3ba83923bc\") " pod="openshift-multus/multus-2bgsc" May 27 19:32:07.476429 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.476189 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f2decf54-fe75-4756-9550-5f9dbf380937-etc-sysctl-d\") pod \"tuned-246q2\" (UID: \"f2decf54-fe75-4756-9550-5f9dbf380937\") " pod="openshift-cluster-node-tuning-operator/tuned-246q2" May 27 19:32:07.476429 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.476209 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f2decf54-fe75-4756-9550-5f9dbf380937-tmp\") pod \"tuned-246q2\" (UID: \"f2decf54-fe75-4756-9550-5f9dbf380937\") " pod="openshift-cluster-node-tuning-operator/tuned-246q2" May 27 19:32:07.476429 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.476231 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/546d5521-7b50-46d6-829d-cbbe35bf130a-host-run-netns\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.476429 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.476254 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/546d5521-7b50-46d6-829d-cbbe35bf130a-run-systemd\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.476660 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.476639 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/546d5521-7b50-46d6-829d-cbbe35bf130a-run-ovn\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.476717 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.476699 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/546d5521-7b50-46d6-829d-cbbe35bf130a-log-socket\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.476771 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.476749 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d14eff58-e510-4dc2-a0ac-fb3ba83923bc-cnibin\") pod \"multus-2bgsc\" (UID: \"d14eff58-e510-4dc2-a0ac-fb3ba83923bc\") " pod="openshift-multus/multus-2bgsc" May 27 19:32:07.476822 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.476778 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f2decf54-fe75-4756-9550-5f9dbf380937-etc-modprobe-d\") pod \"tuned-246q2\" (UID: \"f2decf54-fe75-4756-9550-5f9dbf380937\") " pod="openshift-cluster-node-tuning-operator/tuned-246q2" May 27 19:32:07.476822 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.476802 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2decf54-fe75-4756-9550-5f9dbf380937-var-lib-kubelet\") pod \"tuned-246q2\" (UID: \"f2decf54-fe75-4756-9550-5f9dbf380937\") " pod="openshift-cluster-node-tuning-operator/tuned-246q2" May 27 19:32:07.476916 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.476827 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/546d5521-7b50-46d6-829d-cbbe35bf130a-host-cni-netd\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.476916 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.476853 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/546d5521-7b50-46d6-829d-cbbe35bf130a-ovn-node-metrics-cert\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.476916 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.476877 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f2decf54-fe75-4756-9550-5f9dbf380937-etc-systemd\") pod \"tuned-246q2\" (UID: \"f2decf54-fe75-4756-9550-5f9dbf380937\") " pod="openshift-cluster-node-tuning-operator/tuned-246q2" May 27 19:32:07.476916 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.476904 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vt472\" (UniqueName: \"kubernetes.io/projected/1829aad5-1f6d-4bf4-9da6-15027f679994-kube-api-access-vt472\") pod \"network-check-target-6lzrp\" (UID: \"1829aad5-1f6d-4bf4-9da6-15027f679994\") " pod="openshift-network-diagnostics/network-check-target-6lzrp" May 27 19:32:07.477101 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.476927 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/546d5521-7b50-46d6-829d-cbbe35bf130a-ovnkube-config\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.477101 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.476953 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c429c\" (UniqueName: \"kubernetes.io/projected/546d5521-7b50-46d6-829d-cbbe35bf130a-kube-api-access-c429c\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.477101 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.476975 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cf469379-5081-4986-b3d4-92cc9119a3a2-etc-selinux\") pod \"aws-ebs-csi-driver-node-gkw25\" (UID: \"cf469379-5081-4986-b3d4-92cc9119a3a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkw25" May 27 19:32:07.477101 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.477001 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/546d5521-7b50-46d6-829d-cbbe35bf130a-var-lib-openvswitch\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.477101 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.477023 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d14eff58-e510-4dc2-a0ac-fb3ba83923bc-host-run-netns\") pod \"multus-2bgsc\" (UID: \"d14eff58-e510-4dc2-a0ac-fb3ba83923bc\") " pod="openshift-multus/multus-2bgsc" May 27 19:32:07.477101 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.477046 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f2decf54-fe75-4756-9550-5f9dbf380937-sys\") pod \"tuned-246q2\" (UID: \"f2decf54-fe75-4756-9550-5f9dbf380937\") " pod="openshift-cluster-node-tuning-operator/tuned-246q2" May 27 19:32:07.477101 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.477089 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p22fr\" (UniqueName: \"kubernetes.io/projected/f2decf54-fe75-4756-9550-5f9dbf380937-kube-api-access-p22fr\") pod \"tuned-246q2\" (UID: \"f2decf54-fe75-4756-9550-5f9dbf380937\") " pod="openshift-cluster-node-tuning-operator/tuned-246q2" May 27 19:32:07.477404 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.477130 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/546d5521-7b50-46d6-829d-cbbe35bf130a-node-log\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.477404 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.477163 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d14eff58-e510-4dc2-a0ac-fb3ba83923bc-os-release\") pod \"multus-2bgsc\" (UID: \"d14eff58-e510-4dc2-a0ac-fb3ba83923bc\") " pod="openshift-multus/multus-2bgsc" May 27 19:32:07.477404 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.477188 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f2decf54-fe75-4756-9550-5f9dbf380937-host\") pod \"tuned-246q2\" (UID: \"f2decf54-fe75-4756-9550-5f9dbf380937\") " pod="openshift-cluster-node-tuning-operator/tuned-246q2" May 27 19:32:07.477404 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.477212 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/546d5521-7b50-46d6-829d-cbbe35bf130a-run-openvswitch\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.477404 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.477236 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d14eff58-e510-4dc2-a0ac-fb3ba83923bc-cni-binary-copy\") pod \"multus-2bgsc\" (UID: \"d14eff58-e510-4dc2-a0ac-fb3ba83923bc\") " pod="openshift-multus/multus-2bgsc" May 27 19:32:07.477631 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.477461 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 27 19:32:07.477631 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.477519 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lknm5" May 27 19:32:07.477631 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.477260 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmdh7\" (UniqueName: \"kubernetes.io/projected/d14eff58-e510-4dc2-a0ac-fb3ba83923bc-kube-api-access-nmdh7\") pod \"multus-2bgsc\" (UID: \"d14eff58-e510-4dc2-a0ac-fb3ba83923bc\") " pod="openshift-multus/multus-2bgsc" May 27 19:32:07.477631 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:07.477585 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lknm5" podUID="e375ea8a-c7d3-4c35-a901-a5e9bf859073" May 27 19:32:07.477631 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.477608 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f2decf54-fe75-4756-9550-5f9dbf380937-lib-modules\") pod \"tuned-246q2\" (UID: \"f2decf54-fe75-4756-9550-5f9dbf380937\") " pod="openshift-cluster-node-tuning-operator/tuned-246q2" May 27 19:32:07.477862 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.477636 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/546d5521-7b50-46d6-829d-cbbe35bf130a-host-slash\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.477862 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.477660 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/546d5521-7b50-46d6-829d-cbbe35bf130a-env-overrides\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.477862 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.477687 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d14eff58-e510-4dc2-a0ac-fb3ba83923bc-host-run-k8s-cni-cncf-io\") pod \"multus-2bgsc\" (UID: \"d14eff58-e510-4dc2-a0ac-fb3ba83923bc\") " pod="openshift-multus/multus-2bgsc" May 27 19:32:07.477862 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.477714 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d14eff58-e510-4dc2-a0ac-fb3ba83923bc-host-var-lib-cni-multus\") pod \"multus-2bgsc\" (UID: \"d14eff58-e510-4dc2-a0ac-fb3ba83923bc\") " pod="openshift-multus/multus-2bgsc" May 27 19:32:07.477862 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.477739 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bf52ea50-d810-4b2b-bde4-f58f4cb97288-serviceca\") pod \"node-ca-l6kn5\" (UID: \"bf52ea50-d810-4b2b-bde4-f58f4cb97288\") " pod="openshift-image-registry/node-ca-l6kn5" May 27 19:32:07.477862 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.477762 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d14eff58-e510-4dc2-a0ac-fb3ba83923bc-host-var-lib-cni-bin\") pod \"multus-2bgsc\" (UID: \"d14eff58-e510-4dc2-a0ac-fb3ba83923bc\") " pod="openshift-multus/multus-2bgsc" May 27 19:32:07.477862 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.477784 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2decf54-fe75-4756-9550-5f9dbf380937-etc-kubernetes\") pod \"tuned-246q2\" (UID: \"f2decf54-fe75-4756-9550-5f9dbf380937\") " pod="openshift-cluster-node-tuning-operator/tuned-246q2" May 27 19:32:07.477862 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.477813 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cf469379-5081-4986-b3d4-92cc9119a3a2-socket-dir\") pod \"aws-ebs-csi-driver-node-gkw25\" (UID: \"cf469379-5081-4986-b3d4-92cc9119a3a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkw25" May 27 19:32:07.477862 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.477845 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cf469379-5081-4986-b3d4-92cc9119a3a2-sys-fs\") pod \"aws-ebs-csi-driver-node-gkw25\" (UID: \"cf469379-5081-4986-b3d4-92cc9119a3a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkw25" May 27 19:32:07.478231 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.477868 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/546d5521-7b50-46d6-829d-cbbe35bf130a-host-run-ovn-kubernetes\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.478231 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.477893 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/546d5521-7b50-46d6-829d-cbbe35bf130a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.478231 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.477913 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d14eff58-e510-4dc2-a0ac-fb3ba83923bc-multus-socket-dir-parent\") pod \"multus-2bgsc\" (UID: \"d14eff58-e510-4dc2-a0ac-fb3ba83923bc\") " pod="openshift-multus/multus-2bgsc" May 27 19:32:07.478231 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.477932 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bf52ea50-d810-4b2b-bde4-f58f4cb97288-host\") pod \"node-ca-l6kn5\" (UID: \"bf52ea50-d810-4b2b-bde4-f58f4cb97288\") " pod="openshift-image-registry/node-ca-l6kn5" May 27 19:32:07.478231 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.477955 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/546d5521-7b50-46d6-829d-cbbe35bf130a-ovnkube-script-lib\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.478231 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.477995 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cf469379-5081-4986-b3d4-92cc9119a3a2-registration-dir\") pod \"aws-ebs-csi-driver-node-gkw25\" (UID: \"cf469379-5081-4986-b3d4-92cc9119a3a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkw25" May 27 19:32:07.478231 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.478013 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 27 19:32:07.478231 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.478050 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qb6t4\"" May 27 19:32:07.478231 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.478018 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f2decf54-fe75-4756-9550-5f9dbf380937-etc-sysctl-conf\") pod \"tuned-246q2\" (UID: \"f2decf54-fe75-4756-9550-5f9dbf380937\") " pod="openshift-cluster-node-tuning-operator/tuned-246q2" May 27 19:32:07.478231 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.478218 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f2decf54-fe75-4756-9550-5f9dbf380937-run\") pod \"tuned-246q2\" (UID: \"f2decf54-fe75-4756-9550-5f9dbf380937\") " pod="openshift-cluster-node-tuning-operator/tuned-246q2" May 27 19:32:07.478663 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.478242 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/546d5521-7b50-46d6-829d-cbbe35bf130a-systemd-units\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.478663 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.478290 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d14eff58-e510-4dc2-a0ac-fb3ba83923bc-system-cni-dir\") pod \"multus-2bgsc\" (UID: \"d14eff58-e510-4dc2-a0ac-fb3ba83923bc\") " pod="openshift-multus/multus-2bgsc" May 27 19:32:07.478663 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.478330 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d14eff58-e510-4dc2-a0ac-fb3ba83923bc-hostroot\") pod \"multus-2bgsc\" (UID: \"d14eff58-e510-4dc2-a0ac-fb3ba83923bc\") " pod="openshift-multus/multus-2bgsc" May 27 19:32:07.479696 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.479674 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c8slr" May 27 19:32:07.482055 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.482031 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 27 19:32:07.482359 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.482339 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-j8pt4\"" May 27 19:32:07.482359 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.482354 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 27 19:32:07.482752 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.482603 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 27 19:32:07.533204 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.533169 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-26 19:27:06 +0000 UTC" deadline="2027-10-27 23:58:30.642933905 +0000 UTC" May 27 19:32:07.533204 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.533201 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12436h26m23.109737348s" May 27 19:32:07.565301 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.565257 2555 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 27 19:32:07.578741 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.578708 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/546d5521-7b50-46d6-829d-cbbe35bf130a-env-overrides\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.578913 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.578749 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d14eff58-e510-4dc2-a0ac-fb3ba83923bc-host-run-k8s-cni-cncf-io\") pod \"multus-2bgsc\" (UID: \"d14eff58-e510-4dc2-a0ac-fb3ba83923bc\") " pod="openshift-multus/multus-2bgsc" May 27 19:32:07.578913 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.578803 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d14eff58-e510-4dc2-a0ac-fb3ba83923bc-host-run-k8s-cni-cncf-io\") pod \"multus-2bgsc\" (UID: \"d14eff58-e510-4dc2-a0ac-fb3ba83923bc\") " pod="openshift-multus/multus-2bgsc" May 27 19:32:07.578913 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.578837 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d14eff58-e510-4dc2-a0ac-fb3ba83923bc-host-var-lib-cni-multus\") pod \"multus-2bgsc\" (UID: \"d14eff58-e510-4dc2-a0ac-fb3ba83923bc\") " pod="openshift-multus/multus-2bgsc" May 27 19:32:07.578913 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.578867 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7b4eaa52-ed75-477d-bf99-dd416acd2d27-iptables-alerter-script\") pod \"iptables-alerter-c8slr\" (UID: \"7b4eaa52-ed75-477d-bf99-dd416acd2d27\") " pod="openshift-network-operator/iptables-alerter-c8slr" May 27 19:32:07.578913 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.578891 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bf52ea50-d810-4b2b-bde4-f58f4cb97288-serviceca\") pod \"node-ca-l6kn5\" (UID: \"bf52ea50-d810-4b2b-bde4-f58f4cb97288\") " pod="openshift-image-registry/node-ca-l6kn5" May 27 19:32:07.579168 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.578925 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d14eff58-e510-4dc2-a0ac-fb3ba83923bc-host-var-lib-cni-bin\") pod \"multus-2bgsc\" (UID: \"d14eff58-e510-4dc2-a0ac-fb3ba83923bc\") " pod="openshift-multus/multus-2bgsc" May 27 19:32:07.579168 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.578962 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d14eff58-e510-4dc2-a0ac-fb3ba83923bc-host-var-lib-cni-multus\") pod \"multus-2bgsc\" (UID: \"d14eff58-e510-4dc2-a0ac-fb3ba83923bc\") " pod="openshift-multus/multus-2bgsc" May 27 19:32:07.579168 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.578972 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e375ea8a-c7d3-4c35-a901-a5e9bf859073-original-pull-secret\") pod \"global-pull-secret-syncer-lknm5\" (UID: \"e375ea8a-c7d3-4c35-a901-a5e9bf859073\") " pod="kube-system/global-pull-secret-syncer-lknm5" May 27 19:32:07.579168 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.579021 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2decf54-fe75-4756-9550-5f9dbf380937-etc-kubernetes\") pod \"tuned-246q2\" (UID: \"f2decf54-fe75-4756-9550-5f9dbf380937\") " pod="openshift-cluster-node-tuning-operator/tuned-246q2" May 27 19:32:07.579168 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.579051 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cf469379-5081-4986-b3d4-92cc9119a3a2-socket-dir\") pod \"aws-ebs-csi-driver-node-gkw25\" (UID: \"cf469379-5081-4986-b3d4-92cc9119a3a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkw25" May 27 19:32:07.579168 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.579061 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d14eff58-e510-4dc2-a0ac-fb3ba83923bc-host-var-lib-cni-bin\") pod \"multus-2bgsc\" (UID: \"d14eff58-e510-4dc2-a0ac-fb3ba83923bc\") " pod="openshift-multus/multus-2bgsc" May 27 19:32:07.579168 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.579102 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cf469379-5081-4986-b3d4-92cc9119a3a2-sys-fs\") pod \"aws-ebs-csi-driver-node-gkw25\" (UID: \"cf469379-5081-4986-b3d4-92cc9119a3a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkw25" May 27 19:32:07.579168 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.579128 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/546d5521-7b50-46d6-829d-cbbe35bf130a-host-run-ovn-kubernetes\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.579168 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.579131 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2decf54-fe75-4756-9550-5f9dbf380937-etc-kubernetes\") pod \"tuned-246q2\" (UID: \"f2decf54-fe75-4756-9550-5f9dbf380937\") " pod="openshift-cluster-node-tuning-operator/tuned-246q2" May 27 19:32:07.579168 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.579153 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/546d5521-7b50-46d6-829d-cbbe35bf130a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.579571 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.579199 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/546d5521-7b50-46d6-829d-cbbe35bf130a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.579571 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.579251 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cf469379-5081-4986-b3d4-92cc9119a3a2-sys-fs\") pod \"aws-ebs-csi-driver-node-gkw25\" (UID: \"cf469379-5081-4986-b3d4-92cc9119a3a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkw25" May 27 19:32:07.579571 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.579285 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cf469379-5081-4986-b3d4-92cc9119a3a2-socket-dir\") pod \"aws-ebs-csi-driver-node-gkw25\" (UID: \"cf469379-5081-4986-b3d4-92cc9119a3a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkw25" May 27 19:32:07.579571 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.579300 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/546d5521-7b50-46d6-829d-cbbe35bf130a-host-run-ovn-kubernetes\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.579571 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.579313 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/546d5521-7b50-46d6-829d-cbbe35bf130a-env-overrides\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.579571 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.579315 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d14eff58-e510-4dc2-a0ac-fb3ba83923bc-multus-socket-dir-parent\") pod \"multus-2bgsc\" (UID: \"d14eff58-e510-4dc2-a0ac-fb3ba83923bc\") " pod="openshift-multus/multus-2bgsc" May 27 19:32:07.579571 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.579352 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwlgk\" (UniqueName: \"kubernetes.io/projected/34c87eb0-84f0-4f4c-b319-b6486fd20f52-kube-api-access-nwlgk\") pod \"network-metrics-daemon-nf6f5\" (UID: \"34c87eb0-84f0-4f4c-b319-b6486fd20f52\") " pod="openshift-multus/network-metrics-daemon-nf6f5" May 27 19:32:07.579571 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.579382 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bf52ea50-d810-4b2b-bde4-f58f4cb97288-host\") pod \"node-ca-l6kn5\" (UID: \"bf52ea50-d810-4b2b-bde4-f58f4cb97288\") " pod="openshift-image-registry/node-ca-l6kn5" May 27 19:32:07.579571 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.579401 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d14eff58-e510-4dc2-a0ac-fb3ba83923bc-multus-socket-dir-parent\") pod \"multus-2bgsc\" (UID: \"d14eff58-e510-4dc2-a0ac-fb3ba83923bc\") " pod="openshift-multus/multus-2bgsc" May 27 19:32:07.579571 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.579407 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/546d5521-7b50-46d6-829d-cbbe35bf130a-ovnkube-script-lib\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.579571 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.579438 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bf52ea50-d810-4b2b-bde4-f58f4cb97288-serviceca\") pod \"node-ca-l6kn5\" (UID: \"bf52ea50-d810-4b2b-bde4-f58f4cb97288\") " pod="openshift-image-registry/node-ca-l6kn5" May 27 19:32:07.579571 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.579448 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e6ba391e-3a4a-4ab7-a6a0-ab1069701c90-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jmfgh\" (UID: \"e6ba391e-3a4a-4ab7-a6a0-ab1069701c90\") " pod="openshift-multus/multus-additional-cni-plugins-jmfgh" May 27 19:32:07.579571 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.579454 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bf52ea50-d810-4b2b-bde4-f58f4cb97288-host\") pod \"node-ca-l6kn5\" (UID: \"bf52ea50-d810-4b2b-bde4-f58f4cb97288\") " pod="openshift-image-registry/node-ca-l6kn5" May 27 19:32:07.579571 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.579492 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b4eaa52-ed75-477d-bf99-dd416acd2d27-host-slash\") pod \"iptables-alerter-c8slr\" (UID: \"7b4eaa52-ed75-477d-bf99-dd416acd2d27\") " pod="openshift-network-operator/iptables-alerter-c8slr" May 27 19:32:07.579571 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.579524 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cf469379-5081-4986-b3d4-92cc9119a3a2-registration-dir\") pod \"aws-ebs-csi-driver-node-gkw25\" (UID: \"cf469379-5081-4986-b3d4-92cc9119a3a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkw25" May 27 19:32:07.579571 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.579570 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f2decf54-fe75-4756-9550-5f9dbf380937-etc-sysctl-conf\") pod \"tuned-246q2\" (UID: \"f2decf54-fe75-4756-9550-5f9dbf380937\") " pod="openshift-cluster-node-tuning-operator/tuned-246q2" May 27 19:32:07.580251 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.579694 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f2decf54-fe75-4756-9550-5f9dbf380937-run\") pod \"tuned-246q2\" (UID: \"f2decf54-fe75-4756-9550-5f9dbf380937\") " pod="openshift-cluster-node-tuning-operator/tuned-246q2" May 27 19:32:07.580251 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.579723 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/546d5521-7b50-46d6-829d-cbbe35bf130a-systemd-units\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.580251 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.579747 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d14eff58-e510-4dc2-a0ac-fb3ba83923bc-system-cni-dir\") pod \"multus-2bgsc\" (UID: \"d14eff58-e510-4dc2-a0ac-fb3ba83923bc\") " pod="openshift-multus/multus-2bgsc" May 27 19:32:07.580251 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.579772 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d14eff58-e510-4dc2-a0ac-fb3ba83923bc-hostroot\") pod \"multus-2bgsc\" (UID: \"d14eff58-e510-4dc2-a0ac-fb3ba83923bc\") " pod="openshift-multus/multus-2bgsc" May 27 19:32:07.580251 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.579800 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e6ba391e-3a4a-4ab7-a6a0-ab1069701c90-system-cni-dir\") pod \"multus-additional-cni-plugins-jmfgh\" (UID: \"e6ba391e-3a4a-4ab7-a6a0-ab1069701c90\") " pod="openshift-multus/multus-additional-cni-plugins-jmfgh" May 27 19:32:07.580251 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.579815 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f2decf54-fe75-4756-9550-5f9dbf380937-etc-sysctl-conf\") pod \"tuned-246q2\" (UID: \"f2decf54-fe75-4756-9550-5f9dbf380937\") " pod="openshift-cluster-node-tuning-operator/tuned-246q2" May 27 19:32:07.580251 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.579835 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e6ba391e-3a4a-4ab7-a6a0-ab1069701c90-cnibin\") pod \"multus-additional-cni-plugins-jmfgh\" (UID: \"e6ba391e-3a4a-4ab7-a6a0-ab1069701c90\") " pod="openshift-multus/multus-additional-cni-plugins-jmfgh" May 27 19:32:07.580251 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.579862 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d14eff58-e510-4dc2-a0ac-fb3ba83923bc-multus-cni-dir\") pod \"multus-2bgsc\" (UID: \"d14eff58-e510-4dc2-a0ac-fb3ba83923bc\") " pod="openshift-multus/multus-2bgsc" May 27 19:32:07.580251 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.579866 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d14eff58-e510-4dc2-a0ac-fb3ba83923bc-hostroot\") pod \"multus-2bgsc\" (UID: \"d14eff58-e510-4dc2-a0ac-fb3ba83923bc\") " pod="openshift-multus/multus-2bgsc" May 27 19:32:07.580251 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.579839 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/546d5521-7b50-46d6-829d-cbbe35bf130a-systemd-units\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.580251 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.579908 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/546d5521-7b50-46d6-829d-cbbe35bf130a-ovnkube-script-lib\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.580251 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.579907 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d14eff58-e510-4dc2-a0ac-fb3ba83923bc-host-run-multus-certs\") pod \"multus-2bgsc\" (UID: \"d14eff58-e510-4dc2-a0ac-fb3ba83923bc\") " pod="openshift-multus/multus-2bgsc" May 27 19:32:07.580251 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.579924 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d14eff58-e510-4dc2-a0ac-fb3ba83923bc-system-cni-dir\") pod \"multus-2bgsc\" (UID: \"d14eff58-e510-4dc2-a0ac-fb3ba83923bc\") " pod="openshift-multus/multus-2bgsc" May 27 19:32:07.580251 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.579937 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d14eff58-e510-4dc2-a0ac-fb3ba83923bc-host-run-multus-certs\") pod \"multus-2bgsc\" (UID: \"d14eff58-e510-4dc2-a0ac-fb3ba83923bc\") " pod="openshift-multus/multus-2bgsc" May 27 19:32:07.580251 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.579962 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f2decf54-fe75-4756-9550-5f9dbf380937-run\") pod \"tuned-246q2\" (UID: \"f2decf54-fe75-4756-9550-5f9dbf380937\") " pod="openshift-cluster-node-tuning-operator/tuned-246q2" May 27 19:32:07.580251 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.579967 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e6ba391e-3a4a-4ab7-a6a0-ab1069701c90-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jmfgh\" (UID: \"e6ba391e-3a4a-4ab7-a6a0-ab1069701c90\") " pod="openshift-multus/multus-additional-cni-plugins-jmfgh" May 27 19:32:07.580251 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.580056 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cf469379-5081-4986-b3d4-92cc9119a3a2-registration-dir\") pod \"aws-ebs-csi-driver-node-gkw25\" (UID: \"cf469379-5081-4986-b3d4-92cc9119a3a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkw25" May 27 19:32:07.580251 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.580064 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/88051d01-7dcf-48a9-b39a-b5f50cb8df95-konnectivity-ca\") pod \"konnectivity-agent-kcxhv\" (UID: \"88051d01-7dcf-48a9-b39a-b5f50cb8df95\") " pod="kube-system/konnectivity-agent-kcxhv" May 27 19:32:07.581106 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.580084 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d14eff58-e510-4dc2-a0ac-fb3ba83923bc-multus-cni-dir\") pod \"multus-2bgsc\" (UID: \"d14eff58-e510-4dc2-a0ac-fb3ba83923bc\") " pod="openshift-multus/multus-2bgsc" May 27 19:32:07.581106 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.580097 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cf469379-5081-4986-b3d4-92cc9119a3a2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gkw25\" (UID: \"cf469379-5081-4986-b3d4-92cc9119a3a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkw25" May 27 19:32:07.581106 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.580130 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cf469379-5081-4986-b3d4-92cc9119a3a2-device-dir\") pod \"aws-ebs-csi-driver-node-gkw25\" (UID: \"cf469379-5081-4986-b3d4-92cc9119a3a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkw25" May 27 19:32:07.581106 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.580161 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cf469379-5081-4986-b3d4-92cc9119a3a2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gkw25\" (UID: \"cf469379-5081-4986-b3d4-92cc9119a3a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkw25" May 27 19:32:07.581106 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.580207 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xv4sh\" (UniqueName: \"kubernetes.io/projected/cf469379-5081-4986-b3d4-92cc9119a3a2-kube-api-access-xv4sh\") pod \"aws-ebs-csi-driver-node-gkw25\" (UID: \"cf469379-5081-4986-b3d4-92cc9119a3a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkw25" May 27 19:32:07.581106 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.580314 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l6b52\" (UniqueName: \"kubernetes.io/projected/bf52ea50-d810-4b2b-bde4-f58f4cb97288-kube-api-access-l6b52\") pod \"node-ca-l6kn5\" (UID: \"bf52ea50-d810-4b2b-bde4-f58f4cb97288\") " pod="openshift-image-registry/node-ca-l6kn5" May 27 19:32:07.581106 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.580381 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cf469379-5081-4986-b3d4-92cc9119a3a2-device-dir\") pod \"aws-ebs-csi-driver-node-gkw25\" (UID: \"cf469379-5081-4986-b3d4-92cc9119a3a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkw25" May 27 19:32:07.581106 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.580434 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/546d5521-7b50-46d6-829d-cbbe35bf130a-host-kubelet\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.581106 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.580572 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/546d5521-7b50-46d6-829d-cbbe35bf130a-host-kubelet\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.581106 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.580590 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e6ba391e-3a4a-4ab7-a6a0-ab1069701c90-cni-binary-copy\") pod \"multus-additional-cni-plugins-jmfgh\" (UID: \"e6ba391e-3a4a-4ab7-a6a0-ab1069701c90\") " pod="openshift-multus/multus-additional-cni-plugins-jmfgh" May 27 19:32:07.581106 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.580634 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f2decf54-fe75-4756-9550-5f9dbf380937-etc-sysconfig\") pod \"tuned-246q2\" (UID: \"f2decf54-fe75-4756-9550-5f9dbf380937\") " pod="openshift-cluster-node-tuning-operator/tuned-246q2" May 27 19:32:07.581106 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.580659 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f2decf54-fe75-4756-9550-5f9dbf380937-etc-tuned\") pod \"tuned-246q2\" (UID: \"f2decf54-fe75-4756-9550-5f9dbf380937\") " pod="openshift-cluster-node-tuning-operator/tuned-246q2" May 27 19:32:07.581106 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.580687 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/546d5521-7b50-46d6-829d-cbbe35bf130a-etc-openvswitch\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.581106 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.580702 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f2decf54-fe75-4756-9550-5f9dbf380937-etc-sysconfig\") pod \"tuned-246q2\" (UID: \"f2decf54-fe75-4756-9550-5f9dbf380937\") " pod="openshift-cluster-node-tuning-operator/tuned-246q2" May 27 19:32:07.581106 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.580711 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/546d5521-7b50-46d6-829d-cbbe35bf130a-host-cni-bin\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.581106 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.580737 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d14eff58-e510-4dc2-a0ac-fb3ba83923bc-host-var-lib-kubelet\") pod \"multus-2bgsc\" (UID: \"d14eff58-e510-4dc2-a0ac-fb3ba83923bc\") " pod="openshift-multus/multus-2bgsc" May 27 19:32:07.581106 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.580761 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d14eff58-e510-4dc2-a0ac-fb3ba83923bc-multus-conf-dir\") pod \"multus-2bgsc\" (UID: \"d14eff58-e510-4dc2-a0ac-fb3ba83923bc\") " pod="openshift-multus/multus-2bgsc" May 27 19:32:07.581973 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.580760 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/546d5521-7b50-46d6-829d-cbbe35bf130a-etc-openvswitch\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.581973 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.580793 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/546d5521-7b50-46d6-829d-cbbe35bf130a-host-cni-bin\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.581973 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.580797 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d14eff58-e510-4dc2-a0ac-fb3ba83923bc-host-var-lib-kubelet\") pod \"multus-2bgsc\" (UID: \"d14eff58-e510-4dc2-a0ac-fb3ba83923bc\") " pod="openshift-multus/multus-2bgsc" May 27 19:32:07.581973 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.580817 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d14eff58-e510-4dc2-a0ac-fb3ba83923bc-multus-daemon-config\") pod \"multus-2bgsc\" (UID: \"d14eff58-e510-4dc2-a0ac-fb3ba83923bc\") " pod="openshift-multus/multus-2bgsc" May 27 19:32:07.581973 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.580823 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d14eff58-e510-4dc2-a0ac-fb3ba83923bc-multus-conf-dir\") pod \"multus-2bgsc\" (UID: \"d14eff58-e510-4dc2-a0ac-fb3ba83923bc\") " pod="openshift-multus/multus-2bgsc" May 27 19:32:07.581973 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.580844 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d14eff58-e510-4dc2-a0ac-fb3ba83923bc-etc-kubernetes\") pod \"multus-2bgsc\" (UID: \"d14eff58-e510-4dc2-a0ac-fb3ba83923bc\") " pod="openshift-multus/multus-2bgsc" May 27 19:32:07.581973 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.580861 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f2decf54-fe75-4756-9550-5f9dbf380937-etc-sysctl-d\") pod \"tuned-246q2\" (UID: \"f2decf54-fe75-4756-9550-5f9dbf380937\") " pod="openshift-cluster-node-tuning-operator/tuned-246q2" May 27 19:32:07.581973 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.580883 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f2decf54-fe75-4756-9550-5f9dbf380937-tmp\") pod \"tuned-246q2\" (UID: \"f2decf54-fe75-4756-9550-5f9dbf380937\") " pod="openshift-cluster-node-tuning-operator/tuned-246q2" May 27 19:32:07.581973 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.580928 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d14eff58-e510-4dc2-a0ac-fb3ba83923bc-etc-kubernetes\") pod \"multus-2bgsc\" (UID: \"d14eff58-e510-4dc2-a0ac-fb3ba83923bc\") " pod="openshift-multus/multus-2bgsc" May 27 19:32:07.581973 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.580961 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/546d5521-7b50-46d6-829d-cbbe35bf130a-host-run-netns\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.581973 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.580989 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/546d5521-7b50-46d6-829d-cbbe35bf130a-run-systemd\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.581973 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.581003 2555 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 27 19:32:07.581973 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.581010 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f2decf54-fe75-4756-9550-5f9dbf380937-etc-sysctl-d\") pod \"tuned-246q2\" (UID: \"f2decf54-fe75-4756-9550-5f9dbf380937\") " pod="openshift-cluster-node-tuning-operator/tuned-246q2" May 27 19:32:07.581973 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.581054 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/546d5521-7b50-46d6-829d-cbbe35bf130a-run-ovn\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.581973 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.581014 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/546d5521-7b50-46d6-829d-cbbe35bf130a-run-ovn\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.581973 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.581094 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/546d5521-7b50-46d6-829d-cbbe35bf130a-log-socket\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.581973 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.581113 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d14eff58-e510-4dc2-a0ac-fb3ba83923bc-cnibin\") pod \"multus-2bgsc\" (UID: \"d14eff58-e510-4dc2-a0ac-fb3ba83923bc\") " pod="openshift-multus/multus-2bgsc" May 27 19:32:07.581973 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.581156 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e6ba391e-3a4a-4ab7-a6a0-ab1069701c90-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jmfgh\" (UID: \"e6ba391e-3a4a-4ab7-a6a0-ab1069701c90\") " pod="openshift-multus/multus-additional-cni-plugins-jmfgh" May 27 19:32:07.582833 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.581175 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f2decf54-fe75-4756-9550-5f9dbf380937-etc-modprobe-d\") pod \"tuned-246q2\" (UID: \"f2decf54-fe75-4756-9550-5f9dbf380937\") " pod="openshift-cluster-node-tuning-operator/tuned-246q2" May 27 19:32:07.582833 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.581191 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2decf54-fe75-4756-9550-5f9dbf380937-var-lib-kubelet\") pod \"tuned-246q2\" (UID: \"f2decf54-fe75-4756-9550-5f9dbf380937\") " pod="openshift-cluster-node-tuning-operator/tuned-246q2" May 27 19:32:07.582833 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.581211 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/546d5521-7b50-46d6-829d-cbbe35bf130a-host-cni-netd\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.582833 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.581234 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/546d5521-7b50-46d6-829d-cbbe35bf130a-ovn-node-metrics-cert\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.582833 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.581254 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qdjh\" (UniqueName: \"kubernetes.io/projected/e6ba391e-3a4a-4ab7-a6a0-ab1069701c90-kube-api-access-9qdjh\") pod \"multus-additional-cni-plugins-jmfgh\" (UID: \"e6ba391e-3a4a-4ab7-a6a0-ab1069701c90\") " pod="openshift-multus/multus-additional-cni-plugins-jmfgh" May 27 19:32:07.582833 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.581293 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp9s4\" (UniqueName: \"kubernetes.io/projected/7b4eaa52-ed75-477d-bf99-dd416acd2d27-kube-api-access-qp9s4\") pod \"iptables-alerter-c8slr\" (UID: \"7b4eaa52-ed75-477d-bf99-dd416acd2d27\") " pod="openshift-network-operator/iptables-alerter-c8slr" May 27 19:32:07.582833 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.581313 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d14eff58-e510-4dc2-a0ac-fb3ba83923bc-multus-daemon-config\") pod \"multus-2bgsc\" (UID: \"d14eff58-e510-4dc2-a0ac-fb3ba83923bc\") " pod="openshift-multus/multus-2bgsc" May 27 19:32:07.582833 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.581366 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/546d5521-7b50-46d6-829d-cbbe35bf130a-log-socket\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.582833 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.581375 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d14eff58-e510-4dc2-a0ac-fb3ba83923bc-cnibin\") pod \"multus-2bgsc\" (UID: \"d14eff58-e510-4dc2-a0ac-fb3ba83923bc\") " pod="openshift-multus/multus-2bgsc" May 27 19:32:07.582833 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.581313 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/88051d01-7dcf-48a9-b39a-b5f50cb8df95-agent-certs\") pod \"konnectivity-agent-kcxhv\" (UID: \"88051d01-7dcf-48a9-b39a-b5f50cb8df95\") " pod="kube-system/konnectivity-agent-kcxhv" May 27 19:32:07.582833 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.581414 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34c87eb0-84f0-4f4c-b319-b6486fd20f52-metrics-certs\") pod \"network-metrics-daemon-nf6f5\" (UID: \"34c87eb0-84f0-4f4c-b319-b6486fd20f52\") " pod="openshift-multus/network-metrics-daemon-nf6f5" May 27 19:32:07.582833 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.581423 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2decf54-fe75-4756-9550-5f9dbf380937-var-lib-kubelet\") pod \"tuned-246q2\" (UID: \"f2decf54-fe75-4756-9550-5f9dbf380937\") " pod="openshift-cluster-node-tuning-operator/tuned-246q2" May 27 19:32:07.582833 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.581438 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f2decf54-fe75-4756-9550-5f9dbf380937-etc-systemd\") pod \"tuned-246q2\" (UID: \"f2decf54-fe75-4756-9550-5f9dbf380937\") " pod="openshift-cluster-node-tuning-operator/tuned-246q2" May 27 19:32:07.582833 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.581446 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f2decf54-fe75-4756-9550-5f9dbf380937-etc-modprobe-d\") pod \"tuned-246q2\" (UID: \"f2decf54-fe75-4756-9550-5f9dbf380937\") " pod="openshift-cluster-node-tuning-operator/tuned-246q2" May 27 19:32:07.582833 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.581462 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vt472\" (UniqueName: \"kubernetes.io/projected/1829aad5-1f6d-4bf4-9da6-15027f679994-kube-api-access-vt472\") pod \"network-check-target-6lzrp\" (UID: \"1829aad5-1f6d-4bf4-9da6-15027f679994\") " pod="openshift-network-diagnostics/network-check-target-6lzrp" May 27 19:32:07.582833 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.581468 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/546d5521-7b50-46d6-829d-cbbe35bf130a-host-run-netns\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.582833 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.581499 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/546d5521-7b50-46d6-829d-cbbe35bf130a-ovnkube-config\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.583603 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.581507 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/546d5521-7b50-46d6-829d-cbbe35bf130a-run-systemd\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.583603 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.581531 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c429c\" (UniqueName: \"kubernetes.io/projected/546d5521-7b50-46d6-829d-cbbe35bf130a-kube-api-access-c429c\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.583603 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.581557 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cf469379-5081-4986-b3d4-92cc9119a3a2-etc-selinux\") pod \"aws-ebs-csi-driver-node-gkw25\" (UID: \"cf469379-5081-4986-b3d4-92cc9119a3a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkw25" May 27 19:32:07.583603 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.581584 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/546d5521-7b50-46d6-829d-cbbe35bf130a-var-lib-openvswitch\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.583603 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.581609 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d14eff58-e510-4dc2-a0ac-fb3ba83923bc-host-run-netns\") pod \"multus-2bgsc\" (UID: \"d14eff58-e510-4dc2-a0ac-fb3ba83923bc\") " pod="openshift-multus/multus-2bgsc" May 27 19:32:07.583603 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.581636 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f2decf54-fe75-4756-9550-5f9dbf380937-sys\") pod \"tuned-246q2\" (UID: \"f2decf54-fe75-4756-9550-5f9dbf380937\") " pod="openshift-cluster-node-tuning-operator/tuned-246q2" May 27 19:32:07.583603 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.581660 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p22fr\" (UniqueName: \"kubernetes.io/projected/f2decf54-fe75-4756-9550-5f9dbf380937-kube-api-access-p22fr\") pod \"tuned-246q2\" (UID: \"f2decf54-fe75-4756-9550-5f9dbf380937\") " pod="openshift-cluster-node-tuning-operator/tuned-246q2" May 27 19:32:07.583603 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.581677 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f2decf54-fe75-4756-9550-5f9dbf380937-etc-systemd\") pod \"tuned-246q2\" (UID: \"f2decf54-fe75-4756-9550-5f9dbf380937\") " pod="openshift-cluster-node-tuning-operator/tuned-246q2" May 27 19:32:07.583603 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.581684 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/546d5521-7b50-46d6-829d-cbbe35bf130a-node-log\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.583603 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.581711 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d14eff58-e510-4dc2-a0ac-fb3ba83923bc-os-release\") pod \"multus-2bgsc\" (UID: \"d14eff58-e510-4dc2-a0ac-fb3ba83923bc\") " pod="openshift-multus/multus-2bgsc" May 27 19:32:07.583603 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.581748 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e6ba391e-3a4a-4ab7-a6a0-ab1069701c90-os-release\") pod \"multus-additional-cni-plugins-jmfgh\" (UID: \"e6ba391e-3a4a-4ab7-a6a0-ab1069701c90\") " pod="openshift-multus/multus-additional-cni-plugins-jmfgh" May 27 19:32:07.583603 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.581778 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e375ea8a-c7d3-4c35-a901-a5e9bf859073-kubelet-config\") pod \"global-pull-secret-syncer-lknm5\" (UID: \"e375ea8a-c7d3-4c35-a901-a5e9bf859073\") " pod="kube-system/global-pull-secret-syncer-lknm5" May 27 19:32:07.583603 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.581802 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e375ea8a-c7d3-4c35-a901-a5e9bf859073-dbus\") pod \"global-pull-secret-syncer-lknm5\" (UID: \"e375ea8a-c7d3-4c35-a901-a5e9bf859073\") " pod="kube-system/global-pull-secret-syncer-lknm5" May 27 19:32:07.583603 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.581836 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f2decf54-fe75-4756-9550-5f9dbf380937-host\") pod \"tuned-246q2\" (UID: \"f2decf54-fe75-4756-9550-5f9dbf380937\") " pod="openshift-cluster-node-tuning-operator/tuned-246q2" May 27 19:32:07.583603 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.581861 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/546d5521-7b50-46d6-829d-cbbe35bf130a-run-openvswitch\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.583603 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.581896 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d14eff58-e510-4dc2-a0ac-fb3ba83923bc-cni-binary-copy\") pod \"multus-2bgsc\" (UID: \"d14eff58-e510-4dc2-a0ac-fb3ba83923bc\") " pod="openshift-multus/multus-2bgsc" May 27 19:32:07.583603 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.581921 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nmdh7\" (UniqueName: \"kubernetes.io/projected/d14eff58-e510-4dc2-a0ac-fb3ba83923bc-kube-api-access-nmdh7\") pod \"multus-2bgsc\" (UID: \"d14eff58-e510-4dc2-a0ac-fb3ba83923bc\") " pod="openshift-multus/multus-2bgsc" May 27 19:32:07.584384 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.581924 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cf469379-5081-4986-b3d4-92cc9119a3a2-etc-selinux\") pod \"aws-ebs-csi-driver-node-gkw25\" (UID: \"cf469379-5081-4986-b3d4-92cc9119a3a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkw25" May 27 19:32:07.584384 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.581947 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f2decf54-fe75-4756-9550-5f9dbf380937-lib-modules\") pod \"tuned-246q2\" (UID: \"f2decf54-fe75-4756-9550-5f9dbf380937\") " pod="openshift-cluster-node-tuning-operator/tuned-246q2" May 27 19:32:07.584384 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.581969 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d14eff58-e510-4dc2-a0ac-fb3ba83923bc-host-run-netns\") pod \"multus-2bgsc\" (UID: \"d14eff58-e510-4dc2-a0ac-fb3ba83923bc\") " pod="openshift-multus/multus-2bgsc" May 27 19:32:07.584384 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.581971 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/546d5521-7b50-46d6-829d-cbbe35bf130a-host-slash\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.584384 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.582004 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/546d5521-7b50-46d6-829d-cbbe35bf130a-ovnkube-config\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.584384 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.582007 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f2decf54-fe75-4756-9550-5f9dbf380937-sys\") pod \"tuned-246q2\" (UID: \"f2decf54-fe75-4756-9550-5f9dbf380937\") " pod="openshift-cluster-node-tuning-operator/tuned-246q2" May 27 19:32:07.584384 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.582059 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/546d5521-7b50-46d6-829d-cbbe35bf130a-var-lib-openvswitch\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.584384 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.582065 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f2decf54-fe75-4756-9550-5f9dbf380937-host\") pod \"tuned-246q2\" (UID: \"f2decf54-fe75-4756-9550-5f9dbf380937\") " pod="openshift-cluster-node-tuning-operator/tuned-246q2" May 27 19:32:07.584384 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.582090 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/546d5521-7b50-46d6-829d-cbbe35bf130a-node-log\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.584384 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.582113 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/546d5521-7b50-46d6-829d-cbbe35bf130a-run-openvswitch\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.584384 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.582121 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/546d5521-7b50-46d6-829d-cbbe35bf130a-host-slash\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.584384 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.582230 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d14eff58-e510-4dc2-a0ac-fb3ba83923bc-os-release\") pod \"multus-2bgsc\" (UID: \"d14eff58-e510-4dc2-a0ac-fb3ba83923bc\") " pod="openshift-multus/multus-2bgsc" May 27 19:32:07.584384 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.582342 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f2decf54-fe75-4756-9550-5f9dbf380937-lib-modules\") pod \"tuned-246q2\" (UID: \"f2decf54-fe75-4756-9550-5f9dbf380937\") " pod="openshift-cluster-node-tuning-operator/tuned-246q2" May 27 19:32:07.584384 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.582577 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d14eff58-e510-4dc2-a0ac-fb3ba83923bc-cni-binary-copy\") pod \"multus-2bgsc\" (UID: \"d14eff58-e510-4dc2-a0ac-fb3ba83923bc\") " pod="openshift-multus/multus-2bgsc" May 27 19:32:07.584384 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.583732 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/546d5521-7b50-46d6-829d-cbbe35bf130a-host-cni-netd\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.585076 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.585056 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f2decf54-fe75-4756-9550-5f9dbf380937-etc-tuned\") pod \"tuned-246q2\" (UID: \"f2decf54-fe75-4756-9550-5f9dbf380937\") " pod="openshift-cluster-node-tuning-operator/tuned-246q2" May 27 19:32:07.585255 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.585235 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/546d5521-7b50-46d6-829d-cbbe35bf130a-ovn-node-metrics-cert\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.585573 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.585551 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f2decf54-fe75-4756-9550-5f9dbf380937-tmp\") pod \"tuned-246q2\" (UID: \"f2decf54-fe75-4756-9550-5f9dbf380937\") " pod="openshift-cluster-node-tuning-operator/tuned-246q2" May 27 19:32:07.594849 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:07.592080 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 19:32:07.594849 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:07.592110 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 19:32:07.594849 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:07.592134 2555 projected.go:194] Error preparing data for projected volume kube-api-access-vt472 for pod openshift-network-diagnostics/network-check-target-6lzrp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 19:32:07.594849 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:07.592401 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1829aad5-1f6d-4bf4-9da6-15027f679994-kube-api-access-vt472 podName:1829aad5-1f6d-4bf4-9da6-15027f679994 nodeName:}" failed. No retries permitted until 2026-05-27 19:32:08.092369395 +0000 UTC m=+3.128996083 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vt472" (UniqueName: "kubernetes.io/projected/1829aad5-1f6d-4bf4-9da6-15027f679994-kube-api-access-vt472") pod "network-check-target-6lzrp" (UID: "1829aad5-1f6d-4bf4-9da6-15027f679994") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 19:32:07.596678 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.596655 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv4sh\" (UniqueName: \"kubernetes.io/projected/cf469379-5081-4986-b3d4-92cc9119a3a2-kube-api-access-xv4sh\") pod \"aws-ebs-csi-driver-node-gkw25\" (UID: \"cf469379-5081-4986-b3d4-92cc9119a3a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkw25" May 27 19:32:07.597795 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.597767 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p22fr\" (UniqueName: \"kubernetes.io/projected/f2decf54-fe75-4756-9550-5f9dbf380937-kube-api-access-p22fr\") pod \"tuned-246q2\" (UID: \"f2decf54-fe75-4756-9550-5f9dbf380937\") " pod="openshift-cluster-node-tuning-operator/tuned-246q2" May 27 19:32:07.599157 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.599134 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6b52\" (UniqueName: \"kubernetes.io/projected/bf52ea50-d810-4b2b-bde4-f58f4cb97288-kube-api-access-l6b52\") pod \"node-ca-l6kn5\" (UID: \"bf52ea50-d810-4b2b-bde4-f58f4cb97288\") " pod="openshift-image-registry/node-ca-l6kn5" May 27 19:32:07.599406 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.599388 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmdh7\" (UniqueName: \"kubernetes.io/projected/d14eff58-e510-4dc2-a0ac-fb3ba83923bc-kube-api-access-nmdh7\") pod \"multus-2bgsc\" (UID: \"d14eff58-e510-4dc2-a0ac-fb3ba83923bc\") " pod="openshift-multus/multus-2bgsc" May 27 19:32:07.608494 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.608470 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c429c\" (UniqueName: \"kubernetes.io/projected/546d5521-7b50-46d6-829d-cbbe35bf130a-kube-api-access-c429c\") pod \"ovnkube-node-pth57\" (UID: \"546d5521-7b50-46d6-829d-cbbe35bf130a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.683219 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.683179 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e6ba391e-3a4a-4ab7-a6a0-ab1069701c90-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jmfgh\" (UID: \"e6ba391e-3a4a-4ab7-a6a0-ab1069701c90\") " pod="openshift-multus/multus-additional-cni-plugins-jmfgh" May 27 19:32:07.683405 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.683234 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9qdjh\" (UniqueName: \"kubernetes.io/projected/e6ba391e-3a4a-4ab7-a6a0-ab1069701c90-kube-api-access-9qdjh\") pod \"multus-additional-cni-plugins-jmfgh\" (UID: \"e6ba391e-3a4a-4ab7-a6a0-ab1069701c90\") " pod="openshift-multus/multus-additional-cni-plugins-jmfgh" May 27 19:32:07.683405 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.683325 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qp9s4\" (UniqueName: \"kubernetes.io/projected/7b4eaa52-ed75-477d-bf99-dd416acd2d27-kube-api-access-qp9s4\") pod \"iptables-alerter-c8slr\" (UID: \"7b4eaa52-ed75-477d-bf99-dd416acd2d27\") " pod="openshift-network-operator/iptables-alerter-c8slr" May 27 19:32:07.683405 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.683356 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/88051d01-7dcf-48a9-b39a-b5f50cb8df95-agent-certs\") pod \"konnectivity-agent-kcxhv\" (UID: \"88051d01-7dcf-48a9-b39a-b5f50cb8df95\") " pod="kube-system/konnectivity-agent-kcxhv" May 27 19:32:07.683405 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.683387 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34c87eb0-84f0-4f4c-b319-b6486fd20f52-metrics-certs\") pod \"network-metrics-daemon-nf6f5\" (UID: \"34c87eb0-84f0-4f4c-b319-b6486fd20f52\") " pod="openshift-multus/network-metrics-daemon-nf6f5" May 27 19:32:07.683592 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.683432 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e6ba391e-3a4a-4ab7-a6a0-ab1069701c90-os-release\") pod \"multus-additional-cni-plugins-jmfgh\" (UID: \"e6ba391e-3a4a-4ab7-a6a0-ab1069701c90\") " pod="openshift-multus/multus-additional-cni-plugins-jmfgh" May 27 19:32:07.683592 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.683458 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e375ea8a-c7d3-4c35-a901-a5e9bf859073-kubelet-config\") pod \"global-pull-secret-syncer-lknm5\" (UID: \"e375ea8a-c7d3-4c35-a901-a5e9bf859073\") " pod="kube-system/global-pull-secret-syncer-lknm5" May 27 19:32:07.683592 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.683479 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e375ea8a-c7d3-4c35-a901-a5e9bf859073-dbus\") pod \"global-pull-secret-syncer-lknm5\" (UID: \"e375ea8a-c7d3-4c35-a901-a5e9bf859073\") " pod="kube-system/global-pull-secret-syncer-lknm5" May 27 19:32:07.683592 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.683511 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7b4eaa52-ed75-477d-bf99-dd416acd2d27-iptables-alerter-script\") pod \"iptables-alerter-c8slr\" (UID: \"7b4eaa52-ed75-477d-bf99-dd416acd2d27\") " pod="openshift-network-operator/iptables-alerter-c8slr" May 27 19:32:07.683592 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.683535 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e375ea8a-c7d3-4c35-a901-a5e9bf859073-original-pull-secret\") pod \"global-pull-secret-syncer-lknm5\" (UID: \"e375ea8a-c7d3-4c35-a901-a5e9bf859073\") " pod="kube-system/global-pull-secret-syncer-lknm5" May 27 19:32:07.683592 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.683567 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nwlgk\" (UniqueName: \"kubernetes.io/projected/34c87eb0-84f0-4f4c-b319-b6486fd20f52-kube-api-access-nwlgk\") pod \"network-metrics-daemon-nf6f5\" (UID: \"34c87eb0-84f0-4f4c-b319-b6486fd20f52\") " pod="openshift-multus/network-metrics-daemon-nf6f5" May 27 19:32:07.683592 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.683572 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e6ba391e-3a4a-4ab7-a6a0-ab1069701c90-os-release\") pod \"multus-additional-cni-plugins-jmfgh\" (UID: \"e6ba391e-3a4a-4ab7-a6a0-ab1069701c90\") " pod="openshift-multus/multus-additional-cni-plugins-jmfgh" May 27 19:32:07.683903 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.683630 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e375ea8a-c7d3-4c35-a901-a5e9bf859073-kubelet-config\") pod \"global-pull-secret-syncer-lknm5\" (UID: \"e375ea8a-c7d3-4c35-a901-a5e9bf859073\") " pod="kube-system/global-pull-secret-syncer-lknm5" May 27 19:32:07.683903 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.683650 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e375ea8a-c7d3-4c35-a901-a5e9bf859073-dbus\") pod \"global-pull-secret-syncer-lknm5\" (UID: \"e375ea8a-c7d3-4c35-a901-a5e9bf859073\") " pod="kube-system/global-pull-secret-syncer-lknm5" May 27 19:32:07.683903 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.683659 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e6ba391e-3a4a-4ab7-a6a0-ab1069701c90-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jmfgh\" (UID: \"e6ba391e-3a4a-4ab7-a6a0-ab1069701c90\") " pod="openshift-multus/multus-additional-cni-plugins-jmfgh" May 27 19:32:07.683903 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:07.683687 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 27 19:32:07.683903 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.683714 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b4eaa52-ed75-477d-bf99-dd416acd2d27-host-slash\") pod \"iptables-alerter-c8slr\" (UID: \"7b4eaa52-ed75-477d-bf99-dd416acd2d27\") " pod="openshift-network-operator/iptables-alerter-c8slr" May 27 19:32:07.683903 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.683749 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e6ba391e-3a4a-4ab7-a6a0-ab1069701c90-system-cni-dir\") pod \"multus-additional-cni-plugins-jmfgh\" (UID: \"e6ba391e-3a4a-4ab7-a6a0-ab1069701c90\") " pod="openshift-multus/multus-additional-cni-plugins-jmfgh" May 27 19:32:07.683903 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:07.683775 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e375ea8a-c7d3-4c35-a901-a5e9bf859073-original-pull-secret podName:e375ea8a-c7d3-4c35-a901-a5e9bf859073 nodeName:}" failed. No retries permitted until 2026-05-27 19:32:08.183754781 +0000 UTC m=+3.220381466 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e375ea8a-c7d3-4c35-a901-a5e9bf859073-original-pull-secret") pod "global-pull-secret-syncer-lknm5" (UID: "e375ea8a-c7d3-4c35-a901-a5e9bf859073") : object "kube-system"/"original-pull-secret" not registered May 27 19:32:07.683903 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.683785 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e6ba391e-3a4a-4ab7-a6a0-ab1069701c90-system-cni-dir\") pod \"multus-additional-cni-plugins-jmfgh\" (UID: \"e6ba391e-3a4a-4ab7-a6a0-ab1069701c90\") " pod="openshift-multus/multus-additional-cni-plugins-jmfgh" May 27 19:32:07.683903 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.683814 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e6ba391e-3a4a-4ab7-a6a0-ab1069701c90-cnibin\") pod \"multus-additional-cni-plugins-jmfgh\" (UID: \"e6ba391e-3a4a-4ab7-a6a0-ab1069701c90\") " pod="openshift-multus/multus-additional-cni-plugins-jmfgh" May 27 19:32:07.683903 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.683842 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e6ba391e-3a4a-4ab7-a6a0-ab1069701c90-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jmfgh\" (UID: \"e6ba391e-3a4a-4ab7-a6a0-ab1069701c90\") " pod="openshift-multus/multus-additional-cni-plugins-jmfgh" May 27 19:32:07.683903 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.683847 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e6ba391e-3a4a-4ab7-a6a0-ab1069701c90-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jmfgh\" (UID: \"e6ba391e-3a4a-4ab7-a6a0-ab1069701c90\") " pod="openshift-multus/multus-additional-cni-plugins-jmfgh" May 27 19:32:07.683903 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.683866 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/88051d01-7dcf-48a9-b39a-b5f50cb8df95-konnectivity-ca\") pod \"konnectivity-agent-kcxhv\" (UID: \"88051d01-7dcf-48a9-b39a-b5f50cb8df95\") " pod="kube-system/konnectivity-agent-kcxhv" May 27 19:32:07.683903 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.683896 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e6ba391e-3a4a-4ab7-a6a0-ab1069701c90-cni-binary-copy\") pod \"multus-additional-cni-plugins-jmfgh\" (UID: \"e6ba391e-3a4a-4ab7-a6a0-ab1069701c90\") " pod="openshift-multus/multus-additional-cni-plugins-jmfgh" May 27 19:32:07.684593 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:07.683918 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 19:32:07.684593 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:07.683968 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34c87eb0-84f0-4f4c-b319-b6486fd20f52-metrics-certs podName:34c87eb0-84f0-4f4c-b319-b6486fd20f52 nodeName:}" failed. No retries permitted until 2026-05-27 19:32:08.183952099 +0000 UTC m=+3.220578801 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/34c87eb0-84f0-4f4c-b319-b6486fd20f52-metrics-certs") pod "network-metrics-daemon-nf6f5" (UID: "34c87eb0-84f0-4f4c-b319-b6486fd20f52") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 19:32:07.684593 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.683979 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b4eaa52-ed75-477d-bf99-dd416acd2d27-host-slash\") pod \"iptables-alerter-c8slr\" (UID: \"7b4eaa52-ed75-477d-bf99-dd416acd2d27\") " pod="openshift-network-operator/iptables-alerter-c8slr" May 27 19:32:07.684593 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.684031 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e6ba391e-3a4a-4ab7-a6a0-ab1069701c90-cnibin\") pod \"multus-additional-cni-plugins-jmfgh\" (UID: \"e6ba391e-3a4a-4ab7-a6a0-ab1069701c90\") " pod="openshift-multus/multus-additional-cni-plugins-jmfgh" May 27 19:32:07.684593 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.684053 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e6ba391e-3a4a-4ab7-a6a0-ab1069701c90-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jmfgh\" (UID: \"e6ba391e-3a4a-4ab7-a6a0-ab1069701c90\") " pod="openshift-multus/multus-additional-cni-plugins-jmfgh" May 27 19:32:07.684593 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.684110 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7b4eaa52-ed75-477d-bf99-dd416acd2d27-iptables-alerter-script\") pod \"iptables-alerter-c8slr\" (UID: \"7b4eaa52-ed75-477d-bf99-dd416acd2d27\") " pod="openshift-network-operator/iptables-alerter-c8slr" May 27 19:32:07.684593 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.684118 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e6ba391e-3a4a-4ab7-a6a0-ab1069701c90-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jmfgh\" (UID: \"e6ba391e-3a4a-4ab7-a6a0-ab1069701c90\") " pod="openshift-multus/multus-additional-cni-plugins-jmfgh" May 27 19:32:07.684593 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.684491 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/88051d01-7dcf-48a9-b39a-b5f50cb8df95-konnectivity-ca\") pod \"konnectivity-agent-kcxhv\" (UID: \"88051d01-7dcf-48a9-b39a-b5f50cb8df95\") " pod="kube-system/konnectivity-agent-kcxhv" May 27 19:32:07.684593 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.684515 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e6ba391e-3a4a-4ab7-a6a0-ab1069701c90-cni-binary-copy\") pod \"multus-additional-cni-plugins-jmfgh\" (UID: \"e6ba391e-3a4a-4ab7-a6a0-ab1069701c90\") " pod="openshift-multus/multus-additional-cni-plugins-jmfgh" May 27 19:32:07.686301 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.686259 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/88051d01-7dcf-48a9-b39a-b5f50cb8df95-agent-certs\") pod \"konnectivity-agent-kcxhv\" (UID: \"88051d01-7dcf-48a9-b39a-b5f50cb8df95\") " pod="kube-system/konnectivity-agent-kcxhv" May 27 19:32:07.693403 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.693379 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qdjh\" (UniqueName: \"kubernetes.io/projected/e6ba391e-3a4a-4ab7-a6a0-ab1069701c90-kube-api-access-9qdjh\") pod \"multus-additional-cni-plugins-jmfgh\" (UID: \"e6ba391e-3a4a-4ab7-a6a0-ab1069701c90\") " pod="openshift-multus/multus-additional-cni-plugins-jmfgh" May 27 19:32:07.694639 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.694614 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwlgk\" (UniqueName: \"kubernetes.io/projected/34c87eb0-84f0-4f4c-b319-b6486fd20f52-kube-api-access-nwlgk\") pod \"network-metrics-daemon-nf6f5\" (UID: \"34c87eb0-84f0-4f4c-b319-b6486fd20f52\") " pod="openshift-multus/network-metrics-daemon-nf6f5" May 27 19:32:07.695594 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.695576 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp9s4\" (UniqueName: \"kubernetes.io/projected/7b4eaa52-ed75-477d-bf99-dd416acd2d27-kube-api-access-qp9s4\") pod \"iptables-alerter-c8slr\" (UID: \"7b4eaa52-ed75-477d-bf99-dd416acd2d27\") " pod="openshift-network-operator/iptables-alerter-c8slr" May 27 19:32:07.769187 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.769104 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2bgsc" May 27 19:32:07.780978 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.780952 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkw25" May 27 19:32:07.789745 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.789724 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-246q2" May 27 19:32:07.793240 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.793220 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-l6kn5" May 27 19:32:07.799811 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.799790 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:07.806375 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.806356 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kcxhv" May 27 19:32:07.811277 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.811248 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jmfgh" May 27 19:32:07.817750 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:07.817735 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c8slr" May 27 19:32:08.187180 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:08.187144 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34c87eb0-84f0-4f4c-b319-b6486fd20f52-metrics-certs\") pod \"network-metrics-daemon-nf6f5\" (UID: \"34c87eb0-84f0-4f4c-b319-b6486fd20f52\") " pod="openshift-multus/network-metrics-daemon-nf6f5" May 27 19:32:08.187445 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:08.187194 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vt472\" (UniqueName: \"kubernetes.io/projected/1829aad5-1f6d-4bf4-9da6-15027f679994-kube-api-access-vt472\") pod \"network-check-target-6lzrp\" (UID: \"1829aad5-1f6d-4bf4-9da6-15027f679994\") " pod="openshift-network-diagnostics/network-check-target-6lzrp" May 27 19:32:08.187445 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:08.187236 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e375ea8a-c7d3-4c35-a901-a5e9bf859073-original-pull-secret\") pod \"global-pull-secret-syncer-lknm5\" (UID: \"e375ea8a-c7d3-4c35-a901-a5e9bf859073\") " pod="kube-system/global-pull-secret-syncer-lknm5" May 27 19:32:08.187445 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:08.187286 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 19:32:08.187445 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:08.187343 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 27 19:32:08.187445 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:08.187355 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34c87eb0-84f0-4f4c-b319-b6486fd20f52-metrics-certs podName:34c87eb0-84f0-4f4c-b319-b6486fd20f52 nodeName:}" failed. No retries permitted until 2026-05-27 19:32:09.187333342 +0000 UTC m=+4.223960030 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/34c87eb0-84f0-4f4c-b319-b6486fd20f52-metrics-certs") pod "network-metrics-daemon-nf6f5" (UID: "34c87eb0-84f0-4f4c-b319-b6486fd20f52") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 19:32:08.187445 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:08.187377 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e375ea8a-c7d3-4c35-a901-a5e9bf859073-original-pull-secret podName:e375ea8a-c7d3-4c35-a901-a5e9bf859073 nodeName:}" failed. No retries permitted until 2026-05-27 19:32:09.187367371 +0000 UTC m=+4.223994036 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e375ea8a-c7d3-4c35-a901-a5e9bf859073-original-pull-secret") pod "global-pull-secret-syncer-lknm5" (UID: "e375ea8a-c7d3-4c35-a901-a5e9bf859073") : object "kube-system"/"original-pull-secret" not registered May 27 19:32:08.187445 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:08.187391 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 19:32:08.187445 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:08.187416 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 19:32:08.187445 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:08.187430 2555 projected.go:194] Error preparing data for projected volume kube-api-access-vt472 for pod openshift-network-diagnostics/network-check-target-6lzrp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 19:32:08.187821 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:08.187500 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1829aad5-1f6d-4bf4-9da6-15027f679994-kube-api-access-vt472 podName:1829aad5-1f6d-4bf4-9da6-15027f679994 nodeName:}" failed. No retries permitted until 2026-05-27 19:32:09.187487281 +0000 UTC m=+4.224113948 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vt472" (UniqueName: "kubernetes.io/projected/1829aad5-1f6d-4bf4-9da6-15027f679994-kube-api-access-vt472") pod "network-check-target-6lzrp" (UID: "1829aad5-1f6d-4bf4-9da6-15027f679994") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 19:32:08.342589 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:08.342561 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b4eaa52_ed75_477d_bf99_dd416acd2d27.slice/crio-d9b3672a4b8362b238eb786f50c2937b3d15e4caf8cd176b7d1d0ab237c02a7c WatchSource:0}: Error finding container d9b3672a4b8362b238eb786f50c2937b3d15e4caf8cd176b7d1d0ab237c02a7c: Status 404 returned error can't find the container with id d9b3672a4b8362b238eb786f50c2937b3d15e4caf8cd176b7d1d0ab237c02a7c May 27 19:32:08.343790 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:08.343764 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88051d01_7dcf_48a9_b39a_b5f50cb8df95.slice/crio-b5d8e62054587d051599e7314e3aeaafcdec7dc9f97792775a47165b1ae91018 WatchSource:0}: Error finding container b5d8e62054587d051599e7314e3aeaafcdec7dc9f97792775a47165b1ae91018: Status 404 returned error can't find the container with id b5d8e62054587d051599e7314e3aeaafcdec7dc9f97792775a47165b1ae91018 May 27 19:32:08.344932 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:08.344911 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2decf54_fe75_4756_9550_5f9dbf380937.slice/crio-a7c31dd83cb35c2c84138f859548436d3a51371dea71409277cd3e208cad3583 WatchSource:0}: Error finding container a7c31dd83cb35c2c84138f859548436d3a51371dea71409277cd3e208cad3583: Status 404 returned error can't find the container with id a7c31dd83cb35c2c84138f859548436d3a51371dea71409277cd3e208cad3583 May 27 19:32:08.347477 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:08.347458 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6ba391e_3a4a_4ab7_a6a0_ab1069701c90.slice/crio-d7b9a59070912dd184e94f3c094ce705bf54e98c7f1b2be9a32e5bc8005efeea WatchSource:0}: Error finding container d7b9a59070912dd184e94f3c094ce705bf54e98c7f1b2be9a32e5bc8005efeea: Status 404 returned error can't find the container with id d7b9a59070912dd184e94f3c094ce705bf54e98c7f1b2be9a32e5bc8005efeea May 27 19:32:08.348583 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:08.348564 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod546d5521_7b50_46d6_829d_cbbe35bf130a.slice/crio-cefae5a47410829ae36c9815f11f82930bca41078829e5353229317bc2f880e6 WatchSource:0}: Error finding container cefae5a47410829ae36c9815f11f82930bca41078829e5353229317bc2f880e6: Status 404 returned error can't find the container with id cefae5a47410829ae36c9815f11f82930bca41078829e5353229317bc2f880e6 May 27 19:32:08.349710 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:08.349641 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd14eff58_e510_4dc2_a0ac_fb3ba83923bc.slice/crio-38a83ff8421a6d2ad1767dbafb8627164ffa8bd8f2b97e483918a1dd87684478 WatchSource:0}: Error finding container 38a83ff8421a6d2ad1767dbafb8627164ffa8bd8f2b97e483918a1dd87684478: Status 404 returned error can't find the container with id 38a83ff8421a6d2ad1767dbafb8627164ffa8bd8f2b97e483918a1dd87684478 May 27 19:32:08.351029 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:08.350975 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf469379_5081_4986_b3d4_92cc9119a3a2.slice/crio-87976d6a428dc9f3fb19bddd07c290e55d9adcc8f6472d1b8897edb48fcb8bf4 WatchSource:0}: Error finding container 87976d6a428dc9f3fb19bddd07c290e55d9adcc8f6472d1b8897edb48fcb8bf4: Status 404 returned error can't find the container with id 87976d6a428dc9f3fb19bddd07c290e55d9adcc8f6472d1b8897edb48fcb8bf4 May 27 19:32:08.351391 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:08.351370 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf52ea50_d810_4b2b_bde4_f58f4cb97288.slice/crio-78fb4a47bdc8f36c573bbb4a910dfc86deb9fc4745f31ed777db90435a8468b4 WatchSource:0}: Error finding container 78fb4a47bdc8f36c573bbb4a910dfc86deb9fc4745f31ed777db90435a8468b4: Status 404 returned error can't find the container with id 78fb4a47bdc8f36c573bbb4a910dfc86deb9fc4745f31ed777db90435a8468b4 May 27 19:32:08.534211 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:08.534102 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-26 19:27:06 +0000 UTC" deadline="2028-02-20 21:24:14.349078798 +0000 UTC" May 27 19:32:08.534211 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:08.534132 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15217h52m5.814950265s" May 27 19:32:08.579626 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:08.579602 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-l6kn5" event={"ID":"bf52ea50-d810-4b2b-bde4-f58f4cb97288","Type":"ContainerStarted","Data":"78fb4a47bdc8f36c573bbb4a910dfc86deb9fc4745f31ed777db90435a8468b4"} May 27 19:32:08.582985 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:08.580836 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkw25" event={"ID":"cf469379-5081-4986-b3d4-92cc9119a3a2","Type":"ContainerStarted","Data":"87976d6a428dc9f3fb19bddd07c290e55d9adcc8f6472d1b8897edb48fcb8bf4"} May 27 19:32:08.584230 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:08.584202 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pth57" event={"ID":"546d5521-7b50-46d6-829d-cbbe35bf130a","Type":"ContainerStarted","Data":"cefae5a47410829ae36c9815f11f82930bca41078829e5353229317bc2f880e6"} May 27 19:32:08.585099 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:08.585077 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-246q2" event={"ID":"f2decf54-fe75-4756-9550-5f9dbf380937","Type":"ContainerStarted","Data":"a7c31dd83cb35c2c84138f859548436d3a51371dea71409277cd3e208cad3583"} May 27 19:32:08.586484 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:08.586466 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-51.ec2.internal" event={"ID":"474a050b831840f986e5ea7c3b5dfc5b","Type":"ContainerStarted","Data":"d6fa4a93b4f78e1be576ce926b30321dff69047812131b0c3eac07659ec15b2d"} May 27 19:32:08.587368 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:08.587341 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2bgsc" event={"ID":"d14eff58-e510-4dc2-a0ac-fb3ba83923bc","Type":"ContainerStarted","Data":"38a83ff8421a6d2ad1767dbafb8627164ffa8bd8f2b97e483918a1dd87684478"} May 27 19:32:08.588184 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:08.588167 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmfgh" event={"ID":"e6ba391e-3a4a-4ab7-a6a0-ab1069701c90","Type":"ContainerStarted","Data":"d7b9a59070912dd184e94f3c094ce705bf54e98c7f1b2be9a32e5bc8005efeea"} May 27 19:32:08.589008 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:08.588989 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kcxhv" event={"ID":"88051d01-7dcf-48a9-b39a-b5f50cb8df95","Type":"ContainerStarted","Data":"b5d8e62054587d051599e7314e3aeaafcdec7dc9f97792775a47165b1ae91018"} May 27 19:32:08.589831 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:08.589813 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c8slr" event={"ID":"7b4eaa52-ed75-477d-bf99-dd416acd2d27","Type":"ContainerStarted","Data":"d9b3672a4b8362b238eb786f50c2937b3d15e4caf8cd176b7d1d0ab237c02a7c"} May 27 19:32:08.606018 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:08.605963 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-51.ec2.internal" podStartSLOduration=1.6059479140000001 podStartE2EDuration="1.605947914s" podCreationTimestamp="2026-05-27 19:32:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 19:32:08.605098975 +0000 UTC m=+3.641725661" watchObservedRunningTime="2026-05-27 19:32:08.605947914 +0000 UTC m=+3.642574603" May 27 19:32:09.196194 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:09.195252 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34c87eb0-84f0-4f4c-b319-b6486fd20f52-metrics-certs\") pod \"network-metrics-daemon-nf6f5\" (UID: \"34c87eb0-84f0-4f4c-b319-b6486fd20f52\") " pod="openshift-multus/network-metrics-daemon-nf6f5" May 27 19:32:09.196194 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:09.195318 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vt472\" (UniqueName: \"kubernetes.io/projected/1829aad5-1f6d-4bf4-9da6-15027f679994-kube-api-access-vt472\") pod \"network-check-target-6lzrp\" (UID: \"1829aad5-1f6d-4bf4-9da6-15027f679994\") " pod="openshift-network-diagnostics/network-check-target-6lzrp" May 27 19:32:09.196194 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:09.195364 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e375ea8a-c7d3-4c35-a901-a5e9bf859073-original-pull-secret\") pod \"global-pull-secret-syncer-lknm5\" (UID: \"e375ea8a-c7d3-4c35-a901-a5e9bf859073\") " pod="kube-system/global-pull-secret-syncer-lknm5" May 27 19:32:09.196194 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:09.195500 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 27 19:32:09.196194 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:09.195565 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e375ea8a-c7d3-4c35-a901-a5e9bf859073-original-pull-secret podName:e375ea8a-c7d3-4c35-a901-a5e9bf859073 nodeName:}" failed. No retries permitted until 2026-05-27 19:32:11.195547236 +0000 UTC m=+6.232173906 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e375ea8a-c7d3-4c35-a901-a5e9bf859073-original-pull-secret") pod "global-pull-secret-syncer-lknm5" (UID: "e375ea8a-c7d3-4c35-a901-a5e9bf859073") : object "kube-system"/"original-pull-secret" not registered May 27 19:32:09.196194 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:09.195965 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 19:32:09.196194 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:09.196026 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34c87eb0-84f0-4f4c-b319-b6486fd20f52-metrics-certs podName:34c87eb0-84f0-4f4c-b319-b6486fd20f52 nodeName:}" failed. No retries permitted until 2026-05-27 19:32:11.196009735 +0000 UTC m=+6.232636402 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/34c87eb0-84f0-4f4c-b319-b6486fd20f52-metrics-certs") pod "network-metrics-daemon-nf6f5" (UID: "34c87eb0-84f0-4f4c-b319-b6486fd20f52") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 19:32:09.196194 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:09.196097 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 19:32:09.196194 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:09.196110 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 19:32:09.196194 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:09.196122 2555 projected.go:194] Error preparing data for projected volume kube-api-access-vt472 for pod openshift-network-diagnostics/network-check-target-6lzrp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 19:32:09.196194 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:09.196153 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1829aad5-1f6d-4bf4-9da6-15027f679994-kube-api-access-vt472 podName:1829aad5-1f6d-4bf4-9da6-15027f679994 nodeName:}" failed. No retries permitted until 2026-05-27 19:32:11.196143317 +0000 UTC m=+6.232769985 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vt472" (UniqueName: "kubernetes.io/projected/1829aad5-1f6d-4bf4-9da6-15027f679994-kube-api-access-vt472") pod "network-check-target-6lzrp" (UID: "1829aad5-1f6d-4bf4-9da6-15027f679994") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 19:32:09.573439 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:09.573409 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6lzrp" May 27 19:32:09.573899 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:09.573530 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6lzrp" podUID="1829aad5-1f6d-4bf4-9da6-15027f679994" May 27 19:32:09.573899 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:09.573873 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lknm5" May 27 19:32:09.574012 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:09.573969 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lknm5" podUID="e375ea8a-c7d3-4c35-a901-a5e9bf859073" May 27 19:32:09.574069 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:09.574016 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nf6f5" May 27 19:32:09.574117 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:09.574096 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nf6f5" podUID="34c87eb0-84f0-4f4c-b319-b6486fd20f52" May 27 19:32:09.599301 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:09.598909 2555 generic.go:358] "Generic (PLEG): container finished" podID="d9ce5379620ec9459777df2f25374e23" containerID="fce8e38c0dd360645f5acef43ea71b3b8968ac39f618bd584cc3386da1922704" exitCode=0 May 27 19:32:09.600109 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:09.600031 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-51.ec2.internal" event={"ID":"d9ce5379620ec9459777df2f25374e23","Type":"ContainerDied","Data":"fce8e38c0dd360645f5acef43ea71b3b8968ac39f618bd584cc3386da1922704"} May 27 19:32:10.612805 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:10.612752 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-51.ec2.internal" event={"ID":"d9ce5379620ec9459777df2f25374e23","Type":"ContainerStarted","Data":"ac1ed4c0b8fd38ae7c77b3573bcb215a17a4c987e10600abbae48ac732c0f4a9"} May 27 19:32:11.213312 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:11.213259 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e375ea8a-c7d3-4c35-a901-a5e9bf859073-original-pull-secret\") pod \"global-pull-secret-syncer-lknm5\" (UID: \"e375ea8a-c7d3-4c35-a901-a5e9bf859073\") " pod="kube-system/global-pull-secret-syncer-lknm5" May 27 19:32:11.213492 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:11.213367 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34c87eb0-84f0-4f4c-b319-b6486fd20f52-metrics-certs\") pod \"network-metrics-daemon-nf6f5\" (UID: \"34c87eb0-84f0-4f4c-b319-b6486fd20f52\") " pod="openshift-multus/network-metrics-daemon-nf6f5" May 27 19:32:11.213492 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:11.213380 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 27 19:32:11.213492 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:11.213403 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vt472\" (UniqueName: \"kubernetes.io/projected/1829aad5-1f6d-4bf4-9da6-15027f679994-kube-api-access-vt472\") pod \"network-check-target-6lzrp\" (UID: \"1829aad5-1f6d-4bf4-9da6-15027f679994\") " pod="openshift-network-diagnostics/network-check-target-6lzrp" May 27 19:32:11.213492 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:11.213445 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e375ea8a-c7d3-4c35-a901-a5e9bf859073-original-pull-secret podName:e375ea8a-c7d3-4c35-a901-a5e9bf859073 nodeName:}" failed. No retries permitted until 2026-05-27 19:32:15.213428688 +0000 UTC m=+10.250055354 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e375ea8a-c7d3-4c35-a901-a5e9bf859073-original-pull-secret") pod "global-pull-secret-syncer-lknm5" (UID: "e375ea8a-c7d3-4c35-a901-a5e9bf859073") : object "kube-system"/"original-pull-secret" not registered May 27 19:32:11.213743 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:11.213527 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 19:32:11.213743 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:11.213544 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 19:32:11.213743 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:11.213557 2555 projected.go:194] Error preparing data for projected volume kube-api-access-vt472 for pod openshift-network-diagnostics/network-check-target-6lzrp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 19:32:11.213743 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:11.213604 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1829aad5-1f6d-4bf4-9da6-15027f679994-kube-api-access-vt472 podName:1829aad5-1f6d-4bf4-9da6-15027f679994 nodeName:}" failed. No retries permitted until 2026-05-27 19:32:15.213588089 +0000 UTC m=+10.250214760 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vt472" (UniqueName: "kubernetes.io/projected/1829aad5-1f6d-4bf4-9da6-15027f679994-kube-api-access-vt472") pod "network-check-target-6lzrp" (UID: "1829aad5-1f6d-4bf4-9da6-15027f679994") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 19:32:11.213743 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:11.213663 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 19:32:11.213743 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:11.213692 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34c87eb0-84f0-4f4c-b319-b6486fd20f52-metrics-certs podName:34c87eb0-84f0-4f4c-b319-b6486fd20f52 nodeName:}" failed. No retries permitted until 2026-05-27 19:32:15.213681782 +0000 UTC m=+10.250308451 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/34c87eb0-84f0-4f4c-b319-b6486fd20f52-metrics-certs") pod "network-metrics-daemon-nf6f5" (UID: "34c87eb0-84f0-4f4c-b319-b6486fd20f52") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 19:32:11.574319 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:11.574253 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6lzrp" May 27 19:32:11.574509 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:11.574420 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6lzrp" podUID="1829aad5-1f6d-4bf4-9da6-15027f679994" May 27 19:32:11.574509 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:11.574467 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lknm5" May 27 19:32:11.574627 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:11.574567 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lknm5" podUID="e375ea8a-c7d3-4c35-a901-a5e9bf859073" May 27 19:32:11.574627 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:11.574621 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nf6f5" May 27 19:32:11.575492 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:11.575097 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nf6f5" podUID="34c87eb0-84f0-4f4c-b319-b6486fd20f52" May 27 19:32:13.573185 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:13.573152 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6lzrp" May 27 19:32:13.573664 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:13.573164 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nf6f5" May 27 19:32:13.573664 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:13.573294 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6lzrp" podUID="1829aad5-1f6d-4bf4-9da6-15027f679994" May 27 19:32:13.573664 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:13.573366 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nf6f5" podUID="34c87eb0-84f0-4f4c-b319-b6486fd20f52" May 27 19:32:13.573664 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:13.573394 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lknm5" May 27 19:32:13.573664 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:13.573486 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lknm5" podUID="e375ea8a-c7d3-4c35-a901-a5e9bf859073" May 27 19:32:15.252333 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:15.252291 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34c87eb0-84f0-4f4c-b319-b6486fd20f52-metrics-certs\") pod \"network-metrics-daemon-nf6f5\" (UID: \"34c87eb0-84f0-4f4c-b319-b6486fd20f52\") " pod="openshift-multus/network-metrics-daemon-nf6f5" May 27 19:32:15.252791 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:15.252343 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vt472\" (UniqueName: \"kubernetes.io/projected/1829aad5-1f6d-4bf4-9da6-15027f679994-kube-api-access-vt472\") pod \"network-check-target-6lzrp\" (UID: \"1829aad5-1f6d-4bf4-9da6-15027f679994\") " pod="openshift-network-diagnostics/network-check-target-6lzrp" May 27 19:32:15.252791 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:15.252386 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e375ea8a-c7d3-4c35-a901-a5e9bf859073-original-pull-secret\") pod \"global-pull-secret-syncer-lknm5\" (UID: \"e375ea8a-c7d3-4c35-a901-a5e9bf859073\") " pod="kube-system/global-pull-secret-syncer-lknm5" May 27 19:32:15.252791 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:15.252527 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 27 19:32:15.252791 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:15.252592 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e375ea8a-c7d3-4c35-a901-a5e9bf859073-original-pull-secret podName:e375ea8a-c7d3-4c35-a901-a5e9bf859073 nodeName:}" failed. No retries permitted until 2026-05-27 19:32:23.252574191 +0000 UTC m=+18.289200858 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e375ea8a-c7d3-4c35-a901-a5e9bf859073-original-pull-secret") pod "global-pull-secret-syncer-lknm5" (UID: "e375ea8a-c7d3-4c35-a901-a5e9bf859073") : object "kube-system"/"original-pull-secret" not registered May 27 19:32:15.252791 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:15.252658 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 19:32:15.252791 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:15.252690 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34c87eb0-84f0-4f4c-b319-b6486fd20f52-metrics-certs podName:34c87eb0-84f0-4f4c-b319-b6486fd20f52 nodeName:}" failed. No retries permitted until 2026-05-27 19:32:23.252677326 +0000 UTC m=+18.289303990 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/34c87eb0-84f0-4f4c-b319-b6486fd20f52-metrics-certs") pod "network-metrics-daemon-nf6f5" (UID: "34c87eb0-84f0-4f4c-b319-b6486fd20f52") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 19:32:15.252791 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:15.252763 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 19:32:15.252791 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:15.252775 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 19:32:15.252791 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:15.252787 2555 projected.go:194] Error preparing data for projected volume kube-api-access-vt472 for pod openshift-network-diagnostics/network-check-target-6lzrp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 19:32:15.253335 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:15.252819 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1829aad5-1f6d-4bf4-9da6-15027f679994-kube-api-access-vt472 podName:1829aad5-1f6d-4bf4-9da6-15027f679994 nodeName:}" failed. No retries permitted until 2026-05-27 19:32:23.25280901 +0000 UTC m=+18.289435681 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vt472" (UniqueName: "kubernetes.io/projected/1829aad5-1f6d-4bf4-9da6-15027f679994-kube-api-access-vt472") pod "network-check-target-6lzrp" (UID: "1829aad5-1f6d-4bf4-9da6-15027f679994") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 19:32:15.574419 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:15.574386 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6lzrp" May 27 19:32:15.574607 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:15.574500 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6lzrp" podUID="1829aad5-1f6d-4bf4-9da6-15027f679994" May 27 19:32:15.575164 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:15.574901 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nf6f5" May 27 19:32:15.575164 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:15.575007 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nf6f5" podUID="34c87eb0-84f0-4f4c-b319-b6486fd20f52" May 27 19:32:15.575164 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:15.575066 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lknm5" May 27 19:32:15.575164 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:15.575133 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lknm5" podUID="e375ea8a-c7d3-4c35-a901-a5e9bf859073" May 27 19:32:17.573090 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:17.573056 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nf6f5" May 27 19:32:17.573543 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:17.573056 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6lzrp" May 27 19:32:17.573543 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:17.573181 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nf6f5" podUID="34c87eb0-84f0-4f4c-b319-b6486fd20f52" May 27 19:32:17.573543 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:17.573056 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lknm5" May 27 19:32:17.573543 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:17.573251 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6lzrp" podUID="1829aad5-1f6d-4bf4-9da6-15027f679994" May 27 19:32:17.573543 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:17.573347 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lknm5" podUID="e375ea8a-c7d3-4c35-a901-a5e9bf859073" May 27 19:32:19.572619 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:19.572587 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6lzrp" May 27 19:32:19.573064 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:19.572597 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nf6f5" May 27 19:32:19.573064 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:19.572707 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6lzrp" podUID="1829aad5-1f6d-4bf4-9da6-15027f679994" May 27 19:32:19.573064 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:19.572804 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nf6f5" podUID="34c87eb0-84f0-4f4c-b319-b6486fd20f52" May 27 19:32:19.573064 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:19.572849 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lknm5" May 27 19:32:19.573064 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:19.572916 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lknm5" podUID="e375ea8a-c7d3-4c35-a901-a5e9bf859073" May 27 19:32:21.573229 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:21.573195 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nf6f5" May 27 19:32:21.573600 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:21.573330 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lknm5" May 27 19:32:21.573600 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:21.573341 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nf6f5" podUID="34c87eb0-84f0-4f4c-b319-b6486fd20f52" May 27 19:32:21.573600 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:21.573414 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6lzrp" May 27 19:32:21.573600 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:21.573503 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6lzrp" podUID="1829aad5-1f6d-4bf4-9da6-15027f679994" May 27 19:32:21.573600 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:21.573408 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lknm5" podUID="e375ea8a-c7d3-4c35-a901-a5e9bf859073" May 27 19:32:23.311616 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:23.311579 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34c87eb0-84f0-4f4c-b319-b6486fd20f52-metrics-certs\") pod \"network-metrics-daemon-nf6f5\" (UID: \"34c87eb0-84f0-4f4c-b319-b6486fd20f52\") " pod="openshift-multus/network-metrics-daemon-nf6f5" May 27 19:32:23.311616 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:23.311623 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vt472\" (UniqueName: \"kubernetes.io/projected/1829aad5-1f6d-4bf4-9da6-15027f679994-kube-api-access-vt472\") pod \"network-check-target-6lzrp\" (UID: \"1829aad5-1f6d-4bf4-9da6-15027f679994\") " pod="openshift-network-diagnostics/network-check-target-6lzrp" May 27 19:32:23.312198 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:23.311659 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e375ea8a-c7d3-4c35-a901-a5e9bf859073-original-pull-secret\") pod \"global-pull-secret-syncer-lknm5\" (UID: \"e375ea8a-c7d3-4c35-a901-a5e9bf859073\") " pod="kube-system/global-pull-secret-syncer-lknm5" May 27 19:32:23.312198 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:23.311759 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 27 19:32:23.312198 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:23.311765 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 19:32:23.312198 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:23.311822 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 19:32:23.312198 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:23.311832 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e375ea8a-c7d3-4c35-a901-a5e9bf859073-original-pull-secret podName:e375ea8a-c7d3-4c35-a901-a5e9bf859073 nodeName:}" failed. No retries permitted until 2026-05-27 19:32:39.31181005 +0000 UTC m=+34.348436722 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e375ea8a-c7d3-4c35-a901-a5e9bf859073-original-pull-secret") pod "global-pull-secret-syncer-lknm5" (UID: "e375ea8a-c7d3-4c35-a901-a5e9bf859073") : object "kube-system"/"original-pull-secret" not registered May 27 19:32:23.312198 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:23.311847 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 19:32:23.312198 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:23.311862 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34c87eb0-84f0-4f4c-b319-b6486fd20f52-metrics-certs podName:34c87eb0-84f0-4f4c-b319-b6486fd20f52 nodeName:}" failed. No retries permitted until 2026-05-27 19:32:39.311853597 +0000 UTC m=+34.348480262 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/34c87eb0-84f0-4f4c-b319-b6486fd20f52-metrics-certs") pod "network-metrics-daemon-nf6f5" (UID: "34c87eb0-84f0-4f4c-b319-b6486fd20f52") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 19:32:23.312198 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:23.311862 2555 projected.go:194] Error preparing data for projected volume kube-api-access-vt472 for pod openshift-network-diagnostics/network-check-target-6lzrp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 19:32:23.312198 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:23.311917 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1829aad5-1f6d-4bf4-9da6-15027f679994-kube-api-access-vt472 podName:1829aad5-1f6d-4bf4-9da6-15027f679994 nodeName:}" failed. No retries permitted until 2026-05-27 19:32:39.311902401 +0000 UTC m=+34.348529071 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vt472" (UniqueName: "kubernetes.io/projected/1829aad5-1f6d-4bf4-9da6-15027f679994-kube-api-access-vt472") pod "network-check-target-6lzrp" (UID: "1829aad5-1f6d-4bf4-9da6-15027f679994") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 19:32:23.573527 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:23.573434 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lknm5" May 27 19:32:23.573695 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:23.573434 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6lzrp" May 27 19:32:23.573695 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:23.573570 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lknm5" podUID="e375ea8a-c7d3-4c35-a901-a5e9bf859073" May 27 19:32:23.573695 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:23.573434 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nf6f5" May 27 19:32:23.573695 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:23.573647 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6lzrp" podUID="1829aad5-1f6d-4bf4-9da6-15027f679994" May 27 19:32:23.573912 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:23.573713 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nf6f5" podUID="34c87eb0-84f0-4f4c-b319-b6486fd20f52" May 27 19:32:25.573911 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:25.573880 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6lzrp" May 27 19:32:25.574399 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:25.573973 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6lzrp" podUID="1829aad5-1f6d-4bf4-9da6-15027f679994" May 27 19:32:25.574399 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:25.574063 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lknm5" May 27 19:32:25.574399 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:25.574168 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lknm5" podUID="e375ea8a-c7d3-4c35-a901-a5e9bf859073" May 27 19:32:25.574399 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:25.574214 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nf6f5" May 27 19:32:25.574399 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:25.574337 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nf6f5" podUID="34c87eb0-84f0-4f4c-b319-b6486fd20f52" May 27 19:32:26.564096 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:26.563907 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-51.ec2.internal" podStartSLOduration=19.563895134 podStartE2EDuration="19.563895134s" podCreationTimestamp="2026-05-27 19:32:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 19:32:10.630068835 +0000 UTC m=+5.666695524" watchObservedRunningTime="2026-05-27 19:32:26.563895134 +0000 UTC m=+21.600521821" May 27 19:32:26.564569 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:26.564551 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-2hvwq"] May 27 19:32:26.592512 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:26.592486 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2hvwq" May 27 19:32:26.594860 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:26.594680 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 27 19:32:26.594971 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:26.594859 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-76w72\"" May 27 19:32:26.594971 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:26.594820 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 27 19:32:26.639489 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:26.639464 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkw25" event={"ID":"cf469379-5081-4986-b3d4-92cc9119a3a2","Type":"ContainerStarted","Data":"8d531148617098b3543954f5f46e7fa1c6b251a16ad6423e4bcb5eb0d45f6fc6"} May 27 19:32:26.641209 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:26.641187 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pth57" event={"ID":"546d5521-7b50-46d6-829d-cbbe35bf130a","Type":"ContainerStarted","Data":"8e02294660bfcfd2d5bc0bc96da69b97d11425deff8965cdecfa54dee2a8e967"} May 27 19:32:26.641316 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:26.641218 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pth57" event={"ID":"546d5521-7b50-46d6-829d-cbbe35bf130a","Type":"ContainerStarted","Data":"d084aa095acf797dad5cfeb9462403b8768b12306a40942a5f7acf6fd1fd7cc4"} May 27 19:32:26.641316 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:26.641231 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pth57" event={"ID":"546d5521-7b50-46d6-829d-cbbe35bf130a","Type":"ContainerStarted","Data":"56bd5071e2678feebf6f445151a531d6934a02c959fa11e1a4e8bf75840e44e2"} May 27 19:32:26.641316 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:26.641243 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pth57" event={"ID":"546d5521-7b50-46d6-829d-cbbe35bf130a","Type":"ContainerStarted","Data":"f0e2559324291e300a33c6d9153d544b603fbda10dc693baf83d4476a0b4f23b"} May 27 19:32:26.642333 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:26.642298 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-246q2" event={"ID":"f2decf54-fe75-4756-9550-5f9dbf380937","Type":"ContainerStarted","Data":"9a6faf5716e7f4f8915fb2a7ada2fc9f67a66833c5a614eff1edfb93d454acf2"} May 27 19:32:26.643440 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:26.643420 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2bgsc" event={"ID":"d14eff58-e510-4dc2-a0ac-fb3ba83923bc","Type":"ContainerStarted","Data":"f6e501b01f0c729de799eb63cbdfae1f557dc8bd3110c0406b0f4152dca1a1d4"} May 27 19:32:26.644600 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:26.644579 2555 generic.go:358] "Generic (PLEG): container finished" podID="e6ba391e-3a4a-4ab7-a6a0-ab1069701c90" containerID="c89aae567e41e7cf7e29cd8f7f1fb4b75c12156a8814037a76462ebd92e75a56" exitCode=0 May 27 19:32:26.644670 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:26.644646 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmfgh" event={"ID":"e6ba391e-3a4a-4ab7-a6a0-ab1069701c90","Type":"ContainerDied","Data":"c89aae567e41e7cf7e29cd8f7f1fb4b75c12156a8814037a76462ebd92e75a56"} May 27 19:32:26.645906 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:26.645883 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kcxhv" event={"ID":"88051d01-7dcf-48a9-b39a-b5f50cb8df95","Type":"ContainerStarted","Data":"fa527d0a3c9f87628726f60d8f89471eb7e9a5f2346c3d33233d66a07d5f48cd"} May 27 19:32:26.647086 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:26.647065 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-l6kn5" event={"ID":"bf52ea50-d810-4b2b-bde4-f58f4cb97288","Type":"ContainerStarted","Data":"efde46fc52728f55062d53549be563c96cbdcaec9e6772d937c593201ff1ef9c"} May 27 19:32:26.689004 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:26.688959 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kcxhv" podStartSLOduration=8.498211662 podStartE2EDuration="21.688946807s" podCreationTimestamp="2026-05-27 19:32:05 +0000 UTC" firstStartedPulling="2026-05-27 19:32:08.346323024 +0000 UTC m=+3.382949706" lastFinishedPulling="2026-05-27 19:32:21.537058176 +0000 UTC m=+16.573684851" observedRunningTime="2026-05-27 19:32:26.688732711 +0000 UTC m=+21.725359399" watchObservedRunningTime="2026-05-27 19:32:26.688946807 +0000 UTC m=+21.725573494" May 27 19:32:26.689127 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:26.689107 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-246q2" podStartSLOduration=3.923394891 podStartE2EDuration="21.689100808s" podCreationTimestamp="2026-05-27 19:32:05 +0000 UTC" firstStartedPulling="2026-05-27 19:32:08.34681957 +0000 UTC m=+3.383446251" lastFinishedPulling="2026-05-27 19:32:26.112525501 +0000 UTC m=+21.149152168" observedRunningTime="2026-05-27 19:32:26.676122148 +0000 UTC m=+21.712748835" watchObservedRunningTime="2026-05-27 19:32:26.689100808 +0000 UTC m=+21.725727493" May 27 19:32:26.703448 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:26.703412 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-2bgsc" podStartSLOduration=3.894576063 podStartE2EDuration="21.703399982s" podCreationTimestamp="2026-05-27 19:32:05 +0000 UTC" firstStartedPulling="2026-05-27 19:32:08.351835448 +0000 UTC m=+3.388462116" lastFinishedPulling="2026-05-27 19:32:26.160659367 +0000 UTC m=+21.197286035" observedRunningTime="2026-05-27 19:32:26.703158027 +0000 UTC m=+21.739784715" watchObservedRunningTime="2026-05-27 19:32:26.703399982 +0000 UTC m=+21.740026668" May 27 19:32:26.715318 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:26.715283 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-l6kn5" podStartSLOduration=3.961156258 podStartE2EDuration="21.715258684s" podCreationTimestamp="2026-05-27 19:32:05 +0000 UTC" firstStartedPulling="2026-05-27 19:32:08.353725879 +0000 UTC m=+3.390352557" lastFinishedPulling="2026-05-27 19:32:26.10782831 +0000 UTC m=+21.144454983" observedRunningTime="2026-05-27 19:32:26.715253574 +0000 UTC m=+21.751880260" watchObservedRunningTime="2026-05-27 19:32:26.715258684 +0000 UTC m=+21.751885392" May 27 19:32:26.735932 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:26.735901 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2xss\" (UniqueName: \"kubernetes.io/projected/e7cb0741-7765-422b-8269-5a430024b259-kube-api-access-k2xss\") pod \"node-resolver-2hvwq\" (UID: \"e7cb0741-7765-422b-8269-5a430024b259\") " pod="openshift-dns/node-resolver-2hvwq" May 27 19:32:26.736054 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:26.735987 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7cb0741-7765-422b-8269-5a430024b259-tmp-dir\") pod \"node-resolver-2hvwq\" (UID: \"e7cb0741-7765-422b-8269-5a430024b259\") " pod="openshift-dns/node-resolver-2hvwq" May 27 19:32:26.736054 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:26.736045 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e7cb0741-7765-422b-8269-5a430024b259-hosts-file\") pod \"node-resolver-2hvwq\" (UID: \"e7cb0741-7765-422b-8269-5a430024b259\") " pod="openshift-dns/node-resolver-2hvwq" May 27 19:32:26.837485 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:26.837457 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k2xss\" (UniqueName: \"kubernetes.io/projected/e7cb0741-7765-422b-8269-5a430024b259-kube-api-access-k2xss\") pod \"node-resolver-2hvwq\" (UID: \"e7cb0741-7765-422b-8269-5a430024b259\") " pod="openshift-dns/node-resolver-2hvwq" May 27 19:32:26.837592 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:26.837510 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7cb0741-7765-422b-8269-5a430024b259-tmp-dir\") pod \"node-resolver-2hvwq\" (UID: \"e7cb0741-7765-422b-8269-5a430024b259\") " pod="openshift-dns/node-resolver-2hvwq" May 27 19:32:26.837592 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:26.837540 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e7cb0741-7765-422b-8269-5a430024b259-hosts-file\") pod \"node-resolver-2hvwq\" (UID: \"e7cb0741-7765-422b-8269-5a430024b259\") " pod="openshift-dns/node-resolver-2hvwq" May 27 19:32:26.837717 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:26.837634 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e7cb0741-7765-422b-8269-5a430024b259-hosts-file\") pod \"node-resolver-2hvwq\" (UID: \"e7cb0741-7765-422b-8269-5a430024b259\") " pod="openshift-dns/node-resolver-2hvwq" May 27 19:32:26.837853 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:26.837826 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7cb0741-7765-422b-8269-5a430024b259-tmp-dir\") pod \"node-resolver-2hvwq\" (UID: \"e7cb0741-7765-422b-8269-5a430024b259\") " pod="openshift-dns/node-resolver-2hvwq" May 27 19:32:26.851912 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:26.851856 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2xss\" (UniqueName: \"kubernetes.io/projected/e7cb0741-7765-422b-8269-5a430024b259-kube-api-access-k2xss\") pod \"node-resolver-2hvwq\" (UID: \"e7cb0741-7765-422b-8269-5a430024b259\") " pod="openshift-dns/node-resolver-2hvwq" May 27 19:32:26.900923 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:26.900889 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2hvwq" May 27 19:32:26.908147 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:26.908120 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7cb0741_7765_422b_8269_5a430024b259.slice/crio-87defca589e844e819d1367fdc7677e22fae8db30877c335f94c131dfd50335a WatchSource:0}: Error finding container 87defca589e844e819d1367fdc7677e22fae8db30877c335f94c131dfd50335a: Status 404 returned error can't find the container with id 87defca589e844e819d1367fdc7677e22fae8db30877c335f94c131dfd50335a May 27 19:32:27.407405 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:27.407383 2555 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 27 19:32:27.561715 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:27.561158 2555 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-27T19:32:27.407401718Z","UUID":"5aff061b-8e30-491c-a1c1-a3a8d11d26d6","Handler":null,"Name":"","Endpoint":""} May 27 19:32:27.565564 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:27.565538 2555 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 27 19:32:27.565697 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:27.565574 2555 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 27 19:32:27.573217 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:27.573191 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nf6f5" May 27 19:32:27.573389 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:27.573189 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6lzrp" May 27 19:32:27.573389 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:27.573191 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lknm5" May 27 19:32:27.573389 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:27.573377 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nf6f5" podUID="34c87eb0-84f0-4f4c-b319-b6486fd20f52" May 27 19:32:27.573568 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:27.573428 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6lzrp" podUID="1829aad5-1f6d-4bf4-9da6-15027f679994" May 27 19:32:27.573568 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:27.573524 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lknm5" podUID="e375ea8a-c7d3-4c35-a901-a5e9bf859073" May 27 19:32:27.650438 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:27.650359 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c8slr" event={"ID":"7b4eaa52-ed75-477d-bf99-dd416acd2d27","Type":"ContainerStarted","Data":"855897bda69ae3da2afb521cd56921788e0f5a4be2c7207eb088db529f9ff0cc"} May 27 19:32:27.651767 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:27.651738 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2hvwq" event={"ID":"e7cb0741-7765-422b-8269-5a430024b259","Type":"ContainerStarted","Data":"42cbd55b15a9204d9bb32e9bdb5d1a015b3ea14f4559f377652092555732d26c"} May 27 19:32:27.651918 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:27.651777 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2hvwq" event={"ID":"e7cb0741-7765-422b-8269-5a430024b259","Type":"ContainerStarted","Data":"87defca589e844e819d1367fdc7677e22fae8db30877c335f94c131dfd50335a"} May 27 19:32:27.653386 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:27.653358 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkw25" event={"ID":"cf469379-5081-4986-b3d4-92cc9119a3a2","Type":"ContainerStarted","Data":"4aa1bd725df593f7bb92dbd11284bf9eccefdfcba114a0e671a5e3d1b5a98125"} May 27 19:32:27.656247 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:27.656209 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pth57" event={"ID":"546d5521-7b50-46d6-829d-cbbe35bf130a","Type":"ContainerStarted","Data":"3044ebf193b7b7454de3f67300f3fa6d0757fe56239c8c526df3383acfe4e8c5"} May 27 19:32:27.656364 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:27.656250 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pth57" event={"ID":"546d5521-7b50-46d6-829d-cbbe35bf130a","Type":"ContainerStarted","Data":"36c864765d5ae1fb97883eb61f4aabc4c7658d217af1fb7a6f518e1a91fcd415"} May 27 19:32:27.685594 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:27.685556 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-c8slr" podStartSLOduration=3.9208058169999997 podStartE2EDuration="21.685544647s" podCreationTimestamp="2026-05-27 19:32:06 +0000 UTC" firstStartedPulling="2026-05-27 19:32:08.344344095 +0000 UTC m=+3.380970761" lastFinishedPulling="2026-05-27 19:32:26.10908291 +0000 UTC m=+21.145709591" observedRunningTime="2026-05-27 19:32:27.669958379 +0000 UTC m=+22.706585066" watchObservedRunningTime="2026-05-27 19:32:27.685544647 +0000 UTC m=+22.722171334" May 27 19:32:28.659902 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:28.659865 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkw25" event={"ID":"cf469379-5081-4986-b3d4-92cc9119a3a2","Type":"ContainerStarted","Data":"e2251ff99b52ba4152d13bfde430659305e7c1d84a639a823c4b37e4fd3683a6"} May 27 19:32:29.572722 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:29.572503 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lknm5" May 27 19:32:29.572907 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:29.572822 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lknm5" podUID="e375ea8a-c7d3-4c35-a901-a5e9bf859073" May 27 19:32:29.572907 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:29.572538 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nf6f5" May 27 19:32:29.573022 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:29.572942 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nf6f5" podUID="34c87eb0-84f0-4f4c-b319-b6486fd20f52" May 27 19:32:29.573022 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:29.572549 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6lzrp" May 27 19:32:29.573130 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:29.573024 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6lzrp" podUID="1829aad5-1f6d-4bf4-9da6-15027f679994" May 27 19:32:29.665283 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:29.665242 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pth57" event={"ID":"546d5521-7b50-46d6-829d-cbbe35bf130a","Type":"ContainerStarted","Data":"469bcb475f5b5ea44f00b64899cc2d27f433c374642e14d67b0324062b59efc9"} May 27 19:32:29.684513 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:29.684469 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkw25" podStartSLOduration=4.504106183 podStartE2EDuration="24.684455613s" podCreationTimestamp="2026-05-27 19:32:05 +0000 UTC" firstStartedPulling="2026-05-27 19:32:08.352539083 +0000 UTC m=+3.389165763" lastFinishedPulling="2026-05-27 19:32:28.532888513 +0000 UTC m=+23.569515193" observedRunningTime="2026-05-27 19:32:29.684372045 +0000 UTC m=+24.720998734" watchObservedRunningTime="2026-05-27 19:32:29.684455613 +0000 UTC m=+24.721082299" May 27 19:32:29.684905 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:29.684876 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-2hvwq" podStartSLOduration=3.68487092 podStartE2EDuration="3.68487092s" podCreationTimestamp="2026-05-27 19:32:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 19:32:27.685388288 +0000 UTC m=+22.722014975" watchObservedRunningTime="2026-05-27 19:32:29.68487092 +0000 UTC m=+24.721497607" May 27 19:32:30.699510 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:30.699479 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kcxhv" May 27 19:32:30.700153 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:30.700135 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kcxhv" May 27 19:32:31.572908 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:31.572876 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6lzrp" May 27 19:32:31.573041 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:31.572887 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nf6f5" May 27 19:32:31.573041 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:31.572983 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6lzrp" podUID="1829aad5-1f6d-4bf4-9da6-15027f679994" May 27 19:32:31.573041 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:31.572993 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lknm5" May 27 19:32:31.573184 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:31.573095 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nf6f5" podUID="34c87eb0-84f0-4f4c-b319-b6486fd20f52" May 27 19:32:31.573230 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:31.573187 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lknm5" podUID="e375ea8a-c7d3-4c35-a901-a5e9bf859073" May 27 19:32:31.671151 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:31.671121 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pth57" event={"ID":"546d5521-7b50-46d6-829d-cbbe35bf130a","Type":"ContainerStarted","Data":"70a046d1ccc71ba83b0803446d31c07534a524a28bcbb6ccf0807fd18939d27f"} May 27 19:32:31.671535 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:31.671464 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kcxhv" May 27 19:32:31.671535 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:31.671499 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:31.671535 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:31.671511 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:31.672013 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:31.671995 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kcxhv" May 27 19:32:31.686979 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:31.686958 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:31.687261 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:31.687246 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:31.697813 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:31.697759 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pth57" podStartSLOduration=8.867638767 podStartE2EDuration="26.697744557s" podCreationTimestamp="2026-05-27 19:32:05 +0000 UTC" firstStartedPulling="2026-05-27 19:32:08.35084645 +0000 UTC m=+3.387473123" lastFinishedPulling="2026-05-27 19:32:26.180952238 +0000 UTC m=+21.217578913" observedRunningTime="2026-05-27 19:32:31.696859294 +0000 UTC m=+26.733485980" watchObservedRunningTime="2026-05-27 19:32:31.697744557 +0000 UTC m=+26.734371246" May 27 19:32:31.873193 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:31.873019 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:32:32.675149 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:32.675105 2555 generic.go:358] "Generic (PLEG): container finished" podID="e6ba391e-3a4a-4ab7-a6a0-ab1069701c90" containerID="a92a819d7619d2db8e5944bce9491927c1e8a49e090bddeab76e29fd8371998a" exitCode=0 May 27 19:32:32.676952 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:32.676917 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmfgh" event={"ID":"e6ba391e-3a4a-4ab7-a6a0-ab1069701c90","Type":"ContainerDied","Data":"a92a819d7619d2db8e5944bce9491927c1e8a49e090bddeab76e29fd8371998a"} May 27 19:32:33.388167 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:33.388136 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6lzrp"] May 27 19:32:33.388680 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:33.388286 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6lzrp" May 27 19:32:33.388680 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:33.388392 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6lzrp" podUID="1829aad5-1f6d-4bf4-9da6-15027f679994" May 27 19:32:33.392039 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:33.391952 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lknm5"] May 27 19:32:33.392170 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:33.392088 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lknm5" May 27 19:32:33.392236 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:33.392178 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lknm5" podUID="e375ea8a-c7d3-4c35-a901-a5e9bf859073" May 27 19:32:33.392623 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:33.392603 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nf6f5"] May 27 19:32:33.392726 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:33.392712 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nf6f5" May 27 19:32:33.392873 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:33.392841 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nf6f5" podUID="34c87eb0-84f0-4f4c-b319-b6486fd20f52" May 27 19:32:34.572680 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:34.572653 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nf6f5" May 27 19:32:34.573101 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:34.572653 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6lzrp" May 27 19:32:34.573101 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:34.572755 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nf6f5" podUID="34c87eb0-84f0-4f4c-b319-b6486fd20f52" May 27 19:32:34.573101 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:34.572830 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6lzrp" podUID="1829aad5-1f6d-4bf4-9da6-15027f679994" May 27 19:32:34.680005 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:34.679966 2555 generic.go:358] "Generic (PLEG): container finished" podID="e6ba391e-3a4a-4ab7-a6a0-ab1069701c90" containerID="784311077cd07fc4bf135f736cfdd5316a3df2d8ed08eee05d62afa1c9b7c2d8" exitCode=0 May 27 19:32:34.680156 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:34.680041 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmfgh" event={"ID":"e6ba391e-3a4a-4ab7-a6a0-ab1069701c90","Type":"ContainerDied","Data":"784311077cd07fc4bf135f736cfdd5316a3df2d8ed08eee05d62afa1c9b7c2d8"} May 27 19:32:35.573328 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:35.573303 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lknm5" May 27 19:32:35.573698 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:35.573414 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lknm5" podUID="e375ea8a-c7d3-4c35-a901-a5e9bf859073" May 27 19:32:35.684063 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:35.684030 2555 generic.go:358] "Generic (PLEG): container finished" podID="e6ba391e-3a4a-4ab7-a6a0-ab1069701c90" containerID="4d9cc6d4df1970768fbe4f54eb27b9cdff47f87867385abee254fbb94c57e819" exitCode=0 May 27 19:32:35.684230 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:35.684075 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmfgh" event={"ID":"e6ba391e-3a4a-4ab7-a6a0-ab1069701c90","Type":"ContainerDied","Data":"4d9cc6d4df1970768fbe4f54eb27b9cdff47f87867385abee254fbb94c57e819"} May 27 19:32:36.573337 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:36.573300 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6lzrp" May 27 19:32:36.573774 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:36.573421 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6lzrp" podUID="1829aad5-1f6d-4bf4-9da6-15027f679994" May 27 19:32:36.573774 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:36.573481 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nf6f5" May 27 19:32:36.573774 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:36.573627 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nf6f5" podUID="34c87eb0-84f0-4f4c-b319-b6486fd20f52" May 27 19:32:37.573097 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:37.573067 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lknm5" May 27 19:32:37.573290 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:37.573194 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lknm5" podUID="e375ea8a-c7d3-4c35-a901-a5e9bf859073" May 27 19:32:38.573086 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.573055 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nf6f5" May 27 19:32:38.573692 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.573055 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6lzrp" May 27 19:32:38.573692 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:38.573194 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nf6f5" podUID="34c87eb0-84f0-4f4c-b319-b6486fd20f52" May 27 19:32:38.573692 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:38.573279 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6lzrp" podUID="1829aad5-1f6d-4bf4-9da6-15027f679994" May 27 19:32:38.753465 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.753435 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-51.ec2.internal" event="NodeReady" May 27 19:32:38.753646 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.753591 2555 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 27 19:32:38.803533 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.803502 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-56fc7546f-jd8l8"] May 27 19:32:38.805306 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.805287 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56fc7546f-jd8l8" May 27 19:32:38.807823 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.807791 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 27 19:32:38.808125 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.808103 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-sntsc\"" May 27 19:32:38.808226 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.808191 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 27 19:32:38.808322 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.808307 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 27 19:32:38.815040 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.815012 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 27 19:32:38.820208 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.820188 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56fc7546f-jd8l8"] May 27 19:32:38.829680 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.829044 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-c9ls5"] May 27 19:32:38.831613 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.831593 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-mffsf"] May 27 19:32:38.831723 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.831639 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-c9ls5" May 27 19:32:38.833517 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.833496 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bhbv4"] May 27 19:32:38.833904 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.833639 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-mffsf" May 27 19:32:38.835018 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.835002 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hjmsq\"" May 27 19:32:38.835442 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.835341 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-kxg9n"] May 27 19:32:38.835552 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.835487 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bhbv4" May 27 19:32:38.835966 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.835944 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" May 27 19:32:38.836813 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.836392 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 27 19:32:38.837047 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.837024 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-vn5pd\"" May 27 19:32:38.837633 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.837613 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" May 27 19:32:38.838060 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.838040 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-vbz74"] May 27 19:32:38.838538 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.838520 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 27 19:32:38.838959 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.838942 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 27 19:32:38.839019 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.838973 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" May 27 19:32:38.839356 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.839340 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" May 27 19:32:38.839812 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.839793 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 27 19:32:38.840242 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.840225 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7w8r9\"" May 27 19:32:38.841206 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.840625 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 27 19:32:38.842330 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.842308 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-kxg9n" May 27 19:32:38.842417 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.842330 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-vbz74" May 27 19:32:38.846967 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.846935 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 27 19:32:38.847052 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.847024 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-hvrnt\"" May 27 19:32:38.847178 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.847145 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" May 27 19:32:38.847239 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.847207 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 27 19:32:38.847413 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.847394 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-bzgvq\"" May 27 19:32:38.847526 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.847509 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" May 27 19:32:38.848161 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.848141 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bhbv4"] May 27 19:32:38.849057 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.848942 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-vbz74"] May 27 19:32:38.854101 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.854075 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-c9ls5"] May 27 19:32:38.865991 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.865810 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-kxg9n"] May 27 19:32:38.870728 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.870632 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-mffsf"] May 27 19:32:38.938664 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.938630 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgs4h\" (UniqueName: \"kubernetes.io/projected/c3ae619c-4765-4aad-b15c-4fcaf20b6cb8-kube-api-access-rgs4h\") pod \"network-check-source-7f44b6dd87-kxg9n\" (UID: \"c3ae619c-4765-4aad-b15c-4fcaf20b6cb8\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-kxg9n" May 27 19:32:38.938664 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.938671 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4f8c7bdc-51de-4a81-9dfc-003af9f4679a-config\") pod \"service-ca-operator-57b5b68b8-mffsf\" (UID: \"4f8c7bdc-51de-4a81-9dfc-003af9f4679a\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-mffsf" May 27 19:32:38.938664 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.938696 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9eda2122-90ad-4903-9dae-d20f0654eeec-registry-tls\") pod \"image-registry-56fc7546f-jd8l8\" (UID: \"9eda2122-90ad-4903-9dae-d20f0654eeec\") " pod="openshift-image-registry/image-registry-56fc7546f-jd8l8" May 27 19:32:38.938664 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.938738 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9eda2122-90ad-4903-9dae-d20f0654eeec-trusted-ca\") pod \"image-registry-56fc7546f-jd8l8\" (UID: \"9eda2122-90ad-4903-9dae-d20f0654eeec\") " pod="openshift-image-registry/image-registry-56fc7546f-jd8l8" May 27 19:32:38.938664 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.938786 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa63b18f-db50-412b-9280-777369bf9ded-tmp-dir\") pod \"dns-default-c9ls5\" (UID: \"fa63b18f-db50-412b-9280-777369bf9ded\") " pod="openshift-dns/dns-default-c9ls5" May 27 19:32:38.938664 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.938808 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p88m5\" (UniqueName: \"kubernetes.io/projected/9eda2122-90ad-4903-9dae-d20f0654eeec-kube-api-access-p88m5\") pod \"image-registry-56fc7546f-jd8l8\" (UID: \"9eda2122-90ad-4903-9dae-d20f0654eeec\") " pod="openshift-image-registry/image-registry-56fc7546f-jd8l8" May 27 19:32:38.938664 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.938825 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a2be77ab-d596-46ef-8967-88c344e07fb4-cert\") pod \"ingress-canary-bhbv4\" (UID: \"a2be77ab-d596-46ef-8967-88c344e07fb4\") " pod="openshift-ingress-canary/ingress-canary-bhbv4" May 27 19:32:38.938664 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.938848 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fa63b18f-db50-412b-9280-777369bf9ded-config-volume\") pod \"dns-default-c9ls5\" (UID: \"fa63b18f-db50-412b-9280-777369bf9ded\") " pod="openshift-dns/dns-default-c9ls5" May 27 19:32:38.938664 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.938864 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77tf9\" (UniqueName: \"kubernetes.io/projected/fa63b18f-db50-412b-9280-777369bf9ded-kube-api-access-77tf9\") pod \"dns-default-c9ls5\" (UID: \"fa63b18f-db50-412b-9280-777369bf9ded\") " pod="openshift-dns/dns-default-c9ls5" May 27 19:32:38.938664 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.938880 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbbgf\" (UniqueName: \"kubernetes.io/projected/4f8c7bdc-51de-4a81-9dfc-003af9f4679a-kube-api-access-jbbgf\") pod \"service-ca-operator-57b5b68b8-mffsf\" (UID: \"4f8c7bdc-51de-4a81-9dfc-003af9f4679a\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-mffsf" May 27 19:32:38.938664 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.938901 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9eda2122-90ad-4903-9dae-d20f0654eeec-installation-pull-secrets\") pod \"image-registry-56fc7546f-jd8l8\" (UID: \"9eda2122-90ad-4903-9dae-d20f0654eeec\") " pod="openshift-image-registry/image-registry-56fc7546f-jd8l8" May 27 19:32:38.939418 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.938931 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9eda2122-90ad-4903-9dae-d20f0654eeec-registry-certificates\") pod \"image-registry-56fc7546f-jd8l8\" (UID: \"9eda2122-90ad-4903-9dae-d20f0654eeec\") " pod="openshift-image-registry/image-registry-56fc7546f-jd8l8" May 27 19:32:38.939418 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.938969 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9eda2122-90ad-4903-9dae-d20f0654eeec-bound-sa-token\") pod \"image-registry-56fc7546f-jd8l8\" (UID: \"9eda2122-90ad-4903-9dae-d20f0654eeec\") " pod="openshift-image-registry/image-registry-56fc7546f-jd8l8" May 27 19:32:38.939418 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.939024 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa63b18f-db50-412b-9280-777369bf9ded-metrics-tls\") pod \"dns-default-c9ls5\" (UID: \"fa63b18f-db50-412b-9280-777369bf9ded\") " pod="openshift-dns/dns-default-c9ls5" May 27 19:32:38.939418 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.939055 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9eda2122-90ad-4903-9dae-d20f0654eeec-ca-trust-extracted\") pod \"image-registry-56fc7546f-jd8l8\" (UID: \"9eda2122-90ad-4903-9dae-d20f0654eeec\") " pod="openshift-image-registry/image-registry-56fc7546f-jd8l8" May 27 19:32:38.939418 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.939107 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4f8c7bdc-51de-4a81-9dfc-003af9f4679a-serving-cert\") pod \"service-ca-operator-57b5b68b8-mffsf\" (UID: \"4f8c7bdc-51de-4a81-9dfc-003af9f4679a\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-mffsf" May 27 19:32:38.939418 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.939133 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9eda2122-90ad-4903-9dae-d20f0654eeec-image-registry-private-configuration\") pod \"image-registry-56fc7546f-jd8l8\" (UID: \"9eda2122-90ad-4903-9dae-d20f0654eeec\") " pod="openshift-image-registry/image-registry-56fc7546f-jd8l8" May 27 19:32:38.939418 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:38.939164 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmvll\" (UniqueName: \"kubernetes.io/projected/a2be77ab-d596-46ef-8967-88c344e07fb4-kube-api-access-zmvll\") pod \"ingress-canary-bhbv4\" (UID: \"a2be77ab-d596-46ef-8967-88c344e07fb4\") " pod="openshift-ingress-canary/ingress-canary-bhbv4" May 27 19:32:39.039829 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:39.039800 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4f8c7bdc-51de-4a81-9dfc-003af9f4679a-serving-cert\") pod \"service-ca-operator-57b5b68b8-mffsf\" (UID: \"4f8c7bdc-51de-4a81-9dfc-003af9f4679a\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-mffsf" May 27 19:32:39.039829 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:39.039838 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9eda2122-90ad-4903-9dae-d20f0654eeec-image-registry-private-configuration\") pod \"image-registry-56fc7546f-jd8l8\" (UID: \"9eda2122-90ad-4903-9dae-d20f0654eeec\") " pod="openshift-image-registry/image-registry-56fc7546f-jd8l8" May 27 19:32:39.040022 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:39.039861 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zmvll\" (UniqueName: \"kubernetes.io/projected/a2be77ab-d596-46ef-8967-88c344e07fb4-kube-api-access-zmvll\") pod \"ingress-canary-bhbv4\" (UID: \"a2be77ab-d596-46ef-8967-88c344e07fb4\") " pod="openshift-ingress-canary/ingress-canary-bhbv4" May 27 19:32:39.040022 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:39.039892 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/54e71063-a75f-4ebc-8cdb-84280227744e-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-vbz74\" (UID: \"54e71063-a75f-4ebc-8cdb-84280227744e\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-vbz74" May 27 19:32:39.040096 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:39.040023 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rgs4h\" (UniqueName: \"kubernetes.io/projected/c3ae619c-4765-4aad-b15c-4fcaf20b6cb8-kube-api-access-rgs4h\") pod \"network-check-source-7f44b6dd87-kxg9n\" (UID: \"c3ae619c-4765-4aad-b15c-4fcaf20b6cb8\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-kxg9n" May 27 19:32:39.040096 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:39.040052 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4f8c7bdc-51de-4a81-9dfc-003af9f4679a-config\") pod \"service-ca-operator-57b5b68b8-mffsf\" (UID: \"4f8c7bdc-51de-4a81-9dfc-003af9f4679a\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-mffsf" May 27 19:32:39.040096 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:39.040077 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9eda2122-90ad-4903-9dae-d20f0654eeec-registry-tls\") pod \"image-registry-56fc7546f-jd8l8\" (UID: \"9eda2122-90ad-4903-9dae-d20f0654eeec\") " pod="openshift-image-registry/image-registry-56fc7546f-jd8l8" May 27 19:32:39.040232 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:39.040103 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9eda2122-90ad-4903-9dae-d20f0654eeec-trusted-ca\") pod \"image-registry-56fc7546f-jd8l8\" (UID: \"9eda2122-90ad-4903-9dae-d20f0654eeec\") " pod="openshift-image-registry/image-registry-56fc7546f-jd8l8" May 27 19:32:39.040232 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:39.040132 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa63b18f-db50-412b-9280-777369bf9ded-tmp-dir\") pod \"dns-default-c9ls5\" (UID: \"fa63b18f-db50-412b-9280-777369bf9ded\") " pod="openshift-dns/dns-default-c9ls5" May 27 19:32:39.040360 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:39.040230 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 27 19:32:39.040360 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:39.040251 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56fc7546f-jd8l8: secret "image-registry-tls" not found May 27 19:32:39.040360 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:39.040331 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9eda2122-90ad-4903-9dae-d20f0654eeec-registry-tls podName:9eda2122-90ad-4903-9dae-d20f0654eeec nodeName:}" failed. No retries permitted until 2026-05-27 19:32:39.540308176 +0000 UTC m=+34.576934848 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9eda2122-90ad-4903-9dae-d20f0654eeec-registry-tls") pod "image-registry-56fc7546f-jd8l8" (UID: "9eda2122-90ad-4903-9dae-d20f0654eeec") : secret "image-registry-tls" not found May 27 19:32:39.040535 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:39.040506 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa63b18f-db50-412b-9280-777369bf9ded-tmp-dir\") pod \"dns-default-c9ls5\" (UID: \"fa63b18f-db50-412b-9280-777369bf9ded\") " pod="openshift-dns/dns-default-c9ls5" May 27 19:32:39.040607 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:39.040506 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p88m5\" (UniqueName: \"kubernetes.io/projected/9eda2122-90ad-4903-9dae-d20f0654eeec-kube-api-access-p88m5\") pod \"image-registry-56fc7546f-jd8l8\" (UID: \"9eda2122-90ad-4903-9dae-d20f0654eeec\") " pod="openshift-image-registry/image-registry-56fc7546f-jd8l8" May 27 19:32:39.040607 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:39.040570 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a2be77ab-d596-46ef-8967-88c344e07fb4-cert\") pod \"ingress-canary-bhbv4\" (UID: \"a2be77ab-d596-46ef-8967-88c344e07fb4\") " pod="openshift-ingress-canary/ingress-canary-bhbv4" May 27 19:32:39.040607 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:39.040602 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fa63b18f-db50-412b-9280-777369bf9ded-config-volume\") pod \"dns-default-c9ls5\" (UID: \"fa63b18f-db50-412b-9280-777369bf9ded\") " pod="openshift-dns/dns-default-c9ls5" May 27 19:32:39.040749 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:39.040676 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 19:32:39.040749 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:39.040737 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2be77ab-d596-46ef-8967-88c344e07fb4-cert podName:a2be77ab-d596-46ef-8967-88c344e07fb4 nodeName:}" failed. No retries permitted until 2026-05-27 19:32:39.540720303 +0000 UTC m=+34.577346982 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a2be77ab-d596-46ef-8967-88c344e07fb4-cert") pod "ingress-canary-bhbv4" (UID: "a2be77ab-d596-46ef-8967-88c344e07fb4") : secret "canary-serving-cert" not found May 27 19:32:39.040833 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:39.040780 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4f8c7bdc-51de-4a81-9dfc-003af9f4679a-config\") pod \"service-ca-operator-57b5b68b8-mffsf\" (UID: \"4f8c7bdc-51de-4a81-9dfc-003af9f4679a\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-mffsf" May 27 19:32:39.040889 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:39.040827 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-77tf9\" (UniqueName: \"kubernetes.io/projected/fa63b18f-db50-412b-9280-777369bf9ded-kube-api-access-77tf9\") pod \"dns-default-c9ls5\" (UID: \"fa63b18f-db50-412b-9280-777369bf9ded\") " pod="openshift-dns/dns-default-c9ls5" May 27 19:32:39.040889 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:39.040862 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jbbgf\" (UniqueName: \"kubernetes.io/projected/4f8c7bdc-51de-4a81-9dfc-003af9f4679a-kube-api-access-jbbgf\") pod \"service-ca-operator-57b5b68b8-mffsf\" (UID: \"4f8c7bdc-51de-4a81-9dfc-003af9f4679a\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-mffsf" May 27 19:32:39.040988 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:39.040897 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9eda2122-90ad-4903-9dae-d20f0654eeec-installation-pull-secrets\") pod \"image-registry-56fc7546f-jd8l8\" (UID: \"9eda2122-90ad-4903-9dae-d20f0654eeec\") " pod="openshift-image-registry/image-registry-56fc7546f-jd8l8" May 27 19:32:39.040988 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:39.040931 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9eda2122-90ad-4903-9dae-d20f0654eeec-registry-certificates\") pod \"image-registry-56fc7546f-jd8l8\" (UID: \"9eda2122-90ad-4903-9dae-d20f0654eeec\") " pod="openshift-image-registry/image-registry-56fc7546f-jd8l8" May 27 19:32:39.041081 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:39.041004 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9eda2122-90ad-4903-9dae-d20f0654eeec-bound-sa-token\") pod \"image-registry-56fc7546f-jd8l8\" (UID: \"9eda2122-90ad-4903-9dae-d20f0654eeec\") " pod="openshift-image-registry/image-registry-56fc7546f-jd8l8" May 27 19:32:39.041135 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:39.041076 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa63b18f-db50-412b-9280-777369bf9ded-metrics-tls\") pod \"dns-default-c9ls5\" (UID: \"fa63b18f-db50-412b-9280-777369bf9ded\") " pod="openshift-dns/dns-default-c9ls5" May 27 19:32:39.041135 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:39.041091 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9eda2122-90ad-4903-9dae-d20f0654eeec-trusted-ca\") pod \"image-registry-56fc7546f-jd8l8\" (UID: \"9eda2122-90ad-4903-9dae-d20f0654eeec\") " pod="openshift-image-registry/image-registry-56fc7546f-jd8l8" May 27 19:32:39.041230 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:39.041131 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9eda2122-90ad-4903-9dae-d20f0654eeec-ca-trust-extracted\") pod \"image-registry-56fc7546f-jd8l8\" (UID: \"9eda2122-90ad-4903-9dae-d20f0654eeec\") " pod="openshift-image-registry/image-registry-56fc7546f-jd8l8" May 27 19:32:39.041230 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:39.041174 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/54e71063-a75f-4ebc-8cdb-84280227744e-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-vbz74\" (UID: \"54e71063-a75f-4ebc-8cdb-84280227744e\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-vbz74" May 27 19:32:39.041230 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:39.041189 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fa63b18f-db50-412b-9280-777369bf9ded-config-volume\") pod \"dns-default-c9ls5\" (UID: \"fa63b18f-db50-412b-9280-777369bf9ded\") " pod="openshift-dns/dns-default-c9ls5" May 27 19:32:39.041401 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:39.041314 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 19:32:39.041401 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:39.041356 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa63b18f-db50-412b-9280-777369bf9ded-metrics-tls podName:fa63b18f-db50-412b-9280-777369bf9ded nodeName:}" failed. No retries permitted until 2026-05-27 19:32:39.541342407 +0000 UTC m=+34.577969089 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fa63b18f-db50-412b-9280-777369bf9ded-metrics-tls") pod "dns-default-c9ls5" (UID: "fa63b18f-db50-412b-9280-777369bf9ded") : secret "dns-default-metrics-tls" not found May 27 19:32:39.041577 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:39.041553 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9eda2122-90ad-4903-9dae-d20f0654eeec-registry-certificates\") pod \"image-registry-56fc7546f-jd8l8\" (UID: \"9eda2122-90ad-4903-9dae-d20f0654eeec\") " pod="openshift-image-registry/image-registry-56fc7546f-jd8l8" May 27 19:32:39.041661 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:39.041610 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9eda2122-90ad-4903-9dae-d20f0654eeec-ca-trust-extracted\") pod \"image-registry-56fc7546f-jd8l8\" (UID: \"9eda2122-90ad-4903-9dae-d20f0654eeec\") " pod="openshift-image-registry/image-registry-56fc7546f-jd8l8" May 27 19:32:39.044584 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:39.044560 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4f8c7bdc-51de-4a81-9dfc-003af9f4679a-serving-cert\") pod \"service-ca-operator-57b5b68b8-mffsf\" (UID: \"4f8c7bdc-51de-4a81-9dfc-003af9f4679a\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-mffsf" May 27 19:32:39.044691 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:39.044670 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9eda2122-90ad-4903-9dae-d20f0654eeec-installation-pull-secrets\") pod \"image-registry-56fc7546f-jd8l8\" (UID: \"9eda2122-90ad-4903-9dae-d20f0654eeec\") " pod="openshift-image-registry/image-registry-56fc7546f-jd8l8" May 27 19:32:39.044691 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:39.044683 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9eda2122-90ad-4903-9dae-d20f0654eeec-image-registry-private-configuration\") pod \"image-registry-56fc7546f-jd8l8\" (UID: \"9eda2122-90ad-4903-9dae-d20f0654eeec\") " pod="openshift-image-registry/image-registry-56fc7546f-jd8l8" May 27 19:32:39.051459 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:39.051394 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77tf9\" (UniqueName: \"kubernetes.io/projected/fa63b18f-db50-412b-9280-777369bf9ded-kube-api-access-77tf9\") pod \"dns-default-c9ls5\" (UID: \"fa63b18f-db50-412b-9280-777369bf9ded\") " pod="openshift-dns/dns-default-c9ls5" May 27 19:32:39.052497 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:39.052378 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p88m5\" (UniqueName: \"kubernetes.io/projected/9eda2122-90ad-4903-9dae-d20f0654eeec-kube-api-access-p88m5\") pod \"image-registry-56fc7546f-jd8l8\" (UID: \"9eda2122-90ad-4903-9dae-d20f0654eeec\") " pod="openshift-image-registry/image-registry-56fc7546f-jd8l8" May 27 19:32:39.052972 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:39.052950 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgs4h\" (UniqueName: \"kubernetes.io/projected/c3ae619c-4765-4aad-b15c-4fcaf20b6cb8-kube-api-access-rgs4h\") pod \"network-check-source-7f44b6dd87-kxg9n\" (UID: \"c3ae619c-4765-4aad-b15c-4fcaf20b6cb8\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-kxg9n" May 27 19:32:39.053877 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:39.053858 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbbgf\" (UniqueName: \"kubernetes.io/projected/4f8c7bdc-51de-4a81-9dfc-003af9f4679a-kube-api-access-jbbgf\") pod \"service-ca-operator-57b5b68b8-mffsf\" (UID: \"4f8c7bdc-51de-4a81-9dfc-003af9f4679a\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-mffsf" May 27 19:32:39.053962 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:39.053880 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9eda2122-90ad-4903-9dae-d20f0654eeec-bound-sa-token\") pod \"image-registry-56fc7546f-jd8l8\" (UID: \"9eda2122-90ad-4903-9dae-d20f0654eeec\") " pod="openshift-image-registry/image-registry-56fc7546f-jd8l8" May 27 19:32:39.054292 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:39.054249 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmvll\" (UniqueName: \"kubernetes.io/projected/a2be77ab-d596-46ef-8967-88c344e07fb4-kube-api-access-zmvll\") pod \"ingress-canary-bhbv4\" (UID: \"a2be77ab-d596-46ef-8967-88c344e07fb4\") " pod="openshift-ingress-canary/ingress-canary-bhbv4" May 27 19:32:39.142229 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:39.142138 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/54e71063-a75f-4ebc-8cdb-84280227744e-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-vbz74\" (UID: \"54e71063-a75f-4ebc-8cdb-84280227744e\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-vbz74" May 27 19:32:39.142229 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:39.142213 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/54e71063-a75f-4ebc-8cdb-84280227744e-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-vbz74\" (UID: \"54e71063-a75f-4ebc-8cdb-84280227744e\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-vbz74" May 27 19:32:39.142463 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:39.142304 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 27 19:32:39.142463 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:39.142389 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54e71063-a75f-4ebc-8cdb-84280227744e-networking-console-plugin-cert podName:54e71063-a75f-4ebc-8cdb-84280227744e nodeName:}" failed. No retries permitted until 2026-05-27 19:32:39.642367149 +0000 UTC m=+34.678993828 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/54e71063-a75f-4ebc-8cdb-84280227744e-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-vbz74" (UID: "54e71063-a75f-4ebc-8cdb-84280227744e") : secret "networking-console-plugin-cert" not found May 27 19:32:39.142890 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:39.142870 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/54e71063-a75f-4ebc-8cdb-84280227744e-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-vbz74\" (UID: \"54e71063-a75f-4ebc-8cdb-84280227744e\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-vbz74" May 27 19:32:39.150243 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:39.150218 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-mffsf" May 27 19:32:39.167161 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:39.167134 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-kxg9n" May 27 19:32:39.344015 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:39.343974 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34c87eb0-84f0-4f4c-b319-b6486fd20f52-metrics-certs\") pod \"network-metrics-daemon-nf6f5\" (UID: \"34c87eb0-84f0-4f4c-b319-b6486fd20f52\") " pod="openshift-multus/network-metrics-daemon-nf6f5" May 27 19:32:39.344201 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:39.344029 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vt472\" (UniqueName: \"kubernetes.io/projected/1829aad5-1f6d-4bf4-9da6-15027f679994-kube-api-access-vt472\") pod \"network-check-target-6lzrp\" (UID: \"1829aad5-1f6d-4bf4-9da6-15027f679994\") " pod="openshift-network-diagnostics/network-check-target-6lzrp" May 27 19:32:39.344201 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:39.344132 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e375ea8a-c7d3-4c35-a901-a5e9bf859073-original-pull-secret\") pod \"global-pull-secret-syncer-lknm5\" (UID: \"e375ea8a-c7d3-4c35-a901-a5e9bf859073\") " pod="kube-system/global-pull-secret-syncer-lknm5" May 27 19:32:39.344201 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:39.344156 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 19:32:39.344379 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:39.344232 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34c87eb0-84f0-4f4c-b319-b6486fd20f52-metrics-certs podName:34c87eb0-84f0-4f4c-b319-b6486fd20f52 nodeName:}" failed. No retries permitted until 2026-05-27 19:33:11.344213001 +0000 UTC m=+66.380839683 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/34c87eb0-84f0-4f4c-b319-b6486fd20f52-metrics-certs") pod "network-metrics-daemon-nf6f5" (UID: "34c87eb0-84f0-4f4c-b319-b6486fd20f52") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 19:32:39.344379 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:39.344244 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 27 19:32:39.344379 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:39.344334 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e375ea8a-c7d3-4c35-a901-a5e9bf859073-original-pull-secret podName:e375ea8a-c7d3-4c35-a901-a5e9bf859073 nodeName:}" failed. No retries permitted until 2026-05-27 19:33:11.344319176 +0000 UTC m=+66.380945853 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e375ea8a-c7d3-4c35-a901-a5e9bf859073-original-pull-secret") pod "global-pull-secret-syncer-lknm5" (UID: "e375ea8a-c7d3-4c35-a901-a5e9bf859073") : object "kube-system"/"original-pull-secret" not registered May 27 19:32:39.347007 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:39.346985 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vt472\" (UniqueName: \"kubernetes.io/projected/1829aad5-1f6d-4bf4-9da6-15027f679994-kube-api-access-vt472\") pod \"network-check-target-6lzrp\" (UID: \"1829aad5-1f6d-4bf4-9da6-15027f679994\") " pod="openshift-network-diagnostics/network-check-target-6lzrp" May 27 19:32:39.545779 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:39.545694 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9eda2122-90ad-4903-9dae-d20f0654eeec-registry-tls\") pod \"image-registry-56fc7546f-jd8l8\" (UID: \"9eda2122-90ad-4903-9dae-d20f0654eeec\") " pod="openshift-image-registry/image-registry-56fc7546f-jd8l8" May 27 19:32:39.545779 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:39.545746 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a2be77ab-d596-46ef-8967-88c344e07fb4-cert\") pod \"ingress-canary-bhbv4\" (UID: \"a2be77ab-d596-46ef-8967-88c344e07fb4\") " pod="openshift-ingress-canary/ingress-canary-bhbv4" May 27 19:32:39.546026 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:39.545812 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa63b18f-db50-412b-9280-777369bf9ded-metrics-tls\") pod \"dns-default-c9ls5\" (UID: \"fa63b18f-db50-412b-9280-777369bf9ded\") " pod="openshift-dns/dns-default-c9ls5" May 27 19:32:39.546026 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:39.545876 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 27 19:32:39.546026 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:39.545901 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56fc7546f-jd8l8: secret "image-registry-tls" not found May 27 19:32:39.546026 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:39.545915 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 19:32:39.546026 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:39.545901 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 19:32:39.546026 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:39.545972 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa63b18f-db50-412b-9280-777369bf9ded-metrics-tls podName:fa63b18f-db50-412b-9280-777369bf9ded nodeName:}" failed. No retries permitted until 2026-05-27 19:32:40.545954727 +0000 UTC m=+35.582581395 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fa63b18f-db50-412b-9280-777369bf9ded-metrics-tls") pod "dns-default-c9ls5" (UID: "fa63b18f-db50-412b-9280-777369bf9ded") : secret "dns-default-metrics-tls" not found May 27 19:32:39.546026 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:39.545994 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9eda2122-90ad-4903-9dae-d20f0654eeec-registry-tls podName:9eda2122-90ad-4903-9dae-d20f0654eeec nodeName:}" failed. No retries permitted until 2026-05-27 19:32:40.545977831 +0000 UTC m=+35.582604509 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9eda2122-90ad-4903-9dae-d20f0654eeec-registry-tls") pod "image-registry-56fc7546f-jd8l8" (UID: "9eda2122-90ad-4903-9dae-d20f0654eeec") : secret "image-registry-tls" not found May 27 19:32:39.546026 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:39.546012 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2be77ab-d596-46ef-8967-88c344e07fb4-cert podName:a2be77ab-d596-46ef-8967-88c344e07fb4 nodeName:}" failed. No retries permitted until 2026-05-27 19:32:40.54600262 +0000 UTC m=+35.582629287 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a2be77ab-d596-46ef-8967-88c344e07fb4-cert") pod "ingress-canary-bhbv4" (UID: "a2be77ab-d596-46ef-8967-88c344e07fb4") : secret "canary-serving-cert" not found May 27 19:32:39.573361 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:39.573322 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lknm5" May 27 19:32:39.575730 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:39.575706 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 27 19:32:39.646567 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:39.646528 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/54e71063-a75f-4ebc-8cdb-84280227744e-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-vbz74\" (UID: \"54e71063-a75f-4ebc-8cdb-84280227744e\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-vbz74" May 27 19:32:39.646730 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:39.646638 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 27 19:32:39.646730 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:39.646712 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54e71063-a75f-4ebc-8cdb-84280227744e-networking-console-plugin-cert podName:54e71063-a75f-4ebc-8cdb-84280227744e nodeName:}" failed. No retries permitted until 2026-05-27 19:32:40.646692994 +0000 UTC m=+35.683319682 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/54e71063-a75f-4ebc-8cdb-84280227744e-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-vbz74" (UID: "54e71063-a75f-4ebc-8cdb-84280227744e") : secret "networking-console-plugin-cert" not found May 27 19:32:40.551335 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:40.551290 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa63b18f-db50-412b-9280-777369bf9ded-metrics-tls\") pod \"dns-default-c9ls5\" (UID: \"fa63b18f-db50-412b-9280-777369bf9ded\") " pod="openshift-dns/dns-default-c9ls5" May 27 19:32:40.551496 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:40.551391 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9eda2122-90ad-4903-9dae-d20f0654eeec-registry-tls\") pod \"image-registry-56fc7546f-jd8l8\" (UID: \"9eda2122-90ad-4903-9dae-d20f0654eeec\") " pod="openshift-image-registry/image-registry-56fc7546f-jd8l8" May 27 19:32:40.551496 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:40.551415 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a2be77ab-d596-46ef-8967-88c344e07fb4-cert\") pod \"ingress-canary-bhbv4\" (UID: \"a2be77ab-d596-46ef-8967-88c344e07fb4\") " pod="openshift-ingress-canary/ingress-canary-bhbv4" May 27 19:32:40.551496 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:40.551458 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 19:32:40.551633 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:40.551513 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 19:32:40.551633 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:40.551527 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 27 19:32:40.551633 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:40.551544 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa63b18f-db50-412b-9280-777369bf9ded-metrics-tls podName:fa63b18f-db50-412b-9280-777369bf9ded nodeName:}" failed. No retries permitted until 2026-05-27 19:32:42.551520638 +0000 UTC m=+37.588147308 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fa63b18f-db50-412b-9280-777369bf9ded-metrics-tls") pod "dns-default-c9ls5" (UID: "fa63b18f-db50-412b-9280-777369bf9ded") : secret "dns-default-metrics-tls" not found May 27 19:32:40.551633 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:40.551548 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56fc7546f-jd8l8: secret "image-registry-tls" not found May 27 19:32:40.551633 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:40.551565 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2be77ab-d596-46ef-8967-88c344e07fb4-cert podName:a2be77ab-d596-46ef-8967-88c344e07fb4 nodeName:}" failed. No retries permitted until 2026-05-27 19:32:42.551554708 +0000 UTC m=+37.588181379 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a2be77ab-d596-46ef-8967-88c344e07fb4-cert") pod "ingress-canary-bhbv4" (UID: "a2be77ab-d596-46ef-8967-88c344e07fb4") : secret "canary-serving-cert" not found May 27 19:32:40.551633 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:40.551598 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9eda2122-90ad-4903-9dae-d20f0654eeec-registry-tls podName:9eda2122-90ad-4903-9dae-d20f0654eeec nodeName:}" failed. No retries permitted until 2026-05-27 19:32:42.551581932 +0000 UTC m=+37.588208610 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9eda2122-90ad-4903-9dae-d20f0654eeec-registry-tls") pod "image-registry-56fc7546f-jd8l8" (UID: "9eda2122-90ad-4903-9dae-d20f0654eeec") : secret "image-registry-tls" not found May 27 19:32:40.572573 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:40.572544 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6lzrp" May 27 19:32:40.572751 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:40.572553 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nf6f5" May 27 19:32:40.575783 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:40.575758 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6hg7p\"" May 27 19:32:40.576142 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:40.575813 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tzfh2\"" May 27 19:32:40.576142 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:40.575811 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 27 19:32:40.583087 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:40.583070 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6lzrp" May 27 19:32:40.651937 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:40.651894 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/54e71063-a75f-4ebc-8cdb-84280227744e-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-vbz74\" (UID: \"54e71063-a75f-4ebc-8cdb-84280227744e\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-vbz74" May 27 19:32:40.652106 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:40.651993 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 27 19:32:40.652106 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:40.652071 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54e71063-a75f-4ebc-8cdb-84280227744e-networking-console-plugin-cert podName:54e71063-a75f-4ebc-8cdb-84280227744e nodeName:}" failed. No retries permitted until 2026-05-27 19:32:42.652049781 +0000 UTC m=+37.688676447 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/54e71063-a75f-4ebc-8cdb-84280227744e-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-vbz74" (UID: "54e71063-a75f-4ebc-8cdb-84280227744e") : secret "networking-console-plugin-cert" not found May 27 19:32:41.367714 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:41.367685 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-kxg9n"] May 27 19:32:41.368575 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:41.368415 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6lzrp"] May 27 19:32:41.370067 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:41.370047 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-mffsf"] May 27 19:32:41.378082 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:41.378053 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1829aad5_1f6d_4bf4_9da6_15027f679994.slice/crio-782703f5f78f45b950c6de30c17857508990480f501b9899a1418bbcc675bc53 WatchSource:0}: Error finding container 782703f5f78f45b950c6de30c17857508990480f501b9899a1418bbcc675bc53: Status 404 returned error can't find the container with id 782703f5f78f45b950c6de30c17857508990480f501b9899a1418bbcc675bc53 May 27 19:32:41.378603 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:41.378580 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3ae619c_4765_4aad_b15c_4fcaf20b6cb8.slice/crio-4d4861cd4c942574b0da76a390eace5a0d7ee540bc9a3617c166a560c8aaa4f6 WatchSource:0}: Error finding container 4d4861cd4c942574b0da76a390eace5a0d7ee540bc9a3617c166a560c8aaa4f6: Status 404 returned error can't find the container with id 4d4861cd4c942574b0da76a390eace5a0d7ee540bc9a3617c166a560c8aaa4f6 May 27 19:32:41.379561 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:32:41.379539 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f8c7bdc_51de_4a81_9dfc_003af9f4679a.slice/crio-317fbc0afb33e4411a403484f6790a6f1b54b3ddee2cfbfed9ee850b8dc76e8f WatchSource:0}: Error finding container 317fbc0afb33e4411a403484f6790a6f1b54b3ddee2cfbfed9ee850b8dc76e8f: Status 404 returned error can't find the container with id 317fbc0afb33e4411a403484f6790a6f1b54b3ddee2cfbfed9ee850b8dc76e8f May 27 19:32:41.699180 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:41.699149 2555 generic.go:358] "Generic (PLEG): container finished" podID="e6ba391e-3a4a-4ab7-a6a0-ab1069701c90" containerID="634e2a954967de9e620fd29b9e557a36ea6c4276c39436bdded8ff10db42e852" exitCode=0 May 27 19:32:41.699652 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:41.699227 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmfgh" event={"ID":"e6ba391e-3a4a-4ab7-a6a0-ab1069701c90","Type":"ContainerDied","Data":"634e2a954967de9e620fd29b9e557a36ea6c4276c39436bdded8ff10db42e852"} May 27 19:32:41.700236 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:41.700214 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6lzrp" event={"ID":"1829aad5-1f6d-4bf4-9da6-15027f679994","Type":"ContainerStarted","Data":"782703f5f78f45b950c6de30c17857508990480f501b9899a1418bbcc675bc53"} May 27 19:32:41.701140 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:41.701121 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-kxg9n" event={"ID":"c3ae619c-4765-4aad-b15c-4fcaf20b6cb8","Type":"ContainerStarted","Data":"4d4861cd4c942574b0da76a390eace5a0d7ee540bc9a3617c166a560c8aaa4f6"} May 27 19:32:41.701964 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:41.701939 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-mffsf" event={"ID":"4f8c7bdc-51de-4a81-9dfc-003af9f4679a","Type":"ContainerStarted","Data":"317fbc0afb33e4411a403484f6790a6f1b54b3ddee2cfbfed9ee850b8dc76e8f"} May 27 19:32:42.567365 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:42.567301 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9eda2122-90ad-4903-9dae-d20f0654eeec-registry-tls\") pod \"image-registry-56fc7546f-jd8l8\" (UID: \"9eda2122-90ad-4903-9dae-d20f0654eeec\") " pod="openshift-image-registry/image-registry-56fc7546f-jd8l8" May 27 19:32:42.567365 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:42.567354 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a2be77ab-d596-46ef-8967-88c344e07fb4-cert\") pod \"ingress-canary-bhbv4\" (UID: \"a2be77ab-d596-46ef-8967-88c344e07fb4\") " pod="openshift-ingress-canary/ingress-canary-bhbv4" May 27 19:32:42.567365 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:42.567426 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa63b18f-db50-412b-9280-777369bf9ded-metrics-tls\") pod \"dns-default-c9ls5\" (UID: \"fa63b18f-db50-412b-9280-777369bf9ded\") " pod="openshift-dns/dns-default-c9ls5" May 27 19:32:42.567820 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:42.567456 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 27 19:32:42.567820 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:42.567479 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56fc7546f-jd8l8: secret "image-registry-tls" not found May 27 19:32:42.567820 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:42.567540 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9eda2122-90ad-4903-9dae-d20f0654eeec-registry-tls podName:9eda2122-90ad-4903-9dae-d20f0654eeec nodeName:}" failed. No retries permitted until 2026-05-27 19:32:46.567519603 +0000 UTC m=+41.604146273 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9eda2122-90ad-4903-9dae-d20f0654eeec-registry-tls") pod "image-registry-56fc7546f-jd8l8" (UID: "9eda2122-90ad-4903-9dae-d20f0654eeec") : secret "image-registry-tls" not found May 27 19:32:42.567820 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:42.567548 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 19:32:42.567820 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:42.567604 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa63b18f-db50-412b-9280-777369bf9ded-metrics-tls podName:fa63b18f-db50-412b-9280-777369bf9ded nodeName:}" failed. No retries permitted until 2026-05-27 19:32:46.567586046 +0000 UTC m=+41.604212717 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fa63b18f-db50-412b-9280-777369bf9ded-metrics-tls") pod "dns-default-c9ls5" (UID: "fa63b18f-db50-412b-9280-777369bf9ded") : secret "dns-default-metrics-tls" not found May 27 19:32:42.567820 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:42.567666 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 19:32:42.567820 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:42.567696 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2be77ab-d596-46ef-8967-88c344e07fb4-cert podName:a2be77ab-d596-46ef-8967-88c344e07fb4 nodeName:}" failed. No retries permitted until 2026-05-27 19:32:46.567685299 +0000 UTC m=+41.604311969 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a2be77ab-d596-46ef-8967-88c344e07fb4-cert") pod "ingress-canary-bhbv4" (UID: "a2be77ab-d596-46ef-8967-88c344e07fb4") : secret "canary-serving-cert" not found May 27 19:32:42.668740 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:42.668457 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/54e71063-a75f-4ebc-8cdb-84280227744e-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-vbz74\" (UID: \"54e71063-a75f-4ebc-8cdb-84280227744e\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-vbz74" May 27 19:32:42.668740 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:42.668649 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 27 19:32:42.668740 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:42.668718 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54e71063-a75f-4ebc-8cdb-84280227744e-networking-console-plugin-cert podName:54e71063-a75f-4ebc-8cdb-84280227744e nodeName:}" failed. No retries permitted until 2026-05-27 19:32:46.66869949 +0000 UTC m=+41.705326179 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/54e71063-a75f-4ebc-8cdb-84280227744e-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-vbz74" (UID: "54e71063-a75f-4ebc-8cdb-84280227744e") : secret "networking-console-plugin-cert" not found May 27 19:32:42.708707 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:42.708008 2555 generic.go:358] "Generic (PLEG): container finished" podID="e6ba391e-3a4a-4ab7-a6a0-ab1069701c90" containerID="e5ffc8d8f2c354f00f6e01d668eafbf6ce0ed8d93342e1536608ee37d0fda35e" exitCode=0 May 27 19:32:42.708707 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:42.708064 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmfgh" event={"ID":"e6ba391e-3a4a-4ab7-a6a0-ab1069701c90","Type":"ContainerDied","Data":"e5ffc8d8f2c354f00f6e01d668eafbf6ce0ed8d93342e1536608ee37d0fda35e"} May 27 19:32:43.712210 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:43.712175 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmfgh" event={"ID":"e6ba391e-3a4a-4ab7-a6a0-ab1069701c90","Type":"ContainerStarted","Data":"abb2ea7f90d8f74ad35f99afc2672e1962a5e413deaacb44cb937e19523770a4"} May 27 19:32:43.734099 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:43.734053 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jmfgh" podStartSLOduration=5.674214802 podStartE2EDuration="38.734036151s" podCreationTimestamp="2026-05-27 19:32:05 +0000 UTC" firstStartedPulling="2026-05-27 19:32:08.349251765 +0000 UTC m=+3.385878430" lastFinishedPulling="2026-05-27 19:32:41.409073115 +0000 UTC m=+36.445699779" observedRunningTime="2026-05-27 19:32:43.733913229 +0000 UTC m=+38.770539916" watchObservedRunningTime="2026-05-27 19:32:43.734036151 +0000 UTC m=+38.770662839" May 27 19:32:45.716915 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:45.716828 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-kxg9n" event={"ID":"c3ae619c-4765-4aad-b15c-4fcaf20b6cb8","Type":"ContainerStarted","Data":"56fa30840863912579e9af5fa74800fe3f4a86d6d642816a01015f21a0f344d0"} May 27 19:32:45.718127 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:45.718101 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-mffsf" event={"ID":"4f8c7bdc-51de-4a81-9dfc-003af9f4679a","Type":"ContainerStarted","Data":"cdfc8c8a212008e16d7d4fc9f7c0115628dfde4ca3219e239b97fb185866ef44"} May 27 19:32:45.719232 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:45.719201 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6lzrp" event={"ID":"1829aad5-1f6d-4bf4-9da6-15027f679994","Type":"ContainerStarted","Data":"835f99ff5e54a7c1c311a0bc3cec46f8a516fcc5153796b2687cb14174cac891"} May 27 19:32:45.735501 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:45.735462 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-kxg9n" podStartSLOduration=36.943185998 podStartE2EDuration="40.735448325s" podCreationTimestamp="2026-05-27 19:32:05 +0000 UTC" firstStartedPulling="2026-05-27 19:32:41.385218297 +0000 UTC m=+36.421844967" lastFinishedPulling="2026-05-27 19:32:45.177480625 +0000 UTC m=+40.214107294" observedRunningTime="2026-05-27 19:32:45.734562225 +0000 UTC m=+40.771188912" watchObservedRunningTime="2026-05-27 19:32:45.735448325 +0000 UTC m=+40.772075014" May 27 19:32:45.752219 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:45.752171 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6lzrp" podStartSLOduration=36.94966944 podStartE2EDuration="40.75212807s" podCreationTimestamp="2026-05-27 19:32:05 +0000 UTC" firstStartedPulling="2026-05-27 19:32:41.385191379 +0000 UTC m=+36.421818044" lastFinishedPulling="2026-05-27 19:32:45.187650008 +0000 UTC m=+40.224276674" observedRunningTime="2026-05-27 19:32:45.751068533 +0000 UTC m=+40.787695234" watchObservedRunningTime="2026-05-27 19:32:45.75212807 +0000 UTC m=+40.788754758" May 27 19:32:45.766209 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:45.766172 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-mffsf" podStartSLOduration=35.974483085 podStartE2EDuration="39.766161538s" podCreationTimestamp="2026-05-27 19:32:06 +0000 UTC" firstStartedPulling="2026-05-27 19:32:41.385252076 +0000 UTC m=+36.421878747" lastFinishedPulling="2026-05-27 19:32:45.176930522 +0000 UTC m=+40.213557200" observedRunningTime="2026-05-27 19:32:45.765596367 +0000 UTC m=+40.802223055" watchObservedRunningTime="2026-05-27 19:32:45.766161538 +0000 UTC m=+40.802788224" May 27 19:32:46.600024 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:46.599986 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9eda2122-90ad-4903-9dae-d20f0654eeec-registry-tls\") pod \"image-registry-56fc7546f-jd8l8\" (UID: \"9eda2122-90ad-4903-9dae-d20f0654eeec\") " pod="openshift-image-registry/image-registry-56fc7546f-jd8l8" May 27 19:32:46.600209 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:46.600030 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a2be77ab-d596-46ef-8967-88c344e07fb4-cert\") pod \"ingress-canary-bhbv4\" (UID: \"a2be77ab-d596-46ef-8967-88c344e07fb4\") " pod="openshift-ingress-canary/ingress-canary-bhbv4" May 27 19:32:46.600209 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:46.600082 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa63b18f-db50-412b-9280-777369bf9ded-metrics-tls\") pod \"dns-default-c9ls5\" (UID: \"fa63b18f-db50-412b-9280-777369bf9ded\") " pod="openshift-dns/dns-default-c9ls5" May 27 19:32:46.600209 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:46.600141 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 27 19:32:46.600209 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:46.600158 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56fc7546f-jd8l8: secret "image-registry-tls" not found May 27 19:32:46.600209 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:46.600180 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 19:32:46.600209 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:46.600213 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9eda2122-90ad-4903-9dae-d20f0654eeec-registry-tls podName:9eda2122-90ad-4903-9dae-d20f0654eeec nodeName:}" failed. No retries permitted until 2026-05-27 19:32:54.600197818 +0000 UTC m=+49.636824503 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9eda2122-90ad-4903-9dae-d20f0654eeec-registry-tls") pod "image-registry-56fc7546f-jd8l8" (UID: "9eda2122-90ad-4903-9dae-d20f0654eeec") : secret "image-registry-tls" not found May 27 19:32:46.600483 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:46.600227 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2be77ab-d596-46ef-8967-88c344e07fb4-cert podName:a2be77ab-d596-46ef-8967-88c344e07fb4 nodeName:}" failed. No retries permitted until 2026-05-27 19:32:54.600221514 +0000 UTC m=+49.636848179 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a2be77ab-d596-46ef-8967-88c344e07fb4-cert") pod "ingress-canary-bhbv4" (UID: "a2be77ab-d596-46ef-8967-88c344e07fb4") : secret "canary-serving-cert" not found May 27 19:32:46.600483 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:46.600185 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 19:32:46.600483 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:46.600334 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa63b18f-db50-412b-9280-777369bf9ded-metrics-tls podName:fa63b18f-db50-412b-9280-777369bf9ded nodeName:}" failed. No retries permitted until 2026-05-27 19:32:54.600315494 +0000 UTC m=+49.636942169 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fa63b18f-db50-412b-9280-777369bf9ded-metrics-tls") pod "dns-default-c9ls5" (UID: "fa63b18f-db50-412b-9280-777369bf9ded") : secret "dns-default-metrics-tls" not found May 27 19:32:46.701047 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:46.701012 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/54e71063-a75f-4ebc-8cdb-84280227744e-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-vbz74\" (UID: \"54e71063-a75f-4ebc-8cdb-84280227744e\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-vbz74" May 27 19:32:46.701211 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:46.701160 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 27 19:32:46.701287 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:46.701226 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54e71063-a75f-4ebc-8cdb-84280227744e-networking-console-plugin-cert podName:54e71063-a75f-4ebc-8cdb-84280227744e nodeName:}" failed. No retries permitted until 2026-05-27 19:32:54.701206109 +0000 UTC m=+49.737832779 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/54e71063-a75f-4ebc-8cdb-84280227744e-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-vbz74" (UID: "54e71063-a75f-4ebc-8cdb-84280227744e") : secret "networking-console-plugin-cert" not found May 27 19:32:46.721642 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:46.721617 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6lzrp" May 27 19:32:54.655495 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:54.655454 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa63b18f-db50-412b-9280-777369bf9ded-metrics-tls\") pod \"dns-default-c9ls5\" (UID: \"fa63b18f-db50-412b-9280-777369bf9ded\") " pod="openshift-dns/dns-default-c9ls5" May 27 19:32:54.655930 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:54.655546 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9eda2122-90ad-4903-9dae-d20f0654eeec-registry-tls\") pod \"image-registry-56fc7546f-jd8l8\" (UID: \"9eda2122-90ad-4903-9dae-d20f0654eeec\") " pod="openshift-image-registry/image-registry-56fc7546f-jd8l8" May 27 19:32:54.655930 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:54.655580 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a2be77ab-d596-46ef-8967-88c344e07fb4-cert\") pod \"ingress-canary-bhbv4\" (UID: \"a2be77ab-d596-46ef-8967-88c344e07fb4\") " pod="openshift-ingress-canary/ingress-canary-bhbv4" May 27 19:32:54.655930 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:54.655604 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 19:32:54.655930 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:54.655670 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 27 19:32:54.655930 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:54.655688 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56fc7546f-jd8l8: secret "image-registry-tls" not found May 27 19:32:54.655930 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:54.655709 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 19:32:54.655930 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:54.655674 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa63b18f-db50-412b-9280-777369bf9ded-metrics-tls podName:fa63b18f-db50-412b-9280-777369bf9ded nodeName:}" failed. No retries permitted until 2026-05-27 19:33:10.655657496 +0000 UTC m=+65.692284161 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fa63b18f-db50-412b-9280-777369bf9ded-metrics-tls") pod "dns-default-c9ls5" (UID: "fa63b18f-db50-412b-9280-777369bf9ded") : secret "dns-default-metrics-tls" not found May 27 19:32:54.655930 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:54.655747 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9eda2122-90ad-4903-9dae-d20f0654eeec-registry-tls podName:9eda2122-90ad-4903-9dae-d20f0654eeec nodeName:}" failed. No retries permitted until 2026-05-27 19:33:10.655734289 +0000 UTC m=+65.692360955 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9eda2122-90ad-4903-9dae-d20f0654eeec-registry-tls") pod "image-registry-56fc7546f-jd8l8" (UID: "9eda2122-90ad-4903-9dae-d20f0654eeec") : secret "image-registry-tls" not found May 27 19:32:54.655930 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:54.655758 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2be77ab-d596-46ef-8967-88c344e07fb4-cert podName:a2be77ab-d596-46ef-8967-88c344e07fb4 nodeName:}" failed. No retries permitted until 2026-05-27 19:33:10.655751542 +0000 UTC m=+65.692378207 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a2be77ab-d596-46ef-8967-88c344e07fb4-cert") pod "ingress-canary-bhbv4" (UID: "a2be77ab-d596-46ef-8967-88c344e07fb4") : secret "canary-serving-cert" not found May 27 19:32:54.756741 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:32:54.756705 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/54e71063-a75f-4ebc-8cdb-84280227744e-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-vbz74\" (UID: \"54e71063-a75f-4ebc-8cdb-84280227744e\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-vbz74" May 27 19:32:54.756908 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:54.756846 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 27 19:32:54.756908 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:32:54.756905 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54e71063-a75f-4ebc-8cdb-84280227744e-networking-console-plugin-cert podName:54e71063-a75f-4ebc-8cdb-84280227744e nodeName:}" failed. No retries permitted until 2026-05-27 19:33:10.756890542 +0000 UTC m=+65.793517208 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/54e71063-a75f-4ebc-8cdb-84280227744e-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-vbz74" (UID: "54e71063-a75f-4ebc-8cdb-84280227744e") : secret "networking-console-plugin-cert" not found May 27 19:33:03.692895 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:03.692868 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pth57" May 27 19:33:09.097310 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.097276 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-q8fkz"] May 27 19:33:09.099744 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.099728 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-q8fkz" May 27 19:33:09.103095 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.103063 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" May 27 19:33:09.104562 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.104537 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-65454f44b7-btjxj"] May 27 19:33:09.104787 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.104769 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" May 27 19:33:09.105007 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.104992 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-kvhbn\"" May 27 19:33:09.109743 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.109719 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799875cb5-j7bdw"] May 27 19:33:09.109890 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.109874 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65454f44b7-btjxj" May 27 19:33:09.111846 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.111830 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799875cb5-j7bdw" May 27 19:33:09.112210 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.112190 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" May 27 19:33:09.112325 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.112231 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" May 27 19:33:09.112325 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.112258 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" May 27 19:33:09.112437 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.112411 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" May 27 19:33:09.113942 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.113923 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" May 27 19:33:09.114228 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.114195 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" May 27 19:33:09.114620 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.114599 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" May 27 19:33:09.114715 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.114656 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" May 27 19:33:09.115501 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.115479 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-q8fkz"] May 27 19:33:09.120375 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.120346 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-65454f44b7-btjxj"] May 27 19:33:09.141186 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.141168 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799875cb5-j7bdw"] May 27 19:33:09.167122 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.167099 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvr7p\" (UniqueName: \"kubernetes.io/projected/d4509ba7-3326-4d3f-9525-f2f4c10cf873-kube-api-access-hvr7p\") pod \"volume-data-source-validator-5cf8c89d64-q8fkz\" (UID: \"d4509ba7-3326-4d3f-9525-f2f4c10cf873\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-q8fkz" May 27 19:33:09.167211 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.167140 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/16eeb4d4-e7b1-4c2d-8af2-d1ab10b36f07-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7799875cb5-j7bdw\" (UID: \"16eeb4d4-e7b1-4c2d-8af2-d1ab10b36f07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799875cb5-j7bdw" May 27 19:33:09.167211 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.167168 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bnxx\" (UniqueName: \"kubernetes.io/projected/dc24f656-68e3-4493-a4f8-6b3cbd4d69dc-kube-api-access-5bnxx\") pod \"klusterlet-addon-workmgr-65454f44b7-btjxj\" (UID: \"dc24f656-68e3-4493-a4f8-6b3cbd4d69dc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65454f44b7-btjxj" May 27 19:33:09.167333 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.167212 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc24f656-68e3-4493-a4f8-6b3cbd4d69dc-tmp\") pod \"klusterlet-addon-workmgr-65454f44b7-btjxj\" (UID: \"dc24f656-68e3-4493-a4f8-6b3cbd4d69dc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65454f44b7-btjxj" May 27 19:33:09.167333 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.167240 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/16eeb4d4-e7b1-4c2d-8af2-d1ab10b36f07-ca\") pod \"cluster-proxy-proxy-agent-7799875cb5-j7bdw\" (UID: \"16eeb4d4-e7b1-4c2d-8af2-d1ab10b36f07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799875cb5-j7bdw" May 27 19:33:09.167333 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.167287 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/16eeb4d4-e7b1-4c2d-8af2-d1ab10b36f07-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-7799875cb5-j7bdw\" (UID: \"16eeb4d4-e7b1-4c2d-8af2-d1ab10b36f07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799875cb5-j7bdw" May 27 19:33:09.167333 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.167309 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/16eeb4d4-e7b1-4c2d-8af2-d1ab10b36f07-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7799875cb5-j7bdw\" (UID: \"16eeb4d4-e7b1-4c2d-8af2-d1ab10b36f07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799875cb5-j7bdw" May 27 19:33:09.167490 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.167366 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/16eeb4d4-e7b1-4c2d-8af2-d1ab10b36f07-hub\") pod \"cluster-proxy-proxy-agent-7799875cb5-j7bdw\" (UID: \"16eeb4d4-e7b1-4c2d-8af2-d1ab10b36f07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799875cb5-j7bdw" May 27 19:33:09.167490 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.167385 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dszsb\" (UniqueName: \"kubernetes.io/projected/16eeb4d4-e7b1-4c2d-8af2-d1ab10b36f07-kube-api-access-dszsb\") pod \"cluster-proxy-proxy-agent-7799875cb5-j7bdw\" (UID: \"16eeb4d4-e7b1-4c2d-8af2-d1ab10b36f07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799875cb5-j7bdw" May 27 19:33:09.167490 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.167433 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/dc24f656-68e3-4493-a4f8-6b3cbd4d69dc-klusterlet-config\") pod \"klusterlet-addon-workmgr-65454f44b7-btjxj\" (UID: \"dc24f656-68e3-4493-a4f8-6b3cbd4d69dc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65454f44b7-btjxj" May 27 19:33:09.227629 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.227606 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-56fc7546f-jd8l8"] May 27 19:33:09.227788 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:33:09.227771 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-56fc7546f-jd8l8" podUID="9eda2122-90ad-4903-9dae-d20f0654eeec" May 27 19:33:09.268073 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.268040 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/16eeb4d4-e7b1-4c2d-8af2-d1ab10b36f07-hub\") pod \"cluster-proxy-proxy-agent-7799875cb5-j7bdw\" (UID: \"16eeb4d4-e7b1-4c2d-8af2-d1ab10b36f07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799875cb5-j7bdw" May 27 19:33:09.268211 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.268084 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dszsb\" (UniqueName: \"kubernetes.io/projected/16eeb4d4-e7b1-4c2d-8af2-d1ab10b36f07-kube-api-access-dszsb\") pod \"cluster-proxy-proxy-agent-7799875cb5-j7bdw\" (UID: \"16eeb4d4-e7b1-4c2d-8af2-d1ab10b36f07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799875cb5-j7bdw" May 27 19:33:09.268211 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.268138 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/dc24f656-68e3-4493-a4f8-6b3cbd4d69dc-klusterlet-config\") pod \"klusterlet-addon-workmgr-65454f44b7-btjxj\" (UID: \"dc24f656-68e3-4493-a4f8-6b3cbd4d69dc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65454f44b7-btjxj" May 27 19:33:09.268211 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.268187 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hvr7p\" (UniqueName: \"kubernetes.io/projected/d4509ba7-3326-4d3f-9525-f2f4c10cf873-kube-api-access-hvr7p\") pod \"volume-data-source-validator-5cf8c89d64-q8fkz\" (UID: \"d4509ba7-3326-4d3f-9525-f2f4c10cf873\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-q8fkz" May 27 19:33:09.268408 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.268224 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/16eeb4d4-e7b1-4c2d-8af2-d1ab10b36f07-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7799875cb5-j7bdw\" (UID: \"16eeb4d4-e7b1-4c2d-8af2-d1ab10b36f07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799875cb5-j7bdw" May 27 19:33:09.268408 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.268250 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5bnxx\" (UniqueName: \"kubernetes.io/projected/dc24f656-68e3-4493-a4f8-6b3cbd4d69dc-kube-api-access-5bnxx\") pod \"klusterlet-addon-workmgr-65454f44b7-btjxj\" (UID: \"dc24f656-68e3-4493-a4f8-6b3cbd4d69dc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65454f44b7-btjxj" May 27 19:33:09.268408 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.268313 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc24f656-68e3-4493-a4f8-6b3cbd4d69dc-tmp\") pod \"klusterlet-addon-workmgr-65454f44b7-btjxj\" (UID: \"dc24f656-68e3-4493-a4f8-6b3cbd4d69dc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65454f44b7-btjxj" May 27 19:33:09.268408 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.268353 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/16eeb4d4-e7b1-4c2d-8af2-d1ab10b36f07-ca\") pod \"cluster-proxy-proxy-agent-7799875cb5-j7bdw\" (UID: \"16eeb4d4-e7b1-4c2d-8af2-d1ab10b36f07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799875cb5-j7bdw" May 27 19:33:09.268408 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.268385 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/16eeb4d4-e7b1-4c2d-8af2-d1ab10b36f07-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-7799875cb5-j7bdw\" (UID: \"16eeb4d4-e7b1-4c2d-8af2-d1ab10b36f07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799875cb5-j7bdw" May 27 19:33:09.268657 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.268409 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/16eeb4d4-e7b1-4c2d-8af2-d1ab10b36f07-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7799875cb5-j7bdw\" (UID: \"16eeb4d4-e7b1-4c2d-8af2-d1ab10b36f07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799875cb5-j7bdw" May 27 19:33:09.268764 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.268738 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc24f656-68e3-4493-a4f8-6b3cbd4d69dc-tmp\") pod \"klusterlet-addon-workmgr-65454f44b7-btjxj\" (UID: \"dc24f656-68e3-4493-a4f8-6b3cbd4d69dc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65454f44b7-btjxj" May 27 19:33:09.269509 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.269489 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/16eeb4d4-e7b1-4c2d-8af2-d1ab10b36f07-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-7799875cb5-j7bdw\" (UID: \"16eeb4d4-e7b1-4c2d-8af2-d1ab10b36f07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799875cb5-j7bdw" May 27 19:33:09.272280 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.272237 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/16eeb4d4-e7b1-4c2d-8af2-d1ab10b36f07-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7799875cb5-j7bdw\" (UID: \"16eeb4d4-e7b1-4c2d-8af2-d1ab10b36f07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799875cb5-j7bdw" May 27 19:33:09.272434 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.272411 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/16eeb4d4-e7b1-4c2d-8af2-d1ab10b36f07-ca\") pod \"cluster-proxy-proxy-agent-7799875cb5-j7bdw\" (UID: \"16eeb4d4-e7b1-4c2d-8af2-d1ab10b36f07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799875cb5-j7bdw" May 27 19:33:09.272493 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.272443 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/16eeb4d4-e7b1-4c2d-8af2-d1ab10b36f07-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7799875cb5-j7bdw\" (UID: \"16eeb4d4-e7b1-4c2d-8af2-d1ab10b36f07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799875cb5-j7bdw" May 27 19:33:09.272528 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.272509 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/dc24f656-68e3-4493-a4f8-6b3cbd4d69dc-klusterlet-config\") pod \"klusterlet-addon-workmgr-65454f44b7-btjxj\" (UID: \"dc24f656-68e3-4493-a4f8-6b3cbd4d69dc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65454f44b7-btjxj" May 27 19:33:09.272577 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.272561 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/16eeb4d4-e7b1-4c2d-8af2-d1ab10b36f07-hub\") pod \"cluster-proxy-proxy-agent-7799875cb5-j7bdw\" (UID: \"16eeb4d4-e7b1-4c2d-8af2-d1ab10b36f07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799875cb5-j7bdw" May 27 19:33:09.293736 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.293711 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvr7p\" (UniqueName: \"kubernetes.io/projected/d4509ba7-3326-4d3f-9525-f2f4c10cf873-kube-api-access-hvr7p\") pod \"volume-data-source-validator-5cf8c89d64-q8fkz\" (UID: \"d4509ba7-3326-4d3f-9525-f2f4c10cf873\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-q8fkz" May 27 19:33:09.294470 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.294452 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dszsb\" (UniqueName: \"kubernetes.io/projected/16eeb4d4-e7b1-4c2d-8af2-d1ab10b36f07-kube-api-access-dszsb\") pod \"cluster-proxy-proxy-agent-7799875cb5-j7bdw\" (UID: \"16eeb4d4-e7b1-4c2d-8af2-d1ab10b36f07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799875cb5-j7bdw" May 27 19:33:09.296034 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.296019 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bnxx\" (UniqueName: \"kubernetes.io/projected/dc24f656-68e3-4493-a4f8-6b3cbd4d69dc-kube-api-access-5bnxx\") pod \"klusterlet-addon-workmgr-65454f44b7-btjxj\" (UID: \"dc24f656-68e3-4493-a4f8-6b3cbd4d69dc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65454f44b7-btjxj" May 27 19:33:09.307916 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.307893 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5546b79695-kzwjl"] May 27 19:33:09.310391 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.310377 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5546b79695-kzwjl" May 27 19:33:09.324898 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.324877 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5546b79695-kzwjl"] May 27 19:33:09.369613 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.369555 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/88f1d61c-af5f-44cc-9b7e-e82747bf21c4-image-registry-private-configuration\") pod \"image-registry-5546b79695-kzwjl\" (UID: \"88f1d61c-af5f-44cc-9b7e-e82747bf21c4\") " pod="openshift-image-registry/image-registry-5546b79695-kzwjl" May 27 19:33:09.369613 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.369600 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/88f1d61c-af5f-44cc-9b7e-e82747bf21c4-registry-certificates\") pod \"image-registry-5546b79695-kzwjl\" (UID: \"88f1d61c-af5f-44cc-9b7e-e82747bf21c4\") " pod="openshift-image-registry/image-registry-5546b79695-kzwjl" May 27 19:33:09.369731 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.369617 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/88f1d61c-af5f-44cc-9b7e-e82747bf21c4-trusted-ca\") pod \"image-registry-5546b79695-kzwjl\" (UID: \"88f1d61c-af5f-44cc-9b7e-e82747bf21c4\") " pod="openshift-image-registry/image-registry-5546b79695-kzwjl" May 27 19:33:09.369731 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.369642 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ns9ll\" (UniqueName: \"kubernetes.io/projected/88f1d61c-af5f-44cc-9b7e-e82747bf21c4-kube-api-access-ns9ll\") pod \"image-registry-5546b79695-kzwjl\" (UID: \"88f1d61c-af5f-44cc-9b7e-e82747bf21c4\") " pod="openshift-image-registry/image-registry-5546b79695-kzwjl" May 27 19:33:09.369731 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.369683 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/88f1d61c-af5f-44cc-9b7e-e82747bf21c4-bound-sa-token\") pod \"image-registry-5546b79695-kzwjl\" (UID: \"88f1d61c-af5f-44cc-9b7e-e82747bf21c4\") " pod="openshift-image-registry/image-registry-5546b79695-kzwjl" May 27 19:33:09.369817 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.369742 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/88f1d61c-af5f-44cc-9b7e-e82747bf21c4-ca-trust-extracted\") pod \"image-registry-5546b79695-kzwjl\" (UID: \"88f1d61c-af5f-44cc-9b7e-e82747bf21c4\") " pod="openshift-image-registry/image-registry-5546b79695-kzwjl" May 27 19:33:09.369817 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.369765 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/88f1d61c-af5f-44cc-9b7e-e82747bf21c4-registry-tls\") pod \"image-registry-5546b79695-kzwjl\" (UID: \"88f1d61c-af5f-44cc-9b7e-e82747bf21c4\") " pod="openshift-image-registry/image-registry-5546b79695-kzwjl" May 27 19:33:09.369817 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.369782 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/88f1d61c-af5f-44cc-9b7e-e82747bf21c4-installation-pull-secrets\") pod \"image-registry-5546b79695-kzwjl\" (UID: \"88f1d61c-af5f-44cc-9b7e-e82747bf21c4\") " pod="openshift-image-registry/image-registry-5546b79695-kzwjl" May 27 19:33:09.410281 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.410249 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-q8fkz" May 27 19:33:09.419902 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.419883 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65454f44b7-btjxj" May 27 19:33:09.435575 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.435547 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799875cb5-j7bdw" May 27 19:33:09.470704 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.470607 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/88f1d61c-af5f-44cc-9b7e-e82747bf21c4-image-registry-private-configuration\") pod \"image-registry-5546b79695-kzwjl\" (UID: \"88f1d61c-af5f-44cc-9b7e-e82747bf21c4\") " pod="openshift-image-registry/image-registry-5546b79695-kzwjl" May 27 19:33:09.470704 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.470674 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/88f1d61c-af5f-44cc-9b7e-e82747bf21c4-registry-certificates\") pod \"image-registry-5546b79695-kzwjl\" (UID: \"88f1d61c-af5f-44cc-9b7e-e82747bf21c4\") " pod="openshift-image-registry/image-registry-5546b79695-kzwjl" May 27 19:33:09.470704 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.470703 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/88f1d61c-af5f-44cc-9b7e-e82747bf21c4-trusted-ca\") pod \"image-registry-5546b79695-kzwjl\" (UID: \"88f1d61c-af5f-44cc-9b7e-e82747bf21c4\") " pod="openshift-image-registry/image-registry-5546b79695-kzwjl" May 27 19:33:09.470975 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.470745 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ns9ll\" (UniqueName: \"kubernetes.io/projected/88f1d61c-af5f-44cc-9b7e-e82747bf21c4-kube-api-access-ns9ll\") pod \"image-registry-5546b79695-kzwjl\" (UID: \"88f1d61c-af5f-44cc-9b7e-e82747bf21c4\") " pod="openshift-image-registry/image-registry-5546b79695-kzwjl" May 27 19:33:09.470975 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.470825 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/88f1d61c-af5f-44cc-9b7e-e82747bf21c4-bound-sa-token\") pod \"image-registry-5546b79695-kzwjl\" (UID: \"88f1d61c-af5f-44cc-9b7e-e82747bf21c4\") " pod="openshift-image-registry/image-registry-5546b79695-kzwjl" May 27 19:33:09.470975 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.470877 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/88f1d61c-af5f-44cc-9b7e-e82747bf21c4-ca-trust-extracted\") pod \"image-registry-5546b79695-kzwjl\" (UID: \"88f1d61c-af5f-44cc-9b7e-e82747bf21c4\") " pod="openshift-image-registry/image-registry-5546b79695-kzwjl" May 27 19:33:09.470975 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.470916 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/88f1d61c-af5f-44cc-9b7e-e82747bf21c4-registry-tls\") pod \"image-registry-5546b79695-kzwjl\" (UID: \"88f1d61c-af5f-44cc-9b7e-e82747bf21c4\") " pod="openshift-image-registry/image-registry-5546b79695-kzwjl" May 27 19:33:09.470975 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.470947 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/88f1d61c-af5f-44cc-9b7e-e82747bf21c4-installation-pull-secrets\") pod \"image-registry-5546b79695-kzwjl\" (UID: \"88f1d61c-af5f-44cc-9b7e-e82747bf21c4\") " pod="openshift-image-registry/image-registry-5546b79695-kzwjl" May 27 19:33:09.477055 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.475313 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/88f1d61c-af5f-44cc-9b7e-e82747bf21c4-ca-trust-extracted\") pod \"image-registry-5546b79695-kzwjl\" (UID: \"88f1d61c-af5f-44cc-9b7e-e82747bf21c4\") " pod="openshift-image-registry/image-registry-5546b79695-kzwjl" May 27 19:33:09.477055 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.475771 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/88f1d61c-af5f-44cc-9b7e-e82747bf21c4-registry-certificates\") pod \"image-registry-5546b79695-kzwjl\" (UID: \"88f1d61c-af5f-44cc-9b7e-e82747bf21c4\") " pod="openshift-image-registry/image-registry-5546b79695-kzwjl" May 27 19:33:09.477055 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.476160 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/88f1d61c-af5f-44cc-9b7e-e82747bf21c4-installation-pull-secrets\") pod \"image-registry-5546b79695-kzwjl\" (UID: \"88f1d61c-af5f-44cc-9b7e-e82747bf21c4\") " pod="openshift-image-registry/image-registry-5546b79695-kzwjl" May 27 19:33:09.477055 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.476833 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/88f1d61c-af5f-44cc-9b7e-e82747bf21c4-trusted-ca\") pod \"image-registry-5546b79695-kzwjl\" (UID: \"88f1d61c-af5f-44cc-9b7e-e82747bf21c4\") " pod="openshift-image-registry/image-registry-5546b79695-kzwjl" May 27 19:33:09.477987 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.477865 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/88f1d61c-af5f-44cc-9b7e-e82747bf21c4-registry-tls\") pod \"image-registry-5546b79695-kzwjl\" (UID: \"88f1d61c-af5f-44cc-9b7e-e82747bf21c4\") " pod="openshift-image-registry/image-registry-5546b79695-kzwjl" May 27 19:33:09.481052 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.480731 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/88f1d61c-af5f-44cc-9b7e-e82747bf21c4-image-registry-private-configuration\") pod \"image-registry-5546b79695-kzwjl\" (UID: \"88f1d61c-af5f-44cc-9b7e-e82747bf21c4\") " pod="openshift-image-registry/image-registry-5546b79695-kzwjl" May 27 19:33:09.483463 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.483418 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/88f1d61c-af5f-44cc-9b7e-e82747bf21c4-bound-sa-token\") pod \"image-registry-5546b79695-kzwjl\" (UID: \"88f1d61c-af5f-44cc-9b7e-e82747bf21c4\") " pod="openshift-image-registry/image-registry-5546b79695-kzwjl" May 27 19:33:09.485691 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.485647 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ns9ll\" (UniqueName: \"kubernetes.io/projected/88f1d61c-af5f-44cc-9b7e-e82747bf21c4-kube-api-access-ns9ll\") pod \"image-registry-5546b79695-kzwjl\" (UID: \"88f1d61c-af5f-44cc-9b7e-e82747bf21c4\") " pod="openshift-image-registry/image-registry-5546b79695-kzwjl" May 27 19:33:09.551867 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.551835 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-q8fkz"] May 27 19:33:09.554390 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:33:09.554360 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4509ba7_3326_4d3f_9525_f2f4c10cf873.slice/crio-3cc645833eea320674f577acc0f6dfad536cea49130bde03a6a1744092dfc52c WatchSource:0}: Error finding container 3cc645833eea320674f577acc0f6dfad536cea49130bde03a6a1744092dfc52c: Status 404 returned error can't find the container with id 3cc645833eea320674f577acc0f6dfad536cea49130bde03a6a1744092dfc52c May 27 19:33:09.571975 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.571955 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-65454f44b7-btjxj"] May 27 19:33:09.573703 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:33:09.573678 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc24f656_68e3_4493_a4f8_6b3cbd4d69dc.slice/crio-5058656cc4f4e4f6088ff9450a216f6326d2bf4d220d377c1db87d927e3a6c42 WatchSource:0}: Error finding container 5058656cc4f4e4f6088ff9450a216f6326d2bf4d220d377c1db87d927e3a6c42: Status 404 returned error can't find the container with id 5058656cc4f4e4f6088ff9450a216f6326d2bf4d220d377c1db87d927e3a6c42 May 27 19:33:09.587210 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.587115 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799875cb5-j7bdw"] May 27 19:33:09.589475 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:33:09.589455 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod16eeb4d4_e7b1_4c2d_8af2_d1ab10b36f07.slice/crio-e189b2b3309fae29743f11b658194fef898253bb35bf4ce84930e2be77ea2d6c WatchSource:0}: Error finding container e189b2b3309fae29743f11b658194fef898253bb35bf4ce84930e2be77ea2d6c: Status 404 returned error can't find the container with id e189b2b3309fae29743f11b658194fef898253bb35bf4ce84930e2be77ea2d6c May 27 19:33:09.620994 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.620948 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-sntsc\"" May 27 19:33:09.629053 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.629034 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5546b79695-kzwjl" May 27 19:33:09.761441 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.761312 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5546b79695-kzwjl"] May 27 19:33:09.763995 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:33:09.763964 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88f1d61c_af5f_44cc_9b7e_e82747bf21c4.slice/crio-2ad97b878c24ef4b2b8777a17e0af54be18fdc8dca57f1749bf1c515c67d3910 WatchSource:0}: Error finding container 2ad97b878c24ef4b2b8777a17e0af54be18fdc8dca57f1749bf1c515c67d3910: Status 404 returned error can't find the container with id 2ad97b878c24ef4b2b8777a17e0af54be18fdc8dca57f1749bf1c515c67d3910 May 27 19:33:09.764917 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.764890 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65454f44b7-btjxj" event={"ID":"dc24f656-68e3-4493-a4f8-6b3cbd4d69dc","Type":"ContainerStarted","Data":"5058656cc4f4e4f6088ff9450a216f6326d2bf4d220d377c1db87d927e3a6c42"} May 27 19:33:09.765820 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.765796 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799875cb5-j7bdw" event={"ID":"16eeb4d4-e7b1-4c2d-8af2-d1ab10b36f07","Type":"ContainerStarted","Data":"e189b2b3309fae29743f11b658194fef898253bb35bf4ce84930e2be77ea2d6c"} May 27 19:33:09.766831 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.766814 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56fc7546f-jd8l8" May 27 19:33:09.766932 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.766825 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-q8fkz" event={"ID":"d4509ba7-3326-4d3f-9525-f2f4c10cf873","Type":"ContainerStarted","Data":"3cc645833eea320674f577acc0f6dfad536cea49130bde03a6a1744092dfc52c"} May 27 19:33:09.771473 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.771457 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56fc7546f-jd8l8" May 27 19:33:09.874871 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.874790 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9eda2122-90ad-4903-9dae-d20f0654eeec-bound-sa-token\") pod \"9eda2122-90ad-4903-9dae-d20f0654eeec\" (UID: \"9eda2122-90ad-4903-9dae-d20f0654eeec\") " May 27 19:33:09.874871 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.874841 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p88m5\" (UniqueName: \"kubernetes.io/projected/9eda2122-90ad-4903-9dae-d20f0654eeec-kube-api-access-p88m5\") pod \"9eda2122-90ad-4903-9dae-d20f0654eeec\" (UID: \"9eda2122-90ad-4903-9dae-d20f0654eeec\") " May 27 19:33:09.874871 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.874868 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9eda2122-90ad-4903-9dae-d20f0654eeec-image-registry-private-configuration\") pod \"9eda2122-90ad-4903-9dae-d20f0654eeec\" (UID: \"9eda2122-90ad-4903-9dae-d20f0654eeec\") " May 27 19:33:09.875115 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.874897 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9eda2122-90ad-4903-9dae-d20f0654eeec-trusted-ca\") pod \"9eda2122-90ad-4903-9dae-d20f0654eeec\" (UID: \"9eda2122-90ad-4903-9dae-d20f0654eeec\") " May 27 19:33:09.875115 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.874920 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9eda2122-90ad-4903-9dae-d20f0654eeec-ca-trust-extracted\") pod \"9eda2122-90ad-4903-9dae-d20f0654eeec\" (UID: \"9eda2122-90ad-4903-9dae-d20f0654eeec\") " May 27 19:33:09.875115 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.874943 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9eda2122-90ad-4903-9dae-d20f0654eeec-registry-certificates\") pod \"9eda2122-90ad-4903-9dae-d20f0654eeec\" (UID: \"9eda2122-90ad-4903-9dae-d20f0654eeec\") " May 27 19:33:09.875115 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.874980 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9eda2122-90ad-4903-9dae-d20f0654eeec-installation-pull-secrets\") pod \"9eda2122-90ad-4903-9dae-d20f0654eeec\" (UID: \"9eda2122-90ad-4903-9dae-d20f0654eeec\") " May 27 19:33:09.875459 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.875432 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9eda2122-90ad-4903-9dae-d20f0654eeec-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9eda2122-90ad-4903-9dae-d20f0654eeec" (UID: "9eda2122-90ad-4903-9dae-d20f0654eeec"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 19:33:09.875618 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.875459 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9eda2122-90ad-4903-9dae-d20f0654eeec-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9eda2122-90ad-4903-9dae-d20f0654eeec" (UID: "9eda2122-90ad-4903-9dae-d20f0654eeec"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 19:33:09.875722 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.875641 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9eda2122-90ad-4903-9dae-d20f0654eeec-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9eda2122-90ad-4903-9dae-d20f0654eeec" (UID: "9eda2122-90ad-4903-9dae-d20f0654eeec"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 19:33:09.877178 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.877153 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9eda2122-90ad-4903-9dae-d20f0654eeec-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9eda2122-90ad-4903-9dae-d20f0654eeec" (UID: "9eda2122-90ad-4903-9dae-d20f0654eeec"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 19:33:09.877313 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.877301 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9eda2122-90ad-4903-9dae-d20f0654eeec-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9eda2122-90ad-4903-9dae-d20f0654eeec" (UID: "9eda2122-90ad-4903-9dae-d20f0654eeec"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 19:33:09.877426 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.877407 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9eda2122-90ad-4903-9dae-d20f0654eeec-kube-api-access-p88m5" (OuterVolumeSpecName: "kube-api-access-p88m5") pod "9eda2122-90ad-4903-9dae-d20f0654eeec" (UID: "9eda2122-90ad-4903-9dae-d20f0654eeec"). InnerVolumeSpecName "kube-api-access-p88m5". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 19:33:09.877623 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.877593 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9eda2122-90ad-4903-9dae-d20f0654eeec-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9eda2122-90ad-4903-9dae-d20f0654eeec" (UID: "9eda2122-90ad-4903-9dae-d20f0654eeec"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 19:33:09.976634 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.976596 2555 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9eda2122-90ad-4903-9dae-d20f0654eeec-installation-pull-secrets\") on node \"ip-10-0-139-51.ec2.internal\" DevicePath \"\"" May 27 19:33:09.976634 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.976633 2555 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9eda2122-90ad-4903-9dae-d20f0654eeec-bound-sa-token\") on node \"ip-10-0-139-51.ec2.internal\" DevicePath \"\"" May 27 19:33:09.976811 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.976650 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p88m5\" (UniqueName: \"kubernetes.io/projected/9eda2122-90ad-4903-9dae-d20f0654eeec-kube-api-access-p88m5\") on node \"ip-10-0-139-51.ec2.internal\" DevicePath \"\"" May 27 19:33:09.976811 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.976667 2555 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9eda2122-90ad-4903-9dae-d20f0654eeec-image-registry-private-configuration\") on node \"ip-10-0-139-51.ec2.internal\" DevicePath \"\"" May 27 19:33:09.976811 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.976684 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9eda2122-90ad-4903-9dae-d20f0654eeec-trusted-ca\") on node \"ip-10-0-139-51.ec2.internal\" DevicePath \"\"" May 27 19:33:09.976811 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.976699 2555 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9eda2122-90ad-4903-9dae-d20f0654eeec-ca-trust-extracted\") on node \"ip-10-0-139-51.ec2.internal\" DevicePath \"\"" May 27 19:33:09.976811 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:09.976713 2555 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9eda2122-90ad-4903-9dae-d20f0654eeec-registry-certificates\") on node \"ip-10-0-139-51.ec2.internal\" DevicePath \"\"" May 27 19:33:10.684001 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:10.682779 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9eda2122-90ad-4903-9dae-d20f0654eeec-registry-tls\") pod \"image-registry-56fc7546f-jd8l8\" (UID: \"9eda2122-90ad-4903-9dae-d20f0654eeec\") " pod="openshift-image-registry/image-registry-56fc7546f-jd8l8" May 27 19:33:10.684001 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:10.682901 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a2be77ab-d596-46ef-8967-88c344e07fb4-cert\") pod \"ingress-canary-bhbv4\" (UID: \"a2be77ab-d596-46ef-8967-88c344e07fb4\") " pod="openshift-ingress-canary/ingress-canary-bhbv4" May 27 19:33:10.684001 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:10.683015 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa63b18f-db50-412b-9280-777369bf9ded-metrics-tls\") pod \"dns-default-c9ls5\" (UID: \"fa63b18f-db50-412b-9280-777369bf9ded\") " pod="openshift-dns/dns-default-c9ls5" May 27 19:33:10.689151 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:10.689097 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa63b18f-db50-412b-9280-777369bf9ded-metrics-tls\") pod \"dns-default-c9ls5\" (UID: \"fa63b18f-db50-412b-9280-777369bf9ded\") " pod="openshift-dns/dns-default-c9ls5" May 27 19:33:10.690920 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:10.690872 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9eda2122-90ad-4903-9dae-d20f0654eeec-registry-tls\") pod \"image-registry-56fc7546f-jd8l8\" (UID: \"9eda2122-90ad-4903-9dae-d20f0654eeec\") " pod="openshift-image-registry/image-registry-56fc7546f-jd8l8" May 27 19:33:10.693251 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:10.693205 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a2be77ab-d596-46ef-8967-88c344e07fb4-cert\") pod \"ingress-canary-bhbv4\" (UID: \"a2be77ab-d596-46ef-8967-88c344e07fb4\") " pod="openshift-ingress-canary/ingress-canary-bhbv4" May 27 19:33:10.771773 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:10.771689 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5546b79695-kzwjl" event={"ID":"88f1d61c-af5f-44cc-9b7e-e82747bf21c4","Type":"ContainerStarted","Data":"45c45923e74002979807177fd4b704dba1a7f5346d678a847c279adc9f1d4195"} May 27 19:33:10.771773 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:10.771732 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5546b79695-kzwjl" event={"ID":"88f1d61c-af5f-44cc-9b7e-e82747bf21c4","Type":"ContainerStarted","Data":"2ad97b878c24ef4b2b8777a17e0af54be18fdc8dca57f1749bf1c515c67d3910"} May 27 19:33:10.772007 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:10.771901 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5546b79695-kzwjl" May 27 19:33:10.772421 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:10.772199 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56fc7546f-jd8l8" May 27 19:33:10.784091 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:10.783384 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9eda2122-90ad-4903-9dae-d20f0654eeec-registry-tls\") pod \"9eda2122-90ad-4903-9dae-d20f0654eeec\" (UID: \"9eda2122-90ad-4903-9dae-d20f0654eeec\") " May 27 19:33:10.784091 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:10.783544 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/54e71063-a75f-4ebc-8cdb-84280227744e-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-vbz74\" (UID: \"54e71063-a75f-4ebc-8cdb-84280227744e\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-vbz74" May 27 19:33:10.787658 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:10.787612 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/54e71063-a75f-4ebc-8cdb-84280227744e-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-vbz74\" (UID: \"54e71063-a75f-4ebc-8cdb-84280227744e\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-vbz74" May 27 19:33:10.797885 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:10.797671 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5546b79695-kzwjl" podStartSLOduration=1.797655977 podStartE2EDuration="1.797655977s" podCreationTimestamp="2026-05-27 19:33:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 19:33:10.796221194 +0000 UTC m=+65.832847883" watchObservedRunningTime="2026-05-27 19:33:10.797655977 +0000 UTC m=+65.834282664" May 27 19:33:10.799735 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:10.799707 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9eda2122-90ad-4903-9dae-d20f0654eeec-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9eda2122-90ad-4903-9dae-d20f0654eeec" (UID: "9eda2122-90ad-4903-9dae-d20f0654eeec"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 19:33:10.885306 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:10.884665 2555 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9eda2122-90ad-4903-9dae-d20f0654eeec-registry-tls\") on node \"ip-10-0-139-51.ec2.internal\" DevicePath \"\"" May 27 19:33:10.945207 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:10.945060 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hjmsq\"" May 27 19:33:10.953859 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:10.953250 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-c9ls5" May 27 19:33:10.961784 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:10.961709 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7w8r9\"" May 27 19:33:10.971066 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:10.970530 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bhbv4" May 27 19:33:10.975835 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:10.975634 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-bzgvq\"" May 27 19:33:10.985298 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:10.984629 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-vbz74" May 27 19:33:11.116921 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:11.116871 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-56fc7546f-jd8l8"] May 27 19:33:11.118168 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:11.118146 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-56fc7546f-jd8l8"] May 27 19:33:11.389002 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:11.388648 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34c87eb0-84f0-4f4c-b319-b6486fd20f52-metrics-certs\") pod \"network-metrics-daemon-nf6f5\" (UID: \"34c87eb0-84f0-4f4c-b319-b6486fd20f52\") " pod="openshift-multus/network-metrics-daemon-nf6f5" May 27 19:33:11.389002 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:11.388738 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e375ea8a-c7d3-4c35-a901-a5e9bf859073-original-pull-secret\") pod \"global-pull-secret-syncer-lknm5\" (UID: \"e375ea8a-c7d3-4c35-a901-a5e9bf859073\") " pod="kube-system/global-pull-secret-syncer-lknm5" May 27 19:33:11.391982 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:11.391560 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 27 19:33:11.391982 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:11.391812 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 27 19:33:11.404781 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:11.404717 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34c87eb0-84f0-4f4c-b319-b6486fd20f52-metrics-certs\") pod \"network-metrics-daemon-nf6f5\" (UID: \"34c87eb0-84f0-4f4c-b319-b6486fd20f52\") " pod="openshift-multus/network-metrics-daemon-nf6f5" May 27 19:33:11.405261 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:11.405216 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e375ea8a-c7d3-4c35-a901-a5e9bf859073-original-pull-secret\") pod \"global-pull-secret-syncer-lknm5\" (UID: \"e375ea8a-c7d3-4c35-a901-a5e9bf859073\") " pod="kube-system/global-pull-secret-syncer-lknm5" May 27 19:33:11.491547 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:11.491515 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6hg7p\"" May 27 19:33:11.499337 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:11.499314 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nf6f5" May 27 19:33:11.576172 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:11.576142 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9eda2122-90ad-4903-9dae-d20f0654eeec" path="/var/lib/kubelet/pods/9eda2122-90ad-4903-9dae-d20f0654eeec/volumes" May 27 19:33:11.684133 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:11.683752 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lknm5" May 27 19:33:15.911477 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:15.911412 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bhbv4"] May 27 19:33:15.993747 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:15.993700 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-c9ls5"] May 27 19:33:15.998669 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:33:15.998630 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa63b18f_db50_412b_9280_777369bf9ded.slice/crio-d1d55f27d58633d9fac768d24bded3d4284e9f45afb3fb576f7278725d8d0fa8 WatchSource:0}: Error finding container d1d55f27d58633d9fac768d24bded3d4284e9f45afb3fb576f7278725d8d0fa8: Status 404 returned error can't find the container with id d1d55f27d58633d9fac768d24bded3d4284e9f45afb3fb576f7278725d8d0fa8 May 27 19:33:16.213402 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:16.213369 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-vbz74"] May 27 19:33:16.217182 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:33:16.217151 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54e71063_a75f_4ebc_8cdb_84280227744e.slice/crio-cf7ace0d58d2a0230344b273ee7284c6a2d379276026f1062fb3e8be63d8c75f WatchSource:0}: Error finding container cf7ace0d58d2a0230344b273ee7284c6a2d379276026f1062fb3e8be63d8c75f: Status 404 returned error can't find the container with id cf7ace0d58d2a0230344b273ee7284c6a2d379276026f1062fb3e8be63d8c75f May 27 19:33:16.217520 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:16.217481 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lknm5"] May 27 19:33:16.218506 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:16.218489 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nf6f5"] May 27 19:33:16.220196 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:33:16.220164 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34c87eb0_84f0_4f4c_b319_b6486fd20f52.slice/crio-e9699e2835919f6e54e27c1d9069cf883e0906d04166d8a3deb79c7556c7f898 WatchSource:0}: Error finding container e9699e2835919f6e54e27c1d9069cf883e0906d04166d8a3deb79c7556c7f898: Status 404 returned error can't find the container with id e9699e2835919f6e54e27c1d9069cf883e0906d04166d8a3deb79c7556c7f898 May 27 19:33:16.220942 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:33:16.220920 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode375ea8a_c7d3_4c35_a901_a5e9bf859073.slice/crio-809c5591ea8725f17ffde66a7db8b4e55a3ef1707088fa76c882dcf950607ce8 WatchSource:0}: Error finding container 809c5591ea8725f17ffde66a7db8b4e55a3ef1707088fa76c882dcf950607ce8: Status 404 returned error can't find the container with id 809c5591ea8725f17ffde66a7db8b4e55a3ef1707088fa76c882dcf950607ce8 May 27 19:33:16.792159 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:16.792079 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799875cb5-j7bdw" event={"ID":"16eeb4d4-e7b1-4c2d-8af2-d1ab10b36f07","Type":"ContainerStarted","Data":"182b4c943b52780d624e35841bf07d6353a4ea0174252bbb612d04357823e289"} May 27 19:33:16.797055 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:16.796356 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-q8fkz" event={"ID":"d4509ba7-3326-4d3f-9525-f2f4c10cf873","Type":"ContainerStarted","Data":"e44593d1a7ccee673e6f2fdac6e3439809cf9efeb4c73eaa642b713b70fe6347"} May 27 19:33:16.800466 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:16.800440 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-vbz74" event={"ID":"54e71063-a75f-4ebc-8cdb-84280227744e","Type":"ContainerStarted","Data":"cf7ace0d58d2a0230344b273ee7284c6a2d379276026f1062fb3e8be63d8c75f"} May 27 19:33:16.802085 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:16.802046 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lknm5" event={"ID":"e375ea8a-c7d3-4c35-a901-a5e9bf859073","Type":"ContainerStarted","Data":"809c5591ea8725f17ffde66a7db8b4e55a3ef1707088fa76c882dcf950607ce8"} May 27 19:33:16.803709 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:16.803685 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nf6f5" event={"ID":"34c87eb0-84f0-4f4c-b319-b6486fd20f52","Type":"ContainerStarted","Data":"e9699e2835919f6e54e27c1d9069cf883e0906d04166d8a3deb79c7556c7f898"} May 27 19:33:16.807201 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:16.807177 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c9ls5" event={"ID":"fa63b18f-db50-412b-9280-777369bf9ded","Type":"ContainerStarted","Data":"d1d55f27d58633d9fac768d24bded3d4284e9f45afb3fb576f7278725d8d0fa8"} May 27 19:33:16.810585 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:16.810558 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65454f44b7-btjxj" event={"ID":"dc24f656-68e3-4493-a4f8-6b3cbd4d69dc","Type":"ContainerStarted","Data":"7ec3a5ec67e0dd67b6553391430a7b35b571a2e5c478a528cc3f106ccf366c46"} May 27 19:33:16.811124 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:16.811079 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65454f44b7-btjxj" May 27 19:33:16.812180 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:16.812017 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bhbv4" event={"ID":"a2be77ab-d596-46ef-8967-88c344e07fb4","Type":"ContainerStarted","Data":"1e8129e54215fcd5b92602b112526f8277e71e89e413547ea2e1708574215f89"} May 27 19:33:16.812830 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:16.812796 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65454f44b7-btjxj" May 27 19:33:16.838020 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:16.836801 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-q8fkz" podStartSLOduration=1.6344529190000001 podStartE2EDuration="7.836785843s" podCreationTimestamp="2026-05-27 19:33:09 +0000 UTC" firstStartedPulling="2026-05-27 19:33:09.556437084 +0000 UTC m=+64.593063764" lastFinishedPulling="2026-05-27 19:33:15.758770005 +0000 UTC m=+70.795396688" observedRunningTime="2026-05-27 19:33:16.835811871 +0000 UTC m=+71.872438554" watchObservedRunningTime="2026-05-27 19:33:16.836785843 +0000 UTC m=+71.873412532" May 27 19:33:16.868404 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:16.868140 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65454f44b7-btjxj" podStartSLOduration=1.635408363 podStartE2EDuration="7.868124314s" podCreationTimestamp="2026-05-27 19:33:09 +0000 UTC" firstStartedPulling="2026-05-27 19:33:09.575291677 +0000 UTC m=+64.611918343" lastFinishedPulling="2026-05-27 19:33:15.808007625 +0000 UTC m=+70.844634294" observedRunningTime="2026-05-27 19:33:16.865941351 +0000 UTC m=+71.902568039" watchObservedRunningTime="2026-05-27 19:33:16.868124314 +0000 UTC m=+71.904750999" May 27 19:33:17.726830 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:17.726054 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6lzrp" May 27 19:33:18.641104 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:18.641073 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2hvwq_e7cb0741-7765-422b-8269-5a430024b259/dns-node-resolver/0.log" May 27 19:33:19.247862 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:19.247823 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5546b79695-kzwjl_88f1d61c-af5f-44cc-9b7e-e82747bf21c4/registry/0.log" May 27 19:33:20.040625 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:20.040595 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-l6kn5_bf52ea50-d810-4b2b-bde4-f58f4cb97288/node-ca/0.log" May 27 19:33:21.835552 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:21.835517 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c9ls5" event={"ID":"fa63b18f-db50-412b-9280-777369bf9ded","Type":"ContainerStarted","Data":"529379d0a16865febeb11b582c33f8615086035d4f97e4e792aeaa74e06336e8"} May 27 19:33:21.835944 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:21.835556 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c9ls5" event={"ID":"fa63b18f-db50-412b-9280-777369bf9ded","Type":"ContainerStarted","Data":"f36433e979831ce2ce1b8acb5ccb395c6e231f4d402e9ea81d94732dceed5acc"} May 27 19:33:21.835944 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:21.835597 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-c9ls5" May 27 19:33:21.836878 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:21.836850 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bhbv4" event={"ID":"a2be77ab-d596-46ef-8967-88c344e07fb4","Type":"ContainerStarted","Data":"92a84cac9086473051964ca1bb22996f28a3d0f21ae30d7a9f7f3b04ebd6514f"} May 27 19:33:21.838560 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:21.838536 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799875cb5-j7bdw" event={"ID":"16eeb4d4-e7b1-4c2d-8af2-d1ab10b36f07","Type":"ContainerStarted","Data":"cb485f73cf41744304290a18a6655e7a96713e69adf1878b7981b2e9a97e95ed"} May 27 19:33:21.838668 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:21.838568 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799875cb5-j7bdw" event={"ID":"16eeb4d4-e7b1-4c2d-8af2-d1ab10b36f07","Type":"ContainerStarted","Data":"2651bdf5d33bff372dbca7b7823d1cc16abae4f91bb0fd07342e2feb9ce2d11b"} May 27 19:33:21.839784 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:21.839759 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-vbz74" event={"ID":"54e71063-a75f-4ebc-8cdb-84280227744e","Type":"ContainerStarted","Data":"7b9cc9b5ff93996f1879d284ce8a08dbfc4200bb43356e781a6648234456750e"} May 27 19:33:21.840950 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:21.840928 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lknm5" event={"ID":"e375ea8a-c7d3-4c35-a901-a5e9bf859073","Type":"ContainerStarted","Data":"8d4333f19198fa425ecbd6925b7061b928dcef7d677968e0147ce3fab5e7f991"} May 27 19:33:21.842256 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:21.842238 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nf6f5" event={"ID":"34c87eb0-84f0-4f4c-b319-b6486fd20f52","Type":"ContainerStarted","Data":"5586e2c7937dba32fc621bdf61f4ab4639b1b1949cc189a7b199b4953b9c06e7"} May 27 19:33:21.842348 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:21.842260 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nf6f5" event={"ID":"34c87eb0-84f0-4f4c-b319-b6486fd20f52","Type":"ContainerStarted","Data":"f3bce57ab7b3f31e53e303ac879a9f79eb4cfbbb2cd2fd2cf4eb97b85bfa26ca"} May 27 19:33:21.853979 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:21.853941 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-c9ls5" podStartSLOduration=39.085496541 podStartE2EDuration="43.853930213s" podCreationTimestamp="2026-05-27 19:32:38 +0000 UTC" firstStartedPulling="2026-05-27 19:33:16.001518562 +0000 UTC m=+71.038145240" lastFinishedPulling="2026-05-27 19:33:20.769952233 +0000 UTC m=+75.806578912" observedRunningTime="2026-05-27 19:33:21.852922719 +0000 UTC m=+76.889549412" watchObservedRunningTime="2026-05-27 19:33:21.853930213 +0000 UTC m=+76.890556899" May 27 19:33:21.868930 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:21.868885 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nf6f5" podStartSLOduration=72.320907846 podStartE2EDuration="1m16.868873563s" podCreationTimestamp="2026-05-27 19:32:05 +0000 UTC" firstStartedPulling="2026-05-27 19:33:16.221985665 +0000 UTC m=+71.258612333" lastFinishedPulling="2026-05-27 19:33:20.769951371 +0000 UTC m=+75.806578050" observedRunningTime="2026-05-27 19:33:21.86771434 +0000 UTC m=+76.904341027" watchObservedRunningTime="2026-05-27 19:33:21.868873563 +0000 UTC m=+76.905500253" May 27 19:33:21.884256 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:21.884223 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799875cb5-j7bdw" podStartSLOduration=1.683493264 podStartE2EDuration="12.884213198s" podCreationTimestamp="2026-05-27 19:33:09 +0000 UTC" firstStartedPulling="2026-05-27 19:33:09.591025805 +0000 UTC m=+64.627652470" lastFinishedPulling="2026-05-27 19:33:20.791745731 +0000 UTC m=+75.828372404" observedRunningTime="2026-05-27 19:33:21.883478649 +0000 UTC m=+76.920105336" watchObservedRunningTime="2026-05-27 19:33:21.884213198 +0000 UTC m=+76.920839884" May 27 19:33:21.898209 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:21.898173 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lknm5" podStartSLOduration=71.302466212 podStartE2EDuration="1m15.89816188s" podCreationTimestamp="2026-05-27 19:32:06 +0000 UTC" firstStartedPulling="2026-05-27 19:33:16.222771875 +0000 UTC m=+71.259398544" lastFinishedPulling="2026-05-27 19:33:20.818467536 +0000 UTC m=+75.855094212" observedRunningTime="2026-05-27 19:33:21.89734232 +0000 UTC m=+76.933969020" watchObservedRunningTime="2026-05-27 19:33:21.89816188 +0000 UTC m=+76.934788601" May 27 19:33:21.916393 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:21.916344 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bhbv4" podStartSLOduration=39.059838139 podStartE2EDuration="43.916332171s" podCreationTimestamp="2026-05-27 19:32:38 +0000 UTC" firstStartedPulling="2026-05-27 19:33:15.918588521 +0000 UTC m=+70.955215200" lastFinishedPulling="2026-05-27 19:33:20.775082561 +0000 UTC m=+75.811709232" observedRunningTime="2026-05-27 19:33:21.915479943 +0000 UTC m=+76.952106630" watchObservedRunningTime="2026-05-27 19:33:21.916332171 +0000 UTC m=+76.952958857" May 27 19:33:21.931923 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:21.931877 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-vbz74" podStartSLOduration=46.381024879 podStartE2EDuration="50.93186389s" podCreationTimestamp="2026-05-27 19:32:31 +0000 UTC" firstStartedPulling="2026-05-27 19:33:16.219111334 +0000 UTC m=+71.255738000" lastFinishedPulling="2026-05-27 19:33:20.769950336 +0000 UTC m=+75.806577011" observedRunningTime="2026-05-27 19:33:21.93086929 +0000 UTC m=+76.967495977" watchObservedRunningTime="2026-05-27 19:33:21.93186389 +0000 UTC m=+76.968490595" May 27 19:33:26.437404 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:26.437281 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-29ds8"] May 27 19:33:26.439685 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:26.439665 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-29ds8" May 27 19:33:26.441934 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:26.441905 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 27 19:33:26.442240 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:26.442216 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 27 19:33:26.442353 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:26.442216 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 27 19:33:26.442891 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:26.442871 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jqbp5\"" May 27 19:33:26.443012 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:26.442872 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 27 19:33:26.451410 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:26.451387 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-29ds8"] May 27 19:33:26.508253 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:26.508205 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9159ef26-3fcb-4525-98d8-6df93075402a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-29ds8\" (UID: \"9159ef26-3fcb-4525-98d8-6df93075402a\") " pod="openshift-insights/insights-runtime-extractor-29ds8" May 27 19:33:26.508440 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:26.508373 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9159ef26-3fcb-4525-98d8-6df93075402a-data-volume\") pod \"insights-runtime-extractor-29ds8\" (UID: \"9159ef26-3fcb-4525-98d8-6df93075402a\") " pod="openshift-insights/insights-runtime-extractor-29ds8" May 27 19:33:26.508440 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:26.508405 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rv9ht\" (UniqueName: \"kubernetes.io/projected/9159ef26-3fcb-4525-98d8-6df93075402a-kube-api-access-rv9ht\") pod \"insights-runtime-extractor-29ds8\" (UID: \"9159ef26-3fcb-4525-98d8-6df93075402a\") " pod="openshift-insights/insights-runtime-extractor-29ds8" May 27 19:33:26.508536 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:26.508456 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9159ef26-3fcb-4525-98d8-6df93075402a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-29ds8\" (UID: \"9159ef26-3fcb-4525-98d8-6df93075402a\") " pod="openshift-insights/insights-runtime-extractor-29ds8" May 27 19:33:26.508536 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:26.508494 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9159ef26-3fcb-4525-98d8-6df93075402a-crio-socket\") pod \"insights-runtime-extractor-29ds8\" (UID: \"9159ef26-3fcb-4525-98d8-6df93075402a\") " pod="openshift-insights/insights-runtime-extractor-29ds8" May 27 19:33:26.609800 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:26.609761 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9159ef26-3fcb-4525-98d8-6df93075402a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-29ds8\" (UID: \"9159ef26-3fcb-4525-98d8-6df93075402a\") " pod="openshift-insights/insights-runtime-extractor-29ds8" May 27 19:33:26.609979 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:26.609817 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9159ef26-3fcb-4525-98d8-6df93075402a-data-volume\") pod \"insights-runtime-extractor-29ds8\" (UID: \"9159ef26-3fcb-4525-98d8-6df93075402a\") " pod="openshift-insights/insights-runtime-extractor-29ds8" May 27 19:33:26.609979 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:26.609841 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rv9ht\" (UniqueName: \"kubernetes.io/projected/9159ef26-3fcb-4525-98d8-6df93075402a-kube-api-access-rv9ht\") pod \"insights-runtime-extractor-29ds8\" (UID: \"9159ef26-3fcb-4525-98d8-6df93075402a\") " pod="openshift-insights/insights-runtime-extractor-29ds8" May 27 19:33:26.609979 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:26.609871 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9159ef26-3fcb-4525-98d8-6df93075402a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-29ds8\" (UID: \"9159ef26-3fcb-4525-98d8-6df93075402a\") " pod="openshift-insights/insights-runtime-extractor-29ds8" May 27 19:33:26.609979 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:26.609887 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9159ef26-3fcb-4525-98d8-6df93075402a-crio-socket\") pod \"insights-runtime-extractor-29ds8\" (UID: \"9159ef26-3fcb-4525-98d8-6df93075402a\") " pod="openshift-insights/insights-runtime-extractor-29ds8" May 27 19:33:26.610123 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:26.610047 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9159ef26-3fcb-4525-98d8-6df93075402a-crio-socket\") pod \"insights-runtime-extractor-29ds8\" (UID: \"9159ef26-3fcb-4525-98d8-6df93075402a\") " pod="openshift-insights/insights-runtime-extractor-29ds8" May 27 19:33:26.610364 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:26.610341 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9159ef26-3fcb-4525-98d8-6df93075402a-data-volume\") pod \"insights-runtime-extractor-29ds8\" (UID: \"9159ef26-3fcb-4525-98d8-6df93075402a\") " pod="openshift-insights/insights-runtime-extractor-29ds8" May 27 19:33:26.610524 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:26.610509 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9159ef26-3fcb-4525-98d8-6df93075402a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-29ds8\" (UID: \"9159ef26-3fcb-4525-98d8-6df93075402a\") " pod="openshift-insights/insights-runtime-extractor-29ds8" May 27 19:33:26.612258 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:26.612237 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9159ef26-3fcb-4525-98d8-6df93075402a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-29ds8\" (UID: \"9159ef26-3fcb-4525-98d8-6df93075402a\") " pod="openshift-insights/insights-runtime-extractor-29ds8" May 27 19:33:26.617929 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:26.617901 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rv9ht\" (UniqueName: \"kubernetes.io/projected/9159ef26-3fcb-4525-98d8-6df93075402a-kube-api-access-rv9ht\") pod \"insights-runtime-extractor-29ds8\" (UID: \"9159ef26-3fcb-4525-98d8-6df93075402a\") " pod="openshift-insights/insights-runtime-extractor-29ds8" May 27 19:33:26.749343 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:26.749230 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-29ds8" May 27 19:33:26.869753 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:26.869730 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-29ds8"] May 27 19:33:26.872611 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:33:26.872587 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9159ef26_3fcb_4525_98d8_6df93075402a.slice/crio-91747b00f076e834052a227e5867f7375edb3ed3a3b499dd18cb1a59b3cd2b5d WatchSource:0}: Error finding container 91747b00f076e834052a227e5867f7375edb3ed3a3b499dd18cb1a59b3cd2b5d: Status 404 returned error can't find the container with id 91747b00f076e834052a227e5867f7375edb3ed3a3b499dd18cb1a59b3cd2b5d May 27 19:33:27.860154 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:27.860121 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-f7d6l"] May 27 19:33:27.862388 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:27.862363 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-29ds8" event={"ID":"9159ef26-3fcb-4525-98d8-6df93075402a","Type":"ContainerStarted","Data":"3417c0bc2f72f4f471790607a1ee1f05c614eba9a130e472f4ec62b50a699587"} May 27 19:33:27.862388 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:27.862387 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-29ds8" event={"ID":"9159ef26-3fcb-4525-98d8-6df93075402a","Type":"ContainerStarted","Data":"888b55623af8cf1a2d8d6fad8e2d26263bc0797ff371f530f19c27af66e6762a"} May 27 19:33:27.862527 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:27.862397 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-29ds8" event={"ID":"9159ef26-3fcb-4525-98d8-6df93075402a","Type":"ContainerStarted","Data":"91747b00f076e834052a227e5867f7375edb3ed3a3b499dd18cb1a59b3cd2b5d"} May 27 19:33:27.862527 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:27.862495 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f7d6l" May 27 19:33:27.864858 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:27.864834 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 27 19:33:27.864858 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:27.864851 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mghmn\"" May 27 19:33:27.865539 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:27.865517 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 27 19:33:27.865628 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:27.865592 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 27 19:33:27.865628 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:27.865611 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 27 19:33:27.865740 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:27.865693 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 27 19:33:27.865796 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:27.865770 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 27 19:33:28.022482 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:28.022446 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/18382d20-71bd-451e-b322-2121a3b51fb3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f7d6l\" (UID: \"18382d20-71bd-451e-b322-2121a3b51fb3\") " pod="openshift-monitoring/node-exporter-f7d6l" May 27 19:33:28.022482 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:28.022487 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/18382d20-71bd-451e-b322-2121a3b51fb3-node-exporter-textfile\") pod \"node-exporter-f7d6l\" (UID: \"18382d20-71bd-451e-b322-2121a3b51fb3\") " pod="openshift-monitoring/node-exporter-f7d6l" May 27 19:33:28.022721 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:28.022518 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/18382d20-71bd-451e-b322-2121a3b51fb3-node-exporter-tls\") pod \"node-exporter-f7d6l\" (UID: \"18382d20-71bd-451e-b322-2121a3b51fb3\") " pod="openshift-monitoring/node-exporter-f7d6l" May 27 19:33:28.022721 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:28.022567 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/18382d20-71bd-451e-b322-2121a3b51fb3-node-exporter-accelerators-collector-config\") pod \"node-exporter-f7d6l\" (UID: \"18382d20-71bd-451e-b322-2121a3b51fb3\") " pod="openshift-monitoring/node-exporter-f7d6l" May 27 19:33:28.022721 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:28.022617 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/18382d20-71bd-451e-b322-2121a3b51fb3-sys\") pod \"node-exporter-f7d6l\" (UID: \"18382d20-71bd-451e-b322-2121a3b51fb3\") " pod="openshift-monitoring/node-exporter-f7d6l" May 27 19:33:28.022721 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:28.022647 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/18382d20-71bd-451e-b322-2121a3b51fb3-node-exporter-wtmp\") pod \"node-exporter-f7d6l\" (UID: \"18382d20-71bd-451e-b322-2121a3b51fb3\") " pod="openshift-monitoring/node-exporter-f7d6l" May 27 19:33:28.022721 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:28.022673 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/18382d20-71bd-451e-b322-2121a3b51fb3-root\") pod \"node-exporter-f7d6l\" (UID: \"18382d20-71bd-451e-b322-2121a3b51fb3\") " pod="openshift-monitoring/node-exporter-f7d6l" May 27 19:33:28.022721 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:28.022709 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18382d20-71bd-451e-b322-2121a3b51fb3-metrics-client-ca\") pod \"node-exporter-f7d6l\" (UID: \"18382d20-71bd-451e-b322-2121a3b51fb3\") " pod="openshift-monitoring/node-exporter-f7d6l" May 27 19:33:28.022961 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:28.022764 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxw8z\" (UniqueName: \"kubernetes.io/projected/18382d20-71bd-451e-b322-2121a3b51fb3-kube-api-access-pxw8z\") pod \"node-exporter-f7d6l\" (UID: \"18382d20-71bd-451e-b322-2121a3b51fb3\") " pod="openshift-monitoring/node-exporter-f7d6l" May 27 19:33:28.123769 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:28.123697 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/18382d20-71bd-451e-b322-2121a3b51fb3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f7d6l\" (UID: \"18382d20-71bd-451e-b322-2121a3b51fb3\") " pod="openshift-monitoring/node-exporter-f7d6l" May 27 19:33:28.123769 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:28.123738 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/18382d20-71bd-451e-b322-2121a3b51fb3-node-exporter-textfile\") pod \"node-exporter-f7d6l\" (UID: \"18382d20-71bd-451e-b322-2121a3b51fb3\") " pod="openshift-monitoring/node-exporter-f7d6l" May 27 19:33:28.123972 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:28.123770 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/18382d20-71bd-451e-b322-2121a3b51fb3-node-exporter-tls\") pod \"node-exporter-f7d6l\" (UID: \"18382d20-71bd-451e-b322-2121a3b51fb3\") " pod="openshift-monitoring/node-exporter-f7d6l" May 27 19:33:28.123972 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:28.123797 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/18382d20-71bd-451e-b322-2121a3b51fb3-node-exporter-accelerators-collector-config\") pod \"node-exporter-f7d6l\" (UID: \"18382d20-71bd-451e-b322-2121a3b51fb3\") " pod="openshift-monitoring/node-exporter-f7d6l" May 27 19:33:28.123972 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:28.123827 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/18382d20-71bd-451e-b322-2121a3b51fb3-sys\") pod \"node-exporter-f7d6l\" (UID: \"18382d20-71bd-451e-b322-2121a3b51fb3\") " pod="openshift-monitoring/node-exporter-f7d6l" May 27 19:33:28.123972 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:28.123852 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/18382d20-71bd-451e-b322-2121a3b51fb3-node-exporter-wtmp\") pod \"node-exporter-f7d6l\" (UID: \"18382d20-71bd-451e-b322-2121a3b51fb3\") " pod="openshift-monitoring/node-exporter-f7d6l" May 27 19:33:28.123972 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:28.123878 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/18382d20-71bd-451e-b322-2121a3b51fb3-root\") pod \"node-exporter-f7d6l\" (UID: \"18382d20-71bd-451e-b322-2121a3b51fb3\") " pod="openshift-monitoring/node-exporter-f7d6l" May 27 19:33:28.123972 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:28.123916 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18382d20-71bd-451e-b322-2121a3b51fb3-metrics-client-ca\") pod \"node-exporter-f7d6l\" (UID: \"18382d20-71bd-451e-b322-2121a3b51fb3\") " pod="openshift-monitoring/node-exporter-f7d6l" May 27 19:33:28.123972 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:28.123917 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/18382d20-71bd-451e-b322-2121a3b51fb3-sys\") pod \"node-exporter-f7d6l\" (UID: \"18382d20-71bd-451e-b322-2121a3b51fb3\") " pod="openshift-monitoring/node-exporter-f7d6l" May 27 19:33:28.123972 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:28.123946 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pxw8z\" (UniqueName: \"kubernetes.io/projected/18382d20-71bd-451e-b322-2121a3b51fb3-kube-api-access-pxw8z\") pod \"node-exporter-f7d6l\" (UID: \"18382d20-71bd-451e-b322-2121a3b51fb3\") " pod="openshift-monitoring/node-exporter-f7d6l" May 27 19:33:28.124358 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:28.123989 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/18382d20-71bd-451e-b322-2121a3b51fb3-root\") pod \"node-exporter-f7d6l\" (UID: \"18382d20-71bd-451e-b322-2121a3b51fb3\") " pod="openshift-monitoring/node-exporter-f7d6l" May 27 19:33:28.124358 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:28.124003 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/18382d20-71bd-451e-b322-2121a3b51fb3-node-exporter-wtmp\") pod \"node-exporter-f7d6l\" (UID: \"18382d20-71bd-451e-b322-2121a3b51fb3\") " pod="openshift-monitoring/node-exporter-f7d6l" May 27 19:33:28.124358 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:28.124243 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/18382d20-71bd-451e-b322-2121a3b51fb3-node-exporter-textfile\") pod \"node-exporter-f7d6l\" (UID: \"18382d20-71bd-451e-b322-2121a3b51fb3\") " pod="openshift-monitoring/node-exporter-f7d6l" May 27 19:33:28.124534 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:28.124515 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18382d20-71bd-451e-b322-2121a3b51fb3-metrics-client-ca\") pod \"node-exporter-f7d6l\" (UID: \"18382d20-71bd-451e-b322-2121a3b51fb3\") " pod="openshift-monitoring/node-exporter-f7d6l" May 27 19:33:28.124570 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:28.124535 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/18382d20-71bd-451e-b322-2121a3b51fb3-node-exporter-accelerators-collector-config\") pod \"node-exporter-f7d6l\" (UID: \"18382d20-71bd-451e-b322-2121a3b51fb3\") " pod="openshift-monitoring/node-exporter-f7d6l" May 27 19:33:28.126548 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:28.126526 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/18382d20-71bd-451e-b322-2121a3b51fb3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f7d6l\" (UID: \"18382d20-71bd-451e-b322-2121a3b51fb3\") " pod="openshift-monitoring/node-exporter-f7d6l" May 27 19:33:28.126672 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:28.126615 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/18382d20-71bd-451e-b322-2121a3b51fb3-node-exporter-tls\") pod \"node-exporter-f7d6l\" (UID: \"18382d20-71bd-451e-b322-2121a3b51fb3\") " pod="openshift-monitoring/node-exporter-f7d6l" May 27 19:33:28.135992 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:28.135963 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxw8z\" (UniqueName: \"kubernetes.io/projected/18382d20-71bd-451e-b322-2121a3b51fb3-kube-api-access-pxw8z\") pod \"node-exporter-f7d6l\" (UID: \"18382d20-71bd-451e-b322-2121a3b51fb3\") " pod="openshift-monitoring/node-exporter-f7d6l" May 27 19:33:28.172033 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:28.172006 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f7d6l" May 27 19:33:28.181136 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:33:28.181103 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18382d20_71bd_451e_b322_2121a3b51fb3.slice/crio-d8eacbc922758aab95902377287ccd3f12c406ae623a567555c68319331937ad WatchSource:0}: Error finding container d8eacbc922758aab95902377287ccd3f12c406ae623a567555c68319331937ad: Status 404 returned error can't find the container with id d8eacbc922758aab95902377287ccd3f12c406ae623a567555c68319331937ad May 27 19:33:28.866063 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:28.866025 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f7d6l" event={"ID":"18382d20-71bd-451e-b322-2121a3b51fb3","Type":"ContainerStarted","Data":"d8eacbc922758aab95902377287ccd3f12c406ae623a567555c68319331937ad"} May 27 19:33:29.633365 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:29.633331 2555 patch_prober.go:28] interesting pod/image-registry-5546b79695-kzwjl container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 27 19:33:29.633512 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:29.633385 2555 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5546b79695-kzwjl" podUID="88f1d61c-af5f-44cc-9b7e-e82747bf21c4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 27 19:33:29.870232 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:29.870198 2555 generic.go:358] "Generic (PLEG): container finished" podID="18382d20-71bd-451e-b322-2121a3b51fb3" containerID="b6d102d8b133a49e31856631cd19fcab35bb904a3c12ede578bfe5d7fd70584b" exitCode=0 May 27 19:33:29.870626 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:29.870297 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f7d6l" event={"ID":"18382d20-71bd-451e-b322-2121a3b51fb3","Type":"ContainerDied","Data":"b6d102d8b133a49e31856631cd19fcab35bb904a3c12ede578bfe5d7fd70584b"} May 27 19:33:29.872043 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:29.872019 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-29ds8" event={"ID":"9159ef26-3fcb-4525-98d8-6df93075402a","Type":"ContainerStarted","Data":"d27a9a5a1e6d702172dcff87a7ca33c6460cee8b4fa5d367b54c0045e13e888b"} May 27 19:33:29.906244 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:29.906189 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-29ds8" podStartSLOduration=1.9048511559999999 podStartE2EDuration="3.90617224s" podCreationTimestamp="2026-05-27 19:33:26 +0000 UTC" firstStartedPulling="2026-05-27 19:33:26.92611878 +0000 UTC m=+81.962745449" lastFinishedPulling="2026-05-27 19:33:28.927439851 +0000 UTC m=+83.964066533" observedRunningTime="2026-05-27 19:33:29.905714821 +0000 UTC m=+84.942341509" watchObservedRunningTime="2026-05-27 19:33:29.90617224 +0000 UTC m=+84.942798953" May 27 19:33:30.876464 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:30.876427 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f7d6l" event={"ID":"18382d20-71bd-451e-b322-2121a3b51fb3","Type":"ContainerStarted","Data":"a810996d271a15f71f98207e8cd2975fa65a74636f132b2a52ba3ebfe74318bc"} May 27 19:33:30.876464 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:30.876468 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f7d6l" event={"ID":"18382d20-71bd-451e-b322-2121a3b51fb3","Type":"ContainerStarted","Data":"5e1325a93783751d3f4c128b68fc6573a4429b6a8e3741b82c78c286c8a871e6"} May 27 19:33:30.897968 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:30.897912 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-f7d6l" podStartSLOduration=2.675669901 podStartE2EDuration="3.89789853s" podCreationTimestamp="2026-05-27 19:33:27 +0000 UTC" firstStartedPulling="2026-05-27 19:33:28.183078552 +0000 UTC m=+83.219705229" lastFinishedPulling="2026-05-27 19:33:29.405307191 +0000 UTC m=+84.441933858" observedRunningTime="2026-05-27 19:33:30.896053794 +0000 UTC m=+85.932680482" watchObservedRunningTime="2026-05-27 19:33:30.89789853 +0000 UTC m=+85.934525217" May 27 19:33:31.778773 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:31.778747 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5546b79695-kzwjl" May 27 19:33:31.847742 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:33:31.847706 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-c9ls5" May 27 19:34:01.961951 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:34:01.961914 2555 generic.go:358] "Generic (PLEG): container finished" podID="4f8c7bdc-51de-4a81-9dfc-003af9f4679a" containerID="cdfc8c8a212008e16d7d4fc9f7c0115628dfde4ca3219e239b97fb185866ef44" exitCode=0 May 27 19:34:01.962495 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:34:01.961983 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-mffsf" event={"ID":"4f8c7bdc-51de-4a81-9dfc-003af9f4679a","Type":"ContainerDied","Data":"cdfc8c8a212008e16d7d4fc9f7c0115628dfde4ca3219e239b97fb185866ef44"} May 27 19:34:01.962495 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:34:01.962433 2555 scope.go:117] "RemoveContainer" containerID="cdfc8c8a212008e16d7d4fc9f7c0115628dfde4ca3219e239b97fb185866ef44" May 27 19:34:02.965885 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:34:02.965850 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-mffsf" event={"ID":"4f8c7bdc-51de-4a81-9dfc-003af9f4679a","Type":"ContainerStarted","Data":"f72b3f25834745d1e82166dc6f00ed00cffb6b727be5ed58432edb35c5b7192c"} May 27 19:35:57.666660 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:35:57.666625 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-x2ntc"] May 27 19:35:57.669622 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:35:57.669602 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-x2ntc" May 27 19:35:57.672086 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:35:57.672065 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-5zxrs\"" May 27 19:35:57.672514 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:35:57.672497 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 27 19:35:57.672807 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:35:57.672793 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 27 19:35:57.683149 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:35:57.683122 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-x2ntc"] May 27 19:35:57.770039 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:35:57.769993 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0528d1e3-a8d1-4c94-9150-5183d174c585-bound-sa-token\") pod \"cert-manager-79c8d999ff-x2ntc\" (UID: \"0528d1e3-a8d1-4c94-9150-5183d174c585\") " pod="cert-manager/cert-manager-79c8d999ff-x2ntc" May 27 19:35:57.770215 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:35:57.770059 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmmv5\" (UniqueName: \"kubernetes.io/projected/0528d1e3-a8d1-4c94-9150-5183d174c585-kube-api-access-mmmv5\") pod \"cert-manager-79c8d999ff-x2ntc\" (UID: \"0528d1e3-a8d1-4c94-9150-5183d174c585\") " pod="cert-manager/cert-manager-79c8d999ff-x2ntc" May 27 19:35:57.871286 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:35:57.871236 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mmmv5\" (UniqueName: \"kubernetes.io/projected/0528d1e3-a8d1-4c94-9150-5183d174c585-kube-api-access-mmmv5\") pod \"cert-manager-79c8d999ff-x2ntc\" (UID: \"0528d1e3-a8d1-4c94-9150-5183d174c585\") " pod="cert-manager/cert-manager-79c8d999ff-x2ntc" May 27 19:35:57.871400 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:35:57.871324 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0528d1e3-a8d1-4c94-9150-5183d174c585-bound-sa-token\") pod \"cert-manager-79c8d999ff-x2ntc\" (UID: \"0528d1e3-a8d1-4c94-9150-5183d174c585\") " pod="cert-manager/cert-manager-79c8d999ff-x2ntc" May 27 19:35:57.879967 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:35:57.879938 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0528d1e3-a8d1-4c94-9150-5183d174c585-bound-sa-token\") pod \"cert-manager-79c8d999ff-x2ntc\" (UID: \"0528d1e3-a8d1-4c94-9150-5183d174c585\") " pod="cert-manager/cert-manager-79c8d999ff-x2ntc" May 27 19:35:57.880091 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:35:57.880075 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmmv5\" (UniqueName: \"kubernetes.io/projected/0528d1e3-a8d1-4c94-9150-5183d174c585-kube-api-access-mmmv5\") pod \"cert-manager-79c8d999ff-x2ntc\" (UID: \"0528d1e3-a8d1-4c94-9150-5183d174c585\") " pod="cert-manager/cert-manager-79c8d999ff-x2ntc" May 27 19:35:57.978009 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:35:57.977917 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-x2ntc" May 27 19:35:58.103244 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:35:58.103218 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-x2ntc"] May 27 19:35:58.105779 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:35:58.105755 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0528d1e3_a8d1_4c94_9150_5183d174c585.slice/crio-f1737712da96f5fe8646f3747dff1b8602ca7e2e584314f7e97ea7da6bd4463b WatchSource:0}: Error finding container f1737712da96f5fe8646f3747dff1b8602ca7e2e584314f7e97ea7da6bd4463b: Status 404 returned error can't find the container with id f1737712da96f5fe8646f3747dff1b8602ca7e2e584314f7e97ea7da6bd4463b May 27 19:35:58.259947 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:35:58.259880 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-x2ntc" event={"ID":"0528d1e3-a8d1-4c94-9150-5183d174c585","Type":"ContainerStarted","Data":"f1737712da96f5fe8646f3747dff1b8602ca7e2e584314f7e97ea7da6bd4463b"} May 27 19:36:01.270242 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:01.270206 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-x2ntc" event={"ID":"0528d1e3-a8d1-4c94-9150-5183d174c585","Type":"ContainerStarted","Data":"edbf08507873da74397e89b508d9931b338fc272cda15b5963781989d585bbda"} May 27 19:36:01.289228 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:01.289183 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-x2ntc" podStartSLOduration=1.9888116390000001 podStartE2EDuration="4.289171442s" podCreationTimestamp="2026-05-27 19:35:57 +0000 UTC" firstStartedPulling="2026-05-27 19:35:58.107466467 +0000 UTC m=+233.144093136" lastFinishedPulling="2026-05-27 19:36:00.407826274 +0000 UTC m=+235.444452939" observedRunningTime="2026-05-27 19:36:01.287675373 +0000 UTC m=+236.324302061" watchObservedRunningTime="2026-05-27 19:36:01.289171442 +0000 UTC m=+236.325798128" May 27 19:36:07.867849 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:07.867814 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f485759dc-9bhrb"] May 27 19:36:07.871156 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:07.871139 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f485759dc-9bhrb" May 27 19:36:07.873441 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:07.873417 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 27 19:36:07.873550 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:07.873487 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 27 19:36:07.873913 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:07.873895 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 27 19:36:07.874210 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:07.874196 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kwr6d\"" May 27 19:36:07.874433 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:07.874420 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 27 19:36:07.891459 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:07.891430 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f485759dc-9bhrb"] May 27 19:36:07.944258 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:07.944236 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e6819017-76fe-410e-b890-e02cd5c48f3a-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f485759dc-9bhrb\" (UID: \"e6819017-76fe-410e-b890-e02cd5c48f3a\") " pod="opendatahub/opendatahub-operator-controller-manager-6f485759dc-9bhrb" May 27 19:36:07.944378 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:07.944333 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e6819017-76fe-410e-b890-e02cd5c48f3a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f485759dc-9bhrb\" (UID: \"e6819017-76fe-410e-b890-e02cd5c48f3a\") " pod="opendatahub/opendatahub-operator-controller-manager-6f485759dc-9bhrb" May 27 19:36:07.944378 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:07.944358 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhjzc\" (UniqueName: \"kubernetes.io/projected/e6819017-76fe-410e-b890-e02cd5c48f3a-kube-api-access-dhjzc\") pod \"opendatahub-operator-controller-manager-6f485759dc-9bhrb\" (UID: \"e6819017-76fe-410e-b890-e02cd5c48f3a\") " pod="opendatahub/opendatahub-operator-controller-manager-6f485759dc-9bhrb" May 27 19:36:08.044830 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:08.044803 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e6819017-76fe-410e-b890-e02cd5c48f3a-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f485759dc-9bhrb\" (UID: \"e6819017-76fe-410e-b890-e02cd5c48f3a\") " pod="opendatahub/opendatahub-operator-controller-manager-6f485759dc-9bhrb" May 27 19:36:08.044945 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:08.044857 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e6819017-76fe-410e-b890-e02cd5c48f3a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f485759dc-9bhrb\" (UID: \"e6819017-76fe-410e-b890-e02cd5c48f3a\") " pod="opendatahub/opendatahub-operator-controller-manager-6f485759dc-9bhrb" May 27 19:36:08.044945 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:08.044885 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dhjzc\" (UniqueName: \"kubernetes.io/projected/e6819017-76fe-410e-b890-e02cd5c48f3a-kube-api-access-dhjzc\") pod \"opendatahub-operator-controller-manager-6f485759dc-9bhrb\" (UID: \"e6819017-76fe-410e-b890-e02cd5c48f3a\") " pod="opendatahub/opendatahub-operator-controller-manager-6f485759dc-9bhrb" May 27 19:36:08.047167 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:08.047145 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e6819017-76fe-410e-b890-e02cd5c48f3a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f485759dc-9bhrb\" (UID: \"e6819017-76fe-410e-b890-e02cd5c48f3a\") " pod="opendatahub/opendatahub-operator-controller-manager-6f485759dc-9bhrb" May 27 19:36:08.047284 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:08.047192 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e6819017-76fe-410e-b890-e02cd5c48f3a-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f485759dc-9bhrb\" (UID: \"e6819017-76fe-410e-b890-e02cd5c48f3a\") " pod="opendatahub/opendatahub-operator-controller-manager-6f485759dc-9bhrb" May 27 19:36:08.054152 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:08.054129 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhjzc\" (UniqueName: \"kubernetes.io/projected/e6819017-76fe-410e-b890-e02cd5c48f3a-kube-api-access-dhjzc\") pod \"opendatahub-operator-controller-manager-6f485759dc-9bhrb\" (UID: \"e6819017-76fe-410e-b890-e02cd5c48f3a\") " pod="opendatahub/opendatahub-operator-controller-manager-6f485759dc-9bhrb" May 27 19:36:08.181003 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:08.180928 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f485759dc-9bhrb" May 27 19:36:08.306430 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:08.306387 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f485759dc-9bhrb"] May 27 19:36:08.309149 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:36:08.309121 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6819017_76fe_410e_b890_e02cd5c48f3a.slice/crio-b7dce8e5004b2225773d9e51e1c97964c1b8fcabf3edd33761ae71f06b8efcc3 WatchSource:0}: Error finding container b7dce8e5004b2225773d9e51e1c97964c1b8fcabf3edd33761ae71f06b8efcc3: Status 404 returned error can't find the container with id b7dce8e5004b2225773d9e51e1c97964c1b8fcabf3edd33761ae71f06b8efcc3 May 27 19:36:09.293112 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:09.293059 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f485759dc-9bhrb" event={"ID":"e6819017-76fe-410e-b890-e02cd5c48f3a","Type":"ContainerStarted","Data":"b7dce8e5004b2225773d9e51e1c97964c1b8fcabf3edd33761ae71f06b8efcc3"} May 27 19:36:11.300151 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:11.300112 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f485759dc-9bhrb" event={"ID":"e6819017-76fe-410e-b890-e02cd5c48f3a","Type":"ContainerStarted","Data":"48724d3054d25fa76592b803cf02312420efdaa6e6193f928aa804dad382cef4"} May 27 19:36:11.300624 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:11.300316 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6f485759dc-9bhrb" May 27 19:36:11.326041 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:11.325983 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6f485759dc-9bhrb" podStartSLOduration=1.846611249 podStartE2EDuration="4.325972431s" podCreationTimestamp="2026-05-27 19:36:07 +0000 UTC" firstStartedPulling="2026-05-27 19:36:08.310728473 +0000 UTC m=+243.347355138" lastFinishedPulling="2026-05-27 19:36:10.790089648 +0000 UTC m=+245.826716320" observedRunningTime="2026-05-27 19:36:11.325911654 +0000 UTC m=+246.362538341" watchObservedRunningTime="2026-05-27 19:36:11.325972431 +0000 UTC m=+246.362599115" May 27 19:36:22.306477 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:22.306440 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6f485759dc-9bhrb" May 27 19:36:28.920771 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:28.920683 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-psnv9"] May 27 19:36:28.923801 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:28.923779 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-psnv9" May 27 19:36:28.926110 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:28.926090 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" May 27 19:36:28.926287 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:28.926250 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-ntggb\"" May 27 19:36:28.931800 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:28.931776 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-psnv9"] May 27 19:36:28.995012 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:28.994988 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/462a870e-b9ed-4c02-b1cb-165cda4237d5-cert\") pod \"odh-model-controller-858dbf95b8-psnv9\" (UID: \"462a870e-b9ed-4c02-b1cb-165cda4237d5\") " pod="opendatahub/odh-model-controller-858dbf95b8-psnv9" May 27 19:36:28.995131 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:28.995050 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blntm\" (UniqueName: \"kubernetes.io/projected/462a870e-b9ed-4c02-b1cb-165cda4237d5-kube-api-access-blntm\") pod \"odh-model-controller-858dbf95b8-psnv9\" (UID: \"462a870e-b9ed-4c02-b1cb-165cda4237d5\") " pod="opendatahub/odh-model-controller-858dbf95b8-psnv9" May 27 19:36:29.096408 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:29.096373 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-blntm\" (UniqueName: \"kubernetes.io/projected/462a870e-b9ed-4c02-b1cb-165cda4237d5-kube-api-access-blntm\") pod \"odh-model-controller-858dbf95b8-psnv9\" (UID: \"462a870e-b9ed-4c02-b1cb-165cda4237d5\") " pod="opendatahub/odh-model-controller-858dbf95b8-psnv9" May 27 19:36:29.096567 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:29.096434 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/462a870e-b9ed-4c02-b1cb-165cda4237d5-cert\") pod \"odh-model-controller-858dbf95b8-psnv9\" (UID: \"462a870e-b9ed-4c02-b1cb-165cda4237d5\") " pod="opendatahub/odh-model-controller-858dbf95b8-psnv9" May 27 19:36:29.096567 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:36:29.096546 2555 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found May 27 19:36:29.096672 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:36:29.096596 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/462a870e-b9ed-4c02-b1cb-165cda4237d5-cert podName:462a870e-b9ed-4c02-b1cb-165cda4237d5 nodeName:}" failed. No retries permitted until 2026-05-27 19:36:29.596580641 +0000 UTC m=+264.633207306 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/462a870e-b9ed-4c02-b1cb-165cda4237d5-cert") pod "odh-model-controller-858dbf95b8-psnv9" (UID: "462a870e-b9ed-4c02-b1cb-165cda4237d5") : secret "odh-model-controller-webhook-cert" not found May 27 19:36:29.107431 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:29.107405 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blntm\" (UniqueName: \"kubernetes.io/projected/462a870e-b9ed-4c02-b1cb-165cda4237d5-kube-api-access-blntm\") pod \"odh-model-controller-858dbf95b8-psnv9\" (UID: \"462a870e-b9ed-4c02-b1cb-165cda4237d5\") " pod="opendatahub/odh-model-controller-858dbf95b8-psnv9" May 27 19:36:29.599201 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:29.599166 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/462a870e-b9ed-4c02-b1cb-165cda4237d5-cert\") pod \"odh-model-controller-858dbf95b8-psnv9\" (UID: \"462a870e-b9ed-4c02-b1cb-165cda4237d5\") " pod="opendatahub/odh-model-controller-858dbf95b8-psnv9" May 27 19:36:29.601467 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:29.601449 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/462a870e-b9ed-4c02-b1cb-165cda4237d5-cert\") pod \"odh-model-controller-858dbf95b8-psnv9\" (UID: \"462a870e-b9ed-4c02-b1cb-165cda4237d5\") " pod="opendatahub/odh-model-controller-858dbf95b8-psnv9" May 27 19:36:29.834488 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:29.834454 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-psnv9" May 27 19:36:29.959640 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:29.959477 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-psnv9"] May 27 19:36:29.962235 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:36:29.962201 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod462a870e_b9ed_4c02_b1cb_165cda4237d5.slice/crio-bf4bba008c372aade71b4de3d51bbb61bd87230dc677846f83d93a2d1fd019bd WatchSource:0}: Error finding container bf4bba008c372aade71b4de3d51bbb61bd87230dc677846f83d93a2d1fd019bd: Status 404 returned error can't find the container with id bf4bba008c372aade71b4de3d51bbb61bd87230dc677846f83d93a2d1fd019bd May 27 19:36:30.351080 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:30.351045 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-psnv9" event={"ID":"462a870e-b9ed-4c02-b1cb-165cda4237d5","Type":"ContainerStarted","Data":"bf4bba008c372aade71b4de3d51bbb61bd87230dc677846f83d93a2d1fd019bd"} May 27 19:36:33.363612 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:33.363579 2555 generic.go:358] "Generic (PLEG): container finished" podID="462a870e-b9ed-4c02-b1cb-165cda4237d5" containerID="3936d0aa332bca13719d2af3640f14c35d50d38194a01544c1e78fe8f0fef646" exitCode=1 May 27 19:36:33.364010 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:33.363655 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-psnv9" event={"ID":"462a870e-b9ed-4c02-b1cb-165cda4237d5","Type":"ContainerDied","Data":"3936d0aa332bca13719d2af3640f14c35d50d38194a01544c1e78fe8f0fef646"} May 27 19:36:33.364010 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:33.363862 2555 scope.go:117] "RemoveContainer" containerID="3936d0aa332bca13719d2af3640f14c35d50d38194a01544c1e78fe8f0fef646" May 27 19:36:33.886663 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:33.886636 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-58jfn"] May 27 19:36:33.889515 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:33.889499 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-58jfn" May 27 19:36:33.891970 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:33.891946 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-tqrnh\"" May 27 19:36:33.892069 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:33.891950 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" May 27 19:36:33.900236 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:33.900209 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-58jfn"] May 27 19:36:34.034593 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:34.034521 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eefbf6a3-8585-4f25-84e6-ca6cb5df2e6a-cert\") pod \"kserve-controller-manager-856948b99f-58jfn\" (UID: \"eefbf6a3-8585-4f25-84e6-ca6cb5df2e6a\") " pod="opendatahub/kserve-controller-manager-856948b99f-58jfn" May 27 19:36:34.034726 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:34.034656 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5hbw\" (UniqueName: \"kubernetes.io/projected/eefbf6a3-8585-4f25-84e6-ca6cb5df2e6a-kube-api-access-d5hbw\") pod \"kserve-controller-manager-856948b99f-58jfn\" (UID: \"eefbf6a3-8585-4f25-84e6-ca6cb5df2e6a\") " pod="opendatahub/kserve-controller-manager-856948b99f-58jfn" May 27 19:36:34.135340 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:34.135304 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d5hbw\" (UniqueName: \"kubernetes.io/projected/eefbf6a3-8585-4f25-84e6-ca6cb5df2e6a-kube-api-access-d5hbw\") pod \"kserve-controller-manager-856948b99f-58jfn\" (UID: \"eefbf6a3-8585-4f25-84e6-ca6cb5df2e6a\") " pod="opendatahub/kserve-controller-manager-856948b99f-58jfn" May 27 19:36:34.135340 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:34.135345 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eefbf6a3-8585-4f25-84e6-ca6cb5df2e6a-cert\") pod \"kserve-controller-manager-856948b99f-58jfn\" (UID: \"eefbf6a3-8585-4f25-84e6-ca6cb5df2e6a\") " pod="opendatahub/kserve-controller-manager-856948b99f-58jfn" May 27 19:36:34.137766 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:34.137728 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eefbf6a3-8585-4f25-84e6-ca6cb5df2e6a-cert\") pod \"kserve-controller-manager-856948b99f-58jfn\" (UID: \"eefbf6a3-8585-4f25-84e6-ca6cb5df2e6a\") " pod="opendatahub/kserve-controller-manager-856948b99f-58jfn" May 27 19:36:34.144089 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:34.144066 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5hbw\" (UniqueName: \"kubernetes.io/projected/eefbf6a3-8585-4f25-84e6-ca6cb5df2e6a-kube-api-access-d5hbw\") pod \"kserve-controller-manager-856948b99f-58jfn\" (UID: \"eefbf6a3-8585-4f25-84e6-ca6cb5df2e6a\") " pod="opendatahub/kserve-controller-manager-856948b99f-58jfn" May 27 19:36:34.198941 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:34.198919 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-58jfn" May 27 19:36:34.324285 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:34.324242 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-58jfn"] May 27 19:36:34.326560 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:36:34.326532 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeefbf6a3_8585_4f25_84e6_ca6cb5df2e6a.slice/crio-4931a38f9459bf8c86ebdbdf4647c0a98da04888675f9fb22dd5865b97364f1b WatchSource:0}: Error finding container 4931a38f9459bf8c86ebdbdf4647c0a98da04888675f9fb22dd5865b97364f1b: Status 404 returned error can't find the container with id 4931a38f9459bf8c86ebdbdf4647c0a98da04888675f9fb22dd5865b97364f1b May 27 19:36:34.367805 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:34.367772 2555 generic.go:358] "Generic (PLEG): container finished" podID="462a870e-b9ed-4c02-b1cb-165cda4237d5" containerID="165a8c5fee56d24692bb3454aba88ed3d5138f4f69afcf0ee63c7f965d4ab371" exitCode=1 May 27 19:36:34.368192 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:34.367855 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-psnv9" event={"ID":"462a870e-b9ed-4c02-b1cb-165cda4237d5","Type":"ContainerDied","Data":"165a8c5fee56d24692bb3454aba88ed3d5138f4f69afcf0ee63c7f965d4ab371"} May 27 19:36:34.368192 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:34.367903 2555 scope.go:117] "RemoveContainer" containerID="3936d0aa332bca13719d2af3640f14c35d50d38194a01544c1e78fe8f0fef646" May 27 19:36:34.368192 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:34.368106 2555 scope.go:117] "RemoveContainer" containerID="165a8c5fee56d24692bb3454aba88ed3d5138f4f69afcf0ee63c7f965d4ab371" May 27 19:36:34.368369 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:36:34.368317 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-psnv9_opendatahub(462a870e-b9ed-4c02-b1cb-165cda4237d5)\"" pod="opendatahub/odh-model-controller-858dbf95b8-psnv9" podUID="462a870e-b9ed-4c02-b1cb-165cda4237d5" May 27 19:36:34.369005 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:34.368984 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-58jfn" event={"ID":"eefbf6a3-8585-4f25-84e6-ca6cb5df2e6a","Type":"ContainerStarted","Data":"4931a38f9459bf8c86ebdbdf4647c0a98da04888675f9fb22dd5865b97364f1b"} May 27 19:36:35.374075 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:35.374041 2555 scope.go:117] "RemoveContainer" containerID="165a8c5fee56d24692bb3454aba88ed3d5138f4f69afcf0ee63c7f965d4ab371" May 27 19:36:35.374487 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:36:35.374302 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-psnv9_opendatahub(462a870e-b9ed-4c02-b1cb-165cda4237d5)\"" pod="opendatahub/odh-model-controller-858dbf95b8-psnv9" podUID="462a870e-b9ed-4c02-b1cb-165cda4237d5" May 27 19:36:36.660763 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:36.660725 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6c44b8656c-4b4z5"] May 27 19:36:36.663764 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:36.663746 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6c44b8656c-4b4z5" May 27 19:36:36.665931 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:36.665908 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 27 19:36:36.666057 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:36.666042 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 27 19:36:36.666129 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:36.666093 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-pnwpd\"" May 27 19:36:36.666129 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:36.666110 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 27 19:36:36.666225 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:36.666180 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 27 19:36:36.673884 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:36.673865 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6c44b8656c-4b4z5"] May 27 19:36:36.755201 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:36.755168 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrfcg\" (UniqueName: \"kubernetes.io/projected/3c2431d5-aa36-41a6-ae4a-d4bf9e378be1-kube-api-access-vrfcg\") pod \"kube-auth-proxy-6c44b8656c-4b4z5\" (UID: \"3c2431d5-aa36-41a6-ae4a-d4bf9e378be1\") " pod="openshift-ingress/kube-auth-proxy-6c44b8656c-4b4z5" May 27 19:36:36.755362 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:36.755208 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c2431d5-aa36-41a6-ae4a-d4bf9e378be1-tmp\") pod \"kube-auth-proxy-6c44b8656c-4b4z5\" (UID: \"3c2431d5-aa36-41a6-ae4a-d4bf9e378be1\") " pod="openshift-ingress/kube-auth-proxy-6c44b8656c-4b4z5" May 27 19:36:36.755362 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:36.755231 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c2431d5-aa36-41a6-ae4a-d4bf9e378be1-tls-certs\") pod \"kube-auth-proxy-6c44b8656c-4b4z5\" (UID: \"3c2431d5-aa36-41a6-ae4a-d4bf9e378be1\") " pod="openshift-ingress/kube-auth-proxy-6c44b8656c-4b4z5" May 27 19:36:36.856282 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:36.856230 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vrfcg\" (UniqueName: \"kubernetes.io/projected/3c2431d5-aa36-41a6-ae4a-d4bf9e378be1-kube-api-access-vrfcg\") pod \"kube-auth-proxy-6c44b8656c-4b4z5\" (UID: \"3c2431d5-aa36-41a6-ae4a-d4bf9e378be1\") " pod="openshift-ingress/kube-auth-proxy-6c44b8656c-4b4z5" May 27 19:36:36.856453 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:36.856307 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c2431d5-aa36-41a6-ae4a-d4bf9e378be1-tmp\") pod \"kube-auth-proxy-6c44b8656c-4b4z5\" (UID: \"3c2431d5-aa36-41a6-ae4a-d4bf9e378be1\") " pod="openshift-ingress/kube-auth-proxy-6c44b8656c-4b4z5" May 27 19:36:36.856453 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:36.856341 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c2431d5-aa36-41a6-ae4a-d4bf9e378be1-tls-certs\") pod \"kube-auth-proxy-6c44b8656c-4b4z5\" (UID: \"3c2431d5-aa36-41a6-ae4a-d4bf9e378be1\") " pod="openshift-ingress/kube-auth-proxy-6c44b8656c-4b4z5" May 27 19:36:36.856576 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:36:36.856464 2555 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found May 27 19:36:36.856576 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:36:36.856533 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c2431d5-aa36-41a6-ae4a-d4bf9e378be1-tls-certs podName:3c2431d5-aa36-41a6-ae4a-d4bf9e378be1 nodeName:}" failed. No retries permitted until 2026-05-27 19:36:37.356512527 +0000 UTC m=+272.393139206 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/3c2431d5-aa36-41a6-ae4a-d4bf9e378be1-tls-certs") pod "kube-auth-proxy-6c44b8656c-4b4z5" (UID: "3c2431d5-aa36-41a6-ae4a-d4bf9e378be1") : secret "kube-auth-proxy-tls" not found May 27 19:36:36.858874 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:36.858846 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c2431d5-aa36-41a6-ae4a-d4bf9e378be1-tmp\") pod \"kube-auth-proxy-6c44b8656c-4b4z5\" (UID: \"3c2431d5-aa36-41a6-ae4a-d4bf9e378be1\") " pod="openshift-ingress/kube-auth-proxy-6c44b8656c-4b4z5" May 27 19:36:36.864982 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:36.864961 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrfcg\" (UniqueName: \"kubernetes.io/projected/3c2431d5-aa36-41a6-ae4a-d4bf9e378be1-kube-api-access-vrfcg\") pod \"kube-auth-proxy-6c44b8656c-4b4z5\" (UID: \"3c2431d5-aa36-41a6-ae4a-d4bf9e378be1\") " pod="openshift-ingress/kube-auth-proxy-6c44b8656c-4b4z5" May 27 19:36:37.361717 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:37.361671 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c2431d5-aa36-41a6-ae4a-d4bf9e378be1-tls-certs\") pod \"kube-auth-proxy-6c44b8656c-4b4z5\" (UID: \"3c2431d5-aa36-41a6-ae4a-d4bf9e378be1\") " pod="openshift-ingress/kube-auth-proxy-6c44b8656c-4b4z5" May 27 19:36:37.364278 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:37.364242 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c2431d5-aa36-41a6-ae4a-d4bf9e378be1-tls-certs\") pod \"kube-auth-proxy-6c44b8656c-4b4z5\" (UID: \"3c2431d5-aa36-41a6-ae4a-d4bf9e378be1\") " pod="openshift-ingress/kube-auth-proxy-6c44b8656c-4b4z5" May 27 19:36:37.574339 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:37.574303 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6c44b8656c-4b4z5" May 27 19:36:37.724331 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:37.724303 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6c44b8656c-4b4z5"] May 27 19:36:37.727725 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:36:37.727701 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c2431d5_aa36_41a6_ae4a_d4bf9e378be1.slice/crio-6889c6080e994346c2320049aaf5ebfe552875326aa4de86da67f69c992a5550 WatchSource:0}: Error finding container 6889c6080e994346c2320049aaf5ebfe552875326aa4de86da67f69c992a5550: Status 404 returned error can't find the container with id 6889c6080e994346c2320049aaf5ebfe552875326aa4de86da67f69c992a5550 May 27 19:36:38.384377 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:38.384337 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-58jfn" event={"ID":"eefbf6a3-8585-4f25-84e6-ca6cb5df2e6a","Type":"ContainerStarted","Data":"9c75e1f9aa11cd8aa389dbe4882c6456bfc58b2678eff5a520485edd7ee0d5c1"} May 27 19:36:38.384571 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:38.384464 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-58jfn" May 27 19:36:38.385530 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:38.385505 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6c44b8656c-4b4z5" event={"ID":"3c2431d5-aa36-41a6-ae4a-d4bf9e378be1","Type":"ContainerStarted","Data":"6889c6080e994346c2320049aaf5ebfe552875326aa4de86da67f69c992a5550"} May 27 19:36:38.412073 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:38.407695 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-58jfn" podStartSLOduration=2.298517888 podStartE2EDuration="5.407672061s" podCreationTimestamp="2026-05-27 19:36:33 +0000 UTC" firstStartedPulling="2026-05-27 19:36:34.327791627 +0000 UTC m=+269.364418291" lastFinishedPulling="2026-05-27 19:36:37.436945797 +0000 UTC m=+272.473572464" observedRunningTime="2026-05-27 19:36:38.404341997 +0000 UTC m=+273.440968685" watchObservedRunningTime="2026-05-27 19:36:38.407672061 +0000 UTC m=+273.444298748" May 27 19:36:39.835463 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:39.835428 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-psnv9" May 27 19:36:39.835901 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:39.835792 2555 scope.go:117] "RemoveContainer" containerID="165a8c5fee56d24692bb3454aba88ed3d5138f4f69afcf0ee63c7f965d4ab371" May 27 19:36:39.835969 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:36:39.835952 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-psnv9_opendatahub(462a870e-b9ed-4c02-b1cb-165cda4237d5)\"" pod="opendatahub/odh-model-controller-858dbf95b8-psnv9" podUID="462a870e-b9ed-4c02-b1cb-165cda4237d5" May 27 19:36:41.396688 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:41.396643 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6c44b8656c-4b4z5" event={"ID":"3c2431d5-aa36-41a6-ae4a-d4bf9e378be1","Type":"ContainerStarted","Data":"543af7b5ea93793fe213c6b44555ad6d1430818d54fbd931e4f492b3781f350f"} May 27 19:36:41.414495 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:41.414449 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6c44b8656c-4b4z5" podStartSLOduration=1.8636686120000001 podStartE2EDuration="5.414435481s" podCreationTimestamp="2026-05-27 19:36:36 +0000 UTC" firstStartedPulling="2026-05-27 19:36:37.729720605 +0000 UTC m=+272.766347270" lastFinishedPulling="2026-05-27 19:36:41.280487475 +0000 UTC m=+276.317114139" observedRunningTime="2026-05-27 19:36:41.412763756 +0000 UTC m=+276.449390442" watchObservedRunningTime="2026-05-27 19:36:41.414435481 +0000 UTC m=+276.451062168" May 27 19:36:49.834875 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:49.834841 2555 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/odh-model-controller-858dbf95b8-psnv9" May 27 19:36:49.835242 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:49.835200 2555 scope.go:117] "RemoveContainer" containerID="165a8c5fee56d24692bb3454aba88ed3d5138f4f69afcf0ee63c7f965d4ab371" May 27 19:36:50.425885 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:50.425802 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-psnv9" event={"ID":"462a870e-b9ed-4c02-b1cb-165cda4237d5","Type":"ContainerStarted","Data":"d04d15a6a9701075a0509d99bd8713cce290b5bb02891ff7a20370acb96f13d7"} May 27 19:36:50.426031 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:50.426014 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-psnv9" May 27 19:36:50.445863 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:50.445817 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-psnv9" podStartSLOduration=2.34560371 podStartE2EDuration="22.445801807s" podCreationTimestamp="2026-05-27 19:36:28 +0000 UTC" firstStartedPulling="2026-05-27 19:36:29.96359435 +0000 UTC m=+265.000221029" lastFinishedPulling="2026-05-27 19:36:50.063792461 +0000 UTC m=+285.100419126" observedRunningTime="2026-05-27 19:36:50.445158556 +0000 UTC m=+285.481785243" watchObservedRunningTime="2026-05-27 19:36:50.445801807 +0000 UTC m=+285.482428494" May 27 19:36:54.923538 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:54.923486 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-82mkr"] May 27 19:36:54.927493 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:54.927472 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-82mkr" May 27 19:36:54.929905 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:54.929886 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" May 27 19:36:54.930138 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:54.930119 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" May 27 19:36:54.930479 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:54.930461 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-6cv78\"" May 27 19:36:54.938671 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:54.938641 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-82mkr"] May 27 19:36:55.097996 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:55.097968 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/02439c76-c454-4fb5-85a9-39b7aacf6c47-operator-config\") pod \"servicemesh-operator3-55f49c5f94-82mkr\" (UID: \"02439c76-c454-4fb5-85a9-39b7aacf6c47\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-82mkr" May 27 19:36:55.098133 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:55.098032 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rh26b\" (UniqueName: \"kubernetes.io/projected/02439c76-c454-4fb5-85a9-39b7aacf6c47-kube-api-access-rh26b\") pod \"servicemesh-operator3-55f49c5f94-82mkr\" (UID: \"02439c76-c454-4fb5-85a9-39b7aacf6c47\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-82mkr" May 27 19:36:55.198621 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:55.198556 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/02439c76-c454-4fb5-85a9-39b7aacf6c47-operator-config\") pod \"servicemesh-operator3-55f49c5f94-82mkr\" (UID: \"02439c76-c454-4fb5-85a9-39b7aacf6c47\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-82mkr" May 27 19:36:55.198733 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:55.198621 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rh26b\" (UniqueName: \"kubernetes.io/projected/02439c76-c454-4fb5-85a9-39b7aacf6c47-kube-api-access-rh26b\") pod \"servicemesh-operator3-55f49c5f94-82mkr\" (UID: \"02439c76-c454-4fb5-85a9-39b7aacf6c47\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-82mkr" May 27 19:36:55.200986 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:55.200956 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/02439c76-c454-4fb5-85a9-39b7aacf6c47-operator-config\") pod \"servicemesh-operator3-55f49c5f94-82mkr\" (UID: \"02439c76-c454-4fb5-85a9-39b7aacf6c47\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-82mkr" May 27 19:36:55.214941 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:55.214913 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rh26b\" (UniqueName: \"kubernetes.io/projected/02439c76-c454-4fb5-85a9-39b7aacf6c47-kube-api-access-rh26b\") pod \"servicemesh-operator3-55f49c5f94-82mkr\" (UID: \"02439c76-c454-4fb5-85a9-39b7aacf6c47\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-82mkr" May 27 19:36:55.236593 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:55.236574 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-82mkr" May 27 19:36:55.368884 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:55.368859 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-82mkr"] May 27 19:36:55.371013 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:36:55.370988 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02439c76_c454_4fb5_85a9_39b7aacf6c47.slice/crio-43f17740bdb1e742e2fb8cca1de3da4535a3f21bbb832cb57a7c866f9124c795 WatchSource:0}: Error finding container 43f17740bdb1e742e2fb8cca1de3da4535a3f21bbb832cb57a7c866f9124c795: Status 404 returned error can't find the container with id 43f17740bdb1e742e2fb8cca1de3da4535a3f21bbb832cb57a7c866f9124c795 May 27 19:36:55.442031 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:55.442003 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-82mkr" event={"ID":"02439c76-c454-4fb5-85a9-39b7aacf6c47","Type":"ContainerStarted","Data":"43f17740bdb1e742e2fb8cca1de3da4535a3f21bbb832cb57a7c866f9124c795"} May 27 19:36:58.458926 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:58.458887 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-82mkr" event={"ID":"02439c76-c454-4fb5-85a9-39b7aacf6c47","Type":"ContainerStarted","Data":"557556ffed156585b44f5d70e317639aff0c4778cd68f739f3a04bd571893206"} May 27 19:36:58.459337 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:58.458997 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-82mkr" May 27 19:36:58.480165 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:36:58.480127 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-82mkr" podStartSLOduration=2.006899933 podStartE2EDuration="4.480114593s" podCreationTimestamp="2026-05-27 19:36:54 +0000 UTC" firstStartedPulling="2026-05-27 19:36:55.37359149 +0000 UTC m=+290.410218159" lastFinishedPulling="2026-05-27 19:36:57.846806141 +0000 UTC m=+292.883432819" observedRunningTime="2026-05-27 19:36:58.478832515 +0000 UTC m=+293.515459230" watchObservedRunningTime="2026-05-27 19:36:58.480114593 +0000 UTC m=+293.516741314" May 27 19:37:01.431589 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:37:01.431560 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-psnv9" May 27 19:37:04.984309 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:37:04.984257 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-x5xzn"] May 27 19:37:04.987531 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:37:04.987510 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x5xzn" May 27 19:37:04.990111 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:37:04.990095 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" May 27 19:37:04.990217 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:37:04.990092 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 27 19:37:04.990217 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:37:04.990095 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" May 27 19:37:04.990428 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:37:04.990409 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" May 27 19:37:04.990428 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:37:04.990423 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-n585l\"" May 27 19:37:05.002283 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:37:05.002241 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-x5xzn"] May 27 19:37:05.073884 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:37:05.073851 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94bjv\" (UniqueName: \"kubernetes.io/projected/01b14747-6035-4762-b007-1f8d3a43d4ca-kube-api-access-94bjv\") pod \"istiod-openshift-gateway-798958bb55-x5xzn\" (UID: \"01b14747-6035-4762-b007-1f8d3a43d4ca\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x5xzn" May 27 19:37:05.073884 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:37:05.073889 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/01b14747-6035-4762-b007-1f8d3a43d4ca-cacerts\") pod \"istiod-openshift-gateway-798958bb55-x5xzn\" (UID: \"01b14747-6035-4762-b007-1f8d3a43d4ca\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x5xzn" May 27 19:37:05.074103 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:37:05.073906 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/01b14747-6035-4762-b007-1f8d3a43d4ca-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-x5xzn\" (UID: \"01b14747-6035-4762-b007-1f8d3a43d4ca\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x5xzn" May 27 19:37:05.074103 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:37:05.074052 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/01b14747-6035-4762-b007-1f8d3a43d4ca-local-certs\") pod \"istiod-openshift-gateway-798958bb55-x5xzn\" (UID: \"01b14747-6035-4762-b007-1f8d3a43d4ca\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x5xzn" May 27 19:37:05.074103 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:37:05.074090 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01b14747-6035-4762-b007-1f8d3a43d4ca-istio-token\") pod \"istiod-openshift-gateway-798958bb55-x5xzn\" (UID: \"01b14747-6035-4762-b007-1f8d3a43d4ca\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x5xzn" May 27 19:37:05.074247 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:37:05.074116 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/01b14747-6035-4762-b007-1f8d3a43d4ca-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-x5xzn\" (UID: \"01b14747-6035-4762-b007-1f8d3a43d4ca\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x5xzn" May 27 19:37:05.074247 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:37:05.074149 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/01b14747-6035-4762-b007-1f8d3a43d4ca-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-x5xzn\" (UID: \"01b14747-6035-4762-b007-1f8d3a43d4ca\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x5xzn" May 27 19:37:05.174455 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:37:05.174423 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/01b14747-6035-4762-b007-1f8d3a43d4ca-local-certs\") pod \"istiod-openshift-gateway-798958bb55-x5xzn\" (UID: \"01b14747-6035-4762-b007-1f8d3a43d4ca\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x5xzn" May 27 19:37:05.174455 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:37:05.174456 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01b14747-6035-4762-b007-1f8d3a43d4ca-istio-token\") pod \"istiod-openshift-gateway-798958bb55-x5xzn\" (UID: \"01b14747-6035-4762-b007-1f8d3a43d4ca\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x5xzn" May 27 19:37:05.174671 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:37:05.174474 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/01b14747-6035-4762-b007-1f8d3a43d4ca-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-x5xzn\" (UID: \"01b14747-6035-4762-b007-1f8d3a43d4ca\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x5xzn" May 27 19:37:05.174671 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:37:05.174497 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/01b14747-6035-4762-b007-1f8d3a43d4ca-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-x5xzn\" (UID: \"01b14747-6035-4762-b007-1f8d3a43d4ca\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x5xzn" May 27 19:37:05.174671 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:37:05.174530 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-94bjv\" (UniqueName: \"kubernetes.io/projected/01b14747-6035-4762-b007-1f8d3a43d4ca-kube-api-access-94bjv\") pod \"istiod-openshift-gateway-798958bb55-x5xzn\" (UID: \"01b14747-6035-4762-b007-1f8d3a43d4ca\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x5xzn" May 27 19:37:05.174671 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:37:05.174561 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/01b14747-6035-4762-b007-1f8d3a43d4ca-cacerts\") pod \"istiod-openshift-gateway-798958bb55-x5xzn\" (UID: \"01b14747-6035-4762-b007-1f8d3a43d4ca\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x5xzn" May 27 19:37:05.174671 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:37:05.174587 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/01b14747-6035-4762-b007-1f8d3a43d4ca-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-x5xzn\" (UID: \"01b14747-6035-4762-b007-1f8d3a43d4ca\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x5xzn" May 27 19:37:05.175347 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:37:05.175319 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/01b14747-6035-4762-b007-1f8d3a43d4ca-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-x5xzn\" (UID: \"01b14747-6035-4762-b007-1f8d3a43d4ca\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x5xzn" May 27 19:37:05.177100 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:37:05.177080 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/01b14747-6035-4762-b007-1f8d3a43d4ca-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-x5xzn\" (UID: \"01b14747-6035-4762-b007-1f8d3a43d4ca\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x5xzn" May 27 19:37:05.177197 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:37:05.177116 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/01b14747-6035-4762-b007-1f8d3a43d4ca-local-certs\") pod \"istiod-openshift-gateway-798958bb55-x5xzn\" (UID: \"01b14747-6035-4762-b007-1f8d3a43d4ca\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x5xzn" May 27 19:37:05.177197 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:37:05.177138 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/01b14747-6035-4762-b007-1f8d3a43d4ca-cacerts\") pod \"istiod-openshift-gateway-798958bb55-x5xzn\" (UID: \"01b14747-6035-4762-b007-1f8d3a43d4ca\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x5xzn" May 27 19:37:05.177300 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:37:05.177237 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/01b14747-6035-4762-b007-1f8d3a43d4ca-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-x5xzn\" (UID: \"01b14747-6035-4762-b007-1f8d3a43d4ca\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x5xzn" May 27 19:37:05.182674 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:37:05.182647 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94bjv\" (UniqueName: \"kubernetes.io/projected/01b14747-6035-4762-b007-1f8d3a43d4ca-kube-api-access-94bjv\") pod \"istiod-openshift-gateway-798958bb55-x5xzn\" (UID: \"01b14747-6035-4762-b007-1f8d3a43d4ca\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x5xzn" May 27 19:37:05.182752 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:37:05.182654 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01b14747-6035-4762-b007-1f8d3a43d4ca-istio-token\") pod \"istiod-openshift-gateway-798958bb55-x5xzn\" (UID: \"01b14747-6035-4762-b007-1f8d3a43d4ca\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x5xzn" May 27 19:37:05.296932 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:37:05.296907 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x5xzn" May 27 19:37:05.431091 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:37:05.430975 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-x5xzn"] May 27 19:37:05.433600 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:37:05.433560 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01b14747_6035_4762_b007_1f8d3a43d4ca.slice/crio-9dff0ecd2bc3448a0bc86098cb650ee570965bc2fbd19df05e2a23dfe82e8b40 WatchSource:0}: Error finding container 9dff0ecd2bc3448a0bc86098cb650ee570965bc2fbd19df05e2a23dfe82e8b40: Status 404 returned error can't find the container with id 9dff0ecd2bc3448a0bc86098cb650ee570965bc2fbd19df05e2a23dfe82e8b40 May 27 19:37:05.482358 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:37:05.482322 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x5xzn" event={"ID":"01b14747-6035-4762-b007-1f8d3a43d4ca","Type":"ContainerStarted","Data":"9dff0ecd2bc3448a0bc86098cb650ee570965bc2fbd19df05e2a23dfe82e8b40"} May 27 19:37:05.498242 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:37:05.498212 2555 kubelet.go:1628] "Image garbage collection succeeded" May 27 19:37:07.982588 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:37:07.982544 2555 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 27 19:37:07.982891 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:37:07.982627 2555 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 27 19:37:08.493945 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:37:08.493908 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x5xzn" event={"ID":"01b14747-6035-4762-b007-1f8d3a43d4ca","Type":"ContainerStarted","Data":"b3a0fa6bec5731b1be4df7ff9476c9c179c143c0f6c58a3b428608a7b9071908"} May 27 19:37:08.494121 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:37:08.494057 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x5xzn" May 27 19:37:08.514992 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:37:08.514934 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x5xzn" podStartSLOduration=1.968304262 podStartE2EDuration="4.514916619s" podCreationTimestamp="2026-05-27 19:37:04 +0000 UTC" firstStartedPulling="2026-05-27 19:37:05.435635122 +0000 UTC m=+300.472261790" lastFinishedPulling="2026-05-27 19:37:07.982247478 +0000 UTC m=+303.018874147" observedRunningTime="2026-05-27 19:37:08.513317975 +0000 UTC m=+303.549944656" watchObservedRunningTime="2026-05-27 19:37:08.514916619 +0000 UTC m=+303.551543307" May 27 19:37:09.394810 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:37:09.394778 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-58jfn" May 27 19:37:09.464251 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:37:09.464221 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-82mkr" May 27 19:37:09.508003 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:37:09.507738 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-x5xzn" May 27 19:38:05.319921 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:05.319833 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8x6wj"] May 27 19:38:05.322185 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:05.322164 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8x6wj" May 27 19:38:05.325594 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:05.325576 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 27 19:38:05.326292 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:05.326278 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-rpvxd\"" May 27 19:38:05.326360 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:05.326292 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 27 19:38:05.338215 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:05.338193 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8x6wj"] May 27 19:38:05.444022 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:05.443600 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4s24\" (UniqueName: \"kubernetes.io/projected/80df3b03-4363-4609-bc42-bc3428818d91-kube-api-access-s4s24\") pod \"limitador-operator-controller-manager-85c4996f8c-8x6wj\" (UID: \"80df3b03-4363-4609-bc42-bc3428818d91\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8x6wj" May 27 19:38:05.544174 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:05.544130 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s4s24\" (UniqueName: \"kubernetes.io/projected/80df3b03-4363-4609-bc42-bc3428818d91-kube-api-access-s4s24\") pod \"limitador-operator-controller-manager-85c4996f8c-8x6wj\" (UID: \"80df3b03-4363-4609-bc42-bc3428818d91\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8x6wj" May 27 19:38:05.565431 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:05.565401 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 27 19:38:05.567637 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:05.567617 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 27 19:38:05.578302 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:05.578221 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4s24\" (UniqueName: \"kubernetes.io/projected/80df3b03-4363-4609-bc42-bc3428818d91-kube-api-access-s4s24\") pod \"limitador-operator-controller-manager-85c4996f8c-8x6wj\" (UID: \"80df3b03-4363-4609-bc42-bc3428818d91\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8x6wj" May 27 19:38:05.634117 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:05.634097 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-rpvxd\"" May 27 19:38:05.641946 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:05.641927 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8x6wj" May 27 19:38:05.766942 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:05.766917 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8x6wj"] May 27 19:38:05.769299 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:38:05.769258 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80df3b03_4363_4609_bc42_bc3428818d91.slice/crio-385a74619b5b4eb925d368c984af2697adec0794b6f3196dc56e80d7e34eae26 WatchSource:0}: Error finding container 385a74619b5b4eb925d368c984af2697adec0794b6f3196dc56e80d7e34eae26: Status 404 returned error can't find the container with id 385a74619b5b4eb925d368c984af2697adec0794b6f3196dc56e80d7e34eae26 May 27 19:38:05.771180 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:05.771163 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 19:38:06.672573 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:06.672536 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8x6wj" event={"ID":"80df3b03-4363-4609-bc42-bc3428818d91","Type":"ContainerStarted","Data":"385a74619b5b4eb925d368c984af2697adec0794b6f3196dc56e80d7e34eae26"} May 27 19:38:08.680638 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:08.680598 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8x6wj" event={"ID":"80df3b03-4363-4609-bc42-bc3428818d91","Type":"ContainerStarted","Data":"a0cf4193a4f27d5eadb6195b3ced8bfdce8f82949991537b98e11bcf9a16fa33"} May 27 19:38:08.681010 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:08.680757 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8x6wj" May 27 19:38:08.700433 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:08.700387 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8x6wj" podStartSLOduration=1.551356237 podStartE2EDuration="3.700370542s" podCreationTimestamp="2026-05-27 19:38:05 +0000 UTC" firstStartedPulling="2026-05-27 19:38:05.77133765 +0000 UTC m=+360.807964315" lastFinishedPulling="2026-05-27 19:38:07.920351941 +0000 UTC m=+362.956978620" observedRunningTime="2026-05-27 19:38:08.698954201 +0000 UTC m=+363.735580888" watchObservedRunningTime="2026-05-27 19:38:08.700370542 +0000 UTC m=+363.736997228" May 27 19:38:19.685294 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:19.685235 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8x6wj" May 27 19:38:29.672088 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:29.672049 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8x6wj"] May 27 19:38:29.672555 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:29.672356 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8x6wj" podUID="80df3b03-4363-4609-bc42-bc3428818d91" containerName="manager" containerID="cri-o://a0cf4193a4f27d5eadb6195b3ced8bfdce8f82949991537b98e11bcf9a16fa33" gracePeriod=2 May 27 19:38:29.683781 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:29.683743 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8x6wj" podUID="80df3b03-4363-4609-bc42-bc3428818d91" containerName="manager" probeResult="failure" output="Get \"http://10.132.0.24:8081/readyz\": dial tcp 10.132.0.24:8081: connect: connection refused" May 27 19:38:29.689650 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:29.689624 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8x6wj"] May 27 19:38:29.702634 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:29.702611 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tgk74"] May 27 19:38:29.702894 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:29.702880 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80df3b03-4363-4609-bc42-bc3428818d91" containerName="manager" May 27 19:38:29.702894 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:29.702894 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="80df3b03-4363-4609-bc42-bc3428818d91" containerName="manager" May 27 19:38:29.703028 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:29.702949 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="80df3b03-4363-4609-bc42-bc3428818d91" containerName="manager" May 27 19:38:29.705760 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:29.705737 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tgk74" May 27 19:38:29.718145 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:29.718119 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tgk74"] May 27 19:38:29.723921 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:29.723893 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5xl7\" (UniqueName: \"kubernetes.io/projected/6ce7407b-3845-42c2-b3b5-4e4a3f9a0588-kube-api-access-g5xl7\") pod \"limitador-operator-controller-manager-85c4996f8c-tgk74\" (UID: \"6ce7407b-3845-42c2-b3b5-4e4a3f9a0588\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tgk74" May 27 19:38:29.824454 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:29.824420 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g5xl7\" (UniqueName: \"kubernetes.io/projected/6ce7407b-3845-42c2-b3b5-4e4a3f9a0588-kube-api-access-g5xl7\") pod \"limitador-operator-controller-manager-85c4996f8c-tgk74\" (UID: \"6ce7407b-3845-42c2-b3b5-4e4a3f9a0588\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tgk74" May 27 19:38:29.839959 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:29.839930 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5xl7\" (UniqueName: \"kubernetes.io/projected/6ce7407b-3845-42c2-b3b5-4e4a3f9a0588-kube-api-access-g5xl7\") pod \"limitador-operator-controller-manager-85c4996f8c-tgk74\" (UID: \"6ce7407b-3845-42c2-b3b5-4e4a3f9a0588\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tgk74" May 27 19:38:29.904343 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:29.904320 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8x6wj" May 27 19:38:29.906518 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:29.906489 2555 status_manager.go:895] "Failed to get status for pod" podUID="80df3b03-4363-4609-bc42-bc3428818d91" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8x6wj" err="pods \"limitador-operator-controller-manager-85c4996f8c-8x6wj\" is forbidden: User \"system:node:ip-10-0-139-51.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-51.ec2.internal' and this object" May 27 19:38:29.925073 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:29.925025 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4s24\" (UniqueName: \"kubernetes.io/projected/80df3b03-4363-4609-bc42-bc3428818d91-kube-api-access-s4s24\") pod \"80df3b03-4363-4609-bc42-bc3428818d91\" (UID: \"80df3b03-4363-4609-bc42-bc3428818d91\") " May 27 19:38:29.927017 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:29.926993 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80df3b03-4363-4609-bc42-bc3428818d91-kube-api-access-s4s24" (OuterVolumeSpecName: "kube-api-access-s4s24") pod "80df3b03-4363-4609-bc42-bc3428818d91" (UID: "80df3b03-4363-4609-bc42-bc3428818d91"). InnerVolumeSpecName "kube-api-access-s4s24". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 19:38:30.026008 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:30.025987 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4s24\" (UniqueName: \"kubernetes.io/projected/80df3b03-4363-4609-bc42-bc3428818d91-kube-api-access-s4s24\") on node \"ip-10-0-139-51.ec2.internal\" DevicePath \"\"" May 27 19:38:30.037979 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:30.037951 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tgk74" May 27 19:38:30.170263 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:30.170232 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tgk74"] May 27 19:38:30.173088 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:38:30.173063 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ce7407b_3845_42c2_b3b5_4e4a3f9a0588.slice/crio-22841e1058a50b1139d92dbb6fa02d9b2269265318758499f5cf89eff518e780 WatchSource:0}: Error finding container 22841e1058a50b1139d92dbb6fa02d9b2269265318758499f5cf89eff518e780: Status 404 returned error can't find the container with id 22841e1058a50b1139d92dbb6fa02d9b2269265318758499f5cf89eff518e780 May 27 19:38:30.750227 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:30.750194 2555 generic.go:358] "Generic (PLEG): container finished" podID="80df3b03-4363-4609-bc42-bc3428818d91" containerID="a0cf4193a4f27d5eadb6195b3ced8bfdce8f82949991537b98e11bcf9a16fa33" exitCode=0 May 27 19:38:30.750642 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:30.750238 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8x6wj" May 27 19:38:30.750642 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:30.750318 2555 scope.go:117] "RemoveContainer" containerID="a0cf4193a4f27d5eadb6195b3ced8bfdce8f82949991537b98e11bcf9a16fa33" May 27 19:38:30.751718 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:30.751696 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tgk74" event={"ID":"6ce7407b-3845-42c2-b3b5-4e4a3f9a0588","Type":"ContainerStarted","Data":"af5557d996c04e48d724bed42ae4e3281be5acea97b477dc1e7cd369cc4b72b2"} May 27 19:38:30.751803 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:30.751731 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tgk74" event={"ID":"6ce7407b-3845-42c2-b3b5-4e4a3f9a0588","Type":"ContainerStarted","Data":"22841e1058a50b1139d92dbb6fa02d9b2269265318758499f5cf89eff518e780"} May 27 19:38:30.751858 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:30.751837 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tgk74" May 27 19:38:30.753378 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:30.753358 2555 status_manager.go:895] "Failed to get status for pod" podUID="80df3b03-4363-4609-bc42-bc3428818d91" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8x6wj" err="pods \"limitador-operator-controller-manager-85c4996f8c-8x6wj\" is forbidden: User \"system:node:ip-10-0-139-51.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-51.ec2.internal' and this object" May 27 19:38:30.755556 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:30.755528 2555 status_manager.go:895] "Failed to get status for pod" podUID="80df3b03-4363-4609-bc42-bc3428818d91" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8x6wj" err="pods \"limitador-operator-controller-manager-85c4996f8c-8x6wj\" is forbidden: User \"system:node:ip-10-0-139-51.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-51.ec2.internal' and this object" May 27 19:38:30.758244 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:30.757995 2555 scope.go:117] "RemoveContainer" containerID="a0cf4193a4f27d5eadb6195b3ced8bfdce8f82949991537b98e11bcf9a16fa33" May 27 19:38:30.758350 ip-10-0-139-51 kubenswrapper[2555]: E0527 19:38:30.758313 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0cf4193a4f27d5eadb6195b3ced8bfdce8f82949991537b98e11bcf9a16fa33\": container with ID starting with a0cf4193a4f27d5eadb6195b3ced8bfdce8f82949991537b98e11bcf9a16fa33 not found: ID does not exist" containerID="a0cf4193a4f27d5eadb6195b3ced8bfdce8f82949991537b98e11bcf9a16fa33" May 27 19:38:30.758408 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:30.758348 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0cf4193a4f27d5eadb6195b3ced8bfdce8f82949991537b98e11bcf9a16fa33"} err="failed to get container status \"a0cf4193a4f27d5eadb6195b3ced8bfdce8f82949991537b98e11bcf9a16fa33\": rpc error: code = NotFound desc = could not find container \"a0cf4193a4f27d5eadb6195b3ced8bfdce8f82949991537b98e11bcf9a16fa33\": container with ID starting with a0cf4193a4f27d5eadb6195b3ced8bfdce8f82949991537b98e11bcf9a16fa33 not found: ID does not exist" May 27 19:38:30.787704 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:30.787638 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tgk74" podStartSLOduration=1.787626902 podStartE2EDuration="1.787626902s" podCreationTimestamp="2026-05-27 19:38:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 19:38:30.786974257 +0000 UTC m=+385.823600944" watchObservedRunningTime="2026-05-27 19:38:30.787626902 +0000 UTC m=+385.824253589" May 27 19:38:30.789196 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:30.789163 2555 status_manager.go:895] "Failed to get status for pod" podUID="80df3b03-4363-4609-bc42-bc3428818d91" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-8x6wj" err="pods \"limitador-operator-controller-manager-85c4996f8c-8x6wj\" is forbidden: User \"system:node:ip-10-0-139-51.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-51.ec2.internal' and this object" May 27 19:38:31.576998 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:31.576967 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80df3b03-4363-4609-bc42-bc3428818d91" path="/var/lib/kubelet/pods/80df3b03-4363-4609-bc42-bc3428818d91/volumes" May 27 19:38:41.757960 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:38:41.757929 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tgk74" May 27 19:39:20.449829 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:39:20.449789 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:39:20.454013 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:39:20.453994 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-ndlpn" May 27 19:39:20.456159 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:39:20.456136 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 27 19:39:20.456300 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:39:20.456230 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-xvkj4\"" May 27 19:39:20.461248 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:39:20.461208 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:39:20.493947 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:39:20.493915 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:39:20.613361 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:39:20.613332 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvx8j\" (UniqueName: \"kubernetes.io/projected/93bc5f03-ae8c-46a0-814d-64a384dc43d6-kube-api-access-kvx8j\") pod \"limitador-limitador-78c99df468-ndlpn\" (UID: \"93bc5f03-ae8c-46a0-814d-64a384dc43d6\") " pod="kuadrant-system/limitador-limitador-78c99df468-ndlpn" May 27 19:39:20.613499 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:39:20.613364 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/93bc5f03-ae8c-46a0-814d-64a384dc43d6-config-file\") pod \"limitador-limitador-78c99df468-ndlpn\" (UID: \"93bc5f03-ae8c-46a0-814d-64a384dc43d6\") " pod="kuadrant-system/limitador-limitador-78c99df468-ndlpn" May 27 19:39:20.713697 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:39:20.713632 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kvx8j\" (UniqueName: \"kubernetes.io/projected/93bc5f03-ae8c-46a0-814d-64a384dc43d6-kube-api-access-kvx8j\") pod \"limitador-limitador-78c99df468-ndlpn\" (UID: \"93bc5f03-ae8c-46a0-814d-64a384dc43d6\") " pod="kuadrant-system/limitador-limitador-78c99df468-ndlpn" May 27 19:39:20.713697 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:39:20.713663 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/93bc5f03-ae8c-46a0-814d-64a384dc43d6-config-file\") pod \"limitador-limitador-78c99df468-ndlpn\" (UID: \"93bc5f03-ae8c-46a0-814d-64a384dc43d6\") " pod="kuadrant-system/limitador-limitador-78c99df468-ndlpn" May 27 19:39:20.714209 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:39:20.714191 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/93bc5f03-ae8c-46a0-814d-64a384dc43d6-config-file\") pod \"limitador-limitador-78c99df468-ndlpn\" (UID: \"93bc5f03-ae8c-46a0-814d-64a384dc43d6\") " pod="kuadrant-system/limitador-limitador-78c99df468-ndlpn" May 27 19:39:20.721830 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:39:20.721803 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvx8j\" (UniqueName: \"kubernetes.io/projected/93bc5f03-ae8c-46a0-814d-64a384dc43d6-kube-api-access-kvx8j\") pod \"limitador-limitador-78c99df468-ndlpn\" (UID: \"93bc5f03-ae8c-46a0-814d-64a384dc43d6\") " pod="kuadrant-system/limitador-limitador-78c99df468-ndlpn" May 27 19:39:20.765055 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:39:20.765028 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-ndlpn" May 27 19:39:20.891206 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:39:20.891179 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:39:20.894209 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:39:20.894181 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93bc5f03_ae8c_46a0_814d_64a384dc43d6.slice/crio-c553037d5cb9e0f53cd591eafe9d33b9d403b9128461894caa8d107b594071a0 WatchSource:0}: Error finding container c553037d5cb9e0f53cd591eafe9d33b9d403b9128461894caa8d107b594071a0: Status 404 returned error can't find the container with id c553037d5cb9e0f53cd591eafe9d33b9d403b9128461894caa8d107b594071a0 May 27 19:39:20.905700 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:39:20.905668 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-ndlpn" event={"ID":"93bc5f03-ae8c-46a0-814d-64a384dc43d6","Type":"ContainerStarted","Data":"c553037d5cb9e0f53cd591eafe9d33b9d403b9128461894caa8d107b594071a0"} May 27 19:39:23.917952 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:39:23.917912 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-ndlpn" event={"ID":"93bc5f03-ae8c-46a0-814d-64a384dc43d6","Type":"ContainerStarted","Data":"0010e86aeebd63d38a48c187b29f092221cd96c4663f1efc4ea450f33fb211bb"} May 27 19:39:23.918357 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:39:23.918042 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-ndlpn" May 27 19:39:23.935471 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:39:23.935425 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-ndlpn" podStartSLOduration=1.327858502 podStartE2EDuration="3.935412003s" podCreationTimestamp="2026-05-27 19:39:20 +0000 UTC" firstStartedPulling="2026-05-27 19:39:20.895990367 +0000 UTC m=+435.932617033" lastFinishedPulling="2026-05-27 19:39:23.503543859 +0000 UTC m=+438.540170534" observedRunningTime="2026-05-27 19:39:23.934488595 +0000 UTC m=+438.971115277" watchObservedRunningTime="2026-05-27 19:39:23.935412003 +0000 UTC m=+438.972038691" May 27 19:39:34.922942 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:39:34.922865 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-ndlpn" May 27 19:40:34.734370 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:40:34.734335 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-xgqxb"] May 27 19:40:34.737403 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:40:34.737387 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-xgqxb" May 27 19:40:34.739655 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:40:34.739636 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" May 27 19:40:34.739789 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:40:34.739756 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-vkhdp\"" May 27 19:40:34.746121 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:40:34.746100 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-xgqxb"] May 27 19:40:34.804468 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:40:34.804444 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f92sc\" (UniqueName: \"kubernetes.io/projected/bfc843d8-8c38-4f29-8aaa-8376ac8cb448-kube-api-access-f92sc\") pod \"payload-processing-58b6c8fdc7-xgqxb\" (UID: \"bfc843d8-8c38-4f29-8aaa-8376ac8cb448\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-xgqxb" May 27 19:40:34.900845 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:40:34.900815 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:40:34.905165 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:40:34.905143 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f92sc\" (UniqueName: \"kubernetes.io/projected/bfc843d8-8c38-4f29-8aaa-8376ac8cb448-kube-api-access-f92sc\") pod \"payload-processing-58b6c8fdc7-xgqxb\" (UID: \"bfc843d8-8c38-4f29-8aaa-8376ac8cb448\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-xgqxb" May 27 19:40:34.915595 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:40:34.915564 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f92sc\" (UniqueName: \"kubernetes.io/projected/bfc843d8-8c38-4f29-8aaa-8376ac8cb448-kube-api-access-f92sc\") pod \"payload-processing-58b6c8fdc7-xgqxb\" (UID: \"bfc843d8-8c38-4f29-8aaa-8376ac8cb448\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-xgqxb" May 27 19:40:35.048329 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:40:35.048302 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-xgqxb" May 27 19:40:35.176869 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:40:35.176844 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-xgqxb"] May 27 19:40:35.179439 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:40:35.179408 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfc843d8_8c38_4f29_8aaa_8376ac8cb448.slice/crio-06d536bb71b6f33fd6277f08a2c8f9102d61a175ade8ae99bcc0388fda8f104e WatchSource:0}: Error finding container 06d536bb71b6f33fd6277f08a2c8f9102d61a175ade8ae99bcc0388fda8f104e: Status 404 returned error can't find the container with id 06d536bb71b6f33fd6277f08a2c8f9102d61a175ade8ae99bcc0388fda8f104e May 27 19:40:36.154061 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:40:36.154022 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-xgqxb" event={"ID":"bfc843d8-8c38-4f29-8aaa-8376ac8cb448","Type":"ContainerStarted","Data":"06d536bb71b6f33fd6277f08a2c8f9102d61a175ade8ae99bcc0388fda8f104e"} May 27 19:40:37.158531 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:40:37.158501 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-xgqxb" event={"ID":"bfc843d8-8c38-4f29-8aaa-8376ac8cb448","Type":"ContainerStarted","Data":"9b26e2800a3a7b2ebf37bf052acd0283a2b4877eb02da0734d2eb976f21cb511"} May 27 19:40:37.158898 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:40:37.158606 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-xgqxb" May 27 19:40:37.198626 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:40:37.198580 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-xgqxb" podStartSLOduration=1.688231956 podStartE2EDuration="3.198569248s" podCreationTimestamp="2026-05-27 19:40:34 +0000 UTC" firstStartedPulling="2026-05-27 19:40:35.181160947 +0000 UTC m=+510.217787616" lastFinishedPulling="2026-05-27 19:40:36.691498242 +0000 UTC m=+511.728124908" observedRunningTime="2026-05-27 19:40:37.198227101 +0000 UTC m=+512.234853789" watchObservedRunningTime="2026-05-27 19:40:37.198569248 +0000 UTC m=+512.235195935" May 27 19:40:48.163981 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:40:48.163950 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-xgqxb" May 27 19:40:50.796980 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:40:50.796945 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:40:53.931372 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:40:53.931331 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:40:56.212108 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:40:56.212022 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:41:10.336398 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:10.336360 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-m6jpm"] May 27 19:41:10.339884 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:10.339862 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m6jpm" May 27 19:41:10.342337 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:10.342314 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 27 19:41:10.342337 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:10.342329 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-kph68\"" May 27 19:41:10.342506 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:10.342430 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 27 19:41:10.342705 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:10.342689 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" May 27 19:41:10.350105 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:10.350085 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-m6jpm"] May 27 19:41:10.491309 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:10.491256 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b1fe773-f1dd-4a6c-9b3c-c91f75389bd8-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-m6jpm\" (UID: \"9b1fe773-f1dd-4a6c-9b3c-c91f75389bd8\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m6jpm" May 27 19:41:10.491484 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:10.491357 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvr8f\" (UniqueName: \"kubernetes.io/projected/9b1fe773-f1dd-4a6c-9b3c-c91f75389bd8-kube-api-access-nvr8f\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-m6jpm\" (UID: \"9b1fe773-f1dd-4a6c-9b3c-c91f75389bd8\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m6jpm" May 27 19:41:10.491484 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:10.491395 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b1fe773-f1dd-4a6c-9b3c-c91f75389bd8-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-m6jpm\" (UID: \"9b1fe773-f1dd-4a6c-9b3c-c91f75389bd8\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m6jpm" May 27 19:41:10.491484 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:10.491474 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b1fe773-f1dd-4a6c-9b3c-c91f75389bd8-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-m6jpm\" (UID: \"9b1fe773-f1dd-4a6c-9b3c-c91f75389bd8\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m6jpm" May 27 19:41:10.491620 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:10.491517 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b1fe773-f1dd-4a6c-9b3c-c91f75389bd8-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-m6jpm\" (UID: \"9b1fe773-f1dd-4a6c-9b3c-c91f75389bd8\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m6jpm" May 27 19:41:10.491620 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:10.491543 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9b1fe773-f1dd-4a6c-9b3c-c91f75389bd8-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-m6jpm\" (UID: \"9b1fe773-f1dd-4a6c-9b3c-c91f75389bd8\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m6jpm" May 27 19:41:10.592516 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:10.592429 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b1fe773-f1dd-4a6c-9b3c-c91f75389bd8-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-m6jpm\" (UID: \"9b1fe773-f1dd-4a6c-9b3c-c91f75389bd8\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m6jpm" May 27 19:41:10.592516 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:10.592467 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b1fe773-f1dd-4a6c-9b3c-c91f75389bd8-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-m6jpm\" (UID: \"9b1fe773-f1dd-4a6c-9b3c-c91f75389bd8\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m6jpm" May 27 19:41:10.592516 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:10.592489 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9b1fe773-f1dd-4a6c-9b3c-c91f75389bd8-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-m6jpm\" (UID: \"9b1fe773-f1dd-4a6c-9b3c-c91f75389bd8\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m6jpm" May 27 19:41:10.592780 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:10.592526 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b1fe773-f1dd-4a6c-9b3c-c91f75389bd8-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-m6jpm\" (UID: \"9b1fe773-f1dd-4a6c-9b3c-c91f75389bd8\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m6jpm" May 27 19:41:10.592780 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:10.592576 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nvr8f\" (UniqueName: \"kubernetes.io/projected/9b1fe773-f1dd-4a6c-9b3c-c91f75389bd8-kube-api-access-nvr8f\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-m6jpm\" (UID: \"9b1fe773-f1dd-4a6c-9b3c-c91f75389bd8\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m6jpm" May 27 19:41:10.592780 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:10.592619 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b1fe773-f1dd-4a6c-9b3c-c91f75389bd8-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-m6jpm\" (UID: \"9b1fe773-f1dd-4a6c-9b3c-c91f75389bd8\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m6jpm" May 27 19:41:10.592927 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:10.592894 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b1fe773-f1dd-4a6c-9b3c-c91f75389bd8-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-m6jpm\" (UID: \"9b1fe773-f1dd-4a6c-9b3c-c91f75389bd8\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m6jpm" May 27 19:41:10.592927 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:10.592910 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b1fe773-f1dd-4a6c-9b3c-c91f75389bd8-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-m6jpm\" (UID: \"9b1fe773-f1dd-4a6c-9b3c-c91f75389bd8\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m6jpm" May 27 19:41:10.593038 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:10.593010 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9b1fe773-f1dd-4a6c-9b3c-c91f75389bd8-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-m6jpm\" (UID: \"9b1fe773-f1dd-4a6c-9b3c-c91f75389bd8\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m6jpm" May 27 19:41:10.594890 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:10.594867 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b1fe773-f1dd-4a6c-9b3c-c91f75389bd8-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-m6jpm\" (UID: \"9b1fe773-f1dd-4a6c-9b3c-c91f75389bd8\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m6jpm" May 27 19:41:10.595202 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:10.595181 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b1fe773-f1dd-4a6c-9b3c-c91f75389bd8-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-m6jpm\" (UID: \"9b1fe773-f1dd-4a6c-9b3c-c91f75389bd8\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m6jpm" May 27 19:41:10.600038 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:10.600019 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvr8f\" (UniqueName: \"kubernetes.io/projected/9b1fe773-f1dd-4a6c-9b3c-c91f75389bd8-kube-api-access-nvr8f\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-m6jpm\" (UID: \"9b1fe773-f1dd-4a6c-9b3c-c91f75389bd8\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m6jpm" May 27 19:41:10.649677 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:10.649654 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m6jpm" May 27 19:41:10.785784 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:10.785669 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-m6jpm"] May 27 19:41:10.793708 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:41:10.793675 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b1fe773_f1dd_4a6c_9b3c_c91f75389bd8.slice/crio-0fde7bcb59db45f464e66a139fcee32cd51874a57ff8f0903ac04973b4872570 WatchSource:0}: Error finding container 0fde7bcb59db45f464e66a139fcee32cd51874a57ff8f0903ac04973b4872570: Status 404 returned error can't find the container with id 0fde7bcb59db45f464e66a139fcee32cd51874a57ff8f0903ac04973b4872570 May 27 19:41:11.273989 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:11.273946 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m6jpm" event={"ID":"9b1fe773-f1dd-4a6c-9b3c-c91f75389bd8","Type":"ContainerStarted","Data":"0fde7bcb59db45f464e66a139fcee32cd51874a57ff8f0903ac04973b4872570"} May 27 19:41:11.616417 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:11.616385 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:41:13.028432 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:13.028398 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-dmjmr"] May 27 19:41:13.032002 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:13.031975 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dmjmr" May 27 19:41:13.034764 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:13.034742 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" May 27 19:41:13.043220 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:13.043175 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-dmjmr"] May 27 19:41:13.114283 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:13.114234 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fdlg\" (UniqueName: \"kubernetes.io/projected/6bdfcc20-769e-452b-a14b-737d7aca7224-kube-api-access-7fdlg\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-dmjmr\" (UID: \"6bdfcc20-769e-452b-a14b-737d7aca7224\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dmjmr" May 27 19:41:13.114453 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:13.114294 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6bdfcc20-769e-452b-a14b-737d7aca7224-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-dmjmr\" (UID: \"6bdfcc20-769e-452b-a14b-737d7aca7224\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dmjmr" May 27 19:41:13.114453 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:13.114331 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6bdfcc20-769e-452b-a14b-737d7aca7224-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-dmjmr\" (UID: \"6bdfcc20-769e-452b-a14b-737d7aca7224\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dmjmr" May 27 19:41:13.114453 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:13.114414 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6bdfcc20-769e-452b-a14b-737d7aca7224-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-dmjmr\" (UID: \"6bdfcc20-769e-452b-a14b-737d7aca7224\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dmjmr" May 27 19:41:13.114453 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:13.114445 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6bdfcc20-769e-452b-a14b-737d7aca7224-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-dmjmr\" (UID: \"6bdfcc20-769e-452b-a14b-737d7aca7224\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dmjmr" May 27 19:41:13.114653 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:13.114514 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6bdfcc20-769e-452b-a14b-737d7aca7224-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-dmjmr\" (UID: \"6bdfcc20-769e-452b-a14b-737d7aca7224\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dmjmr" May 27 19:41:13.215841 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:13.215803 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6bdfcc20-769e-452b-a14b-737d7aca7224-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-dmjmr\" (UID: \"6bdfcc20-769e-452b-a14b-737d7aca7224\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dmjmr" May 27 19:41:13.216016 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:13.215865 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7fdlg\" (UniqueName: \"kubernetes.io/projected/6bdfcc20-769e-452b-a14b-737d7aca7224-kube-api-access-7fdlg\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-dmjmr\" (UID: \"6bdfcc20-769e-452b-a14b-737d7aca7224\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dmjmr" May 27 19:41:13.216016 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:13.215893 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6bdfcc20-769e-452b-a14b-737d7aca7224-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-dmjmr\" (UID: \"6bdfcc20-769e-452b-a14b-737d7aca7224\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dmjmr" May 27 19:41:13.216016 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:13.215917 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6bdfcc20-769e-452b-a14b-737d7aca7224-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-dmjmr\" (UID: \"6bdfcc20-769e-452b-a14b-737d7aca7224\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dmjmr" May 27 19:41:13.216016 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:13.215948 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6bdfcc20-769e-452b-a14b-737d7aca7224-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-dmjmr\" (UID: \"6bdfcc20-769e-452b-a14b-737d7aca7224\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dmjmr" May 27 19:41:13.216016 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:13.215975 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6bdfcc20-769e-452b-a14b-737d7aca7224-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-dmjmr\" (UID: \"6bdfcc20-769e-452b-a14b-737d7aca7224\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dmjmr" May 27 19:41:13.216456 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:13.216398 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6bdfcc20-769e-452b-a14b-737d7aca7224-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-dmjmr\" (UID: \"6bdfcc20-769e-452b-a14b-737d7aca7224\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dmjmr" May 27 19:41:13.216456 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:13.216432 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6bdfcc20-769e-452b-a14b-737d7aca7224-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-dmjmr\" (UID: \"6bdfcc20-769e-452b-a14b-737d7aca7224\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dmjmr" May 27 19:41:13.216650 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:13.216492 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6bdfcc20-769e-452b-a14b-737d7aca7224-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-dmjmr\" (UID: \"6bdfcc20-769e-452b-a14b-737d7aca7224\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dmjmr" May 27 19:41:13.218646 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:13.218625 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6bdfcc20-769e-452b-a14b-737d7aca7224-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-dmjmr\" (UID: \"6bdfcc20-769e-452b-a14b-737d7aca7224\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dmjmr" May 27 19:41:13.218781 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:13.218759 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6bdfcc20-769e-452b-a14b-737d7aca7224-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-dmjmr\" (UID: \"6bdfcc20-769e-452b-a14b-737d7aca7224\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dmjmr" May 27 19:41:13.223979 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:13.223960 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fdlg\" (UniqueName: \"kubernetes.io/projected/6bdfcc20-769e-452b-a14b-737d7aca7224-kube-api-access-7fdlg\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-dmjmr\" (UID: \"6bdfcc20-769e-452b-a14b-737d7aca7224\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dmjmr" May 27 19:41:13.344782 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:13.344731 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dmjmr" May 27 19:41:13.493686 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:13.493655 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-dmjmr"] May 27 19:41:13.497117 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:41:13.497083 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bdfcc20_769e_452b_a14b_737d7aca7224.slice/crio-2bf1538df0f5610a602ba27e869ecbae400949089fe9b7350bd42ba9bcba9a2b WatchSource:0}: Error finding container 2bf1538df0f5610a602ba27e869ecbae400949089fe9b7350bd42ba9bcba9a2b: Status 404 returned error can't find the container with id 2bf1538df0f5610a602ba27e869ecbae400949089fe9b7350bd42ba9bcba9a2b May 27 19:41:14.292636 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:14.292600 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dmjmr" event={"ID":"6bdfcc20-769e-452b-a14b-737d7aca7224","Type":"ContainerStarted","Data":"2bf1538df0f5610a602ba27e869ecbae400949089fe9b7350bd42ba9bcba9a2b"} May 27 19:41:15.107757 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:15.107724 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:41:17.307617 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:17.307576 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dmjmr" event={"ID":"6bdfcc20-769e-452b-a14b-737d7aca7224","Type":"ContainerStarted","Data":"8d503435a83d88d6fad386949f7ce5531292a25a804e197d0c8d3ed58b30d2af"} May 27 19:41:17.308859 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:17.308833 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m6jpm" event={"ID":"9b1fe773-f1dd-4a6c-9b3c-c91f75389bd8","Type":"ContainerStarted","Data":"0f88bf162035c22eba350c64efe79e347e0e869a1ab37729e77cb60cd56cebe9"} May 27 19:41:22.328482 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:22.328448 2555 generic.go:358] "Generic (PLEG): container finished" podID="6bdfcc20-769e-452b-a14b-737d7aca7224" containerID="8d503435a83d88d6fad386949f7ce5531292a25a804e197d0c8d3ed58b30d2af" exitCode=0 May 27 19:41:22.328919 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:22.328507 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dmjmr" event={"ID":"6bdfcc20-769e-452b-a14b-737d7aca7224","Type":"ContainerDied","Data":"8d503435a83d88d6fad386949f7ce5531292a25a804e197d0c8d3ed58b30d2af"} May 27 19:41:24.337478 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:24.337442 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dmjmr" event={"ID":"6bdfcc20-769e-452b-a14b-737d7aca7224","Type":"ContainerStarted","Data":"bf0e4219dce7cc28731805ddff4d103047baa241b227412746c5a7dacd04f944"} May 27 19:41:24.337992 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:24.337674 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dmjmr" May 27 19:41:24.358751 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:24.358705 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dmjmr" podStartSLOduration=1.331631647 podStartE2EDuration="11.358689754s" podCreationTimestamp="2026-05-27 19:41:13 +0000 UTC" firstStartedPulling="2026-05-27 19:41:13.499624504 +0000 UTC m=+548.536251183" lastFinishedPulling="2026-05-27 19:41:23.526682622 +0000 UTC m=+558.563309290" observedRunningTime="2026-05-27 19:41:24.356620515 +0000 UTC m=+559.393247201" watchObservedRunningTime="2026-05-27 19:41:24.358689754 +0000 UTC m=+559.395316440" May 27 19:41:26.345291 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:26.345232 2555 generic.go:358] "Generic (PLEG): container finished" podID="9b1fe773-f1dd-4a6c-9b3c-c91f75389bd8" containerID="0f88bf162035c22eba350c64efe79e347e0e869a1ab37729e77cb60cd56cebe9" exitCode=0 May 27 19:41:26.345713 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:26.345310 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m6jpm" event={"ID":"9b1fe773-f1dd-4a6c-9b3c-c91f75389bd8","Type":"ContainerDied","Data":"0f88bf162035c22eba350c64efe79e347e0e869a1ab37729e77cb60cd56cebe9"} May 27 19:41:27.350013 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:27.349982 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m6jpm" event={"ID":"9b1fe773-f1dd-4a6c-9b3c-c91f75389bd8","Type":"ContainerStarted","Data":"03a4dc766d2a7d242aaeac172b536dbe56b3df7b1aacd38e05d04c72189594b4"} May 27 19:41:27.350456 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:27.350194 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m6jpm" May 27 19:41:27.373566 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:27.373529 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m6jpm" podStartSLOduration=1.602549257 podStartE2EDuration="17.373519454s" podCreationTimestamp="2026-05-27 19:41:10 +0000 UTC" firstStartedPulling="2026-05-27 19:41:10.795561855 +0000 UTC m=+545.832188520" lastFinishedPulling="2026-05-27 19:41:26.566532044 +0000 UTC m=+561.603158717" observedRunningTime="2026-05-27 19:41:27.371931983 +0000 UTC m=+562.408558671" watchObservedRunningTime="2026-05-27 19:41:27.373519454 +0000 UTC m=+562.410146141" May 27 19:41:35.353595 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:35.353560 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dmjmr" May 27 19:41:38.367477 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:38.367445 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m6jpm" May 27 19:41:53.802464 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:41:53.802425 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:42:26.906381 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:42:26.906291 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:42:36.905812 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:42:36.905765 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:42:45.700932 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:42:45.700898 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:42:57.199766 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:42:57.199730 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:43:05.407023 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:43:05.406984 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:43:16.310162 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:43:16.310124 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:44:28.210668 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:44:28.210595 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:44:44.301126 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:44:44.301093 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:45:00.142793 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:45:00.142756 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29665185-h5tpw"] May 27 19:45:00.144986 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:45:00.144968 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29665185-h5tpw" May 27 19:45:00.147384 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:45:00.147364 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-5h85p\"" May 27 19:45:00.153594 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:45:00.153572 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29665185-h5tpw"] May 27 19:45:00.223602 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:45:00.223575 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2lgt\" (UniqueName: \"kubernetes.io/projected/45e3ced5-ded7-45ef-9af0-45681f030fa4-kube-api-access-r2lgt\") pod \"maas-api-key-cleanup-29665185-h5tpw\" (UID: \"45e3ced5-ded7-45ef-9af0-45681f030fa4\") " pod="opendatahub/maas-api-key-cleanup-29665185-h5tpw" May 27 19:45:00.324803 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:45:00.324776 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r2lgt\" (UniqueName: \"kubernetes.io/projected/45e3ced5-ded7-45ef-9af0-45681f030fa4-kube-api-access-r2lgt\") pod \"maas-api-key-cleanup-29665185-h5tpw\" (UID: \"45e3ced5-ded7-45ef-9af0-45681f030fa4\") " pod="opendatahub/maas-api-key-cleanup-29665185-h5tpw" May 27 19:45:00.332444 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:45:00.332417 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2lgt\" (UniqueName: \"kubernetes.io/projected/45e3ced5-ded7-45ef-9af0-45681f030fa4-kube-api-access-r2lgt\") pod \"maas-api-key-cleanup-29665185-h5tpw\" (UID: \"45e3ced5-ded7-45ef-9af0-45681f030fa4\") " pod="opendatahub/maas-api-key-cleanup-29665185-h5tpw" May 27 19:45:00.455251 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:45:00.455165 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29665185-h5tpw" May 27 19:45:00.577751 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:45:00.577721 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29665185-h5tpw"] May 27 19:45:00.580508 ip-10-0-139-51 kubenswrapper[2555]: W0527 19:45:00.580478 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45e3ced5_ded7_45ef_9af0_45681f030fa4.slice/crio-b9090be2ccafa334bb83bc59eed28ff0f276c8ccd8af6d3a0598afe5380e809a WatchSource:0}: Error finding container b9090be2ccafa334bb83bc59eed28ff0f276c8ccd8af6d3a0598afe5380e809a: Status 404 returned error can't find the container with id b9090be2ccafa334bb83bc59eed28ff0f276c8ccd8af6d3a0598afe5380e809a May 27 19:45:00.582172 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:45:00.582154 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 19:45:01.035410 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:45:01.035376 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29665185-h5tpw" event={"ID":"45e3ced5-ded7-45ef-9af0-45681f030fa4","Type":"ContainerStarted","Data":"b9090be2ccafa334bb83bc59eed28ff0f276c8ccd8af6d3a0598afe5380e809a"} May 27 19:45:04.047308 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:45:04.047255 2555 generic.go:358] "Generic (PLEG): container finished" podID="45e3ced5-ded7-45ef-9af0-45681f030fa4" containerID="ecb50cde7e6b941bbe52d2a7f4c351480e35919c887800cdda144cb662c89b81" exitCode=0 May 27 19:45:04.047308 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:45:04.047295 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29665185-h5tpw" event={"ID":"45e3ced5-ded7-45ef-9af0-45681f030fa4","Type":"ContainerDied","Data":"ecb50cde7e6b941bbe52d2a7f4c351480e35919c887800cdda144cb662c89b81"} May 27 19:45:05.177885 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:45:05.177863 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29665185-h5tpw" May 27 19:45:05.269545 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:45:05.269516 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2lgt\" (UniqueName: \"kubernetes.io/projected/45e3ced5-ded7-45ef-9af0-45681f030fa4-kube-api-access-r2lgt\") pod \"45e3ced5-ded7-45ef-9af0-45681f030fa4\" (UID: \"45e3ced5-ded7-45ef-9af0-45681f030fa4\") " May 27 19:45:05.271687 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:45:05.271666 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45e3ced5-ded7-45ef-9af0-45681f030fa4-kube-api-access-r2lgt" (OuterVolumeSpecName: "kube-api-access-r2lgt") pod "45e3ced5-ded7-45ef-9af0-45681f030fa4" (UID: "45e3ced5-ded7-45ef-9af0-45681f030fa4"). InnerVolumeSpecName "kube-api-access-r2lgt". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 19:45:05.370330 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:45:05.370257 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2lgt\" (UniqueName: \"kubernetes.io/projected/45e3ced5-ded7-45ef-9af0-45681f030fa4-kube-api-access-r2lgt\") on node \"ip-10-0-139-51.ec2.internal\" DevicePath \"\"" May 27 19:45:06.054313 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:45:06.054259 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29665185-h5tpw" event={"ID":"45e3ced5-ded7-45ef-9af0-45681f030fa4","Type":"ContainerDied","Data":"b9090be2ccafa334bb83bc59eed28ff0f276c8ccd8af6d3a0598afe5380e809a"} May 27 19:45:06.054313 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:45:06.054310 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b9090be2ccafa334bb83bc59eed28ff0f276c8ccd8af6d3a0598afe5380e809a" May 27 19:45:06.054515 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:45:06.054336 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29665185-h5tpw" May 27 19:45:21.905866 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:45:21.905825 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:45:39.508181 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:45:39.508088 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:45:52.908683 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:45:52.908634 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:46:09.701186 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:46:09.701151 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:47:05.106528 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:47:05.106439 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:47:14.000656 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:47:14.000621 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:47:30.304217 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:47:30.304185 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:47:39.011345 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:47:39.011306 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:47:57.106036 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:47:57.106001 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:48:05.104387 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:48:05.104348 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:48:37.626833 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:48:37.626745 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:48:45.710443 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:48:45.710404 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:48:54.298155 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:48:54.298116 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:49:03.108829 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:49:03.108795 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:49:11.604658 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:49:11.604623 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:49:28.315007 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:49:28.314968 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:49:41.509869 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:49:41.509802 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:50:28.506457 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:50:28.506374 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:50:33.513753 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:50:33.513715 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:50:41.621102 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:50:41.621070 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:50:49.610747 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:50:49.610716 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:51:00.199232 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:51:00.199192 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:51:07.405144 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:51:07.405108 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:51:16.699761 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:51:16.699723 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:51:25.807910 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:51:25.807821 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:51:34.219046 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:51:34.219011 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:51:42.603911 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:51:42.603873 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:51:51.911058 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:51:51.911024 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:52:00.314753 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:52:00.314716 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:52:09.514127 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:52:09.514083 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:52:17.633077 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:52:17.633042 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:52:27.524097 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:52:27.524062 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:52:34.708116 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:52:34.708082 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:52:44.611581 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:52:44.611538 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:52:53.502217 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:52:53.502174 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:55:10.579096 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:55:10.579065 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:55:15.782072 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:55:15.782036 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:55:41.879369 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:55:41.879328 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:55:47.970806 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:55:47.970773 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:55:58.288521 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:55:58.288447 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:56:08.382097 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:56:08.382060 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:56:17.478364 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:56:17.478327 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:56:28.175582 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:56:28.175549 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:56:36.378322 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:56:36.378257 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:56:46.971775 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:56:46.971741 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:56:56.285842 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:56:56.285797 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:57:05.968434 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:57:05.968402 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:57:14.968636 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:57:14.968599 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:57:20.472553 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:57:20.472515 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:57:48.577112 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:57:48.577078 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:58:30.576115 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:58:30.576078 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:58:39.476382 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:58:39.476342 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:58:47.679304 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:58:47.679251 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:58:56.779829 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:58:56.779745 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:59:04.972421 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:59:04.972386 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:59:16.075933 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:59:16.075898 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:59:24.971392 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:59:24.971361 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:59:32.975788 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:59:32.975748 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:59:40.874677 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:59:40.874644 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:59:48.772904 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:59:48.772870 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 19:59:58.372476 ip-10-0-139-51 kubenswrapper[2555]: I0527 19:59:58.372436 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 20:00:10.167877 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:00:10.167847 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 20:00:28.671778 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:00:28.671689 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 20:00:36.471017 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:00:36.470976 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 20:00:45.572813 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:00:45.572775 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 20:00:53.873248 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:00:53.873210 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 20:01:10.773870 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:01:10.773833 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 20:01:18.971297 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:01:18.971244 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 20:01:28.277743 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:01:28.277703 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 20:01:36.475622 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:01:36.475583 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 20:01:45.572113 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:01:45.572078 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 20:01:53.577428 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:01:53.577394 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 20:02:02.768854 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:02:02.768814 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 20:02:15.867260 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:02:15.867228 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 20:02:24.769564 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:02:24.769532 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 20:02:37.776110 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:02:37.776072 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 20:02:47.866571 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:02:47.866537 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 20:02:55.871215 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:02:55.871179 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 20:03:03.472531 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:03:03.472495 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 20:03:10.584084 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:03:10.584046 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 20:03:28.478207 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:03:28.478107 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 20:03:36.771841 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:03:36.771809 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 20:03:45.875377 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:03:45.875345 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 20:03:54.079560 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:03:54.079521 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 20:04:17.370611 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:17.370572 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 20:04:30.373388 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:30.373351 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ndlpn"] May 27 20:04:37.455399 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:37.455371 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-58jfn_eefbf6a3-8585-4f25-84e6-ca6cb5df2e6a/manager/0.log" May 27 20:04:37.715206 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:37.715141 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29665185-h5tpw_45e3ced5-ded7-45ef-9af0-45681f030fa4/cleanup/0.log" May 27 20:04:38.091921 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:38.091881 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-psnv9_462a870e-b9ed-4c02-b1cb-165cda4237d5/manager/2.log" May 27 20:04:38.305845 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:38.305815 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f485759dc-9bhrb_e6819017-76fe-410e-b890-e02cd5c48f3a/manager/0.log" May 27 20:04:40.352882 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:40.352849 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-ndlpn_93bc5f03-ae8c-46a0-814d-64a384dc43d6/limitador/0.log" May 27 20:04:40.467398 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:40.467367 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-tgk74_6ce7407b-3845-42c2-b3b5-4e4a3f9a0588/manager/0.log" May 27 20:04:40.913820 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:40.913778 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-x5xzn_01b14747-6035-4762-b007-1f8d3a43d4ca/discovery/0.log" May 27 20:04:41.014541 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:41.014516 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6c44b8656c-4b4z5_3c2431d5-aa36-41a6-ae4a-d4bf9e378be1/kube-auth-proxy/0.log" May 27 20:04:41.334685 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:41.334654 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-xgqxb_bfc843d8-8c38-4f29-8aaa-8376ac8cb448/payload-processing/0.log" May 27 20:04:41.994360 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:41.994329 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-dmjmr_6bdfcc20-769e-452b-a14b-737d7aca7224/storage-initializer/0.log" May 27 20:04:42.001218 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:42.001183 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-dmjmr_6bdfcc20-769e-452b-a14b-737d7aca7224/main/0.log" May 27 20:04:42.322246 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:42.322212 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-m6jpm_9b1fe773-f1dd-4a6c-9b3c-c91f75389bd8/storage-initializer/0.log" May 27 20:04:42.329533 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:42.329506 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-m6jpm_9b1fe773-f1dd-4a6c-9b3c-c91f75389bd8/main/0.log" May 27 20:04:48.640453 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:48.640421 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lknm5_e375ea8a-c7d3-4c35-a901-a5e9bf859073/global-pull-secret-syncer/0.log" May 27 20:04:48.761092 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:48.761065 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kcxhv_88051d01-7dcf-48a9-b39a-b5f50cb8df95/konnectivity-agent/0.log" May 27 20:04:48.832370 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:48.832336 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-51.ec2.internal_474a050b831840f986e5ea7c3b5dfc5b/haproxy/0.log" May 27 20:04:53.418835 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:53.418806 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-ndlpn_93bc5f03-ae8c-46a0-814d-64a384dc43d6/limitador/0.log" May 27 20:04:53.519111 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:53.519077 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-tgk74_6ce7407b-3845-42c2-b3b5-4e4a3f9a0588/manager/0.log" May 27 20:04:55.415725 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:55.415652 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f7d6l_18382d20-71bd-451e-b322-2121a3b51fb3/node-exporter/0.log" May 27 20:04:55.432628 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:55.432602 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f7d6l_18382d20-71bd-451e-b322-2121a3b51fb3/kube-rbac-proxy/0.log" May 27 20:04:55.450188 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:55.450170 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f7d6l_18382d20-71bd-451e-b322-2121a3b51fb3/init-textfile/0.log" May 27 20:04:57.133097 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:57.133065 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-vbz74_54e71063-a75f-4ebc-8cdb-84280227744e/networking-console-plugin/0.log" May 27 20:04:57.520301 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:57.520210 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9lbxp/perf-node-gather-daemonset-ggrmt"] May 27 20:04:57.520590 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:57.520578 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45e3ced5-ded7-45ef-9af0-45681f030fa4" containerName="cleanup" May 27 20:04:57.520632 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:57.520593 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="45e3ced5-ded7-45ef-9af0-45681f030fa4" containerName="cleanup" May 27 20:04:57.520665 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:57.520649 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="45e3ced5-ded7-45ef-9af0-45681f030fa4" containerName="cleanup" May 27 20:04:57.523726 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:57.523705 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9lbxp/perf-node-gather-daemonset-ggrmt" May 27 20:04:57.526107 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:57.526082 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9lbxp\"/\"kube-root-ca.crt\"" May 27 20:04:57.526107 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:57.526098 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9lbxp\"/\"openshift-service-ca.crt\"" May 27 20:04:57.526252 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:57.526142 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9lbxp\"/\"default-dockercfg-6x8sd\"" May 27 20:04:57.531696 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:57.531676 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9lbxp/perf-node-gather-daemonset-ggrmt"] May 27 20:04:57.604858 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:57.604829 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/37def2e1-45fa-4584-8c7f-60c757e0df3c-podres\") pod \"perf-node-gather-daemonset-ggrmt\" (UID: \"37def2e1-45fa-4584-8c7f-60c757e0df3c\") " pod="openshift-must-gather-9lbxp/perf-node-gather-daemonset-ggrmt" May 27 20:04:57.604858 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:57.604862 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/37def2e1-45fa-4584-8c7f-60c757e0df3c-sys\") pod \"perf-node-gather-daemonset-ggrmt\" (UID: \"37def2e1-45fa-4584-8c7f-60c757e0df3c\") " pod="openshift-must-gather-9lbxp/perf-node-gather-daemonset-ggrmt" May 27 20:04:57.605048 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:57.604890 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/37def2e1-45fa-4584-8c7f-60c757e0df3c-lib-modules\") pod \"perf-node-gather-daemonset-ggrmt\" (UID: \"37def2e1-45fa-4584-8c7f-60c757e0df3c\") " pod="openshift-must-gather-9lbxp/perf-node-gather-daemonset-ggrmt" May 27 20:04:57.605048 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:57.604987 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmm77\" (UniqueName: \"kubernetes.io/projected/37def2e1-45fa-4584-8c7f-60c757e0df3c-kube-api-access-gmm77\") pod \"perf-node-gather-daemonset-ggrmt\" (UID: \"37def2e1-45fa-4584-8c7f-60c757e0df3c\") " pod="openshift-must-gather-9lbxp/perf-node-gather-daemonset-ggrmt" May 27 20:04:57.605048 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:57.605026 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/37def2e1-45fa-4584-8c7f-60c757e0df3c-proc\") pod \"perf-node-gather-daemonset-ggrmt\" (UID: \"37def2e1-45fa-4584-8c7f-60c757e0df3c\") " pod="openshift-must-gather-9lbxp/perf-node-gather-daemonset-ggrmt" May 27 20:04:57.705794 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:57.705756 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/37def2e1-45fa-4584-8c7f-60c757e0df3c-podres\") pod \"perf-node-gather-daemonset-ggrmt\" (UID: \"37def2e1-45fa-4584-8c7f-60c757e0df3c\") " pod="openshift-must-gather-9lbxp/perf-node-gather-daemonset-ggrmt" May 27 20:04:57.705959 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:57.705812 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/37def2e1-45fa-4584-8c7f-60c757e0df3c-sys\") pod \"perf-node-gather-daemonset-ggrmt\" (UID: \"37def2e1-45fa-4584-8c7f-60c757e0df3c\") " pod="openshift-must-gather-9lbxp/perf-node-gather-daemonset-ggrmt" May 27 20:04:57.705959 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:57.705845 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/37def2e1-45fa-4584-8c7f-60c757e0df3c-lib-modules\") pod \"perf-node-gather-daemonset-ggrmt\" (UID: \"37def2e1-45fa-4584-8c7f-60c757e0df3c\") " pod="openshift-must-gather-9lbxp/perf-node-gather-daemonset-ggrmt" May 27 20:04:57.705959 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:57.705882 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/37def2e1-45fa-4584-8c7f-60c757e0df3c-podres\") pod \"perf-node-gather-daemonset-ggrmt\" (UID: \"37def2e1-45fa-4584-8c7f-60c757e0df3c\") " pod="openshift-must-gather-9lbxp/perf-node-gather-daemonset-ggrmt" May 27 20:04:57.705959 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:57.705889 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gmm77\" (UniqueName: \"kubernetes.io/projected/37def2e1-45fa-4584-8c7f-60c757e0df3c-kube-api-access-gmm77\") pod \"perf-node-gather-daemonset-ggrmt\" (UID: \"37def2e1-45fa-4584-8c7f-60c757e0df3c\") " pod="openshift-must-gather-9lbxp/perf-node-gather-daemonset-ggrmt" May 27 20:04:57.705959 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:57.705935 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/37def2e1-45fa-4584-8c7f-60c757e0df3c-sys\") pod \"perf-node-gather-daemonset-ggrmt\" (UID: \"37def2e1-45fa-4584-8c7f-60c757e0df3c\") " pod="openshift-must-gather-9lbxp/perf-node-gather-daemonset-ggrmt" May 27 20:04:57.706119 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:57.705963 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/37def2e1-45fa-4584-8c7f-60c757e0df3c-proc\") pod \"perf-node-gather-daemonset-ggrmt\" (UID: \"37def2e1-45fa-4584-8c7f-60c757e0df3c\") " pod="openshift-must-gather-9lbxp/perf-node-gather-daemonset-ggrmt" May 27 20:04:57.706119 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:57.705988 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/37def2e1-45fa-4584-8c7f-60c757e0df3c-lib-modules\") pod \"perf-node-gather-daemonset-ggrmt\" (UID: \"37def2e1-45fa-4584-8c7f-60c757e0df3c\") " pod="openshift-must-gather-9lbxp/perf-node-gather-daemonset-ggrmt" May 27 20:04:57.706119 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:57.706004 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/37def2e1-45fa-4584-8c7f-60c757e0df3c-proc\") pod \"perf-node-gather-daemonset-ggrmt\" (UID: \"37def2e1-45fa-4584-8c7f-60c757e0df3c\") " pod="openshift-must-gather-9lbxp/perf-node-gather-daemonset-ggrmt" May 27 20:04:57.713441 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:57.713417 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmm77\" (UniqueName: \"kubernetes.io/projected/37def2e1-45fa-4584-8c7f-60c757e0df3c-kube-api-access-gmm77\") pod \"perf-node-gather-daemonset-ggrmt\" (UID: \"37def2e1-45fa-4584-8c7f-60c757e0df3c\") " pod="openshift-must-gather-9lbxp/perf-node-gather-daemonset-ggrmt" May 27 20:04:57.835309 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:57.835250 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9lbxp/perf-node-gather-daemonset-ggrmt" May 27 20:04:57.966205 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:57.966174 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9lbxp/perf-node-gather-daemonset-ggrmt"] May 27 20:04:57.968556 ip-10-0-139-51 kubenswrapper[2555]: W0527 20:04:57.968527 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod37def2e1_45fa_4584_8c7f_60c757e0df3c.slice/crio-2e1fb18d97acb480210c562bbb81020cf90c31c0d9afd6669e40f67fd0c865d4 WatchSource:0}: Error finding container 2e1fb18d97acb480210c562bbb81020cf90c31c0d9afd6669e40f67fd0c865d4: Status 404 returned error can't find the container with id 2e1fb18d97acb480210c562bbb81020cf90c31c0d9afd6669e40f67fd0c865d4 May 27 20:04:57.970150 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:57.970135 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 20:04:57.981383 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:57.981359 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9lbxp/perf-node-gather-daemonset-ggrmt" event={"ID":"37def2e1-45fa-4584-8c7f-60c757e0df3c","Type":"ContainerStarted","Data":"2e1fb18d97acb480210c562bbb81020cf90c31c0d9afd6669e40f67fd0c865d4"} May 27 20:04:58.717283 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:58.717231 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-q8fkz_d4509ba7-3326-4d3f-9525-f2f4c10cf873/volume-data-source-validator/0.log" May 27 20:04:58.985791 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:58.985710 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9lbxp/perf-node-gather-daemonset-ggrmt" event={"ID":"37def2e1-45fa-4584-8c7f-60c757e0df3c","Type":"ContainerStarted","Data":"82a0417c6f01ad378cc2b138246303be974ea33b2b3746905ff01e5983c0a5b0"} May 27 20:04:58.985929 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:58.985832 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9lbxp/perf-node-gather-daemonset-ggrmt" May 27 20:04:59.001976 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:59.001921 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-9lbxp/perf-node-gather-daemonset-ggrmt" podStartSLOduration=2.001906537 podStartE2EDuration="2.001906537s" podCreationTimestamp="2026-05-27 20:04:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 20:04:58.999976392 +0000 UTC m=+1974.036603079" watchObservedRunningTime="2026-05-27 20:04:59.001906537 +0000 UTC m=+1974.038533223" May 27 20:04:59.488625 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:59.488593 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-c9ls5_fa63b18f-db50-412b-9280-777369bf9ded/dns/0.log" May 27 20:04:59.506102 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:59.506072 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-c9ls5_fa63b18f-db50-412b-9280-777369bf9ded/kube-rbac-proxy/0.log" May 27 20:04:59.563684 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:04:59.563660 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2hvwq_e7cb0741-7765-422b-8269-5a430024b259/dns-node-resolver/0.log" May 27 20:05:00.063376 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:05:00.063345 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5546b79695-kzwjl_88f1d61c-af5f-44cc-9b7e-e82747bf21c4/registry/0.log" May 27 20:05:00.122162 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:05:00.122135 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-l6kn5_bf52ea50-d810-4b2b-bde4-f58f4cb97288/node-ca/0.log" May 27 20:05:01.066678 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:05:01.066645 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-x5xzn_01b14747-6035-4762-b007-1f8d3a43d4ca/discovery/0.log" May 27 20:05:01.083767 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:05:01.083735 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6c44b8656c-4b4z5_3c2431d5-aa36-41a6-ae4a-d4bf9e378be1/kube-auth-proxy/0.log" May 27 20:05:01.242330 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:05:01.242302 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-xgqxb_bfc843d8-8c38-4f29-8aaa-8376ac8cb448/payload-processing/0.log" May 27 20:05:01.773399 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:05:01.773362 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bhbv4_a2be77ab-d596-46ef-8967-88c344e07fb4/serve-healthcheck-canary/0.log" May 27 20:05:02.237165 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:05:02.237133 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-29ds8_9159ef26-3fcb-4525-98d8-6df93075402a/kube-rbac-proxy/0.log" May 27 20:05:02.253953 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:05:02.253918 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-29ds8_9159ef26-3fcb-4525-98d8-6df93075402a/exporter/0.log" May 27 20:05:02.271978 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:05:02.271952 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-29ds8_9159ef26-3fcb-4525-98d8-6df93075402a/extractor/0.log" May 27 20:05:04.290824 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:05:04.290795 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-58jfn_eefbf6a3-8585-4f25-84e6-ca6cb5df2e6a/manager/0.log" May 27 20:05:04.352671 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:05:04.352642 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29665185-h5tpw_45e3ced5-ded7-45ef-9af0-45681f030fa4/cleanup/0.log" May 27 20:05:04.503621 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:05:04.503590 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-psnv9_462a870e-b9ed-4c02-b1cb-165cda4237d5/manager/1.log" May 27 20:05:04.525182 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:05:04.525153 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-psnv9_462a870e-b9ed-4c02-b1cb-165cda4237d5/manager/2.log" May 27 20:05:04.569859 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:05:04.569834 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f485759dc-9bhrb_e6819017-76fe-410e-b890-e02cd5c48f3a/manager/0.log" May 27 20:05:04.998221 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:05:04.998151 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9lbxp/perf-node-gather-daemonset-ggrmt" May 27 20:05:12.016762 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:05:12.016720 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2bgsc_d14eff58-e510-4dc2-a0ac-fb3ba83923bc/kube-multus/0.log" May 27 20:05:12.202280 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:05:12.202251 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jmfgh_e6ba391e-3a4a-4ab7-a6a0-ab1069701c90/kube-multus-additional-cni-plugins/0.log" May 27 20:05:12.220972 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:05:12.220943 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jmfgh_e6ba391e-3a4a-4ab7-a6a0-ab1069701c90/egress-router-binary-copy/0.log" May 27 20:05:12.238334 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:05:12.238308 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jmfgh_e6ba391e-3a4a-4ab7-a6a0-ab1069701c90/cni-plugins/0.log" May 27 20:05:12.256133 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:05:12.256107 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jmfgh_e6ba391e-3a4a-4ab7-a6a0-ab1069701c90/bond-cni-plugin/0.log" May 27 20:05:12.274000 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:05:12.273949 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jmfgh_e6ba391e-3a4a-4ab7-a6a0-ab1069701c90/routeoverride-cni/0.log" May 27 20:05:12.291925 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:05:12.291905 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jmfgh_e6ba391e-3a4a-4ab7-a6a0-ab1069701c90/whereabouts-cni-bincopy/0.log" May 27 20:05:12.309620 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:05:12.309602 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jmfgh_e6ba391e-3a4a-4ab7-a6a0-ab1069701c90/whereabouts-cni/0.log" May 27 20:05:12.528018 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:05:12.527942 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nf6f5_34c87eb0-84f0-4f4c-b319-b6486fd20f52/network-metrics-daemon/0.log" May 27 20:05:12.544434 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:05:12.544400 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nf6f5_34c87eb0-84f0-4f4c-b319-b6486fd20f52/kube-rbac-proxy/0.log" May 27 20:05:13.423904 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:05:13.423832 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pth57_546d5521-7b50-46d6-829d-cbbe35bf130a/ovn-controller/0.log" May 27 20:05:13.456227 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:05:13.456198 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pth57_546d5521-7b50-46d6-829d-cbbe35bf130a/ovn-acl-logging/0.log" May 27 20:05:13.472970 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:05:13.472946 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pth57_546d5521-7b50-46d6-829d-cbbe35bf130a/kube-rbac-proxy-node/0.log" May 27 20:05:13.490120 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:05:13.490091 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pth57_546d5521-7b50-46d6-829d-cbbe35bf130a/kube-rbac-proxy-ovn-metrics/0.log" May 27 20:05:13.505830 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:05:13.505805 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pth57_546d5521-7b50-46d6-829d-cbbe35bf130a/northd/0.log" May 27 20:05:13.522643 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:05:13.522622 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pth57_546d5521-7b50-46d6-829d-cbbe35bf130a/nbdb/0.log" May 27 20:05:13.539832 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:05:13.539809 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pth57_546d5521-7b50-46d6-829d-cbbe35bf130a/sbdb/0.log" May 27 20:05:13.719244 ip-10-0-139-51 kubenswrapper[2555]: I0527 20:05:13.719174 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pth57_546d5521-7b50-46d6-829d-cbbe35bf130a/ovnkube-controller/0.log"