May 21 20:38:19.477829 ip-10-0-131-158 systemd[1]: Starting Kubernetes Kubelet... May 21 20:38:20.023529 ip-10-0-131-158 kubenswrapper[2570]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 20:38:20.023529 ip-10-0-131-158 kubenswrapper[2570]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 21 20:38:20.023529 ip-10-0-131-158 kubenswrapper[2570]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 20:38:20.023529 ip-10-0-131-158 kubenswrapper[2570]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 21 20:38:20.023529 ip-10-0-131-158 kubenswrapper[2570]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 20:38:20.025236 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.025133 2570 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 21 20:38:20.028135 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028116 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 20:38:20.028135 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028135 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 20:38:20.028203 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028140 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 20:38:20.028203 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028143 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 20:38:20.028203 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028146 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 20:38:20.028203 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028149 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 20:38:20.028203 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028151 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 20:38:20.028203 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028154 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 20:38:20.028203 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028157 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 20:38:20.028203 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028159 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 20:38:20.028203 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028162 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 20:38:20.028203 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028164 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 20:38:20.028203 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028167 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 20:38:20.028203 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028169 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 20:38:20.028203 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028172 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 20:38:20.028203 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028174 2570 feature_gate.go:328] unrecognized feature gate: Example2 May 21 20:38:20.028203 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028177 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 20:38:20.028203 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028179 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 20:38:20.028203 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028182 2570 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 20:38:20.028203 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028185 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 20:38:20.028203 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028193 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 20:38:20.028203 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028195 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 20:38:20.028801 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028198 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 20:38:20.028801 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028200 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 20:38:20.028801 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028203 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 20:38:20.028801 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028206 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 20:38:20.028801 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028209 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 20:38:20.028801 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028211 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 20:38:20.028801 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028214 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 20:38:20.028801 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028217 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 20:38:20.028801 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028220 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 20:38:20.028801 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028225 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 20:38:20.028801 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028228 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 20:38:20.028801 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028231 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 20:38:20.028801 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028234 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 20:38:20.028801 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028237 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 20:38:20.028801 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028239 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 20:38:20.028801 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028243 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 20:38:20.028801 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028246 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 20:38:20.028801 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028250 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 20:38:20.028801 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028305 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 20:38:20.029262 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028310 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 20:38:20.029262 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028313 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 20:38:20.029262 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028316 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 20:38:20.029262 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028319 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 20:38:20.029262 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028321 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 20:38:20.029262 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028324 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 20:38:20.029262 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028327 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 20:38:20.029262 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028329 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 20:38:20.029262 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028332 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 20:38:20.029262 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028335 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 20:38:20.029262 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028337 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 20:38:20.029262 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028339 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 20:38:20.029262 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028342 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 20:38:20.029262 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028345 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 20:38:20.029262 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028349 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 20:38:20.029262 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028351 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 20:38:20.029262 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028354 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 20:38:20.029262 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028357 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 20:38:20.029262 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028361 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 20:38:20.029262 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028363 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 20:38:20.029765 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028366 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 20:38:20.029765 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028368 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 20:38:20.029765 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028371 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 20:38:20.029765 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028373 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 20:38:20.029765 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028376 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 20:38:20.029765 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028386 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 20:38:20.029765 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028388 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 20:38:20.029765 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028391 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 20:38:20.029765 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028393 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 20:38:20.029765 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028396 2570 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 20:38:20.029765 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028399 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 20:38:20.029765 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028402 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 20:38:20.029765 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028407 2570 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 20:38:20.029765 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028410 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 20:38:20.029765 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028413 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 20:38:20.029765 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028416 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 20:38:20.029765 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028418 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 20:38:20.029765 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028421 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 20:38:20.029765 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028424 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 20:38:20.029765 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028426 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 20:38:20.030309 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028429 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 20:38:20.030309 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028431 2570 feature_gate.go:328] unrecognized feature gate: Example May 21 20:38:20.030309 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028434 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 20:38:20.030309 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028436 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 20:38:20.030309 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028439 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 20:38:20.030309 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028877 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 20:38:20.030309 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028883 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 20:38:20.030309 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028886 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 20:38:20.030309 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028889 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 20:38:20.030309 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028892 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 20:38:20.030309 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028895 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 20:38:20.030309 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028897 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 20:38:20.030309 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028900 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 20:38:20.030309 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028903 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 20:38:20.030309 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028905 2570 feature_gate.go:328] unrecognized feature gate: Example2 May 21 20:38:20.030309 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028908 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 20:38:20.030309 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028910 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 20:38:20.030309 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028913 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 20:38:20.030309 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028915 2570 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 20:38:20.030309 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028919 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 20:38:20.030811 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028923 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 20:38:20.030811 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028926 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 20:38:20.030811 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028929 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 20:38:20.030811 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028932 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 20:38:20.030811 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028934 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 20:38:20.030811 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028937 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 20:38:20.030811 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028939 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 20:38:20.030811 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028942 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 20:38:20.030811 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028944 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 20:38:20.030811 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028946 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 20:38:20.030811 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028949 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 20:38:20.030811 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028951 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 20:38:20.030811 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028954 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 20:38:20.030811 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028956 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 20:38:20.030811 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028959 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 20:38:20.030811 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028961 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 20:38:20.030811 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028964 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 20:38:20.030811 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028967 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 20:38:20.030811 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028970 2570 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 20:38:20.030811 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028973 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 20:38:20.031297 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028976 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 20:38:20.031297 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028979 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 20:38:20.031297 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028981 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 20:38:20.031297 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028984 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 20:38:20.031297 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028986 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 20:38:20.031297 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028989 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 20:38:20.031297 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028991 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 20:38:20.031297 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028993 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 20:38:20.031297 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028996 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 20:38:20.031297 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.028998 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 20:38:20.031297 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029001 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 20:38:20.031297 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029004 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 20:38:20.031297 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029006 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 20:38:20.031297 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029009 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 20:38:20.031297 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029015 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 20:38:20.031297 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029018 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 20:38:20.031297 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029020 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 20:38:20.031297 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029022 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 20:38:20.031297 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029026 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 20:38:20.031297 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029028 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 20:38:20.031797 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029031 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 20:38:20.031797 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029033 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 20:38:20.031797 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029035 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 20:38:20.031797 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029038 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 20:38:20.031797 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029040 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 20:38:20.031797 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029043 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 20:38:20.031797 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029045 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 20:38:20.031797 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029048 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 20:38:20.031797 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029051 2570 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 20:38:20.031797 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029053 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 20:38:20.031797 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029056 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 20:38:20.031797 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029059 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 20:38:20.031797 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029062 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 20:38:20.031797 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029064 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 20:38:20.031797 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029066 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 20:38:20.031797 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029069 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 20:38:20.031797 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029071 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 20:38:20.031797 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029074 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 20:38:20.031797 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029076 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 20:38:20.032265 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029079 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 20:38:20.032265 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029081 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 20:38:20.032265 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029084 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 20:38:20.032265 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029086 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 20:38:20.032265 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029089 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 20:38:20.032265 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029091 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 20:38:20.032265 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029093 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 20:38:20.032265 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029096 2570 feature_gate.go:328] unrecognized feature gate: Example May 21 20:38:20.032265 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029099 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 20:38:20.032265 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029101 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 20:38:20.032265 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029105 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 20:38:20.032265 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029109 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 20:38:20.032265 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029188 2570 flags.go:64] FLAG: --address="0.0.0.0" May 21 20:38:20.032265 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029199 2570 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 21 20:38:20.032265 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029206 2570 flags.go:64] FLAG: --anonymous-auth="true" May 21 20:38:20.032265 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029211 2570 flags.go:64] FLAG: --application-metrics-count-limit="100" May 21 20:38:20.032265 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029215 2570 flags.go:64] FLAG: --authentication-token-webhook="false" May 21 20:38:20.032265 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029218 2570 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 21 20:38:20.032265 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029222 2570 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 21 20:38:20.032265 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029227 2570 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 21 20:38:20.032265 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029231 2570 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 21 20:38:20.032812 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029234 2570 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 21 20:38:20.032812 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029237 2570 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 21 20:38:20.032812 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029241 2570 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 21 20:38:20.032812 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029244 2570 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 21 20:38:20.032812 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029247 2570 flags.go:64] FLAG: --cgroup-root="" May 21 20:38:20.032812 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029250 2570 flags.go:64] FLAG: --cgroups-per-qos="true" May 21 20:38:20.032812 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029253 2570 flags.go:64] FLAG: --client-ca-file="" May 21 20:38:20.032812 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029256 2570 flags.go:64] FLAG: --cloud-config="" May 21 20:38:20.032812 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029258 2570 flags.go:64] FLAG: --cloud-provider="external" May 21 20:38:20.032812 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029261 2570 flags.go:64] FLAG: --cluster-dns="[]" May 21 20:38:20.032812 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029266 2570 flags.go:64] FLAG: --cluster-domain="" May 21 20:38:20.032812 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029270 2570 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 21 20:38:20.032812 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029273 2570 flags.go:64] FLAG: --config-dir="" May 21 20:38:20.032812 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029276 2570 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 21 20:38:20.032812 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029279 2570 flags.go:64] FLAG: --container-log-max-files="5" May 21 20:38:20.032812 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029283 2570 flags.go:64] FLAG: --container-log-max-size="10Mi" May 21 20:38:20.032812 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029287 2570 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 21 20:38:20.032812 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029290 2570 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 21 20:38:20.032812 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029294 2570 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 21 20:38:20.032812 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029297 2570 flags.go:64] FLAG: --contention-profiling="false" May 21 20:38:20.032812 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029301 2570 flags.go:64] FLAG: --cpu-cfs-quota="true" May 21 20:38:20.032812 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029305 2570 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 21 20:38:20.032812 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029308 2570 flags.go:64] FLAG: --cpu-manager-policy="none" May 21 20:38:20.032812 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029311 2570 flags.go:64] FLAG: --cpu-manager-policy-options="" May 21 20:38:20.032812 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029315 2570 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 21 20:38:20.033420 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029317 2570 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 21 20:38:20.033420 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029320 2570 flags.go:64] FLAG: --enable-debugging-handlers="true" May 21 20:38:20.033420 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029323 2570 flags.go:64] FLAG: --enable-load-reader="false" May 21 20:38:20.033420 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029326 2570 flags.go:64] FLAG: --enable-server="true" May 21 20:38:20.033420 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029329 2570 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 21 20:38:20.033420 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029334 2570 flags.go:64] FLAG: --event-burst="100" May 21 20:38:20.033420 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029337 2570 flags.go:64] FLAG: --event-qps="50" May 21 20:38:20.033420 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029341 2570 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 21 20:38:20.033420 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029344 2570 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 21 20:38:20.033420 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029347 2570 flags.go:64] FLAG: --eviction-hard="" May 21 20:38:20.033420 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029351 2570 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 21 20:38:20.033420 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029354 2570 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 21 20:38:20.033420 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029357 2570 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 21 20:38:20.033420 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029360 2570 flags.go:64] FLAG: --eviction-soft="" May 21 20:38:20.033420 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029363 2570 flags.go:64] FLAG: --eviction-soft-grace-period="" May 21 20:38:20.033420 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029366 2570 flags.go:64] FLAG: --exit-on-lock-contention="false" May 21 20:38:20.033420 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029368 2570 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 21 20:38:20.033420 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029372 2570 flags.go:64] FLAG: --experimental-mounter-path="" May 21 20:38:20.033420 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029375 2570 flags.go:64] FLAG: --fail-cgroupv1="false" May 21 20:38:20.033420 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029377 2570 flags.go:64] FLAG: --fail-swap-on="true" May 21 20:38:20.033420 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029380 2570 flags.go:64] FLAG: --feature-gates="" May 21 20:38:20.033420 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029385 2570 flags.go:64] FLAG: --file-check-frequency="20s" May 21 20:38:20.033420 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029388 2570 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 21 20:38:20.033420 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029391 2570 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 21 20:38:20.033420 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029394 2570 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 21 20:38:20.034047 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029398 2570 flags.go:64] FLAG: --healthz-port="10248" May 21 20:38:20.034047 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029401 2570 flags.go:64] FLAG: --help="false" May 21 20:38:20.034047 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029404 2570 flags.go:64] FLAG: --hostname-override="ip-10-0-131-158.ec2.internal" May 21 20:38:20.034047 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029407 2570 flags.go:64] FLAG: --housekeeping-interval="10s" May 21 20:38:20.034047 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029411 2570 flags.go:64] FLAG: --http-check-frequency="20s" May 21 20:38:20.034047 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029414 2570 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 21 20:38:20.034047 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029417 2570 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 21 20:38:20.034047 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029421 2570 flags.go:64] FLAG: --image-gc-high-threshold="85" May 21 20:38:20.034047 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029423 2570 flags.go:64] FLAG: --image-gc-low-threshold="80" May 21 20:38:20.034047 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029426 2570 flags.go:64] FLAG: --image-service-endpoint="" May 21 20:38:20.034047 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029429 2570 flags.go:64] FLAG: --kernel-memcg-notification="false" May 21 20:38:20.034047 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029431 2570 flags.go:64] FLAG: --kube-api-burst="100" May 21 20:38:20.034047 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029434 2570 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 21 20:38:20.034047 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029437 2570 flags.go:64] FLAG: --kube-api-qps="50" May 21 20:38:20.034047 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029441 2570 flags.go:64] FLAG: --kube-reserved="" May 21 20:38:20.034047 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029444 2570 flags.go:64] FLAG: --kube-reserved-cgroup="" May 21 20:38:20.034047 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029447 2570 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 21 20:38:20.034047 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029450 2570 flags.go:64] FLAG: --kubelet-cgroups="" May 21 20:38:20.034047 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029453 2570 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 21 20:38:20.034047 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029456 2570 flags.go:64] FLAG: --lock-file="" May 21 20:38:20.034047 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029458 2570 flags.go:64] FLAG: --log-cadvisor-usage="false" May 21 20:38:20.034047 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029462 2570 flags.go:64] FLAG: --log-flush-frequency="5s" May 21 20:38:20.034047 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029481 2570 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 21 20:38:20.034047 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029487 2570 flags.go:64] FLAG: --log-json-split-stream="false" May 21 20:38:20.034651 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029489 2570 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 21 20:38:20.034651 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029492 2570 flags.go:64] FLAG: --log-text-split-stream="false" May 21 20:38:20.034651 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029495 2570 flags.go:64] FLAG: --logging-format="text" May 21 20:38:20.034651 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029498 2570 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 21 20:38:20.034651 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029501 2570 flags.go:64] FLAG: --make-iptables-util-chains="true" May 21 20:38:20.034651 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029504 2570 flags.go:64] FLAG: --manifest-url="" May 21 20:38:20.034651 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029507 2570 flags.go:64] FLAG: --manifest-url-header="" May 21 20:38:20.034651 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029512 2570 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 21 20:38:20.034651 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029515 2570 flags.go:64] FLAG: --max-open-files="1000000" May 21 20:38:20.034651 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029519 2570 flags.go:64] FLAG: --max-pods="110" May 21 20:38:20.034651 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029522 2570 flags.go:64] FLAG: --maximum-dead-containers="-1" May 21 20:38:20.034651 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029525 2570 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 21 20:38:20.034651 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029529 2570 flags.go:64] FLAG: --memory-manager-policy="None" May 21 20:38:20.034651 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029532 2570 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 21 20:38:20.034651 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029535 2570 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 21 20:38:20.034651 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029538 2570 flags.go:64] FLAG: --node-ip="0.0.0.0" May 21 20:38:20.034651 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029540 2570 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 21 20:38:20.034651 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029548 2570 flags.go:64] FLAG: --node-status-max-images="50" May 21 20:38:20.034651 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029551 2570 flags.go:64] FLAG: --node-status-update-frequency="10s" May 21 20:38:20.034651 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029554 2570 flags.go:64] FLAG: --oom-score-adj="-999" May 21 20:38:20.034651 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029558 2570 flags.go:64] FLAG: --pod-cidr="" May 21 20:38:20.034651 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029564 2570 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 21 20:38:20.034651 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029570 2570 flags.go:64] FLAG: --pod-manifest-path="" May 21 20:38:20.035240 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029573 2570 flags.go:64] FLAG: --pod-max-pids="-1" May 21 20:38:20.035240 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029576 2570 flags.go:64] FLAG: --pods-per-core="0" May 21 20:38:20.035240 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029579 2570 flags.go:64] FLAG: --port="10250" May 21 20:38:20.035240 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029582 2570 flags.go:64] FLAG: --protect-kernel-defaults="false" May 21 20:38:20.035240 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029585 2570 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-085293664a51ad0f0" May 21 20:38:20.035240 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029588 2570 flags.go:64] FLAG: --qos-reserved="" May 21 20:38:20.035240 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029591 2570 flags.go:64] FLAG: --read-only-port="10255" May 21 20:38:20.035240 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029594 2570 flags.go:64] FLAG: --register-node="true" May 21 20:38:20.035240 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029597 2570 flags.go:64] FLAG: --register-schedulable="true" May 21 20:38:20.035240 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029600 2570 flags.go:64] FLAG: --register-with-taints="" May 21 20:38:20.035240 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029603 2570 flags.go:64] FLAG: --registry-burst="10" May 21 20:38:20.035240 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029606 2570 flags.go:64] FLAG: --registry-qps="5" May 21 20:38:20.035240 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029608 2570 flags.go:64] FLAG: --reserved-cpus="" May 21 20:38:20.035240 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029611 2570 flags.go:64] FLAG: --reserved-memory="" May 21 20:38:20.035240 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029615 2570 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 21 20:38:20.035240 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029617 2570 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 21 20:38:20.035240 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029620 2570 flags.go:64] FLAG: --rotate-certificates="false" May 21 20:38:20.035240 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029623 2570 flags.go:64] FLAG: --rotate-server-certificates="false" May 21 20:38:20.035240 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029626 2570 flags.go:64] FLAG: --runonce="false" May 21 20:38:20.035240 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029629 2570 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 21 20:38:20.035240 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029631 2570 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 21 20:38:20.035240 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029634 2570 flags.go:64] FLAG: --seccomp-default="false" May 21 20:38:20.035240 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029638 2570 flags.go:64] FLAG: --serialize-image-pulls="true" May 21 20:38:20.035240 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029641 2570 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 21 20:38:20.035240 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029644 2570 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 21 20:38:20.035240 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029647 2570 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 21 20:38:20.035859 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029650 2570 flags.go:64] FLAG: --storage-driver-password="root" May 21 20:38:20.035859 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029653 2570 flags.go:64] FLAG: --storage-driver-secure="false" May 21 20:38:20.035859 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029656 2570 flags.go:64] FLAG: --storage-driver-table="stats" May 21 20:38:20.035859 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029659 2570 flags.go:64] FLAG: --storage-driver-user="root" May 21 20:38:20.035859 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029664 2570 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 21 20:38:20.035859 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029667 2570 flags.go:64] FLAG: --sync-frequency="1m0s" May 21 20:38:20.035859 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029670 2570 flags.go:64] FLAG: --system-cgroups="" May 21 20:38:20.035859 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029673 2570 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 21 20:38:20.035859 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029678 2570 flags.go:64] FLAG: --system-reserved-cgroup="" May 21 20:38:20.035859 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029681 2570 flags.go:64] FLAG: --tls-cert-file="" May 21 20:38:20.035859 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029684 2570 flags.go:64] FLAG: --tls-cipher-suites="[]" May 21 20:38:20.035859 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029689 2570 flags.go:64] FLAG: --tls-min-version="" May 21 20:38:20.035859 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029692 2570 flags.go:64] FLAG: --tls-private-key-file="" May 21 20:38:20.035859 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029695 2570 flags.go:64] FLAG: --topology-manager-policy="none" May 21 20:38:20.035859 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029698 2570 flags.go:64] FLAG: --topology-manager-policy-options="" May 21 20:38:20.035859 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029701 2570 flags.go:64] FLAG: --topology-manager-scope="container" May 21 20:38:20.035859 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029704 2570 flags.go:64] FLAG: --v="2" May 21 20:38:20.035859 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029708 2570 flags.go:64] FLAG: --version="false" May 21 20:38:20.035859 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029712 2570 flags.go:64] FLAG: --vmodule="" May 21 20:38:20.035859 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029717 2570 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 21 20:38:20.035859 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.029720 2570 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 21 20:38:20.035859 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029812 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 20:38:20.035859 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029816 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 20:38:20.035859 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029819 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 20:38:20.036436 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029822 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 20:38:20.036436 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029826 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 20:38:20.036436 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029828 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 20:38:20.036436 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029831 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 20:38:20.036436 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029834 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 20:38:20.036436 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029837 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 20:38:20.036436 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029840 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 20:38:20.036436 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029842 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 20:38:20.036436 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029845 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 20:38:20.036436 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029847 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 20:38:20.036436 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029851 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 20:38:20.036436 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029854 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 20:38:20.036436 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029858 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 20:38:20.036436 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029860 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 20:38:20.036436 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029863 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 20:38:20.036436 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029865 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 20:38:20.036436 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029868 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 20:38:20.036436 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029870 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 20:38:20.036436 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029873 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 20:38:20.036953 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029877 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 20:38:20.036953 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029880 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 20:38:20.036953 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029883 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 20:38:20.036953 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029886 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 20:38:20.036953 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029889 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 20:38:20.036953 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029893 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 20:38:20.036953 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029897 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 20:38:20.036953 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029901 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 20:38:20.036953 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029904 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 20:38:20.036953 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029907 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 20:38:20.036953 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029909 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 20:38:20.036953 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029912 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 20:38:20.036953 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029914 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 20:38:20.036953 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029916 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 20:38:20.036953 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029919 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 20:38:20.036953 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029922 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 20:38:20.036953 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029924 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 20:38:20.036953 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029927 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 20:38:20.036953 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029929 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 20:38:20.037416 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029932 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 20:38:20.037416 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029935 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 20:38:20.037416 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029937 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 20:38:20.037416 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029940 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 20:38:20.037416 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029944 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 20:38:20.037416 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029946 2570 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 20:38:20.037416 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029950 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 20:38:20.037416 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029953 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 20:38:20.037416 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029955 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 20:38:20.037416 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029958 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 20:38:20.037416 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029960 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 20:38:20.037416 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029963 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 20:38:20.037416 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029965 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 20:38:20.037416 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029968 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 20:38:20.037416 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029971 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 20:38:20.037416 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029973 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 20:38:20.037416 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029975 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 20:38:20.037416 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029978 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 20:38:20.037416 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029981 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 20:38:20.037416 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029983 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 20:38:20.037945 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029986 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 20:38:20.037945 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029989 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 20:38:20.037945 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029991 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 20:38:20.037945 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029993 2570 feature_gate.go:328] unrecognized feature gate: Example May 21 20:38:20.037945 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029996 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 20:38:20.037945 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.029998 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 20:38:20.037945 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.030000 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 20:38:20.037945 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.030003 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 20:38:20.037945 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.030006 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 20:38:20.037945 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.030008 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 20:38:20.037945 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.030011 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 20:38:20.037945 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.030013 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 20:38:20.037945 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.030016 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 20:38:20.037945 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.030019 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 20:38:20.037945 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.030021 2570 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 20:38:20.037945 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.030024 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 20:38:20.037945 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.030028 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 20:38:20.037945 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.030030 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 20:38:20.037945 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.030034 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 20:38:20.038436 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.030036 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 20:38:20.038436 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.030039 2570 feature_gate.go:328] unrecognized feature gate: Example2 May 21 20:38:20.038436 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.030041 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 20:38:20.038436 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.030044 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 20:38:20.038436 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.030046 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 20:38:20.038436 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.030049 2570 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 20:38:20.038436 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.030615 2570 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 20:38:20.038436 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.037645 2570 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 21 20:38:20.038436 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.037665 2570 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 21 20:38:20.038436 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037717 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 20:38:20.038436 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037723 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 20:38:20.038436 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037726 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 20:38:20.038436 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037729 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 20:38:20.038436 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037732 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 20:38:20.038436 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037735 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 20:38:20.038436 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037737 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 20:38:20.038910 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037740 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 20:38:20.038910 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037743 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 20:38:20.038910 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037745 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 20:38:20.038910 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037748 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 20:38:20.038910 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037751 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 20:38:20.038910 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037754 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 20:38:20.038910 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037757 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 20:38:20.038910 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037759 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 20:38:20.038910 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037762 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 20:38:20.038910 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037764 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 20:38:20.038910 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037767 2570 feature_gate.go:328] unrecognized feature gate: Example2 May 21 20:38:20.038910 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037770 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 20:38:20.038910 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037772 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 20:38:20.038910 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037775 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 20:38:20.038910 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037777 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 20:38:20.038910 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037780 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 20:38:20.038910 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037783 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 20:38:20.038910 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037785 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 20:38:20.038910 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037788 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 20:38:20.038910 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037790 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 20:38:20.039395 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037793 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 20:38:20.039395 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037795 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 20:38:20.039395 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037798 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 20:38:20.039395 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037801 2570 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 20:38:20.039395 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037805 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 20:38:20.039395 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037808 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 20:38:20.039395 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037811 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 20:38:20.039395 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037813 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 20:38:20.039395 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037816 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 20:38:20.039395 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037819 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 20:38:20.039395 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037822 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 20:38:20.039395 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037824 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 20:38:20.039395 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037826 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 20:38:20.039395 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037829 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 20:38:20.039395 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037831 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 20:38:20.039395 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037834 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 20:38:20.039395 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037836 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 20:38:20.039395 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037838 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 20:38:20.039395 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037841 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 20:38:20.039862 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037844 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 20:38:20.039862 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037846 2570 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 20:38:20.039862 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037850 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 20:38:20.039862 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037852 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 20:38:20.039862 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037855 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 20:38:20.039862 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037857 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 20:38:20.039862 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037860 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 20:38:20.039862 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037862 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 20:38:20.039862 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037865 2570 feature_gate.go:328] unrecognized feature gate: Example May 21 20:38:20.039862 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037869 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 20:38:20.039862 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037873 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 20:38:20.039862 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037876 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 20:38:20.039862 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037879 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 20:38:20.039862 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037881 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 20:38:20.039862 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037884 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 20:38:20.039862 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037886 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 20:38:20.039862 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037888 2570 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 20:38:20.039862 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037892 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 20:38:20.039862 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037895 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 20:38:20.039862 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037897 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 20:38:20.040347 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037900 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 20:38:20.040347 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037903 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 20:38:20.040347 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037905 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 20:38:20.040347 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037908 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 20:38:20.040347 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037910 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 20:38:20.040347 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037913 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 20:38:20.040347 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037915 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 20:38:20.040347 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037919 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 20:38:20.040347 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037924 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 20:38:20.040347 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037927 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 20:38:20.040347 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037929 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 20:38:20.040347 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037932 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 20:38:20.040347 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037934 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 20:38:20.040347 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037938 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 20:38:20.040347 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037941 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 20:38:20.040347 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037943 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 20:38:20.040347 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037946 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 20:38:20.040347 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037949 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 20:38:20.040347 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037952 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 20:38:20.040347 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.037955 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 20:38:20.040868 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.037961 2570 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 20:38:20.040868 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038065 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 20:38:20.040868 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038070 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 20:38:20.040868 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038073 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 20:38:20.040868 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038076 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 20:38:20.040868 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038079 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 20:38:20.040868 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038082 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 20:38:20.040868 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038084 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 20:38:20.040868 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038087 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 20:38:20.040868 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038090 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 20:38:20.040868 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038092 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 20:38:20.040868 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038095 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 20:38:20.040868 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038098 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 20:38:20.040868 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038101 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 20:38:20.040868 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038103 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 20:38:20.041243 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038107 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 20:38:20.041243 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038111 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 20:38:20.041243 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038114 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 20:38:20.041243 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038116 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 20:38:20.041243 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038119 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 20:38:20.041243 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038121 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 20:38:20.041243 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038124 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 20:38:20.041243 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038126 2570 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 20:38:20.041243 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038129 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 20:38:20.041243 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038131 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 20:38:20.041243 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038134 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 20:38:20.041243 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038136 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 20:38:20.041243 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038139 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 20:38:20.041243 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038141 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 20:38:20.041243 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038144 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 20:38:20.041243 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038146 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 20:38:20.041243 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038149 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 20:38:20.041243 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038161 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 20:38:20.041243 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038164 2570 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 20:38:20.041243 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038184 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 20:38:20.041752 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038188 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 20:38:20.041752 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038191 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 20:38:20.041752 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038194 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 20:38:20.041752 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038197 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 20:38:20.041752 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038200 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 20:38:20.041752 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038203 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 20:38:20.041752 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038206 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 20:38:20.041752 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038209 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 20:38:20.041752 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038212 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 20:38:20.041752 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038215 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 20:38:20.041752 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038218 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 20:38:20.041752 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038220 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 20:38:20.041752 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038223 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 20:38:20.041752 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038226 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 20:38:20.041752 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038229 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 20:38:20.041752 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038231 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 20:38:20.041752 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038234 2570 feature_gate.go:328] unrecognized feature gate: Example May 21 20:38:20.041752 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038236 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 20:38:20.041752 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038239 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 20:38:20.042252 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038242 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 20:38:20.042252 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038246 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 20:38:20.042252 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038249 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 20:38:20.042252 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038252 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 20:38:20.042252 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038255 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 20:38:20.042252 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038257 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 20:38:20.042252 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038260 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 20:38:20.042252 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038262 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 20:38:20.042252 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038264 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 20:38:20.042252 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038267 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 20:38:20.042252 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038269 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 20:38:20.042252 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038272 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 20:38:20.042252 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038274 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 20:38:20.042252 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038276 2570 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 20:38:20.042252 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038279 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 20:38:20.042252 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038281 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 20:38:20.042252 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038283 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 20:38:20.042252 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038286 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 20:38:20.042252 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038289 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 20:38:20.042790 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038291 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 20:38:20.042790 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038294 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 20:38:20.042790 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038296 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 20:38:20.042790 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038299 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 20:38:20.042790 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038302 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 20:38:20.042790 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038305 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 20:38:20.042790 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038307 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 20:38:20.042790 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038310 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 20:38:20.042790 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038312 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 20:38:20.042790 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038314 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 20:38:20.042790 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038317 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 20:38:20.042790 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038319 2570 feature_gate.go:328] unrecognized feature gate: Example2 May 21 20:38:20.042790 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038322 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 20:38:20.042790 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:20.038324 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 20:38:20.042790 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.038329 2570 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 20:38:20.042790 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.039543 2570 server.go:962] "Client rotation is on, will bootstrap in background" May 21 20:38:20.043182 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.041686 2570 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 21 20:38:20.043182 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.042935 2570 server.go:1019] "Starting client certificate rotation" May 21 20:38:20.043182 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.043034 2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 20:38:20.043182 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.043075 2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 20:38:20.074235 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.074209 2570 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 20:38:20.076693 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.076522 2570 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 20:38:20.096484 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.096445 2570 log.go:25] "Validated CRI v1 runtime API" May 21 20:38:20.103127 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.103105 2570 log.go:25] "Validated CRI v1 image API" May 21 20:38:20.104612 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.104594 2570 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 21 20:38:20.109519 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.109492 2570 fs.go:135] Filesystem UUIDs: map[4e13eecd-3074-4ce3-b567-fe6e0f56dc57:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 7afc43b8-c0e9-4b8e-a3ae-06d10410e7d7:/dev/nvme0n1p4] May 21 20:38:20.109613 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.109516 2570 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 21 20:38:20.110172 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.110144 2570 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 20:38:20.114071 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.113951 2570 manager.go:217] Machine: {Timestamp:2026-05-21 20:38:20.113414668 +0000 UTC m=+0.495594731 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100373 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28524f29bae99149d78fd13164efe4 SystemUUID:ec28524f-29ba-e991-49d7-8fd13164efe4 BootID:60d318b1-ddbc-48c4-9de2-cc48f8c44f7e Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5c:04:8d:ee:49 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5c:04:8d:ee:49 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c6:32:51:66:28:19 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 21 20:38:20.114734 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.114723 2570 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 21 20:38:20.114832 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.114817 2570 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 21 20:38:20.117010 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.116963 2570 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 21 20:38:20.117163 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.117013 2570 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-158.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 21 20:38:20.117210 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.117170 2570 topology_manager.go:138] "Creating topology manager with none policy" May 21 20:38:20.117210 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.117179 2570 container_manager_linux.go:306] "Creating device plugin manager" May 21 20:38:20.117210 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.117187 2570 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 20:38:20.118343 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.118330 2570 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 20:38:20.119977 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.119963 2570 state_mem.go:36] "Initialized new in-memory state store" May 21 20:38:20.120100 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.120090 2570 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 21 20:38:20.122984 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.122969 2570 kubelet.go:491] "Attempting to sync node with API server" May 21 20:38:20.123023 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.122989 2570 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 21 20:38:20.123023 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.123002 2570 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 21 20:38:20.123023 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.123012 2570 kubelet.go:397] "Adding apiserver pod source" May 21 20:38:20.123023 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.123023 2570 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 21 20:38:20.124276 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.124261 2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 20:38:20.124325 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.124284 2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 20:38:20.128025 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.128008 2570 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 21 20:38:20.129820 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.129801 2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h4lt7" May 21 20:38:20.132592 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.132564 2570 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 21 20:38:20.134765 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.134747 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 21 20:38:20.134865 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.134771 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 21 20:38:20.134865 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.134782 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 21 20:38:20.134865 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.134791 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 21 20:38:20.134865 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.134810 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 21 20:38:20.134865 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.134819 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 21 20:38:20.134865 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.134827 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 21 20:38:20.134865 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.134836 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 21 20:38:20.134865 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.134847 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 21 20:38:20.134865 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.134856 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 21 20:38:20.134865 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.134869 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 21 20:38:20.135204 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.134878 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 21 20:38:20.135616 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.135598 2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h4lt7" May 21 20:38:20.135998 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:20.135972 2570 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 21 20:38:20.135998 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:20.135975 2570 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-158.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 21 20:38:20.136945 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.136929 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 21 20:38:20.137004 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.136951 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 21 20:38:20.139587 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.139568 2570 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-158.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 21 20:38:20.140640 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.140625 2570 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 21 20:38:20.140680 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.140671 2570 server.go:1295] "Started kubelet" May 21 20:38:20.140808 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.140760 2570 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 21 20:38:20.140808 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.140773 2570 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 21 20:38:20.140909 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.140834 2570 server_v1.go:47] "podresources" method="list" useActivePods=true May 21 20:38:20.141520 ip-10-0-131-158 systemd[1]: Started Kubernetes Kubelet. May 21 20:38:20.142125 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.142109 2570 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 21 20:38:20.143899 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.143887 2570 server.go:317] "Adding debug handlers to kubelet server" May 21 20:38:20.148767 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.148748 2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 21 20:38:20.149288 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.149274 2570 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 21 20:38:20.149409 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.149394 2570 volume_manager.go:295] "The desired_state_of_world populator starts" May 21 20:38:20.149460 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.149410 2570 volume_manager.go:297] "Starting Kubelet Volume Manager" May 21 20:38:20.149580 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.149562 2570 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 21 20:38:20.149676 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.149610 2570 reconstruct.go:97] "Volume reconstruction finished" May 21 20:38:20.149676 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.149620 2570 reconciler.go:26] "Reconciler: start to sync state" May 21 20:38:20.150277 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.150224 2570 factory.go:153] Registering CRI-O factory May 21 20:38:20.150277 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.150249 2570 factory.go:223] Registration of the crio container factory successfully May 21 20:38:20.150277 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.150300 2570 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 21 20:38:20.150277 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.150308 2570 factory.go:55] Registering systemd factory May 21 20:38:20.150277 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.150315 2570 factory.go:223] Registration of the systemd container factory successfully May 21 20:38:20.150277 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.150330 2570 factory.go:103] Registering Raw factory May 21 20:38:20.150277 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.150351 2570 manager.go:1196] Started watching for new ooms in manager May 21 20:38:20.150716 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:20.150581 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-158.ec2.internal\" not found" May 21 20:38:20.151308 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:20.151283 2570 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 21 20:38:20.151459 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.151443 2570 manager.go:319] Starting recovery of all containers May 21 20:38:20.158168 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.158136 2570 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 20:38:20.159230 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.159197 2570 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 21 20:38:20.160756 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.160742 2570 manager.go:324] Recovery completed May 21 20:38:20.162209 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:20.162185 2570 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-131-158.ec2.internal\" not found" node="ip-10-0-131-158.ec2.internal" May 21 20:38:20.168251 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.168234 2570 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 20:38:20.170401 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.170385 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-158.ec2.internal" event="NodeHasSufficientMemory" May 21 20:38:20.170497 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.170419 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-158.ec2.internal" event="NodeHasNoDiskPressure" May 21 20:38:20.170497 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.170433 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-158.ec2.internal" event="NodeHasSufficientPID" May 21 20:38:20.171006 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.170992 2570 cpu_manager.go:222] "Starting CPU manager" policy="none" May 21 20:38:20.171064 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.171007 2570 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 21 20:38:20.171064 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.171031 2570 state_mem.go:36] "Initialized new in-memory state store" May 21 20:38:20.173386 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.173373 2570 policy_none.go:49] "None policy: Start" May 21 20:38:20.173435 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.173390 2570 memory_manager.go:186] "Starting memorymanager" policy="None" May 21 20:38:20.173435 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.173401 2570 state_mem.go:35] "Initializing new in-memory state store" May 21 20:38:20.208098 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.208077 2570 manager.go:341] "Starting Device Plugin manager" May 21 20:38:20.208226 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:20.208110 2570 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 21 20:38:20.208226 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.208121 2570 server.go:85] "Starting device plugin registration server" May 21 20:38:20.208407 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.208392 2570 eviction_manager.go:189] "Eviction manager: starting control loop" May 21 20:38:20.208523 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.208407 2570 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 21 20:38:20.208589 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.208583 2570 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 21 20:38:20.208647 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.208637 2570 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 21 20:38:20.208647 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.208646 2570 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 21 20:38:20.209666 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:20.209648 2570 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 21 20:38:20.209783 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:20.209683 2570 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-158.ec2.internal\" not found" May 21 20:38:20.261988 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.261912 2570 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 21 20:38:20.261988 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.261942 2570 status_manager.go:230] "Starting to sync pod status with apiserver" May 21 20:38:20.261988 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.261961 2570 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 21 20:38:20.261988 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.261968 2570 kubelet.go:2451] "Starting kubelet main sync loop" May 21 20:38:20.263416 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:20.262004 2570 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 21 20:38:20.265567 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.265550 2570 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 20:38:20.308883 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.308856 2570 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 20:38:20.310095 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.310076 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-158.ec2.internal" event="NodeHasSufficientMemory" May 21 20:38:20.310216 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.310108 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-158.ec2.internal" event="NodeHasNoDiskPressure" May 21 20:38:20.310216 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.310119 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-158.ec2.internal" event="NodeHasSufficientPID" May 21 20:38:20.310216 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.310141 2570 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-158.ec2.internal" May 21 20:38:20.317983 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.317946 2570 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-158.ec2.internal" May 21 20:38:20.317983 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:20.317982 2570 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-158.ec2.internal\": node \"ip-10-0-131-158.ec2.internal\" not found" May 21 20:38:20.333215 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:20.333186 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-158.ec2.internal\" not found" May 21 20:38:20.362250 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.362213 2570 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-158.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-158.ec2.internal"] May 21 20:38:20.362342 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.362300 2570 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 20:38:20.363246 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.363231 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-158.ec2.internal" event="NodeHasSufficientMemory" May 21 20:38:20.363314 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.363264 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-158.ec2.internal" event="NodeHasNoDiskPressure" May 21 20:38:20.363314 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.363275 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-158.ec2.internal" event="NodeHasSufficientPID" May 21 20:38:20.364670 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.364658 2570 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 20:38:20.364806 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.364791 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-158.ec2.internal" May 21 20:38:20.364858 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.364821 2570 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 20:38:20.365416 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.365399 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-158.ec2.internal" event="NodeHasSufficientMemory" May 21 20:38:20.365416 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.365407 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-158.ec2.internal" event="NodeHasSufficientMemory" May 21 20:38:20.365575 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.365431 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-158.ec2.internal" event="NodeHasNoDiskPressure" May 21 20:38:20.365575 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.365442 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-158.ec2.internal" event="NodeHasNoDiskPressure" May 21 20:38:20.365575 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.365449 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-158.ec2.internal" event="NodeHasSufficientPID" May 21 20:38:20.365575 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.365453 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-158.ec2.internal" event="NodeHasSufficientPID" May 21 20:38:20.366718 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.366704 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-158.ec2.internal" May 21 20:38:20.366783 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.366733 2570 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 20:38:20.367360 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.367343 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-158.ec2.internal" event="NodeHasSufficientMemory" May 21 20:38:20.367443 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.367372 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-158.ec2.internal" event="NodeHasNoDiskPressure" May 21 20:38:20.367443 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.367382 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-158.ec2.internal" event="NodeHasSufficientPID" May 21 20:38:20.385204 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:20.385172 2570 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-158.ec2.internal\" not found" node="ip-10-0-131-158.ec2.internal" May 21 20:38:20.389388 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:20.389368 2570 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-158.ec2.internal\" not found" node="ip-10-0-131-158.ec2.internal" May 21 20:38:20.434403 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:20.434344 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-158.ec2.internal\" not found" May 21 20:38:20.452185 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.452158 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/afa0e1cb1f51f2b57cc3bf0d39b525c9-config\") pod \"kube-apiserver-proxy-ip-10-0-131-158.ec2.internal\" (UID: \"afa0e1cb1f51f2b57cc3bf0d39b525c9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-158.ec2.internal" May 21 20:38:20.452312 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.452188 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ad199929ca2afa061f2f23c1f419b63a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-158.ec2.internal\" (UID: \"ad199929ca2afa061f2f23c1f419b63a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-158.ec2.internal" May 21 20:38:20.452312 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.452208 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad199929ca2afa061f2f23c1f419b63a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-158.ec2.internal\" (UID: \"ad199929ca2afa061f2f23c1f419b63a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-158.ec2.internal" May 21 20:38:20.534703 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:20.534603 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-158.ec2.internal\" not found" May 21 20:38:20.553017 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.552985 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/afa0e1cb1f51f2b57cc3bf0d39b525c9-config\") pod \"kube-apiserver-proxy-ip-10-0-131-158.ec2.internal\" (UID: \"afa0e1cb1f51f2b57cc3bf0d39b525c9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-158.ec2.internal" May 21 20:38:20.553131 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.553027 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ad199929ca2afa061f2f23c1f419b63a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-158.ec2.internal\" (UID: \"ad199929ca2afa061f2f23c1f419b63a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-158.ec2.internal" May 21 20:38:20.553131 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.553067 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad199929ca2afa061f2f23c1f419b63a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-158.ec2.internal\" (UID: \"ad199929ca2afa061f2f23c1f419b63a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-158.ec2.internal" May 21 20:38:20.553131 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.553109 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ad199929ca2afa061f2f23c1f419b63a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-158.ec2.internal\" (UID: \"ad199929ca2afa061f2f23c1f419b63a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-158.ec2.internal" May 21 20:38:20.553131 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.553117 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad199929ca2afa061f2f23c1f419b63a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-158.ec2.internal\" (UID: \"ad199929ca2afa061f2f23c1f419b63a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-158.ec2.internal" May 21 20:38:20.553260 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.553111 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/afa0e1cb1f51f2b57cc3bf0d39b525c9-config\") pod \"kube-apiserver-proxy-ip-10-0-131-158.ec2.internal\" (UID: \"afa0e1cb1f51f2b57cc3bf0d39b525c9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-158.ec2.internal" May 21 20:38:20.635505 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:20.635449 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-158.ec2.internal\" not found" May 21 20:38:20.688953 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.688919 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-158.ec2.internal" May 21 20:38:20.692911 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:20.692892 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-158.ec2.internal" May 21 20:38:20.736610 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:20.736577 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-158.ec2.internal\" not found" May 21 20:38:20.837113 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:20.837039 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-158.ec2.internal\" not found" May 21 20:38:20.937591 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:20.937551 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-158.ec2.internal\" not found" May 21 20:38:21.038531 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:21.038494 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-158.ec2.internal\" not found" May 21 20:38:21.039209 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:21.038717 2570 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 21 20:38:21.042216 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:21.042200 2570 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 21 20:38:21.042370 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:21.042343 2570 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 20:38:21.042370 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:21.042342 2570 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 20:38:21.042462 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:21.042350 2570 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 20:38:21.138295 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:21.138208 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 20:33:20 +0000 UTC" deadline="2028-01-17 20:13:49.660034848 +0000 UTC" May 21 20:38:21.138295 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:21.138248 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14543h35m28.521790775s" May 21 20:38:21.139275 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:21.139259 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-158.ec2.internal\" not found" May 21 20:38:21.149324 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:21.149299 2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 21 20:38:21.158697 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:21.158664 2570 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 20:38:21.179073 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:21.179041 2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4sd4f" May 21 20:38:21.186956 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:21.186925 2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4sd4f" May 21 20:38:21.194631 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:21.194605 2570 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 21 20:38:21.249582 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:21.249552 2570 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-158.ec2.internal" May 21 20:38:21.263773 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:21.263751 2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 20:38:21.264824 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:21.264811 2570 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-158.ec2.internal" May 21 20:38:21.272595 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:21.272575 2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 20:38:21.273223 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:21.273191 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad199929ca2afa061f2f23c1f419b63a.slice/crio-e3b6c88f8f9598a03e41e4d08dddd7ffdd78da6720de37cceb4dc7e073a50f56 WatchSource:0}: Error finding container e3b6c88f8f9598a03e41e4d08dddd7ffdd78da6720de37cceb4dc7e073a50f56: Status 404 returned error can't find the container with id e3b6c88f8f9598a03e41e4d08dddd7ffdd78da6720de37cceb4dc7e073a50f56 May 21 20:38:21.273445 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:21.273424 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafa0e1cb1f51f2b57cc3bf0d39b525c9.slice/crio-9cf2abf5c2610f0758e1e91d7df0f50a0c6eee1d370b397416c61c58ad40e92c WatchSource:0}: Error finding container 9cf2abf5c2610f0758e1e91d7df0f50a0c6eee1d370b397416c61c58ad40e92c: Status 404 returned error can't find the container with id 9cf2abf5c2610f0758e1e91d7df0f50a0c6eee1d370b397416c61c58ad40e92c May 21 20:38:21.278797 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:21.278784 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 20:38:21.929738 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:21.929709 2570 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 20:38:22.124732 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.124704 2570 apiserver.go:52] "Watching apiserver" May 21 20:38:22.131418 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.131390 2570 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 21 20:38:22.131928 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.131903 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-158.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfm56","openshift-dns/node-resolver-jfdql","openshift-image-registry/node-ca-vfm2z","openshift-network-diagnostics/network-check-target-lqwhq","openshift-network-operator/iptables-alerter-pbh8l","openshift-cluster-node-tuning-operator/tuned-gq7wm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-158.ec2.internal","openshift-multus/multus-additional-cni-plugins-8zgxn","openshift-multus/multus-zngpc","openshift-multus/network-metrics-daemon-7lhdn","openshift-ovn-kubernetes/ovnkube-node-7krlb","kube-system/konnectivity-agent-jldwc"] May 21 20:38:22.133459 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.133435 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gq7wm" May 21 20:38:22.134616 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.134595 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfm56" May 21 20:38:22.135326 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.135307 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 21 20:38:22.135422 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.135401 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-88bm8\"" May 21 20:38:22.135494 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.135309 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 21 20:38:22.136486 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.136451 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 21 20:38:22.136614 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.136596 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7dcsz\"" May 21 20:38:22.136778 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.136746 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 21 20:38:22.136933 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.136918 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 21 20:38:22.137289 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.137035 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vfm2z" May 21 20:38:22.138355 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.138324 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jfdql" May 21 20:38:22.138649 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.138629 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 21 20:38:22.138737 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.138652 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 21 20:38:22.138737 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.138659 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jq7r2\"" May 21 20:38:22.138843 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.138782 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 21 20:38:22.139484 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.139451 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqwhq" May 21 20:38:22.139577 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:22.139539 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqwhq" podUID="0a50c0b1-eccc-4bdf-a7d7-eca75843e83b" May 21 20:38:22.139577 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.139566 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pbh8l" May 21 20:38:22.140218 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.140198 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 21 20:38:22.140308 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.140259 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 21 20:38:22.140371 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.140309 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qs6q6\"" May 21 20:38:22.141087 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.140925 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8zgxn" May 21 20:38:22.141412 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.141377 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 21 20:38:22.141682 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.141663 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 21 20:38:22.141783 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.141739 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 21 20:38:22.141847 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.141821 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-q4fz6\"" May 21 20:38:22.143380 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.142196 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zngpc" May 21 20:38:22.143380 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.142699 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 21 20:38:22.143380 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.142777 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qj84r\"" May 21 20:38:22.143380 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.142965 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 21 20:38:22.143380 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.143136 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 21 20:38:22.143380 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.143243 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 21 20:38:22.143749 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.143407 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 21 20:38:22.143749 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.143536 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lhdn" May 21 20:38:22.143749 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:22.143603 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lhdn" podUID="23d4cc46-4752-4afd-a726-67d9eced1af9" May 21 20:38:22.143749 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.143735 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 21 20:38:22.144112 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.144092 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gfml6\"" May 21 20:38:22.146279 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.146255 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.147746 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.147723 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jldwc" May 21 20:38:22.147884 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.147795 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 21 20:38:22.148462 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.148443 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 21 20:38:22.148905 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.148887 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 21 20:38:22.149023 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.149002 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 21 20:38:22.149331 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.149311 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 21 20:38:22.149514 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.149463 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 21 20:38:22.149715 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.149699 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9j9ft\"" May 21 20:38:22.149779 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.149715 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 21 20:38:22.149827 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.149800 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 21 20:38:22.150454 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.150438 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jdphn\"" May 21 20:38:22.150874 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.150859 2570 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 21 20:38:22.161833 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.161803 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d8463ad6-6f3b-4984-ab32-781d1507d42d-ovn-node-metrics-cert\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.161954 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.161849 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pgm5\" (UniqueName: \"kubernetes.io/projected/d8463ad6-6f3b-4984-ab32-781d1507d42d-kube-api-access-6pgm5\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.161954 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.161881 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa1ef7ae-4922-40df-833c-976271407550-system-cni-dir\") pod \"multus-zngpc\" (UID: \"aa1ef7ae-4922-40df-833c-976271407550\") " pod="openshift-multus/multus-zngpc" May 21 20:38:22.161954 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.161910 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aa1ef7ae-4922-40df-833c-976271407550-host-run-netns\") pod \"multus-zngpc\" (UID: \"aa1ef7ae-4922-40df-833c-976271407550\") " pod="openshift-multus/multus-zngpc" May 21 20:38:22.161954 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.161937 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f63dee9f-a259-4e50-8b8e-7b5836fcbeef-host\") pod \"tuned-gq7wm\" (UID: \"f63dee9f-a259-4e50-8b8e-7b5836fcbeef\") " pod="openshift-cluster-node-tuning-operator/tuned-gq7wm" May 21 20:38:22.162108 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.161991 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8463ad6-6f3b-4984-ab32-781d1507d42d-run-openvswitch\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.162108 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.162016 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f63dee9f-a259-4e50-8b8e-7b5836fcbeef-etc-sysconfig\") pod \"tuned-gq7wm\" (UID: \"f63dee9f-a259-4e50-8b8e-7b5836fcbeef\") " pod="openshift-cluster-node-tuning-operator/tuned-gq7wm" May 21 20:38:22.162108 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.162040 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f63dee9f-a259-4e50-8b8e-7b5836fcbeef-var-lib-kubelet\") pod \"tuned-gq7wm\" (UID: \"f63dee9f-a259-4e50-8b8e-7b5836fcbeef\") " pod="openshift-cluster-node-tuning-operator/tuned-gq7wm" May 21 20:38:22.162108 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.162060 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d8463ad6-6f3b-4984-ab32-781d1507d42d-node-log\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.162108 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.162083 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8463ad6-6f3b-4984-ab32-781d1507d42d-host-run-ovn-kubernetes\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.162308 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.162134 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5404da1c-65ab-46a6-8824-6a1eb233b16a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8zgxn\" (UID: \"5404da1c-65ab-46a6-8824-6a1eb233b16a\") " pod="openshift-multus/multus-additional-cni-plugins-8zgxn" May 21 20:38:22.162308 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.162204 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/aa1ef7ae-4922-40df-833c-976271407550-multus-socket-dir-parent\") pod \"multus-zngpc\" (UID: \"aa1ef7ae-4922-40df-833c-976271407550\") " pod="openshift-multus/multus-zngpc" May 21 20:38:22.162308 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.162241 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5404da1c-65ab-46a6-8824-6a1eb233b16a-os-release\") pod \"multus-additional-cni-plugins-8zgxn\" (UID: \"5404da1c-65ab-46a6-8824-6a1eb233b16a\") " pod="openshift-multus/multus-additional-cni-plugins-8zgxn" May 21 20:38:22.162308 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.162257 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/aa1ef7ae-4922-40df-833c-976271407550-host-run-multus-certs\") pod \"multus-zngpc\" (UID: \"aa1ef7ae-4922-40df-833c-976271407550\") " pod="openshift-multus/multus-zngpc" May 21 20:38:22.162308 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.162273 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f63dee9f-a259-4e50-8b8e-7b5836fcbeef-etc-modprobe-d\") pod \"tuned-gq7wm\" (UID: \"f63dee9f-a259-4e50-8b8e-7b5836fcbeef\") " pod="openshift-cluster-node-tuning-operator/tuned-gq7wm" May 21 20:38:22.162308 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.162291 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f63dee9f-a259-4e50-8b8e-7b5836fcbeef-etc-sysctl-d\") pod \"tuned-gq7wm\" (UID: \"f63dee9f-a259-4e50-8b8e-7b5836fcbeef\") " pod="openshift-cluster-node-tuning-operator/tuned-gq7wm" May 21 20:38:22.162564 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.162312 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f63dee9f-a259-4e50-8b8e-7b5836fcbeef-tmp\") pod \"tuned-gq7wm\" (UID: \"f63dee9f-a259-4e50-8b8e-7b5836fcbeef\") " pod="openshift-cluster-node-tuning-operator/tuned-gq7wm" May 21 20:38:22.162564 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.162331 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8463ad6-6f3b-4984-ab32-781d1507d42d-host-cni-bin\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.162564 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.162345 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/aa1ef7ae-4922-40df-833c-976271407550-host-run-k8s-cni-cncf-io\") pod \"multus-zngpc\" (UID: \"aa1ef7ae-4922-40df-833c-976271407550\") " pod="openshift-multus/multus-zngpc" May 21 20:38:22.162564 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.162363 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d8463ad6-6f3b-4984-ab32-781d1507d42d-systemd-units\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.162564 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.162388 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/87db88d5-9543-40d7-ae6f-2fecc9ac8a79-agent-certs\") pod \"konnectivity-agent-jldwc\" (UID: \"87db88d5-9543-40d7-ae6f-2fecc9ac8a79\") " pod="kube-system/konnectivity-agent-jldwc" May 21 20:38:22.162564 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.162408 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aa1ef7ae-4922-40df-833c-976271407550-os-release\") pod \"multus-zngpc\" (UID: \"aa1ef7ae-4922-40df-833c-976271407550\") " pod="openshift-multus/multus-zngpc" May 21 20:38:22.162564 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.162430 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/aa1ef7ae-4922-40df-833c-976271407550-multus-daemon-config\") pod \"multus-zngpc\" (UID: \"aa1ef7ae-4922-40df-833c-976271407550\") " pod="openshift-multus/multus-zngpc" May 21 20:38:22.162564 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.162461 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f63dee9f-a259-4e50-8b8e-7b5836fcbeef-etc-kubernetes\") pod \"tuned-gq7wm\" (UID: \"f63dee9f-a259-4e50-8b8e-7b5836fcbeef\") " pod="openshift-cluster-node-tuning-operator/tuned-gq7wm" May 21 20:38:22.162564 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.162493 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2tfp\" (UniqueName: \"kubernetes.io/projected/f63dee9f-a259-4e50-8b8e-7b5836fcbeef-kube-api-access-h2tfp\") pod \"tuned-gq7wm\" (UID: \"f63dee9f-a259-4e50-8b8e-7b5836fcbeef\") " pod="openshift-cluster-node-tuning-operator/tuned-gq7wm" May 21 20:38:22.162564 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.162511 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4dd7d419-f840-4936-b530-402082ab5877-sys-fs\") pod \"aws-ebs-csi-driver-node-zfm56\" (UID: \"4dd7d419-f840-4936-b530-402082ab5877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfm56" May 21 20:38:22.162564 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.162527 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtdnz\" (UniqueName: \"kubernetes.io/projected/4dd7d419-f840-4936-b530-402082ab5877-kube-api-access-gtdnz\") pod \"aws-ebs-csi-driver-node-zfm56\" (UID: \"4dd7d419-f840-4936-b530-402082ab5877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfm56" May 21 20:38:22.162564 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.162552 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8463ad6-6f3b-4984-ab32-781d1507d42d-host-run-netns\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.162564 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.162570 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d8463ad6-6f3b-4984-ab32-781d1507d42d-log-socket\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.162997 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.162586 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d8463ad6-6f3b-4984-ab32-781d1507d42d-ovnkube-config\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.162997 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.162609 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e4184fd4-d71d-4bda-bda1-e40fa42e76d7-hosts-file\") pod \"node-resolver-jfdql\" (UID: \"e4184fd4-d71d-4bda-bda1-e40fa42e76d7\") " pod="openshift-dns/node-resolver-jfdql" May 21 20:38:22.162997 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.162626 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d8463ad6-6f3b-4984-ab32-781d1507d42d-host-cni-netd\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.162997 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.162640 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aa5c876f-9493-4333-aa52-8a699dae2973-host-slash\") pod \"iptables-alerter-pbh8l\" (UID: \"aa5c876f-9493-4333-aa52-8a699dae2973\") " pod="openshift-network-operator/iptables-alerter-pbh8l" May 21 20:38:22.162997 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.162654 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa1ef7ae-4922-40df-833c-976271407550-etc-kubernetes\") pod \"multus-zngpc\" (UID: \"aa1ef7ae-4922-40df-833c-976271407550\") " pod="openshift-multus/multus-zngpc" May 21 20:38:22.162997 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.162674 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aa1ef7ae-4922-40df-833c-976271407550-multus-conf-dir\") pod \"multus-zngpc\" (UID: \"aa1ef7ae-4922-40df-833c-976271407550\") " pod="openshift-multus/multus-zngpc" May 21 20:38:22.162997 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.162689 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d8463ad6-6f3b-4984-ab32-781d1507d42d-ovnkube-script-lib\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.162997 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.162703 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5404da1c-65ab-46a6-8824-6a1eb233b16a-cni-binary-copy\") pod \"multus-additional-cni-plugins-8zgxn\" (UID: \"5404da1c-65ab-46a6-8824-6a1eb233b16a\") " pod="openshift-multus/multus-additional-cni-plugins-8zgxn" May 21 20:38:22.162997 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.162717 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aa1ef7ae-4922-40df-833c-976271407550-cnibin\") pod \"multus-zngpc\" (UID: \"aa1ef7ae-4922-40df-833c-976271407550\") " pod="openshift-multus/multus-zngpc" May 21 20:38:22.162997 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.162731 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrhh8\" (UniqueName: \"kubernetes.io/projected/bb9b42e0-e4e2-4738-b497-dbed3b79ec9f-kube-api-access-jrhh8\") pod \"node-ca-vfm2z\" (UID: \"bb9b42e0-e4e2-4738-b497-dbed3b79ec9f\") " pod="openshift-image-registry/node-ca-vfm2z" May 21 20:38:22.162997 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.162747 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8463ad6-6f3b-4984-ab32-781d1507d42d-etc-openvswitch\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.162997 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.162771 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5404da1c-65ab-46a6-8824-6a1eb233b16a-system-cni-dir\") pod \"multus-additional-cni-plugins-8zgxn\" (UID: \"5404da1c-65ab-46a6-8824-6a1eb233b16a\") " pod="openshift-multus/multus-additional-cni-plugins-8zgxn" May 21 20:38:22.162997 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.162792 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5404da1c-65ab-46a6-8824-6a1eb233b16a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8zgxn\" (UID: \"5404da1c-65ab-46a6-8824-6a1eb233b16a\") " pod="openshift-multus/multus-additional-cni-plugins-8zgxn" May 21 20:38:22.162997 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.162807 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aa1ef7ae-4922-40df-833c-976271407550-cni-binary-copy\") pod \"multus-zngpc\" (UID: \"aa1ef7ae-4922-40df-833c-976271407550\") " pod="openshift-multus/multus-zngpc" May 21 20:38:22.162997 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.162821 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f63dee9f-a259-4e50-8b8e-7b5836fcbeef-etc-sysctl-conf\") pod \"tuned-gq7wm\" (UID: \"f63dee9f-a259-4e50-8b8e-7b5836fcbeef\") " pod="openshift-cluster-node-tuning-operator/tuned-gq7wm" May 21 20:38:22.162997 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.162841 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f63dee9f-a259-4e50-8b8e-7b5836fcbeef-run\") pod \"tuned-gq7wm\" (UID: \"f63dee9f-a259-4e50-8b8e-7b5836fcbeef\") " pod="openshift-cluster-node-tuning-operator/tuned-gq7wm" May 21 20:38:22.163542 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.162860 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f63dee9f-a259-4e50-8b8e-7b5836fcbeef-lib-modules\") pod \"tuned-gq7wm\" (UID: \"f63dee9f-a259-4e50-8b8e-7b5836fcbeef\") " pod="openshift-cluster-node-tuning-operator/tuned-gq7wm" May 21 20:38:22.163542 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.162880 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8463ad6-6f3b-4984-ab32-781d1507d42d-var-lib-openvswitch\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.163542 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.162896 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/87db88d5-9543-40d7-ae6f-2fecc9ac8a79-konnectivity-ca\") pod \"konnectivity-agent-jldwc\" (UID: \"87db88d5-9543-40d7-ae6f-2fecc9ac8a79\") " pod="kube-system/konnectivity-agent-jldwc" May 21 20:38:22.163542 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.162993 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nl62\" (UniqueName: \"kubernetes.io/projected/aa5c876f-9493-4333-aa52-8a699dae2973-kube-api-access-4nl62\") pod \"iptables-alerter-pbh8l\" (UID: \"aa5c876f-9493-4333-aa52-8a699dae2973\") " pod="openshift-network-operator/iptables-alerter-pbh8l" May 21 20:38:22.163542 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.163020 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5404da1c-65ab-46a6-8824-6a1eb233b16a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8zgxn\" (UID: \"5404da1c-65ab-46a6-8824-6a1eb233b16a\") " pod="openshift-multus/multus-additional-cni-plugins-8zgxn" May 21 20:38:22.163542 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.163049 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gc49t\" (UniqueName: \"kubernetes.io/projected/5404da1c-65ab-46a6-8824-6a1eb233b16a-kube-api-access-gc49t\") pod \"multus-additional-cni-plugins-8zgxn\" (UID: \"5404da1c-65ab-46a6-8824-6a1eb233b16a\") " pod="openshift-multus/multus-additional-cni-plugins-8zgxn" May 21 20:38:22.163542 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.163073 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4dd7d419-f840-4936-b530-402082ab5877-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zfm56\" (UID: \"4dd7d419-f840-4936-b530-402082ab5877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfm56" May 21 20:38:22.163542 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.163102 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4dd7d419-f840-4936-b530-402082ab5877-socket-dir\") pod \"aws-ebs-csi-driver-node-zfm56\" (UID: \"4dd7d419-f840-4936-b530-402082ab5877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfm56" May 21 20:38:22.163542 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.163139 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4dd7d419-f840-4936-b530-402082ab5877-device-dir\") pod \"aws-ebs-csi-driver-node-zfm56\" (UID: \"4dd7d419-f840-4936-b530-402082ab5877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfm56" May 21 20:38:22.163542 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.163161 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crm28\" (UniqueName: \"kubernetes.io/projected/0a50c0b1-eccc-4bdf-a7d7-eca75843e83b-kube-api-access-crm28\") pod \"network-check-target-lqwhq\" (UID: \"0a50c0b1-eccc-4bdf-a7d7-eca75843e83b\") " pod="openshift-network-diagnostics/network-check-target-lqwhq" May 21 20:38:22.163542 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.163184 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/aa1ef7ae-4922-40df-833c-976271407550-hostroot\") pod \"multus-zngpc\" (UID: \"aa1ef7ae-4922-40df-833c-976271407550\") " pod="openshift-multus/multus-zngpc" May 21 20:38:22.163542 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.163199 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzwkz\" (UniqueName: \"kubernetes.io/projected/23d4cc46-4752-4afd-a726-67d9eced1af9-kube-api-access-zzwkz\") pod \"network-metrics-daemon-7lhdn\" (UID: \"23d4cc46-4752-4afd-a726-67d9eced1af9\") " pod="openshift-multus/network-metrics-daemon-7lhdn" May 21 20:38:22.163542 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.163221 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f63dee9f-a259-4e50-8b8e-7b5836fcbeef-etc-systemd\") pod \"tuned-gq7wm\" (UID: \"f63dee9f-a259-4e50-8b8e-7b5836fcbeef\") " pod="openshift-cluster-node-tuning-operator/tuned-gq7wm" May 21 20:38:22.163542 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.163239 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f63dee9f-a259-4e50-8b8e-7b5836fcbeef-sys\") pod \"tuned-gq7wm\" (UID: \"f63dee9f-a259-4e50-8b8e-7b5836fcbeef\") " pod="openshift-cluster-node-tuning-operator/tuned-gq7wm" May 21 20:38:22.163542 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.163259 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f63dee9f-a259-4e50-8b8e-7b5836fcbeef-etc-tuned\") pod \"tuned-gq7wm\" (UID: \"f63dee9f-a259-4e50-8b8e-7b5836fcbeef\") " pod="openshift-cluster-node-tuning-operator/tuned-gq7wm" May 21 20:38:22.163542 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.163288 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa1ef7ae-4922-40df-833c-976271407550-multus-cni-dir\") pod \"multus-zngpc\" (UID: \"aa1ef7ae-4922-40df-833c-976271407550\") " pod="openshift-multus/multus-zngpc" May 21 20:38:22.164094 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.163319 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4dd7d419-f840-4936-b530-402082ab5877-etc-selinux\") pod \"aws-ebs-csi-driver-node-zfm56\" (UID: \"4dd7d419-f840-4936-b530-402082ab5877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfm56" May 21 20:38:22.164094 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.163345 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmp2l\" (UniqueName: \"kubernetes.io/projected/e4184fd4-d71d-4bda-bda1-e40fa42e76d7-kube-api-access-fmp2l\") pod \"node-resolver-jfdql\" (UID: \"e4184fd4-d71d-4bda-bda1-e40fa42e76d7\") " pod="openshift-dns/node-resolver-jfdql" May 21 20:38:22.164094 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.163380 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bb9b42e0-e4e2-4738-b497-dbed3b79ec9f-host\") pod \"node-ca-vfm2z\" (UID: \"bb9b42e0-e4e2-4738-b497-dbed3b79ec9f\") " pod="openshift-image-registry/node-ca-vfm2z" May 21 20:38:22.164094 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.163395 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d8463ad6-6f3b-4984-ab32-781d1507d42d-env-overrides\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.164094 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.163417 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/aa5c876f-9493-4333-aa52-8a699dae2973-iptables-alerter-script\") pod \"iptables-alerter-pbh8l\" (UID: \"aa5c876f-9493-4333-aa52-8a699dae2973\") " pod="openshift-network-operator/iptables-alerter-pbh8l" May 21 20:38:22.164094 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.163437 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23d4cc46-4752-4afd-a726-67d9eced1af9-metrics-certs\") pod \"network-metrics-daemon-7lhdn\" (UID: \"23d4cc46-4752-4afd-a726-67d9eced1af9\") " pod="openshift-multus/network-metrics-daemon-7lhdn" May 21 20:38:22.164094 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.163453 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8463ad6-6f3b-4984-ab32-781d1507d42d-host-kubelet\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.164094 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.163494 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d8463ad6-6f3b-4984-ab32-781d1507d42d-host-slash\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.164094 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.163513 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8463ad6-6f3b-4984-ab32-781d1507d42d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.164094 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.163533 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aa1ef7ae-4922-40df-833c-976271407550-host-var-lib-cni-bin\") pod \"multus-zngpc\" (UID: \"aa1ef7ae-4922-40df-833c-976271407550\") " pod="openshift-multus/multus-zngpc" May 21 20:38:22.164094 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.163557 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z6fh\" (UniqueName: \"kubernetes.io/projected/aa1ef7ae-4922-40df-833c-976271407550-kube-api-access-2z6fh\") pod \"multus-zngpc\" (UID: \"aa1ef7ae-4922-40df-833c-976271407550\") " pod="openshift-multus/multus-zngpc" May 21 20:38:22.164094 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.163581 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bb9b42e0-e4e2-4738-b497-dbed3b79ec9f-serviceca\") pod \"node-ca-vfm2z\" (UID: \"bb9b42e0-e4e2-4738-b497-dbed3b79ec9f\") " pod="openshift-image-registry/node-ca-vfm2z" May 21 20:38:22.164094 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.163610 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d8463ad6-6f3b-4984-ab32-781d1507d42d-run-systemd\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.164094 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.163630 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5404da1c-65ab-46a6-8824-6a1eb233b16a-cnibin\") pod \"multus-additional-cni-plugins-8zgxn\" (UID: \"5404da1c-65ab-46a6-8824-6a1eb233b16a\") " pod="openshift-multus/multus-additional-cni-plugins-8zgxn" May 21 20:38:22.164094 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.163651 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4dd7d419-f840-4936-b530-402082ab5877-registration-dir\") pod \"aws-ebs-csi-driver-node-zfm56\" (UID: \"4dd7d419-f840-4936-b530-402082ab5877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfm56" May 21 20:38:22.164094 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.163667 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4184fd4-d71d-4bda-bda1-e40fa42e76d7-tmp-dir\") pod \"node-resolver-jfdql\" (UID: \"e4184fd4-d71d-4bda-bda1-e40fa42e76d7\") " pod="openshift-dns/node-resolver-jfdql" May 21 20:38:22.164647 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.163685 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/aa1ef7ae-4922-40df-833c-976271407550-host-var-lib-cni-multus\") pod \"multus-zngpc\" (UID: \"aa1ef7ae-4922-40df-833c-976271407550\") " pod="openshift-multus/multus-zngpc" May 21 20:38:22.164647 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.163702 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa1ef7ae-4922-40df-833c-976271407550-host-var-lib-kubelet\") pod \"multus-zngpc\" (UID: \"aa1ef7ae-4922-40df-833c-976271407550\") " pod="openshift-multus/multus-zngpc" May 21 20:38:22.164647 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.163724 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d8463ad6-6f3b-4984-ab32-781d1507d42d-run-ovn\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.187823 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.187790 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 20:33:21 +0000 UTC" deadline="2027-12-18 01:09:59.786139095 +0000 UTC" May 21 20:38:22.187823 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.187819 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13804h31m37.598323032s" May 21 20:38:22.264190 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.264157 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bb9b42e0-e4e2-4738-b497-dbed3b79ec9f-serviceca\") pod \"node-ca-vfm2z\" (UID: \"bb9b42e0-e4e2-4738-b497-dbed3b79ec9f\") " pod="openshift-image-registry/node-ca-vfm2z" May 21 20:38:22.264385 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.264206 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d8463ad6-6f3b-4984-ab32-781d1507d42d-run-systemd\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.264385 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.264232 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5404da1c-65ab-46a6-8824-6a1eb233b16a-cnibin\") pod \"multus-additional-cni-plugins-8zgxn\" (UID: \"5404da1c-65ab-46a6-8824-6a1eb233b16a\") " pod="openshift-multus/multus-additional-cni-plugins-8zgxn" May 21 20:38:22.264385 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.264255 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4dd7d419-f840-4936-b530-402082ab5877-registration-dir\") pod \"aws-ebs-csi-driver-node-zfm56\" (UID: \"4dd7d419-f840-4936-b530-402082ab5877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfm56" May 21 20:38:22.264385 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.264278 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4184fd4-d71d-4bda-bda1-e40fa42e76d7-tmp-dir\") pod \"node-resolver-jfdql\" (UID: \"e4184fd4-d71d-4bda-bda1-e40fa42e76d7\") " pod="openshift-dns/node-resolver-jfdql" May 21 20:38:22.264385 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.264298 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/aa1ef7ae-4922-40df-833c-976271407550-host-var-lib-cni-multus\") pod \"multus-zngpc\" (UID: \"aa1ef7ae-4922-40df-833c-976271407550\") " pod="openshift-multus/multus-zngpc" May 21 20:38:22.264385 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.264318 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa1ef7ae-4922-40df-833c-976271407550-host-var-lib-kubelet\") pod \"multus-zngpc\" (UID: \"aa1ef7ae-4922-40df-833c-976271407550\") " pod="openshift-multus/multus-zngpc" May 21 20:38:22.264385 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.264349 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d8463ad6-6f3b-4984-ab32-781d1507d42d-run-ovn\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.264385 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.264357 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d8463ad6-6f3b-4984-ab32-781d1507d42d-run-systemd\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.264385 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.264370 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d8463ad6-6f3b-4984-ab32-781d1507d42d-ovn-node-metrics-cert\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.264846 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.264414 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6pgm5\" (UniqueName: \"kubernetes.io/projected/d8463ad6-6f3b-4984-ab32-781d1507d42d-kube-api-access-6pgm5\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.264846 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.264433 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa1ef7ae-4922-40df-833c-976271407550-host-var-lib-kubelet\") pod \"multus-zngpc\" (UID: \"aa1ef7ae-4922-40df-833c-976271407550\") " pod="openshift-multus/multus-zngpc" May 21 20:38:22.264846 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.264440 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa1ef7ae-4922-40df-833c-976271407550-system-cni-dir\") pod \"multus-zngpc\" (UID: \"aa1ef7ae-4922-40df-833c-976271407550\") " pod="openshift-multus/multus-zngpc" May 21 20:38:22.264846 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.264487 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aa1ef7ae-4922-40df-833c-976271407550-host-run-netns\") pod \"multus-zngpc\" (UID: \"aa1ef7ae-4922-40df-833c-976271407550\") " pod="openshift-multus/multus-zngpc" May 21 20:38:22.264846 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.264507 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d8463ad6-6f3b-4984-ab32-781d1507d42d-run-ovn\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.264846 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.264512 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f63dee9f-a259-4e50-8b8e-7b5836fcbeef-host\") pod \"tuned-gq7wm\" (UID: \"f63dee9f-a259-4e50-8b8e-7b5836fcbeef\") " pod="openshift-cluster-node-tuning-operator/tuned-gq7wm" May 21 20:38:22.264846 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.264342 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5404da1c-65ab-46a6-8824-6a1eb233b16a-cnibin\") pod \"multus-additional-cni-plugins-8zgxn\" (UID: \"5404da1c-65ab-46a6-8824-6a1eb233b16a\") " pod="openshift-multus/multus-additional-cni-plugins-8zgxn" May 21 20:38:22.264846 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.264546 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8463ad6-6f3b-4984-ab32-781d1507d42d-run-openvswitch\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.264846 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.264571 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f63dee9f-a259-4e50-8b8e-7b5836fcbeef-host\") pod \"tuned-gq7wm\" (UID: \"f63dee9f-a259-4e50-8b8e-7b5836fcbeef\") " pod="openshift-cluster-node-tuning-operator/tuned-gq7wm" May 21 20:38:22.264846 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.264620 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f63dee9f-a259-4e50-8b8e-7b5836fcbeef-etc-sysconfig\") pod \"tuned-gq7wm\" (UID: \"f63dee9f-a259-4e50-8b8e-7b5836fcbeef\") " pod="openshift-cluster-node-tuning-operator/tuned-gq7wm" May 21 20:38:22.264846 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.264628 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8463ad6-6f3b-4984-ab32-781d1507d42d-run-openvswitch\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.264846 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.264681 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aa1ef7ae-4922-40df-833c-976271407550-host-run-netns\") pod \"multus-zngpc\" (UID: \"aa1ef7ae-4922-40df-833c-976271407550\") " pod="openshift-multus/multus-zngpc" May 21 20:38:22.264846 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.264685 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa1ef7ae-4922-40df-833c-976271407550-system-cni-dir\") pod \"multus-zngpc\" (UID: \"aa1ef7ae-4922-40df-833c-976271407550\") " pod="openshift-multus/multus-zngpc" May 21 20:38:22.264846 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.264573 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f63dee9f-a259-4e50-8b8e-7b5836fcbeef-etc-sysconfig\") pod \"tuned-gq7wm\" (UID: \"f63dee9f-a259-4e50-8b8e-7b5836fcbeef\") " pod="openshift-cluster-node-tuning-operator/tuned-gq7wm" May 21 20:38:22.264846 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.264719 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f63dee9f-a259-4e50-8b8e-7b5836fcbeef-var-lib-kubelet\") pod \"tuned-gq7wm\" (UID: \"f63dee9f-a259-4e50-8b8e-7b5836fcbeef\") " pod="openshift-cluster-node-tuning-operator/tuned-gq7wm" May 21 20:38:22.264846 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.264727 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bb9b42e0-e4e2-4738-b497-dbed3b79ec9f-serviceca\") pod \"node-ca-vfm2z\" (UID: \"bb9b42e0-e4e2-4738-b497-dbed3b79ec9f\") " pod="openshift-image-registry/node-ca-vfm2z" May 21 20:38:22.264846 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.264742 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d8463ad6-6f3b-4984-ab32-781d1507d42d-node-log\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.264846 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.264831 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8463ad6-6f3b-4984-ab32-781d1507d42d-host-run-ovn-kubernetes\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.265565 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.264867 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8463ad6-6f3b-4984-ab32-781d1507d42d-host-run-ovn-kubernetes\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.265565 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.264884 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5404da1c-65ab-46a6-8824-6a1eb233b16a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8zgxn\" (UID: \"5404da1c-65ab-46a6-8824-6a1eb233b16a\") " pod="openshift-multus/multus-additional-cni-plugins-8zgxn" May 21 20:38:22.265565 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.264912 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/aa1ef7ae-4922-40df-833c-976271407550-multus-socket-dir-parent\") pod \"multus-zngpc\" (UID: \"aa1ef7ae-4922-40df-833c-976271407550\") " pod="openshift-multus/multus-zngpc" May 21 20:38:22.265565 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.264920 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f63dee9f-a259-4e50-8b8e-7b5836fcbeef-var-lib-kubelet\") pod \"tuned-gq7wm\" (UID: \"f63dee9f-a259-4e50-8b8e-7b5836fcbeef\") " pod="openshift-cluster-node-tuning-operator/tuned-gq7wm" May 21 20:38:22.267816 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.264425 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/aa1ef7ae-4922-40df-833c-976271407550-host-var-lib-cni-multus\") pod \"multus-zngpc\" (UID: \"aa1ef7ae-4922-40df-833c-976271407550\") " pod="openshift-multus/multus-zngpc" May 21 20:38:22.267816 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.265239 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4dd7d419-f840-4936-b530-402082ab5877-registration-dir\") pod \"aws-ebs-csi-driver-node-zfm56\" (UID: \"4dd7d419-f840-4936-b530-402082ab5877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfm56" May 21 20:38:22.268012 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.265297 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/aa1ef7ae-4922-40df-833c-976271407550-multus-socket-dir-parent\") pod \"multus-zngpc\" (UID: \"aa1ef7ae-4922-40df-833c-976271407550\") " pod="openshift-multus/multus-zngpc" May 21 20:38:22.268012 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.265321 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d8463ad6-6f3b-4984-ab32-781d1507d42d-node-log\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.268012 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.265450 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5404da1c-65ab-46a6-8824-6a1eb233b16a-os-release\") pod \"multus-additional-cni-plugins-8zgxn\" (UID: \"5404da1c-65ab-46a6-8824-6a1eb233b16a\") " pod="openshift-multus/multus-additional-cni-plugins-8zgxn" May 21 20:38:22.268012 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.267893 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/aa1ef7ae-4922-40df-833c-976271407550-host-run-multus-certs\") pod \"multus-zngpc\" (UID: \"aa1ef7ae-4922-40df-833c-976271407550\") " pod="openshift-multus/multus-zngpc" May 21 20:38:22.268012 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.267931 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f63dee9f-a259-4e50-8b8e-7b5836fcbeef-etc-modprobe-d\") pod \"tuned-gq7wm\" (UID: \"f63dee9f-a259-4e50-8b8e-7b5836fcbeef\") " pod="openshift-cluster-node-tuning-operator/tuned-gq7wm" May 21 20:38:22.268012 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.267960 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f63dee9f-a259-4e50-8b8e-7b5836fcbeef-etc-sysctl-d\") pod \"tuned-gq7wm\" (UID: \"f63dee9f-a259-4e50-8b8e-7b5836fcbeef\") " pod="openshift-cluster-node-tuning-operator/tuned-gq7wm" May 21 20:38:22.268012 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.265549 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5404da1c-65ab-46a6-8824-6a1eb233b16a-os-release\") pod \"multus-additional-cni-plugins-8zgxn\" (UID: \"5404da1c-65ab-46a6-8824-6a1eb233b16a\") " pod="openshift-multus/multus-additional-cni-plugins-8zgxn" May 21 20:38:22.268012 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.267988 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f63dee9f-a259-4e50-8b8e-7b5836fcbeef-tmp\") pod \"tuned-gq7wm\" (UID: \"f63dee9f-a259-4e50-8b8e-7b5836fcbeef\") " pod="openshift-cluster-node-tuning-operator/tuned-gq7wm" May 21 20:38:22.268012 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.265463 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5404da1c-65ab-46a6-8824-6a1eb233b16a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8zgxn\" (UID: \"5404da1c-65ab-46a6-8824-6a1eb233b16a\") " pod="openshift-multus/multus-additional-cni-plugins-8zgxn" May 21 20:38:22.268012 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.268014 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8463ad6-6f3b-4984-ab32-781d1507d42d-host-cni-bin\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.268492 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.265835 2570 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 21 20:38:22.268492 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.268118 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/aa1ef7ae-4922-40df-833c-976271407550-host-run-k8s-cni-cncf-io\") pod \"multus-zngpc\" (UID: \"aa1ef7ae-4922-40df-833c-976271407550\") " pod="openshift-multus/multus-zngpc" May 21 20:38:22.268492 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.268177 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d8463ad6-6f3b-4984-ab32-781d1507d42d-systemd-units\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.268492 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.268186 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f63dee9f-a259-4e50-8b8e-7b5836fcbeef-etc-sysctl-d\") pod \"tuned-gq7wm\" (UID: \"f63dee9f-a259-4e50-8b8e-7b5836fcbeef\") " pod="openshift-cluster-node-tuning-operator/tuned-gq7wm" May 21 20:38:22.268492 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.268214 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/87db88d5-9543-40d7-ae6f-2fecc9ac8a79-agent-certs\") pod \"konnectivity-agent-jldwc\" (UID: \"87db88d5-9543-40d7-ae6f-2fecc9ac8a79\") " pod="kube-system/konnectivity-agent-jldwc" May 21 20:38:22.268492 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.268249 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aa1ef7ae-4922-40df-833c-976271407550-os-release\") pod \"multus-zngpc\" (UID: \"aa1ef7ae-4922-40df-833c-976271407550\") " pod="openshift-multus/multus-zngpc" May 21 20:38:22.268492 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.268255 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8463ad6-6f3b-4984-ab32-781d1507d42d-host-cni-bin\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.268492 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.268279 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/aa1ef7ae-4922-40df-833c-976271407550-multus-daemon-config\") pod \"multus-zngpc\" (UID: \"aa1ef7ae-4922-40df-833c-976271407550\") " pod="openshift-multus/multus-zngpc" May 21 20:38:22.268492 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.268315 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f63dee9f-a259-4e50-8b8e-7b5836fcbeef-etc-kubernetes\") pod \"tuned-gq7wm\" (UID: \"f63dee9f-a259-4e50-8b8e-7b5836fcbeef\") " pod="openshift-cluster-node-tuning-operator/tuned-gq7wm" May 21 20:38:22.268492 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.268353 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h2tfp\" (UniqueName: \"kubernetes.io/projected/f63dee9f-a259-4e50-8b8e-7b5836fcbeef-kube-api-access-h2tfp\") pod \"tuned-gq7wm\" (UID: \"f63dee9f-a259-4e50-8b8e-7b5836fcbeef\") " pod="openshift-cluster-node-tuning-operator/tuned-gq7wm" May 21 20:38:22.268492 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.268378 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d8463ad6-6f3b-4984-ab32-781d1507d42d-systemd-units\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.268492 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.268398 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4dd7d419-f840-4936-b530-402082ab5877-sys-fs\") pod \"aws-ebs-csi-driver-node-zfm56\" (UID: \"4dd7d419-f840-4936-b530-402082ab5877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfm56" May 21 20:38:22.268492 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.268438 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f63dee9f-a259-4e50-8b8e-7b5836fcbeef-etc-kubernetes\") pod \"tuned-gq7wm\" (UID: \"f63dee9f-a259-4e50-8b8e-7b5836fcbeef\") " pod="openshift-cluster-node-tuning-operator/tuned-gq7wm" May 21 20:38:22.268492 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.268438 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gtdnz\" (UniqueName: \"kubernetes.io/projected/4dd7d419-f840-4936-b530-402082ab5877-kube-api-access-gtdnz\") pod \"aws-ebs-csi-driver-node-zfm56\" (UID: \"4dd7d419-f840-4936-b530-402082ab5877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfm56" May 21 20:38:22.269106 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.268514 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8463ad6-6f3b-4984-ab32-781d1507d42d-host-run-netns\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.269106 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.268538 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d8463ad6-6f3b-4984-ab32-781d1507d42d-log-socket\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.269106 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.268566 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d8463ad6-6f3b-4984-ab32-781d1507d42d-ovnkube-config\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.269106 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.268587 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e4184fd4-d71d-4bda-bda1-e40fa42e76d7-hosts-file\") pod \"node-resolver-jfdql\" (UID: \"e4184fd4-d71d-4bda-bda1-e40fa42e76d7\") " pod="openshift-dns/node-resolver-jfdql" May 21 20:38:22.269106 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.268608 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d8463ad6-6f3b-4984-ab32-781d1507d42d-host-cni-netd\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.269106 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.268624 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aa5c876f-9493-4333-aa52-8a699dae2973-host-slash\") pod \"iptables-alerter-pbh8l\" (UID: \"aa5c876f-9493-4333-aa52-8a699dae2973\") " pod="openshift-network-operator/iptables-alerter-pbh8l" May 21 20:38:22.269106 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.268651 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa1ef7ae-4922-40df-833c-976271407550-etc-kubernetes\") pod \"multus-zngpc\" (UID: \"aa1ef7ae-4922-40df-833c-976271407550\") " pod="openshift-multus/multus-zngpc" May 21 20:38:22.269106 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.268671 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aa1ef7ae-4922-40df-833c-976271407550-multus-conf-dir\") pod \"multus-zngpc\" (UID: \"aa1ef7ae-4922-40df-833c-976271407550\") " pod="openshift-multus/multus-zngpc" May 21 20:38:22.269106 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.268692 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d8463ad6-6f3b-4984-ab32-781d1507d42d-ovnkube-script-lib\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.269106 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.268304 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/aa1ef7ae-4922-40df-833c-976271407550-host-run-multus-certs\") pod \"multus-zngpc\" (UID: \"aa1ef7ae-4922-40df-833c-976271407550\") " pod="openshift-multus/multus-zngpc" May 21 20:38:22.269106 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.268726 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5404da1c-65ab-46a6-8824-6a1eb233b16a-cni-binary-copy\") pod \"multus-additional-cni-plugins-8zgxn\" (UID: \"5404da1c-65ab-46a6-8824-6a1eb233b16a\") " pod="openshift-multus/multus-additional-cni-plugins-8zgxn" May 21 20:38:22.269106 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.268750 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aa1ef7ae-4922-40df-833c-976271407550-cnibin\") pod \"multus-zngpc\" (UID: \"aa1ef7ae-4922-40df-833c-976271407550\") " pod="openshift-multus/multus-zngpc" May 21 20:38:22.269106 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.265629 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4184fd4-d71d-4bda-bda1-e40fa42e76d7-tmp-dir\") pod \"node-resolver-jfdql\" (UID: \"e4184fd4-d71d-4bda-bda1-e40fa42e76d7\") " pod="openshift-dns/node-resolver-jfdql" May 21 20:38:22.269106 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.268814 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aa1ef7ae-4922-40df-833c-976271407550-cnibin\") pod \"multus-zngpc\" (UID: \"aa1ef7ae-4922-40df-833c-976271407550\") " pod="openshift-multus/multus-zngpc" May 21 20:38:22.269106 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.268824 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/aa1ef7ae-4922-40df-833c-976271407550-host-run-k8s-cni-cncf-io\") pod \"multus-zngpc\" (UID: \"aa1ef7ae-4922-40df-833c-976271407550\") " pod="openshift-multus/multus-zngpc" May 21 20:38:22.269106 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.268845 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e4184fd4-d71d-4bda-bda1-e40fa42e76d7-hosts-file\") pod \"node-resolver-jfdql\" (UID: \"e4184fd4-d71d-4bda-bda1-e40fa42e76d7\") " pod="openshift-dns/node-resolver-jfdql" May 21 20:38:22.269106 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.268860 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d8463ad6-6f3b-4984-ab32-781d1507d42d-host-cni-netd\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.269106 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.268873 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jrhh8\" (UniqueName: \"kubernetes.io/projected/bb9b42e0-e4e2-4738-b497-dbed3b79ec9f-kube-api-access-jrhh8\") pod \"node-ca-vfm2z\" (UID: \"bb9b42e0-e4e2-4738-b497-dbed3b79ec9f\") " pod="openshift-image-registry/node-ca-vfm2z" May 21 20:38:22.269941 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.268877 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4dd7d419-f840-4936-b530-402082ab5877-sys-fs\") pod \"aws-ebs-csi-driver-node-zfm56\" (UID: \"4dd7d419-f840-4936-b530-402082ab5877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfm56" May 21 20:38:22.269941 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.268907 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8463ad6-6f3b-4984-ab32-781d1507d42d-etc-openvswitch\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.269941 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.268911 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aa5c876f-9493-4333-aa52-8a699dae2973-host-slash\") pod \"iptables-alerter-pbh8l\" (UID: \"aa5c876f-9493-4333-aa52-8a699dae2973\") " pod="openshift-network-operator/iptables-alerter-pbh8l" May 21 20:38:22.269941 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.268925 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aa1ef7ae-4922-40df-833c-976271407550-os-release\") pod \"multus-zngpc\" (UID: \"aa1ef7ae-4922-40df-833c-976271407550\") " pod="openshift-multus/multus-zngpc" May 21 20:38:22.269941 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.268939 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5404da1c-65ab-46a6-8824-6a1eb233b16a-system-cni-dir\") pod \"multus-additional-cni-plugins-8zgxn\" (UID: \"5404da1c-65ab-46a6-8824-6a1eb233b16a\") " pod="openshift-multus/multus-additional-cni-plugins-8zgxn" May 21 20:38:22.269941 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.268968 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5404da1c-65ab-46a6-8824-6a1eb233b16a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8zgxn\" (UID: \"5404da1c-65ab-46a6-8824-6a1eb233b16a\") " pod="openshift-multus/multus-additional-cni-plugins-8zgxn" May 21 20:38:22.269941 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.268999 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aa1ef7ae-4922-40df-833c-976271407550-cni-binary-copy\") pod \"multus-zngpc\" (UID: \"aa1ef7ae-4922-40df-833c-976271407550\") " pod="openshift-multus/multus-zngpc" May 21 20:38:22.269941 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.269034 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f63dee9f-a259-4e50-8b8e-7b5836fcbeef-etc-sysctl-conf\") pod \"tuned-gq7wm\" (UID: \"f63dee9f-a259-4e50-8b8e-7b5836fcbeef\") " pod="openshift-cluster-node-tuning-operator/tuned-gq7wm" May 21 20:38:22.269941 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.269066 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f63dee9f-a259-4e50-8b8e-7b5836fcbeef-run\") pod \"tuned-gq7wm\" (UID: \"f63dee9f-a259-4e50-8b8e-7b5836fcbeef\") " pod="openshift-cluster-node-tuning-operator/tuned-gq7wm" May 21 20:38:22.269941 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.269100 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f63dee9f-a259-4e50-8b8e-7b5836fcbeef-lib-modules\") pod \"tuned-gq7wm\" (UID: \"f63dee9f-a259-4e50-8b8e-7b5836fcbeef\") " pod="openshift-cluster-node-tuning-operator/tuned-gq7wm" May 21 20:38:22.269941 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.269136 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8463ad6-6f3b-4984-ab32-781d1507d42d-var-lib-openvswitch\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.269941 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.269168 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/87db88d5-9543-40d7-ae6f-2fecc9ac8a79-konnectivity-ca\") pod \"konnectivity-agent-jldwc\" (UID: \"87db88d5-9543-40d7-ae6f-2fecc9ac8a79\") " pod="kube-system/konnectivity-agent-jldwc" May 21 20:38:22.269941 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.269200 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4nl62\" (UniqueName: \"kubernetes.io/projected/aa5c876f-9493-4333-aa52-8a699dae2973-kube-api-access-4nl62\") pod \"iptables-alerter-pbh8l\" (UID: \"aa5c876f-9493-4333-aa52-8a699dae2973\") " pod="openshift-network-operator/iptables-alerter-pbh8l" May 21 20:38:22.269941 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.269224 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f63dee9f-a259-4e50-8b8e-7b5836fcbeef-etc-modprobe-d\") pod \"tuned-gq7wm\" (UID: \"f63dee9f-a259-4e50-8b8e-7b5836fcbeef\") " pod="openshift-cluster-node-tuning-operator/tuned-gq7wm" May 21 20:38:22.269941 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.269233 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5404da1c-65ab-46a6-8824-6a1eb233b16a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8zgxn\" (UID: \"5404da1c-65ab-46a6-8824-6a1eb233b16a\") " pod="openshift-multus/multus-additional-cni-plugins-8zgxn" May 21 20:38:22.269941 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.269271 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gc49t\" (UniqueName: \"kubernetes.io/projected/5404da1c-65ab-46a6-8824-6a1eb233b16a-kube-api-access-gc49t\") pod \"multus-additional-cni-plugins-8zgxn\" (UID: \"5404da1c-65ab-46a6-8824-6a1eb233b16a\") " pod="openshift-multus/multus-additional-cni-plugins-8zgxn" May 21 20:38:22.269941 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.269290 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8463ad6-6f3b-4984-ab32-781d1507d42d-host-run-netns\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.270740 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.269303 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4dd7d419-f840-4936-b530-402082ab5877-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zfm56\" (UID: \"4dd7d419-f840-4936-b530-402082ab5877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfm56" May 21 20:38:22.270740 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.269336 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4dd7d419-f840-4936-b530-402082ab5877-socket-dir\") pod \"aws-ebs-csi-driver-node-zfm56\" (UID: \"4dd7d419-f840-4936-b530-402082ab5877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfm56" May 21 20:38:22.270740 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.269340 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d8463ad6-6f3b-4984-ab32-781d1507d42d-log-socket\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.270740 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.269387 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4dd7d419-f840-4936-b530-402082ab5877-device-dir\") pod \"aws-ebs-csi-driver-node-zfm56\" (UID: \"4dd7d419-f840-4936-b530-402082ab5877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfm56" May 21 20:38:22.270740 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.269409 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5404da1c-65ab-46a6-8824-6a1eb233b16a-system-cni-dir\") pod \"multus-additional-cni-plugins-8zgxn\" (UID: \"5404da1c-65ab-46a6-8824-6a1eb233b16a\") " pod="openshift-multus/multus-additional-cni-plugins-8zgxn" May 21 20:38:22.270740 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.269426 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-crm28\" (UniqueName: \"kubernetes.io/projected/0a50c0b1-eccc-4bdf-a7d7-eca75843e83b-kube-api-access-crm28\") pod \"network-check-target-lqwhq\" (UID: \"0a50c0b1-eccc-4bdf-a7d7-eca75843e83b\") " pod="openshift-network-diagnostics/network-check-target-lqwhq" May 21 20:38:22.270740 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.269512 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/aa1ef7ae-4922-40df-833c-976271407550-multus-daemon-config\") pod \"multus-zngpc\" (UID: \"aa1ef7ae-4922-40df-833c-976271407550\") " pod="openshift-multus/multus-zngpc" May 21 20:38:22.270740 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.269541 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d8463ad6-6f3b-4984-ab32-781d1507d42d-ovnkube-script-lib\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.270740 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.269595 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aa1ef7ae-4922-40df-833c-976271407550-multus-conf-dir\") pod \"multus-zngpc\" (UID: \"aa1ef7ae-4922-40df-833c-976271407550\") " pod="openshift-multus/multus-zngpc" May 21 20:38:22.270740 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.269707 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa1ef7ae-4922-40df-833c-976271407550-etc-kubernetes\") pod \"multus-zngpc\" (UID: \"aa1ef7ae-4922-40df-833c-976271407550\") " pod="openshift-multus/multus-zngpc" May 21 20:38:22.270740 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.269770 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4dd7d419-f840-4936-b530-402082ab5877-device-dir\") pod \"aws-ebs-csi-driver-node-zfm56\" (UID: \"4dd7d419-f840-4936-b530-402082ab5877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfm56" May 21 20:38:22.270740 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.269825 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8463ad6-6f3b-4984-ab32-781d1507d42d-etc-openvswitch\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.270740 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.269983 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5404da1c-65ab-46a6-8824-6a1eb233b16a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8zgxn\" (UID: \"5404da1c-65ab-46a6-8824-6a1eb233b16a\") " pod="openshift-multus/multus-additional-cni-plugins-8zgxn" May 21 20:38:22.270740 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.270459 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4dd7d419-f840-4936-b530-402082ab5877-socket-dir\") pod \"aws-ebs-csi-driver-node-zfm56\" (UID: \"4dd7d419-f840-4936-b530-402082ab5877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfm56" May 21 20:38:22.270740 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.270729 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d8463ad6-6f3b-4984-ab32-781d1507d42d-ovnkube-config\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.275747 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.270758 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aa1ef7ae-4922-40df-833c-976271407550-cni-binary-copy\") pod \"multus-zngpc\" (UID: \"aa1ef7ae-4922-40df-833c-976271407550\") " pod="openshift-multus/multus-zngpc" May 21 20:38:22.275747 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.270785 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/aa1ef7ae-4922-40df-833c-976271407550-hostroot\") pod \"multus-zngpc\" (UID: \"aa1ef7ae-4922-40df-833c-976271407550\") " pod="openshift-multus/multus-zngpc" May 21 20:38:22.275747 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.270844 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/aa1ef7ae-4922-40df-833c-976271407550-hostroot\") pod \"multus-zngpc\" (UID: \"aa1ef7ae-4922-40df-833c-976271407550\") " pod="openshift-multus/multus-zngpc" May 21 20:38:22.275747 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.270866 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f63dee9f-a259-4e50-8b8e-7b5836fcbeef-run\") pod \"tuned-gq7wm\" (UID: \"f63dee9f-a259-4e50-8b8e-7b5836fcbeef\") " pod="openshift-cluster-node-tuning-operator/tuned-gq7wm" May 21 20:38:22.275747 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.270904 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f63dee9f-a259-4e50-8b8e-7b5836fcbeef-etc-sysctl-conf\") pod \"tuned-gq7wm\" (UID: \"f63dee9f-a259-4e50-8b8e-7b5836fcbeef\") " pod="openshift-cluster-node-tuning-operator/tuned-gq7wm" May 21 20:38:22.275747 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.270910 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5404da1c-65ab-46a6-8824-6a1eb233b16a-cni-binary-copy\") pod \"multus-additional-cni-plugins-8zgxn\" (UID: \"5404da1c-65ab-46a6-8824-6a1eb233b16a\") " pod="openshift-multus/multus-additional-cni-plugins-8zgxn" May 21 20:38:22.275747 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.270940 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f63dee9f-a259-4e50-8b8e-7b5836fcbeef-lib-modules\") pod \"tuned-gq7wm\" (UID: \"f63dee9f-a259-4e50-8b8e-7b5836fcbeef\") " pod="openshift-cluster-node-tuning-operator/tuned-gq7wm" May 21 20:38:22.275747 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.270946 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8463ad6-6f3b-4984-ab32-781d1507d42d-var-lib-openvswitch\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.275747 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.270950 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zzwkz\" (UniqueName: \"kubernetes.io/projected/23d4cc46-4752-4afd-a726-67d9eced1af9-kube-api-access-zzwkz\") pod \"network-metrics-daemon-7lhdn\" (UID: \"23d4cc46-4752-4afd-a726-67d9eced1af9\") " pod="openshift-multus/network-metrics-daemon-7lhdn" May 21 20:38:22.275747 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.270985 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4dd7d419-f840-4936-b530-402082ab5877-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zfm56\" (UID: \"4dd7d419-f840-4936-b530-402082ab5877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfm56" May 21 20:38:22.275747 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.270988 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f63dee9f-a259-4e50-8b8e-7b5836fcbeef-etc-systemd\") pod \"tuned-gq7wm\" (UID: \"f63dee9f-a259-4e50-8b8e-7b5836fcbeef\") " pod="openshift-cluster-node-tuning-operator/tuned-gq7wm" May 21 20:38:22.275747 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.271021 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f63dee9f-a259-4e50-8b8e-7b5836fcbeef-sys\") pod \"tuned-gq7wm\" (UID: \"f63dee9f-a259-4e50-8b8e-7b5836fcbeef\") " pod="openshift-cluster-node-tuning-operator/tuned-gq7wm" May 21 20:38:22.275747 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.271051 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f63dee9f-a259-4e50-8b8e-7b5836fcbeef-etc-tuned\") pod \"tuned-gq7wm\" (UID: \"f63dee9f-a259-4e50-8b8e-7b5836fcbeef\") " pod="openshift-cluster-node-tuning-operator/tuned-gq7wm" May 21 20:38:22.275747 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.271077 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa1ef7ae-4922-40df-833c-976271407550-multus-cni-dir\") pod \"multus-zngpc\" (UID: \"aa1ef7ae-4922-40df-833c-976271407550\") " pod="openshift-multus/multus-zngpc" May 21 20:38:22.275747 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.271109 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4dd7d419-f840-4936-b530-402082ab5877-etc-selinux\") pod \"aws-ebs-csi-driver-node-zfm56\" (UID: \"4dd7d419-f840-4936-b530-402082ab5877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfm56" May 21 20:38:22.275747 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.271296 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa1ef7ae-4922-40df-833c-976271407550-multus-cni-dir\") pod \"multus-zngpc\" (UID: \"aa1ef7ae-4922-40df-833c-976271407550\") " pod="openshift-multus/multus-zngpc" May 21 20:38:22.275747 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.271239 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f63dee9f-a259-4e50-8b8e-7b5836fcbeef-etc-systemd\") pod \"tuned-gq7wm\" (UID: \"f63dee9f-a259-4e50-8b8e-7b5836fcbeef\") " pod="openshift-cluster-node-tuning-operator/tuned-gq7wm" May 21 20:38:22.275747 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.271182 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f63dee9f-a259-4e50-8b8e-7b5836fcbeef-sys\") pod \"tuned-gq7wm\" (UID: \"f63dee9f-a259-4e50-8b8e-7b5836fcbeef\") " pod="openshift-cluster-node-tuning-operator/tuned-gq7wm" May 21 20:38:22.276495 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.271339 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fmp2l\" (UniqueName: \"kubernetes.io/projected/e4184fd4-d71d-4bda-bda1-e40fa42e76d7-kube-api-access-fmp2l\") pod \"node-resolver-jfdql\" (UID: \"e4184fd4-d71d-4bda-bda1-e40fa42e76d7\") " pod="openshift-dns/node-resolver-jfdql" May 21 20:38:22.276495 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.271376 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4dd7d419-f840-4936-b530-402082ab5877-etc-selinux\") pod \"aws-ebs-csi-driver-node-zfm56\" (UID: \"4dd7d419-f840-4936-b530-402082ab5877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfm56" May 21 20:38:22.276495 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.271405 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bb9b42e0-e4e2-4738-b497-dbed3b79ec9f-host\") pod \"node-ca-vfm2z\" (UID: \"bb9b42e0-e4e2-4738-b497-dbed3b79ec9f\") " pod="openshift-image-registry/node-ca-vfm2z" May 21 20:38:22.276495 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.271437 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d8463ad6-6f3b-4984-ab32-781d1507d42d-env-overrides\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.276495 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.271489 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/aa5c876f-9493-4333-aa52-8a699dae2973-iptables-alerter-script\") pod \"iptables-alerter-pbh8l\" (UID: \"aa5c876f-9493-4333-aa52-8a699dae2973\") " pod="openshift-network-operator/iptables-alerter-pbh8l" May 21 20:38:22.276495 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.271526 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23d4cc46-4752-4afd-a726-67d9eced1af9-metrics-certs\") pod \"network-metrics-daemon-7lhdn\" (UID: \"23d4cc46-4752-4afd-a726-67d9eced1af9\") " pod="openshift-multus/network-metrics-daemon-7lhdn" May 21 20:38:22.276495 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.271554 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8463ad6-6f3b-4984-ab32-781d1507d42d-host-kubelet\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.276495 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.271584 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d8463ad6-6f3b-4984-ab32-781d1507d42d-host-slash\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.276495 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.271610 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8463ad6-6f3b-4984-ab32-781d1507d42d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.276495 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.271641 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aa1ef7ae-4922-40df-833c-976271407550-host-var-lib-cni-bin\") pod \"multus-zngpc\" (UID: \"aa1ef7ae-4922-40df-833c-976271407550\") " pod="openshift-multus/multus-zngpc" May 21 20:38:22.276495 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.271672 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2z6fh\" (UniqueName: \"kubernetes.io/projected/aa1ef7ae-4922-40df-833c-976271407550-kube-api-access-2z6fh\") pod \"multus-zngpc\" (UID: \"aa1ef7ae-4922-40df-833c-976271407550\") " pod="openshift-multus/multus-zngpc" May 21 20:38:22.276495 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:22.271752 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:38:22.276495 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.271745 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-158.ec2.internal" event={"ID":"ad199929ca2afa061f2f23c1f419b63a","Type":"ContainerStarted","Data":"e3b6c88f8f9598a03e41e4d08dddd7ffdd78da6720de37cceb4dc7e073a50f56"} May 21 20:38:22.276495 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:22.271849 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23d4cc46-4752-4afd-a726-67d9eced1af9-metrics-certs podName:23d4cc46-4752-4afd-a726-67d9eced1af9 nodeName:}" failed. No retries permitted until 2026-05-21 20:38:22.771824203 +0000 UTC m=+3.154004274 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23d4cc46-4752-4afd-a726-67d9eced1af9-metrics-certs") pod "network-metrics-daemon-7lhdn" (UID: "23d4cc46-4752-4afd-a726-67d9eced1af9") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:38:22.276495 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.271887 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d8463ad6-6f3b-4984-ab32-781d1507d42d-host-slash\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.276495 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.271922 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bb9b42e0-e4e2-4738-b497-dbed3b79ec9f-host\") pod \"node-ca-vfm2z\" (UID: \"bb9b42e0-e4e2-4738-b497-dbed3b79ec9f\") " pod="openshift-image-registry/node-ca-vfm2z" May 21 20:38:22.276495 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.271953 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8463ad6-6f3b-4984-ab32-781d1507d42d-host-kubelet\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.277107 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.271979 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d8463ad6-6f3b-4984-ab32-781d1507d42d-ovn-node-metrics-cert\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.277107 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.271987 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8463ad6-6f3b-4984-ab32-781d1507d42d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.277107 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.272217 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/87db88d5-9543-40d7-ae6f-2fecc9ac8a79-agent-certs\") pod \"konnectivity-agent-jldwc\" (UID: \"87db88d5-9543-40d7-ae6f-2fecc9ac8a79\") " pod="kube-system/konnectivity-agent-jldwc" May 21 20:38:22.277107 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.272248 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aa1ef7ae-4922-40df-833c-976271407550-host-var-lib-cni-bin\") pod \"multus-zngpc\" (UID: \"aa1ef7ae-4922-40df-833c-976271407550\") " pod="openshift-multus/multus-zngpc" May 21 20:38:22.277107 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.273279 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d8463ad6-6f3b-4984-ab32-781d1507d42d-env-overrides\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.277107 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.273344 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/aa5c876f-9493-4333-aa52-8a699dae2973-iptables-alerter-script\") pod \"iptables-alerter-pbh8l\" (UID: \"aa5c876f-9493-4333-aa52-8a699dae2973\") " pod="openshift-network-operator/iptables-alerter-pbh8l" May 21 20:38:22.277107 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.273580 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f63dee9f-a259-4e50-8b8e-7b5836fcbeef-tmp\") pod \"tuned-gq7wm\" (UID: \"f63dee9f-a259-4e50-8b8e-7b5836fcbeef\") " pod="openshift-cluster-node-tuning-operator/tuned-gq7wm" May 21 20:38:22.277107 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.273629 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5404da1c-65ab-46a6-8824-6a1eb233b16a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8zgxn\" (UID: \"5404da1c-65ab-46a6-8824-6a1eb233b16a\") " pod="openshift-multus/multus-additional-cni-plugins-8zgxn" May 21 20:38:22.277107 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.273675 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/87db88d5-9543-40d7-ae6f-2fecc9ac8a79-konnectivity-ca\") pod \"konnectivity-agent-jldwc\" (UID: \"87db88d5-9543-40d7-ae6f-2fecc9ac8a79\") " pod="kube-system/konnectivity-agent-jldwc" May 21 20:38:22.277107 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.274175 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f63dee9f-a259-4e50-8b8e-7b5836fcbeef-etc-tuned\") pod \"tuned-gq7wm\" (UID: \"f63dee9f-a259-4e50-8b8e-7b5836fcbeef\") " pod="openshift-cluster-node-tuning-operator/tuned-gq7wm" May 21 20:38:22.277107 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.274536 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-158.ec2.internal" event={"ID":"afa0e1cb1f51f2b57cc3bf0d39b525c9","Type":"ContainerStarted","Data":"9cf2abf5c2610f0758e1e91d7df0f50a0c6eee1d370b397416c61c58ad40e92c"} May 21 20:38:22.277107 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.274703 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pgm5\" (UniqueName: \"kubernetes.io/projected/d8463ad6-6f3b-4984-ab32-781d1507d42d-kube-api-access-6pgm5\") pod \"ovnkube-node-7krlb\" (UID: \"d8463ad6-6f3b-4984-ab32-781d1507d42d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.277107 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.276150 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtdnz\" (UniqueName: \"kubernetes.io/projected/4dd7d419-f840-4936-b530-402082ab5877-kube-api-access-gtdnz\") pod \"aws-ebs-csi-driver-node-zfm56\" (UID: \"4dd7d419-f840-4936-b530-402082ab5877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfm56" May 21 20:38:22.277673 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:22.277525 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 20:38:22.277673 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:22.277548 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 20:38:22.277673 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:22.277565 2570 projected.go:194] Error preparing data for projected volume kube-api-access-crm28 for pod openshift-network-diagnostics/network-check-target-lqwhq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:38:22.277673 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:22.277638 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a50c0b1-eccc-4bdf-a7d7-eca75843e83b-kube-api-access-crm28 podName:0a50c0b1-eccc-4bdf-a7d7-eca75843e83b nodeName:}" failed. No retries permitted until 2026-05-21 20:38:22.777619244 +0000 UTC m=+3.159799313 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-crm28" (UniqueName: "kubernetes.io/projected/0a50c0b1-eccc-4bdf-a7d7-eca75843e83b-kube-api-access-crm28") pod "network-check-target-lqwhq" (UID: "0a50c0b1-eccc-4bdf-a7d7-eca75843e83b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:38:22.280826 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.280771 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrhh8\" (UniqueName: \"kubernetes.io/projected/bb9b42e0-e4e2-4738-b497-dbed3b79ec9f-kube-api-access-jrhh8\") pod \"node-ca-vfm2z\" (UID: \"bb9b42e0-e4e2-4738-b497-dbed3b79ec9f\") " pod="openshift-image-registry/node-ca-vfm2z" May 21 20:38:22.281055 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.281032 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzwkz\" (UniqueName: \"kubernetes.io/projected/23d4cc46-4752-4afd-a726-67d9eced1af9-kube-api-access-zzwkz\") pod \"network-metrics-daemon-7lhdn\" (UID: \"23d4cc46-4752-4afd-a726-67d9eced1af9\") " pod="openshift-multus/network-metrics-daemon-7lhdn" May 21 20:38:22.282060 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.282016 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmp2l\" (UniqueName: \"kubernetes.io/projected/e4184fd4-d71d-4bda-bda1-e40fa42e76d7-kube-api-access-fmp2l\") pod \"node-resolver-jfdql\" (UID: \"e4184fd4-d71d-4bda-bda1-e40fa42e76d7\") " pod="openshift-dns/node-resolver-jfdql" May 21 20:38:22.282853 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.282832 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gc49t\" (UniqueName: \"kubernetes.io/projected/5404da1c-65ab-46a6-8824-6a1eb233b16a-kube-api-access-gc49t\") pod \"multus-additional-cni-plugins-8zgxn\" (UID: \"5404da1c-65ab-46a6-8824-6a1eb233b16a\") " pod="openshift-multus/multus-additional-cni-plugins-8zgxn" May 21 20:38:22.283076 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.283057 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nl62\" (UniqueName: \"kubernetes.io/projected/aa5c876f-9493-4333-aa52-8a699dae2973-kube-api-access-4nl62\") pod \"iptables-alerter-pbh8l\" (UID: \"aa5c876f-9493-4333-aa52-8a699dae2973\") " pod="openshift-network-operator/iptables-alerter-pbh8l" May 21 20:38:22.283584 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.283562 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z6fh\" (UniqueName: \"kubernetes.io/projected/aa1ef7ae-4922-40df-833c-976271407550-kube-api-access-2z6fh\") pod \"multus-zngpc\" (UID: \"aa1ef7ae-4922-40df-833c-976271407550\") " pod="openshift-multus/multus-zngpc" May 21 20:38:22.283666 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.283591 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2tfp\" (UniqueName: \"kubernetes.io/projected/f63dee9f-a259-4e50-8b8e-7b5836fcbeef-kube-api-access-h2tfp\") pod \"tuned-gq7wm\" (UID: \"f63dee9f-a259-4e50-8b8e-7b5836fcbeef\") " pod="openshift-cluster-node-tuning-operator/tuned-gq7wm" May 21 20:38:22.446092 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.446005 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gq7wm" May 21 20:38:22.458995 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.458964 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfm56" May 21 20:38:22.466062 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.466035 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vfm2z" May 21 20:38:22.471732 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.471703 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jfdql" May 21 20:38:22.479497 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.479454 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pbh8l" May 21 20:38:22.486144 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.486119 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8zgxn" May 21 20:38:22.493821 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.493795 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zngpc" May 21 20:38:22.501654 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.501622 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:22.507336 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.507311 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jldwc" May 21 20:38:22.542976 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.542942 2570 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 20:38:22.775322 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.775227 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23d4cc46-4752-4afd-a726-67d9eced1af9-metrics-certs\") pod \"network-metrics-daemon-7lhdn\" (UID: \"23d4cc46-4752-4afd-a726-67d9eced1af9\") " pod="openshift-multus/network-metrics-daemon-7lhdn" May 21 20:38:22.775451 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:22.775364 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:38:22.775451 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:22.775445 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23d4cc46-4752-4afd-a726-67d9eced1af9-metrics-certs podName:23d4cc46-4752-4afd-a726-67d9eced1af9 nodeName:}" failed. No retries permitted until 2026-05-21 20:38:23.775423245 +0000 UTC m=+4.157603309 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23d4cc46-4752-4afd-a726-67d9eced1af9-metrics-certs") pod "network-metrics-daemon-7lhdn" (UID: "23d4cc46-4752-4afd-a726-67d9eced1af9") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:38:22.876610 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:22.876576 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-crm28\" (UniqueName: \"kubernetes.io/projected/0a50c0b1-eccc-4bdf-a7d7-eca75843e83b-kube-api-access-crm28\") pod \"network-check-target-lqwhq\" (UID: \"0a50c0b1-eccc-4bdf-a7d7-eca75843e83b\") " pod="openshift-network-diagnostics/network-check-target-lqwhq" May 21 20:38:22.876792 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:22.876747 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 20:38:22.876792 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:22.876773 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 20:38:22.876792 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:22.876785 2570 projected.go:194] Error preparing data for projected volume kube-api-access-crm28 for pod openshift-network-diagnostics/network-check-target-lqwhq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:38:22.876906 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:22.876846 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a50c0b1-eccc-4bdf-a7d7-eca75843e83b-kube-api-access-crm28 podName:0a50c0b1-eccc-4bdf-a7d7-eca75843e83b nodeName:}" failed. No retries permitted until 2026-05-21 20:38:23.876831046 +0000 UTC m=+4.259011096 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-crm28" (UniqueName: "kubernetes.io/projected/0a50c0b1-eccc-4bdf-a7d7-eca75843e83b-kube-api-access-crm28") pod "network-check-target-lqwhq" (UID: "0a50c0b1-eccc-4bdf-a7d7-eca75843e83b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:38:22.920320 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:22.920280 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8463ad6_6f3b_4984_ab32_781d1507d42d.slice/crio-cff4a637075b1fdde621e6e12ed2399990906cdfeb3fb8823b1e734ced0c63a6 WatchSource:0}: Error finding container cff4a637075b1fdde621e6e12ed2399990906cdfeb3fb8823b1e734ced0c63a6: Status 404 returned error can't find the container with id cff4a637075b1fdde621e6e12ed2399990906cdfeb3fb8823b1e734ced0c63a6 May 21 20:38:22.923716 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:22.923693 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5404da1c_65ab_46a6_8824_6a1eb233b16a.slice/crio-3de30684e9fba0dea41eba77630c073b767a62c6968eee1cdbebe5db80c915fb WatchSource:0}: Error finding container 3de30684e9fba0dea41eba77630c073b767a62c6968eee1cdbebe5db80c915fb: Status 404 returned error can't find the container with id 3de30684e9fba0dea41eba77630c073b767a62c6968eee1cdbebe5db80c915fb May 21 20:38:22.925464 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:22.925438 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa5c876f_9493_4333_aa52_8a699dae2973.slice/crio-ee6c956d6d2e170d4428dd3057a05b576f4ad210f7a1e205dd47c92c9888f048 WatchSource:0}: Error finding container ee6c956d6d2e170d4428dd3057a05b576f4ad210f7a1e205dd47c92c9888f048: Status 404 returned error can't find the container with id ee6c956d6d2e170d4428dd3057a05b576f4ad210f7a1e205dd47c92c9888f048 May 21 20:38:22.926268 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:22.926233 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87db88d5_9543_40d7_ae6f_2fecc9ac8a79.slice/crio-718872e8b9f704b981e15fdc13dea9e5fc5c89252164513b029dc58554d42983 WatchSource:0}: Error finding container 718872e8b9f704b981e15fdc13dea9e5fc5c89252164513b029dc58554d42983: Status 404 returned error can't find the container with id 718872e8b9f704b981e15fdc13dea9e5fc5c89252164513b029dc58554d42983 May 21 20:38:22.926771 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:22.926750 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4184fd4_d71d_4bda_bda1_e40fa42e76d7.slice/crio-4fd5ef4d3ab5c75eb7b978522dfdf0752ca8ba1841f032bea8030c727930ed59 WatchSource:0}: Error finding container 4fd5ef4d3ab5c75eb7b978522dfdf0752ca8ba1841f032bea8030c727930ed59: Status 404 returned error can't find the container with id 4fd5ef4d3ab5c75eb7b978522dfdf0752ca8ba1841f032bea8030c727930ed59 May 21 20:38:22.927561 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:22.927546 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa1ef7ae_4922_40df_833c_976271407550.slice/crio-cc59857cee38a284f65961ee17cac0579a099eea25ee82dbcc974fe7412497cc WatchSource:0}: Error finding container cc59857cee38a284f65961ee17cac0579a099eea25ee82dbcc974fe7412497cc: Status 404 returned error can't find the container with id cc59857cee38a284f65961ee17cac0579a099eea25ee82dbcc974fe7412497cc May 21 20:38:22.929966 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:22.929943 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dd7d419_f840_4936_b530_402082ab5877.slice/crio-62c87d274865c460b7f2c1c3fd677af729fabdca22666a5b0efd9ddf193518a3 WatchSource:0}: Error finding container 62c87d274865c460b7f2c1c3fd677af729fabdca22666a5b0efd9ddf193518a3: Status 404 returned error can't find the container with id 62c87d274865c460b7f2c1c3fd677af729fabdca22666a5b0efd9ddf193518a3 May 21 20:38:22.930599 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:22.930542 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb9b42e0_e4e2_4738_b497_dbed3b79ec9f.slice/crio-5db45b00a1fe7af6c998a0798d92f8d8de0e65bd23d73625d9cbdc36453a6ec4 WatchSource:0}: Error finding container 5db45b00a1fe7af6c998a0798d92f8d8de0e65bd23d73625d9cbdc36453a6ec4: Status 404 returned error can't find the container with id 5db45b00a1fe7af6c998a0798d92f8d8de0e65bd23d73625d9cbdc36453a6ec4 May 21 20:38:22.931412 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:38:22.931392 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf63dee9f_a259_4e50_8b8e_7b5836fcbeef.slice/crio-3d4f6c676d2c87f4051c2961dc89763141399895617bc92142eb329107281c16 WatchSource:0}: Error finding container 3d4f6c676d2c87f4051c2961dc89763141399895617bc92142eb329107281c16: Status 404 returned error can't find the container with id 3d4f6c676d2c87f4051c2961dc89763141399895617bc92142eb329107281c16 May 21 20:38:23.188180 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:23.188143 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 20:33:21 +0000 UTC" deadline="2027-12-28 04:20:58.850805185 +0000 UTC" May 21 20:38:23.188180 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:23.188174 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14047h42m35.662634025s" May 21 20:38:23.278718 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:23.278680 2570 generic.go:358] "Generic (PLEG): container finished" podID="ad199929ca2afa061f2f23c1f419b63a" containerID="95b1c32bf4bb7239f40f32298a81d41ef9a837ccdc0087223c2f1f313cb642d3" exitCode=0 May 21 20:38:23.278888 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:23.278760 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-158.ec2.internal" event={"ID":"ad199929ca2afa061f2f23c1f419b63a","Type":"ContainerDied","Data":"95b1c32bf4bb7239f40f32298a81d41ef9a837ccdc0087223c2f1f313cb642d3"} May 21 20:38:23.280149 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:23.280110 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-158.ec2.internal" event={"ID":"afa0e1cb1f51f2b57cc3bf0d39b525c9","Type":"ContainerStarted","Data":"6566935317d4e3e68721649fe95b815968450853ba29f7664f13312908d4bc95"} May 21 20:38:23.281566 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:23.281540 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gq7wm" event={"ID":"f63dee9f-a259-4e50-8b8e-7b5836fcbeef","Type":"ContainerStarted","Data":"3d4f6c676d2c87f4051c2961dc89763141399895617bc92142eb329107281c16"} May 21 20:38:23.283528 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:23.283493 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfm56" event={"ID":"4dd7d419-f840-4936-b530-402082ab5877","Type":"ContainerStarted","Data":"62c87d274865c460b7f2c1c3fd677af729fabdca22666a5b0efd9ddf193518a3"} May 21 20:38:23.285210 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:23.285188 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zngpc" event={"ID":"aa1ef7ae-4922-40df-833c-976271407550","Type":"ContainerStarted","Data":"cc59857cee38a284f65961ee17cac0579a099eea25ee82dbcc974fe7412497cc"} May 21 20:38:23.288319 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:23.288293 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8zgxn" event={"ID":"5404da1c-65ab-46a6-8824-6a1eb233b16a","Type":"ContainerStarted","Data":"3de30684e9fba0dea41eba77630c073b767a62c6968eee1cdbebe5db80c915fb"} May 21 20:38:23.290556 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:23.290503 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" event={"ID":"d8463ad6-6f3b-4984-ab32-781d1507d42d","Type":"ContainerStarted","Data":"cff4a637075b1fdde621e6e12ed2399990906cdfeb3fb8823b1e734ced0c63a6"} May 21 20:38:23.298345 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:23.298319 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vfm2z" event={"ID":"bb9b42e0-e4e2-4738-b497-dbed3b79ec9f","Type":"ContainerStarted","Data":"5db45b00a1fe7af6c998a0798d92f8d8de0e65bd23d73625d9cbdc36453a6ec4"} May 21 20:38:23.300305 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:23.300244 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jldwc" event={"ID":"87db88d5-9543-40d7-ae6f-2fecc9ac8a79","Type":"ContainerStarted","Data":"718872e8b9f704b981e15fdc13dea9e5fc5c89252164513b029dc58554d42983"} May 21 20:38:23.305402 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:23.305367 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jfdql" event={"ID":"e4184fd4-d71d-4bda-bda1-e40fa42e76d7","Type":"ContainerStarted","Data":"4fd5ef4d3ab5c75eb7b978522dfdf0752ca8ba1841f032bea8030c727930ed59"} May 21 20:38:23.308041 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:23.307980 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-158.ec2.internal" podStartSLOduration=2.307964079 podStartE2EDuration="2.307964079s" podCreationTimestamp="2026-05-21 20:38:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 20:38:23.307859885 +0000 UTC m=+3.690039957" watchObservedRunningTime="2026-05-21 20:38:23.307964079 +0000 UTC m=+3.690144152" May 21 20:38:23.310242 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:23.310211 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pbh8l" event={"ID":"aa5c876f-9493-4333-aa52-8a699dae2973","Type":"ContainerStarted","Data":"ee6c956d6d2e170d4428dd3057a05b576f4ad210f7a1e205dd47c92c9888f048"} May 21 20:38:23.783884 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:23.783195 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23d4cc46-4752-4afd-a726-67d9eced1af9-metrics-certs\") pod \"network-metrics-daemon-7lhdn\" (UID: \"23d4cc46-4752-4afd-a726-67d9eced1af9\") " pod="openshift-multus/network-metrics-daemon-7lhdn" May 21 20:38:23.783884 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:23.783388 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:38:23.783884 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:23.783456 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23d4cc46-4752-4afd-a726-67d9eced1af9-metrics-certs podName:23d4cc46-4752-4afd-a726-67d9eced1af9 nodeName:}" failed. No retries permitted until 2026-05-21 20:38:25.783436912 +0000 UTC m=+6.165616976 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23d4cc46-4752-4afd-a726-67d9eced1af9-metrics-certs") pod "network-metrics-daemon-7lhdn" (UID: "23d4cc46-4752-4afd-a726-67d9eced1af9") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:38:23.884400 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:23.883756 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-crm28\" (UniqueName: \"kubernetes.io/projected/0a50c0b1-eccc-4bdf-a7d7-eca75843e83b-kube-api-access-crm28\") pod \"network-check-target-lqwhq\" (UID: \"0a50c0b1-eccc-4bdf-a7d7-eca75843e83b\") " pod="openshift-network-diagnostics/network-check-target-lqwhq" May 21 20:38:23.884400 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:23.883936 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 20:38:23.884400 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:23.883958 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 20:38:23.884400 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:23.883971 2570 projected.go:194] Error preparing data for projected volume kube-api-access-crm28 for pod openshift-network-diagnostics/network-check-target-lqwhq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:38:23.884400 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:23.884035 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a50c0b1-eccc-4bdf-a7d7-eca75843e83b-kube-api-access-crm28 podName:0a50c0b1-eccc-4bdf-a7d7-eca75843e83b nodeName:}" failed. No retries permitted until 2026-05-21 20:38:25.884014474 +0000 UTC m=+6.266194525 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-crm28" (UniqueName: "kubernetes.io/projected/0a50c0b1-eccc-4bdf-a7d7-eca75843e83b-kube-api-access-crm28") pod "network-check-target-lqwhq" (UID: "0a50c0b1-eccc-4bdf-a7d7-eca75843e83b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:38:24.004693 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:24.004264 2570 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 21 20:38:24.264385 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:24.263707 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lhdn" May 21 20:38:24.264385 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:24.263857 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lhdn" podUID="23d4cc46-4752-4afd-a726-67d9eced1af9" May 21 20:38:24.264385 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:24.263705 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqwhq" May 21 20:38:24.264385 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:24.264294 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqwhq" podUID="0a50c0b1-eccc-4bdf-a7d7-eca75843e83b" May 21 20:38:24.335099 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:24.335062 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-158.ec2.internal" event={"ID":"ad199929ca2afa061f2f23c1f419b63a","Type":"ContainerStarted","Data":"bf1e06d340420fd58d7336c76b51990e089a76a048ed9af3361bfbd7eec8b838"} May 21 20:38:25.797739 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:25.797612 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23d4cc46-4752-4afd-a726-67d9eced1af9-metrics-certs\") pod \"network-metrics-daemon-7lhdn\" (UID: \"23d4cc46-4752-4afd-a726-67d9eced1af9\") " pod="openshift-multus/network-metrics-daemon-7lhdn" May 21 20:38:25.798181 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:25.797829 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:38:25.798181 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:25.797896 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23d4cc46-4752-4afd-a726-67d9eced1af9-metrics-certs podName:23d4cc46-4752-4afd-a726-67d9eced1af9 nodeName:}" failed. No retries permitted until 2026-05-21 20:38:29.797877483 +0000 UTC m=+10.180057538 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23d4cc46-4752-4afd-a726-67d9eced1af9-metrics-certs") pod "network-metrics-daemon-7lhdn" (UID: "23d4cc46-4752-4afd-a726-67d9eced1af9") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:38:25.898639 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:25.898599 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-crm28\" (UniqueName: \"kubernetes.io/projected/0a50c0b1-eccc-4bdf-a7d7-eca75843e83b-kube-api-access-crm28\") pod \"network-check-target-lqwhq\" (UID: \"0a50c0b1-eccc-4bdf-a7d7-eca75843e83b\") " pod="openshift-network-diagnostics/network-check-target-lqwhq" May 21 20:38:25.898805 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:25.898786 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 20:38:25.898852 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:25.898809 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 20:38:25.898852 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:25.898822 2570 projected.go:194] Error preparing data for projected volume kube-api-access-crm28 for pod openshift-network-diagnostics/network-check-target-lqwhq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:38:25.898912 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:25.898885 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a50c0b1-eccc-4bdf-a7d7-eca75843e83b-kube-api-access-crm28 podName:0a50c0b1-eccc-4bdf-a7d7-eca75843e83b nodeName:}" failed. No retries permitted until 2026-05-21 20:38:29.898865781 +0000 UTC m=+10.281045854 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-crm28" (UniqueName: "kubernetes.io/projected/0a50c0b1-eccc-4bdf-a7d7-eca75843e83b-kube-api-access-crm28") pod "network-check-target-lqwhq" (UID: "0a50c0b1-eccc-4bdf-a7d7-eca75843e83b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:38:26.264395 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:26.264313 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqwhq" May 21 20:38:26.264578 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:26.264409 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqwhq" podUID="0a50c0b1-eccc-4bdf-a7d7-eca75843e83b" May 21 20:38:26.264967 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:26.264793 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lhdn" May 21 20:38:26.264967 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:26.264893 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lhdn" podUID="23d4cc46-4752-4afd-a726-67d9eced1af9" May 21 20:38:28.262443 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:28.262375 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqwhq" May 21 20:38:28.262844 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:28.262547 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqwhq" podUID="0a50c0b1-eccc-4bdf-a7d7-eca75843e83b" May 21 20:38:28.263027 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:28.262994 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lhdn" May 21 20:38:28.263169 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:28.263102 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lhdn" podUID="23d4cc46-4752-4afd-a726-67d9eced1af9" May 21 20:38:29.833306 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:29.832733 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23d4cc46-4752-4afd-a726-67d9eced1af9-metrics-certs\") pod \"network-metrics-daemon-7lhdn\" (UID: \"23d4cc46-4752-4afd-a726-67d9eced1af9\") " pod="openshift-multus/network-metrics-daemon-7lhdn" May 21 20:38:29.833306 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:29.832905 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:38:29.833306 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:29.832975 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23d4cc46-4752-4afd-a726-67d9eced1af9-metrics-certs podName:23d4cc46-4752-4afd-a726-67d9eced1af9 nodeName:}" failed. No retries permitted until 2026-05-21 20:38:37.832955723 +0000 UTC m=+18.215135781 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23d4cc46-4752-4afd-a726-67d9eced1af9-metrics-certs") pod "network-metrics-daemon-7lhdn" (UID: "23d4cc46-4752-4afd-a726-67d9eced1af9") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:38:29.847393 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:29.847331 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-158.ec2.internal" podStartSLOduration=8.847312114 podStartE2EDuration="8.847312114s" podCreationTimestamp="2026-05-21 20:38:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 20:38:24.348296761 +0000 UTC m=+4.730476834" watchObservedRunningTime="2026-05-21 20:38:29.847312114 +0000 UTC m=+10.229492187" May 21 20:38:29.847758 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:29.847740 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-ggpmx"] May 21 20:38:29.852062 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:29.851745 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ggpmx" May 21 20:38:29.852062 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:29.851819 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ggpmx" podUID="a8a570de-2345-412f-ab88-790c20e290ac" May 21 20:38:29.933658 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:29.933614 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a8a570de-2345-412f-ab88-790c20e290ac-kubelet-config\") pod \"global-pull-secret-syncer-ggpmx\" (UID: \"a8a570de-2345-412f-ab88-790c20e290ac\") " pod="kube-system/global-pull-secret-syncer-ggpmx" May 21 20:38:29.933658 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:29.933664 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a8a570de-2345-412f-ab88-790c20e290ac-dbus\") pod \"global-pull-secret-syncer-ggpmx\" (UID: \"a8a570de-2345-412f-ab88-790c20e290ac\") " pod="kube-system/global-pull-secret-syncer-ggpmx" May 21 20:38:29.933898 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:29.933715 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-crm28\" (UniqueName: \"kubernetes.io/projected/0a50c0b1-eccc-4bdf-a7d7-eca75843e83b-kube-api-access-crm28\") pod \"network-check-target-lqwhq\" (UID: \"0a50c0b1-eccc-4bdf-a7d7-eca75843e83b\") " pod="openshift-network-diagnostics/network-check-target-lqwhq" May 21 20:38:29.933898 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:29.933735 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a8a570de-2345-412f-ab88-790c20e290ac-original-pull-secret\") pod \"global-pull-secret-syncer-ggpmx\" (UID: \"a8a570de-2345-412f-ab88-790c20e290ac\") " pod="kube-system/global-pull-secret-syncer-ggpmx" May 21 20:38:29.933898 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:29.933848 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 20:38:29.933898 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:29.933873 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 20:38:29.933898 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:29.933884 2570 projected.go:194] Error preparing data for projected volume kube-api-access-crm28 for pod openshift-network-diagnostics/network-check-target-lqwhq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:38:29.934118 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:29.933931 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a50c0b1-eccc-4bdf-a7d7-eca75843e83b-kube-api-access-crm28 podName:0a50c0b1-eccc-4bdf-a7d7-eca75843e83b nodeName:}" failed. No retries permitted until 2026-05-21 20:38:37.9339168 +0000 UTC m=+18.316096859 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-crm28" (UniqueName: "kubernetes.io/projected/0a50c0b1-eccc-4bdf-a7d7-eca75843e83b-kube-api-access-crm28") pod "network-check-target-lqwhq" (UID: "0a50c0b1-eccc-4bdf-a7d7-eca75843e83b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:38:30.034673 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:30.034628 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a8a570de-2345-412f-ab88-790c20e290ac-original-pull-secret\") pod \"global-pull-secret-syncer-ggpmx\" (UID: \"a8a570de-2345-412f-ab88-790c20e290ac\") " pod="kube-system/global-pull-secret-syncer-ggpmx" May 21 20:38:30.034834 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:30.034729 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a8a570de-2345-412f-ab88-790c20e290ac-kubelet-config\") pod \"global-pull-secret-syncer-ggpmx\" (UID: \"a8a570de-2345-412f-ab88-790c20e290ac\") " pod="kube-system/global-pull-secret-syncer-ggpmx" May 21 20:38:30.034834 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:30.034754 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a8a570de-2345-412f-ab88-790c20e290ac-dbus\") pod \"global-pull-secret-syncer-ggpmx\" (UID: \"a8a570de-2345-412f-ab88-790c20e290ac\") " pod="kube-system/global-pull-secret-syncer-ggpmx" May 21 20:38:30.034834 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:30.034790 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 20:38:30.035009 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:30.034855 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8a570de-2345-412f-ab88-790c20e290ac-original-pull-secret podName:a8a570de-2345-412f-ab88-790c20e290ac nodeName:}" failed. No retries permitted until 2026-05-21 20:38:30.534837874 +0000 UTC m=+10.917017926 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a8a570de-2345-412f-ab88-790c20e290ac-original-pull-secret") pod "global-pull-secret-syncer-ggpmx" (UID: "a8a570de-2345-412f-ab88-790c20e290ac") : object "kube-system"/"original-pull-secret" not registered May 21 20:38:30.035009 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:30.034867 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a8a570de-2345-412f-ab88-790c20e290ac-kubelet-config\") pod \"global-pull-secret-syncer-ggpmx\" (UID: \"a8a570de-2345-412f-ab88-790c20e290ac\") " pod="kube-system/global-pull-secret-syncer-ggpmx" May 21 20:38:30.035009 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:30.034940 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a8a570de-2345-412f-ab88-790c20e290ac-dbus\") pod \"global-pull-secret-syncer-ggpmx\" (UID: \"a8a570de-2345-412f-ab88-790c20e290ac\") " pod="kube-system/global-pull-secret-syncer-ggpmx" May 21 20:38:30.263232 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:30.263145 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqwhq" May 21 20:38:30.263373 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:30.263236 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqwhq" podUID="0a50c0b1-eccc-4bdf-a7d7-eca75843e83b" May 21 20:38:30.263373 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:30.263279 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lhdn" May 21 20:38:30.263373 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:30.263325 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lhdn" podUID="23d4cc46-4752-4afd-a726-67d9eced1af9" May 21 20:38:30.539223 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:30.539119 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a8a570de-2345-412f-ab88-790c20e290ac-original-pull-secret\") pod \"global-pull-secret-syncer-ggpmx\" (UID: \"a8a570de-2345-412f-ab88-790c20e290ac\") " pod="kube-system/global-pull-secret-syncer-ggpmx" May 21 20:38:30.539393 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:30.539279 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 20:38:30.539393 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:30.539341 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8a570de-2345-412f-ab88-790c20e290ac-original-pull-secret podName:a8a570de-2345-412f-ab88-790c20e290ac nodeName:}" failed. No retries permitted until 2026-05-21 20:38:31.539322947 +0000 UTC m=+11.921503002 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a8a570de-2345-412f-ab88-790c20e290ac-original-pull-secret") pod "global-pull-secret-syncer-ggpmx" (UID: "a8a570de-2345-412f-ab88-790c20e290ac") : object "kube-system"/"original-pull-secret" not registered May 21 20:38:31.263010 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:31.262907 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ggpmx" May 21 20:38:31.263368 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:31.263051 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ggpmx" podUID="a8a570de-2345-412f-ab88-790c20e290ac" May 21 20:38:31.546796 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:31.546705 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a8a570de-2345-412f-ab88-790c20e290ac-original-pull-secret\") pod \"global-pull-secret-syncer-ggpmx\" (UID: \"a8a570de-2345-412f-ab88-790c20e290ac\") " pod="kube-system/global-pull-secret-syncer-ggpmx" May 21 20:38:31.546952 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:31.546886 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 20:38:31.546952 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:31.546934 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8a570de-2345-412f-ab88-790c20e290ac-original-pull-secret podName:a8a570de-2345-412f-ab88-790c20e290ac nodeName:}" failed. No retries permitted until 2026-05-21 20:38:33.546921401 +0000 UTC m=+13.929101452 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a8a570de-2345-412f-ab88-790c20e290ac-original-pull-secret") pod "global-pull-secret-syncer-ggpmx" (UID: "a8a570de-2345-412f-ab88-790c20e290ac") : object "kube-system"/"original-pull-secret" not registered May 21 20:38:32.263137 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:32.262602 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqwhq" May 21 20:38:32.263137 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:32.262742 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqwhq" podUID="0a50c0b1-eccc-4bdf-a7d7-eca75843e83b" May 21 20:38:32.263137 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:32.262793 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lhdn" May 21 20:38:32.263137 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:32.262910 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lhdn" podUID="23d4cc46-4752-4afd-a726-67d9eced1af9" May 21 20:38:33.262693 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:33.262652 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ggpmx" May 21 20:38:33.262884 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:33.262784 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ggpmx" podUID="a8a570de-2345-412f-ab88-790c20e290ac" May 21 20:38:33.562702 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:33.562654 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a8a570de-2345-412f-ab88-790c20e290ac-original-pull-secret\") pod \"global-pull-secret-syncer-ggpmx\" (UID: \"a8a570de-2345-412f-ab88-790c20e290ac\") " pod="kube-system/global-pull-secret-syncer-ggpmx" May 21 20:38:33.563168 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:33.562814 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 20:38:33.563168 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:33.562896 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8a570de-2345-412f-ab88-790c20e290ac-original-pull-secret podName:a8a570de-2345-412f-ab88-790c20e290ac nodeName:}" failed. No retries permitted until 2026-05-21 20:38:37.562875622 +0000 UTC m=+17.945055689 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a8a570de-2345-412f-ab88-790c20e290ac-original-pull-secret") pod "global-pull-secret-syncer-ggpmx" (UID: "a8a570de-2345-412f-ab88-790c20e290ac") : object "kube-system"/"original-pull-secret" not registered May 21 20:38:34.262913 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:34.262871 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lhdn" May 21 20:38:34.262913 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:34.262910 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqwhq" May 21 20:38:34.263156 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:34.263026 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lhdn" podUID="23d4cc46-4752-4afd-a726-67d9eced1af9" May 21 20:38:34.263214 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:34.263156 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqwhq" podUID="0a50c0b1-eccc-4bdf-a7d7-eca75843e83b" May 21 20:38:35.262803 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:35.262766 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ggpmx" May 21 20:38:35.263246 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:35.262900 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ggpmx" podUID="a8a570de-2345-412f-ab88-790c20e290ac" May 21 20:38:36.263048 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:36.263005 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lhdn" May 21 20:38:36.263459 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:36.263003 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqwhq" May 21 20:38:36.263459 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:36.263151 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lhdn" podUID="23d4cc46-4752-4afd-a726-67d9eced1af9" May 21 20:38:36.263459 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:36.263189 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqwhq" podUID="0a50c0b1-eccc-4bdf-a7d7-eca75843e83b" May 21 20:38:37.262192 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:37.262155 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ggpmx" May 21 20:38:37.262462 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:37.262286 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ggpmx" podUID="a8a570de-2345-412f-ab88-790c20e290ac" May 21 20:38:37.594815 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:37.594722 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a8a570de-2345-412f-ab88-790c20e290ac-original-pull-secret\") pod \"global-pull-secret-syncer-ggpmx\" (UID: \"a8a570de-2345-412f-ab88-790c20e290ac\") " pod="kube-system/global-pull-secret-syncer-ggpmx" May 21 20:38:37.595270 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:37.594901 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 20:38:37.595270 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:37.594977 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8a570de-2345-412f-ab88-790c20e290ac-original-pull-secret podName:a8a570de-2345-412f-ab88-790c20e290ac nodeName:}" failed. No retries permitted until 2026-05-21 20:38:45.594955655 +0000 UTC m=+25.977135707 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a8a570de-2345-412f-ab88-790c20e290ac-original-pull-secret") pod "global-pull-secret-syncer-ggpmx" (UID: "a8a570de-2345-412f-ab88-790c20e290ac") : object "kube-system"/"original-pull-secret" not registered May 21 20:38:37.897265 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:37.897163 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23d4cc46-4752-4afd-a726-67d9eced1af9-metrics-certs\") pod \"network-metrics-daemon-7lhdn\" (UID: \"23d4cc46-4752-4afd-a726-67d9eced1af9\") " pod="openshift-multus/network-metrics-daemon-7lhdn" May 21 20:38:37.897423 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:37.897343 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:38:37.897499 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:37.897430 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23d4cc46-4752-4afd-a726-67d9eced1af9-metrics-certs podName:23d4cc46-4752-4afd-a726-67d9eced1af9 nodeName:}" failed. No retries permitted until 2026-05-21 20:38:53.897406265 +0000 UTC m=+34.279586350 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23d4cc46-4752-4afd-a726-67d9eced1af9-metrics-certs") pod "network-metrics-daemon-7lhdn" (UID: "23d4cc46-4752-4afd-a726-67d9eced1af9") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:38:37.997739 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:37.997691 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-crm28\" (UniqueName: \"kubernetes.io/projected/0a50c0b1-eccc-4bdf-a7d7-eca75843e83b-kube-api-access-crm28\") pod \"network-check-target-lqwhq\" (UID: \"0a50c0b1-eccc-4bdf-a7d7-eca75843e83b\") " pod="openshift-network-diagnostics/network-check-target-lqwhq" May 21 20:38:37.997917 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:37.997892 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 20:38:37.997963 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:37.997918 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 20:38:37.997963 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:37.997933 2570 projected.go:194] Error preparing data for projected volume kube-api-access-crm28 for pod openshift-network-diagnostics/network-check-target-lqwhq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:38:37.998024 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:37.998001 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a50c0b1-eccc-4bdf-a7d7-eca75843e83b-kube-api-access-crm28 podName:0a50c0b1-eccc-4bdf-a7d7-eca75843e83b nodeName:}" failed. No retries permitted until 2026-05-21 20:38:53.99798139 +0000 UTC m=+34.380161439 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-crm28" (UniqueName: "kubernetes.io/projected/0a50c0b1-eccc-4bdf-a7d7-eca75843e83b-kube-api-access-crm28") pod "network-check-target-lqwhq" (UID: "0a50c0b1-eccc-4bdf-a7d7-eca75843e83b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:38:38.263131 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:38.263094 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqwhq" May 21 20:38:38.263301 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:38.263141 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lhdn" May 21 20:38:38.263301 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:38.263224 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqwhq" podUID="0a50c0b1-eccc-4bdf-a7d7-eca75843e83b" May 21 20:38:38.263377 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:38.263325 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lhdn" podUID="23d4cc46-4752-4afd-a726-67d9eced1af9" May 21 20:38:39.262284 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:39.262247 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ggpmx" May 21 20:38:39.262853 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:39.262393 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ggpmx" podUID="a8a570de-2345-412f-ab88-790c20e290ac" May 21 20:38:40.263323 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:40.263279 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqwhq" May 21 20:38:40.263757 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:40.263397 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqwhq" podUID="0a50c0b1-eccc-4bdf-a7d7-eca75843e83b" May 21 20:38:40.263757 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:40.263455 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lhdn" May 21 20:38:40.263757 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:40.263641 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lhdn" podUID="23d4cc46-4752-4afd-a726-67d9eced1af9" May 21 20:38:41.262932 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:41.262901 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ggpmx" May 21 20:38:41.263065 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:41.263004 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ggpmx" podUID="a8a570de-2345-412f-ab88-790c20e290ac" May 21 20:38:41.372200 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:41.371928 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7krlb_d8463ad6-6f3b-4984-ab32-781d1507d42d/ovn-acl-logging/0.log" May 21 20:38:41.372964 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:41.372607 2570 generic.go:358] "Generic (PLEG): container finished" podID="d8463ad6-6f3b-4984-ab32-781d1507d42d" containerID="606a335730ae4808e7399edee5500b9f634a8442af8a1e309eb1f59ccb2ec378" exitCode=1 May 21 20:38:41.372964 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:41.372686 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" event={"ID":"d8463ad6-6f3b-4984-ab32-781d1507d42d","Type":"ContainerDied","Data":"606a335730ae4808e7399edee5500b9f634a8442af8a1e309eb1f59ccb2ec378"} May 21 20:38:41.372964 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:41.372726 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" event={"ID":"d8463ad6-6f3b-4984-ab32-781d1507d42d","Type":"ContainerStarted","Data":"5ef25ed8cbf2400b6006a4e77d626259fd66ababb23b30b395a5e33e395c3eda"} May 21 20:38:41.374057 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:41.374033 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vfm2z" event={"ID":"bb9b42e0-e4e2-4738-b497-dbed3b79ec9f","Type":"ContainerStarted","Data":"02f4238ebb46b1c22dd7b90865ff21b5c9864cde2658d0a1a3ada35d6e2e82b3"} May 21 20:38:41.379526 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:41.379454 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jldwc" event={"ID":"87db88d5-9543-40d7-ae6f-2fecc9ac8a79","Type":"ContainerStarted","Data":"924f872e1ace6fbeba0ffad3879fa702e1b54178da95afa9633b8d3b3d9bab47"} May 21 20:38:41.382264 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:41.382233 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jfdql" event={"ID":"e4184fd4-d71d-4bda-bda1-e40fa42e76d7","Type":"ContainerStarted","Data":"43e3914c65a3c8b726c68ddd321c03f5a8a9937b14c2c0a62fb57e6729a0f68a"} May 21 20:38:41.383485 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:41.383445 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gq7wm" event={"ID":"f63dee9f-a259-4e50-8b8e-7b5836fcbeef","Type":"ContainerStarted","Data":"3fb451a92a8f69fc1293c1bb5a7c1ceb50c4ed51ae57b630e209efac426302ec"} May 21 20:38:41.384880 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:41.384857 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfm56" event={"ID":"4dd7d419-f840-4936-b530-402082ab5877","Type":"ContainerStarted","Data":"062c14b2f11948ab3cb6e712c3b69dbfca10b245023a61962ba1563c364016d4"} May 21 20:38:41.386108 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:41.386089 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zngpc" event={"ID":"aa1ef7ae-4922-40df-833c-976271407550","Type":"ContainerStarted","Data":"99d500419a14ec6c2f04cf012942ceb8371b7a201f8e5c7eea68e98d00742120"} May 21 20:38:41.387691 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:41.387649 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vfm2z" podStartSLOduration=6.931265282 podStartE2EDuration="21.387636697s" podCreationTimestamp="2026-05-21 20:38:20 +0000 UTC" firstStartedPulling="2026-05-21 20:38:22.932434482 +0000 UTC m=+3.314614534" lastFinishedPulling="2026-05-21 20:38:37.388805884 +0000 UTC m=+17.770985949" observedRunningTime="2026-05-21 20:38:41.387570757 +0000 UTC m=+21.769750832" watchObservedRunningTime="2026-05-21 20:38:41.387636697 +0000 UTC m=+21.769816768" May 21 20:38:41.387785 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:41.387757 2570 generic.go:358] "Generic (PLEG): container finished" podID="5404da1c-65ab-46a6-8824-6a1eb233b16a" containerID="ad7e909edff2048c54f737e41d30354c16d30e35a6d8d24e230e9deef1cc03e6" exitCode=0 May 21 20:38:41.387842 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:41.387797 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8zgxn" event={"ID":"5404da1c-65ab-46a6-8824-6a1eb233b16a","Type":"ContainerDied","Data":"ad7e909edff2048c54f737e41d30354c16d30e35a6d8d24e230e9deef1cc03e6"} May 21 20:38:41.402071 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:41.402023 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-zngpc" podStartSLOduration=3.18739938 podStartE2EDuration="21.402008456s" podCreationTimestamp="2026-05-21 20:38:20 +0000 UTC" firstStartedPulling="2026-05-21 20:38:22.92946141 +0000 UTC m=+3.311641465" lastFinishedPulling="2026-05-21 20:38:41.144070491 +0000 UTC m=+21.526250541" observedRunningTime="2026-05-21 20:38:41.401596347 +0000 UTC m=+21.783776419" watchObservedRunningTime="2026-05-21 20:38:41.402008456 +0000 UTC m=+21.784188528" May 21 20:38:41.414356 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:41.414307 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-jfdql" podStartSLOduration=3.475696694 podStartE2EDuration="21.414288465s" podCreationTimestamp="2026-05-21 20:38:20 +0000 UTC" firstStartedPulling="2026-05-21 20:38:22.928563061 +0000 UTC m=+3.310743114" lastFinishedPulling="2026-05-21 20:38:40.867154825 +0000 UTC m=+21.249334885" observedRunningTime="2026-05-21 20:38:41.41363095 +0000 UTC m=+21.795811022" watchObservedRunningTime="2026-05-21 20:38:41.414288465 +0000 UTC m=+21.796468540" May 21 20:38:41.444675 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:41.444629 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jldwc" podStartSLOduration=3.475026877 podStartE2EDuration="21.444614857s" podCreationTimestamp="2026-05-21 20:38:20 +0000 UTC" firstStartedPulling="2026-05-21 20:38:22.928249094 +0000 UTC m=+3.310429144" lastFinishedPulling="2026-05-21 20:38:40.897837072 +0000 UTC m=+21.280017124" observedRunningTime="2026-05-21 20:38:41.429153166 +0000 UTC m=+21.811333238" watchObservedRunningTime="2026-05-21 20:38:41.444614857 +0000 UTC m=+21.826794994" May 21 20:38:41.444970 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:41.444941 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-gq7wm" podStartSLOduration=3.465614247 podStartE2EDuration="21.444932581s" podCreationTimestamp="2026-05-21 20:38:20 +0000 UTC" firstStartedPulling="2026-05-21 20:38:22.933608934 +0000 UTC m=+3.315788984" lastFinishedPulling="2026-05-21 20:38:40.912927261 +0000 UTC m=+21.295107318" observedRunningTime="2026-05-21 20:38:41.444021039 +0000 UTC m=+21.826201112" watchObservedRunningTime="2026-05-21 20:38:41.444932581 +0000 UTC m=+21.827112653" May 21 20:38:42.263012 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:42.262928 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqwhq" May 21 20:38:42.263012 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:42.262965 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lhdn" May 21 20:38:42.263266 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:42.263064 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqwhq" podUID="0a50c0b1-eccc-4bdf-a7d7-eca75843e83b" May 21 20:38:42.263266 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:42.263212 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lhdn" podUID="23d4cc46-4752-4afd-a726-67d9eced1af9" May 21 20:38:42.392950 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:42.392922 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7krlb_d8463ad6-6f3b-4984-ab32-781d1507d42d/ovn-acl-logging/0.log" May 21 20:38:42.393493 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:42.393219 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" event={"ID":"d8463ad6-6f3b-4984-ab32-781d1507d42d","Type":"ContainerStarted","Data":"ef0af5753fed932c77836f54f30ab28eab2297eea0c294c178b1118b9cb9af4d"} May 21 20:38:42.393493 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:42.393253 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" event={"ID":"d8463ad6-6f3b-4984-ab32-781d1507d42d","Type":"ContainerStarted","Data":"8aae6c136642c5b06b64f9a99551e5600400202502333f643b0eba8c49f0ec30"} May 21 20:38:42.393493 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:42.393268 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" event={"ID":"d8463ad6-6f3b-4984-ab32-781d1507d42d","Type":"ContainerStarted","Data":"07bd2b27b0e005d216b02a8575ba7a040cb73142409e3cf837191bff9de9abc6"} May 21 20:38:42.393493 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:42.393278 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" event={"ID":"d8463ad6-6f3b-4984-ab32-781d1507d42d","Type":"ContainerStarted","Data":"4d55d5a938a5dc5073160e85042d5627c887257e4f795587a61b3d49e363256b"} May 21 20:38:42.643159 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:42.642981 2570 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 21 20:38:43.220165 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:43.220025 2570 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T20:38:42.643130689Z","UUID":"d355dc51-6fba-4a2b-bd85-95f542174eab","Handler":null,"Name":"","Endpoint":""} May 21 20:38:43.221998 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:43.221663 2570 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 21 20:38:43.221998 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:43.221695 2570 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 21 20:38:43.263272 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:43.263237 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ggpmx" May 21 20:38:43.263426 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:43.263373 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ggpmx" podUID="a8a570de-2345-412f-ab88-790c20e290ac" May 21 20:38:43.397451 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:43.397407 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfm56" event={"ID":"4dd7d419-f840-4936-b530-402082ab5877","Type":"ContainerStarted","Data":"49346a77fee263898e296f31ea41ebff62ef404c0a29dd48432509061b458263"} May 21 20:38:43.398937 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:43.398890 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pbh8l" event={"ID":"aa5c876f-9493-4333-aa52-8a699dae2973","Type":"ContainerStarted","Data":"6bf0fe07eacfce761bc347187293cb3d71d68d20f685da18d7f378e81ebee633"} May 21 20:38:43.414195 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:43.414146 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pbh8l" podStartSLOduration=5.422751238 podStartE2EDuration="23.414119898s" podCreationTimestamp="2026-05-21 20:38:20 +0000 UTC" firstStartedPulling="2026-05-21 20:38:22.92734717 +0000 UTC m=+3.309527219" lastFinishedPulling="2026-05-21 20:38:40.918715823 +0000 UTC m=+21.300895879" observedRunningTime="2026-05-21 20:38:43.413912653 +0000 UTC m=+23.796092726" watchObservedRunningTime="2026-05-21 20:38:43.414119898 +0000 UTC m=+23.796299971" May 21 20:38:44.262589 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:44.262557 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqwhq" May 21 20:38:44.262779 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:44.262569 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lhdn" May 21 20:38:44.262779 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:44.262677 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqwhq" podUID="0a50c0b1-eccc-4bdf-a7d7-eca75843e83b" May 21 20:38:44.262779 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:44.262747 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lhdn" podUID="23d4cc46-4752-4afd-a726-67d9eced1af9" May 21 20:38:44.403399 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:44.403346 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfm56" event={"ID":"4dd7d419-f840-4936-b530-402082ab5877","Type":"ContainerStarted","Data":"545f9b8eb11a28a2f3c12a785f18e935569285cd18b38634fea870735e02c235"} May 21 20:38:44.421014 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:44.420966 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zfm56" podStartSLOduration=3.829046979 podStartE2EDuration="24.420951065s" podCreationTimestamp="2026-05-21 20:38:20 +0000 UTC" firstStartedPulling="2026-05-21 20:38:22.932401819 +0000 UTC m=+3.314581869" lastFinishedPulling="2026-05-21 20:38:43.524305889 +0000 UTC m=+23.906485955" observedRunningTime="2026-05-21 20:38:44.420399055 +0000 UTC m=+24.802579129" watchObservedRunningTime="2026-05-21 20:38:44.420951065 +0000 UTC m=+24.803131137" May 21 20:38:45.008484 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:45.008442 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jldwc" May 21 20:38:45.009301 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:45.009280 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jldwc" May 21 20:38:45.262915 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:45.262841 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ggpmx" May 21 20:38:45.263076 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:45.262974 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ggpmx" podUID="a8a570de-2345-412f-ab88-790c20e290ac" May 21 20:38:45.408354 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:45.408328 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7krlb_d8463ad6-6f3b-4984-ab32-781d1507d42d/ovn-acl-logging/0.log" May 21 20:38:45.409080 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:45.408734 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" event={"ID":"d8463ad6-6f3b-4984-ab32-781d1507d42d","Type":"ContainerStarted","Data":"ebc92efdb8df3031908b3d8e504d78dc51c0735baaf9152724705c2268b7016f"} May 21 20:38:45.659909 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:45.659811 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a8a570de-2345-412f-ab88-790c20e290ac-original-pull-secret\") pod \"global-pull-secret-syncer-ggpmx\" (UID: \"a8a570de-2345-412f-ab88-790c20e290ac\") " pod="kube-system/global-pull-secret-syncer-ggpmx" May 21 20:38:45.660057 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:45.659948 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 20:38:45.660057 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:45.660006 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8a570de-2345-412f-ab88-790c20e290ac-original-pull-secret podName:a8a570de-2345-412f-ab88-790c20e290ac nodeName:}" failed. No retries permitted until 2026-05-21 20:39:01.65999167 +0000 UTC m=+42.042171720 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a8a570de-2345-412f-ab88-790c20e290ac-original-pull-secret") pod "global-pull-secret-syncer-ggpmx" (UID: "a8a570de-2345-412f-ab88-790c20e290ac") : object "kube-system"/"original-pull-secret" not registered May 21 20:38:46.262783 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:46.262735 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lhdn" May 21 20:38:46.262979 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:46.262733 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqwhq" May 21 20:38:46.262979 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:46.262874 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lhdn" podUID="23d4cc46-4752-4afd-a726-67d9eced1af9" May 21 20:38:46.262979 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:46.262964 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqwhq" podUID="0a50c0b1-eccc-4bdf-a7d7-eca75843e83b" May 21 20:38:46.412449 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:46.412410 2570 generic.go:358] "Generic (PLEG): container finished" podID="5404da1c-65ab-46a6-8824-6a1eb233b16a" containerID="bfbceb29ad0e2bbcb0969ff70a34dfaa9ace55163e62d85360f0fa15fb02541b" exitCode=0 May 21 20:38:46.412819 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:46.412492 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8zgxn" event={"ID":"5404da1c-65ab-46a6-8824-6a1eb233b16a","Type":"ContainerDied","Data":"bfbceb29ad0e2bbcb0969ff70a34dfaa9ace55163e62d85360f0fa15fb02541b"} May 21 20:38:47.263184 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:47.262932 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ggpmx" May 21 20:38:47.263333 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:47.263211 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ggpmx" podUID="a8a570de-2345-412f-ab88-790c20e290ac" May 21 20:38:47.415773 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:47.415745 2570 generic.go:358] "Generic (PLEG): container finished" podID="5404da1c-65ab-46a6-8824-6a1eb233b16a" containerID="ae31c3bf3015e3fb1024e96af92c3cc57852f592ce808da6beebc75caa510058" exitCode=0 May 21 20:38:47.416057 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:47.415799 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8zgxn" event={"ID":"5404da1c-65ab-46a6-8824-6a1eb233b16a","Type":"ContainerDied","Data":"ae31c3bf3015e3fb1024e96af92c3cc57852f592ce808da6beebc75caa510058"} May 21 20:38:48.263006 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:48.262965 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqwhq" May 21 20:38:48.263177 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:48.262967 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lhdn" May 21 20:38:48.263177 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:48.263067 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqwhq" podUID="0a50c0b1-eccc-4bdf-a7d7-eca75843e83b" May 21 20:38:48.263327 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:48.263180 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lhdn" podUID="23d4cc46-4752-4afd-a726-67d9eced1af9" May 21 20:38:48.418904 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:48.418872 2570 generic.go:358] "Generic (PLEG): container finished" podID="5404da1c-65ab-46a6-8824-6a1eb233b16a" containerID="9e9e34067fe331a6e6a7c70b25c0b1a955148d541bfe32731269feb783c00c19" exitCode=0 May 21 20:38:48.419417 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:48.418951 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8zgxn" event={"ID":"5404da1c-65ab-46a6-8824-6a1eb233b16a","Type":"ContainerDied","Data":"9e9e34067fe331a6e6a7c70b25c0b1a955148d541bfe32731269feb783c00c19"} May 21 20:38:48.421989 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:48.421970 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7krlb_d8463ad6-6f3b-4984-ab32-781d1507d42d/ovn-acl-logging/0.log" May 21 20:38:48.422401 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:48.422367 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" event={"ID":"d8463ad6-6f3b-4984-ab32-781d1507d42d","Type":"ContainerStarted","Data":"c248980cc8f19898744b314556f32ea5cdebe3a502b9652ec181340434fd6161"} May 21 20:38:48.422721 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:48.422692 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:48.422721 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:48.422720 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:48.422901 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:48.422886 2570 scope.go:117] "RemoveContainer" containerID="606a335730ae4808e7399edee5500b9f634a8442af8a1e309eb1f59ccb2ec378" May 21 20:38:48.440126 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:48.440102 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:49.263255 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:49.262989 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ggpmx" May 21 20:38:49.263436 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:49.263361 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ggpmx" podUID="a8a570de-2345-412f-ab88-790c20e290ac" May 21 20:38:49.382255 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:49.382216 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lqwhq"] May 21 20:38:49.382429 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:49.382334 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqwhq" May 21 20:38:49.382510 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:49.382427 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqwhq" podUID="0a50c0b1-eccc-4bdf-a7d7-eca75843e83b" May 21 20:38:49.385491 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:49.385437 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ggpmx"] May 21 20:38:49.386243 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:49.386219 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7lhdn"] May 21 20:38:49.386369 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:49.386354 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lhdn" May 21 20:38:49.386632 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:49.386496 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lhdn" podUID="23d4cc46-4752-4afd-a726-67d9eced1af9" May 21 20:38:49.428214 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:49.428123 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7krlb_d8463ad6-6f3b-4984-ab32-781d1507d42d/ovn-acl-logging/0.log" May 21 20:38:49.428869 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:49.428492 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ggpmx" May 21 20:38:49.428869 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:49.428583 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ggpmx" podUID="a8a570de-2345-412f-ab88-790c20e290ac" May 21 20:38:49.428993 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:49.428888 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" event={"ID":"d8463ad6-6f3b-4984-ab32-781d1507d42d","Type":"ContainerStarted","Data":"8a0a90a8ebd241a01e00d82a2ce2f7ab677865f2a6dfb8e92a38f241233a315a"} May 21 20:38:49.429663 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:49.429633 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:49.449765 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:49.449724 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:38:49.455056 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:49.455012 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" podStartSLOduration=11.433291808 podStartE2EDuration="29.454993857s" podCreationTimestamp="2026-05-21 20:38:20 +0000 UTC" firstStartedPulling="2026-05-21 20:38:22.922692785 +0000 UTC m=+3.304872835" lastFinishedPulling="2026-05-21 20:38:40.944394833 +0000 UTC m=+21.326574884" observedRunningTime="2026-05-21 20:38:49.454885331 +0000 UTC m=+29.837065404" watchObservedRunningTime="2026-05-21 20:38:49.454993857 +0000 UTC m=+29.837173908" May 21 20:38:51.262796 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:51.262754 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ggpmx" May 21 20:38:51.263436 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:51.262885 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ggpmx" podUID="a8a570de-2345-412f-ab88-790c20e290ac" May 21 20:38:51.263436 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:51.263268 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqwhq" May 21 20:38:51.263436 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:51.263360 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqwhq" podUID="0a50c0b1-eccc-4bdf-a7d7-eca75843e83b" May 21 20:38:51.263436 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:51.263407 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lhdn" May 21 20:38:51.263603 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:51.263510 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lhdn" podUID="23d4cc46-4752-4afd-a726-67d9eced1af9" May 21 20:38:52.300395 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:52.300350 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jldwc" May 21 20:38:52.300930 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:52.300525 2570 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 21 20:38:52.301407 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:52.301382 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jldwc" May 21 20:38:53.263220 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:53.263182 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqwhq" May 21 20:38:53.263549 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:53.263299 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lhdn" May 21 20:38:53.263549 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:53.263331 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ggpmx" May 21 20:38:53.263549 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:53.263415 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7lhdn" podUID="23d4cc46-4752-4afd-a726-67d9eced1af9" May 21 20:38:53.263549 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:53.263302 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqwhq" podUID="0a50c0b1-eccc-4bdf-a7d7-eca75843e83b" May 21 20:38:53.263750 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:53.263544 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ggpmx" podUID="a8a570de-2345-412f-ab88-790c20e290ac" May 21 20:38:53.916657 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:53.916566 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-158.ec2.internal" event="NodeReady" May 21 20:38:53.917106 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:53.916695 2570 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 21 20:38:53.917106 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:53.916755 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23d4cc46-4752-4afd-a726-67d9eced1af9-metrics-certs\") pod \"network-metrics-daemon-7lhdn\" (UID: \"23d4cc46-4752-4afd-a726-67d9eced1af9\") " pod="openshift-multus/network-metrics-daemon-7lhdn" May 21 20:38:53.917106 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:53.916899 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:38:53.917106 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:53.916954 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23d4cc46-4752-4afd-a726-67d9eced1af9-metrics-certs podName:23d4cc46-4752-4afd-a726-67d9eced1af9 nodeName:}" failed. No retries permitted until 2026-05-21 20:39:25.916934842 +0000 UTC m=+66.299114898 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23d4cc46-4752-4afd-a726-67d9eced1af9-metrics-certs") pod "network-metrics-daemon-7lhdn" (UID: "23d4cc46-4752-4afd-a726-67d9eced1af9") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 20:38:53.959568 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:53.959535 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-x7nft"] May 21 20:38:54.000105 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:54.000067 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-j5jnw"] May 21 20:38:54.000272 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:54.000239 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x7nft" May 21 20:38:54.002310 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:54.002285 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 21 20:38:54.002441 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:54.002391 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-25972\"" May 21 20:38:54.002523 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:54.002393 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 21 20:38:54.013557 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:54.013533 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x7nft"] May 21 20:38:54.013671 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:54.013562 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j5jnw"] May 21 20:38:54.013728 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:54.013673 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j5jnw" May 21 20:38:54.015725 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:54.015701 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 21 20:38:54.015828 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:54.015760 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 21 20:38:54.015985 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:54.015968 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 21 20:38:54.016332 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:54.016309 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-f4n69\"" May 21 20:38:54.017400 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:54.017377 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-crm28\" (UniqueName: \"kubernetes.io/projected/0a50c0b1-eccc-4bdf-a7d7-eca75843e83b-kube-api-access-crm28\") pod \"network-check-target-lqwhq\" (UID: \"0a50c0b1-eccc-4bdf-a7d7-eca75843e83b\") " pod="openshift-network-diagnostics/network-check-target-lqwhq" May 21 20:38:54.017521 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:54.017511 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 20:38:54.017568 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:54.017529 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 20:38:54.017568 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:54.017539 2570 projected.go:194] Error preparing data for projected volume kube-api-access-crm28 for pod openshift-network-diagnostics/network-check-target-lqwhq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:38:54.017635 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:54.017592 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a50c0b1-eccc-4bdf-a7d7-eca75843e83b-kube-api-access-crm28 podName:0a50c0b1-eccc-4bdf-a7d7-eca75843e83b nodeName:}" failed. No retries permitted until 2026-05-21 20:39:26.017577431 +0000 UTC m=+66.399757485 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-crm28" (UniqueName: "kubernetes.io/projected/0a50c0b1-eccc-4bdf-a7d7-eca75843e83b-kube-api-access-crm28") pod "network-check-target-lqwhq" (UID: "0a50c0b1-eccc-4bdf-a7d7-eca75843e83b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 20:38:54.118256 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:54.118220 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19a963d1-f89b-4cee-8b37-3205095efa67-tmp-dir\") pod \"dns-default-x7nft\" (UID: \"19a963d1-f89b-4cee-8b37-3205095efa67\") " pod="openshift-dns/dns-default-x7nft" May 21 20:38:54.118256 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:54.118259 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/19a963d1-f89b-4cee-8b37-3205095efa67-config-volume\") pod \"dns-default-x7nft\" (UID: \"19a963d1-f89b-4cee-8b37-3205095efa67\") " pod="openshift-dns/dns-default-x7nft" May 21 20:38:54.118534 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:54.118284 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d7d41f03-d42a-434d-b1a0-fb94372013b2-cert\") pod \"ingress-canary-j5jnw\" (UID: \"d7d41f03-d42a-434d-b1a0-fb94372013b2\") " pod="openshift-ingress-canary/ingress-canary-j5jnw" May 21 20:38:54.118534 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:54.118425 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhhgn\" (UniqueName: \"kubernetes.io/projected/d7d41f03-d42a-434d-b1a0-fb94372013b2-kube-api-access-bhhgn\") pod \"ingress-canary-j5jnw\" (UID: \"d7d41f03-d42a-434d-b1a0-fb94372013b2\") " pod="openshift-ingress-canary/ingress-canary-j5jnw" May 21 20:38:54.118534 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:54.118464 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tqs9\" (UniqueName: \"kubernetes.io/projected/19a963d1-f89b-4cee-8b37-3205095efa67-kube-api-access-9tqs9\") pod \"dns-default-x7nft\" (UID: \"19a963d1-f89b-4cee-8b37-3205095efa67\") " pod="openshift-dns/dns-default-x7nft" May 21 20:38:54.118534 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:54.118529 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/19a963d1-f89b-4cee-8b37-3205095efa67-metrics-tls\") pod \"dns-default-x7nft\" (UID: \"19a963d1-f89b-4cee-8b37-3205095efa67\") " pod="openshift-dns/dns-default-x7nft" May 21 20:38:54.219832 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:54.219794 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19a963d1-f89b-4cee-8b37-3205095efa67-tmp-dir\") pod \"dns-default-x7nft\" (UID: \"19a963d1-f89b-4cee-8b37-3205095efa67\") " pod="openshift-dns/dns-default-x7nft" May 21 20:38:54.219985 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:54.219838 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/19a963d1-f89b-4cee-8b37-3205095efa67-config-volume\") pod \"dns-default-x7nft\" (UID: \"19a963d1-f89b-4cee-8b37-3205095efa67\") " pod="openshift-dns/dns-default-x7nft" May 21 20:38:54.219985 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:54.219870 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d7d41f03-d42a-434d-b1a0-fb94372013b2-cert\") pod \"ingress-canary-j5jnw\" (UID: \"d7d41f03-d42a-434d-b1a0-fb94372013b2\") " pod="openshift-ingress-canary/ingress-canary-j5jnw" May 21 20:38:54.219985 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:54.219943 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bhhgn\" (UniqueName: \"kubernetes.io/projected/d7d41f03-d42a-434d-b1a0-fb94372013b2-kube-api-access-bhhgn\") pod \"ingress-canary-j5jnw\" (UID: \"d7d41f03-d42a-434d-b1a0-fb94372013b2\") " pod="openshift-ingress-canary/ingress-canary-j5jnw" May 21 20:38:54.219985 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:54.219968 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9tqs9\" (UniqueName: \"kubernetes.io/projected/19a963d1-f89b-4cee-8b37-3205095efa67-kube-api-access-9tqs9\") pod \"dns-default-x7nft\" (UID: \"19a963d1-f89b-4cee-8b37-3205095efa67\") " pod="openshift-dns/dns-default-x7nft" May 21 20:38:54.220163 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:54.220004 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/19a963d1-f89b-4cee-8b37-3205095efa67-metrics-tls\") pod \"dns-default-x7nft\" (UID: \"19a963d1-f89b-4cee-8b37-3205095efa67\") " pod="openshift-dns/dns-default-x7nft" May 21 20:38:54.220163 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:54.220024 2570 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 20:38:54.220163 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:54.220094 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7d41f03-d42a-434d-b1a0-fb94372013b2-cert podName:d7d41f03-d42a-434d-b1a0-fb94372013b2 nodeName:}" failed. No retries permitted until 2026-05-21 20:38:54.720074885 +0000 UTC m=+35.102254954 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d7d41f03-d42a-434d-b1a0-fb94372013b2-cert") pod "ingress-canary-j5jnw" (UID: "d7d41f03-d42a-434d-b1a0-fb94372013b2") : secret "canary-serving-cert" not found May 21 20:38:54.220163 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:54.220104 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 20:38:54.220163 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:54.220153 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19a963d1-f89b-4cee-8b37-3205095efa67-metrics-tls podName:19a963d1-f89b-4cee-8b37-3205095efa67 nodeName:}" failed. No retries permitted until 2026-05-21 20:38:54.720136374 +0000 UTC m=+35.102316424 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/19a963d1-f89b-4cee-8b37-3205095efa67-metrics-tls") pod "dns-default-x7nft" (UID: "19a963d1-f89b-4cee-8b37-3205095efa67") : secret "dns-default-metrics-tls" not found May 21 20:38:54.220351 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:54.220166 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19a963d1-f89b-4cee-8b37-3205095efa67-tmp-dir\") pod \"dns-default-x7nft\" (UID: \"19a963d1-f89b-4cee-8b37-3205095efa67\") " pod="openshift-dns/dns-default-x7nft" May 21 20:38:54.220500 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:54.220452 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/19a963d1-f89b-4cee-8b37-3205095efa67-config-volume\") pod \"dns-default-x7nft\" (UID: \"19a963d1-f89b-4cee-8b37-3205095efa67\") " pod="openshift-dns/dns-default-x7nft" May 21 20:38:54.230302 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:54.230150 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tqs9\" (UniqueName: \"kubernetes.io/projected/19a963d1-f89b-4cee-8b37-3205095efa67-kube-api-access-9tqs9\") pod \"dns-default-x7nft\" (UID: \"19a963d1-f89b-4cee-8b37-3205095efa67\") " pod="openshift-dns/dns-default-x7nft" May 21 20:38:54.230395 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:54.230229 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhhgn\" (UniqueName: \"kubernetes.io/projected/d7d41f03-d42a-434d-b1a0-fb94372013b2-kube-api-access-bhhgn\") pod \"ingress-canary-j5jnw\" (UID: \"d7d41f03-d42a-434d-b1a0-fb94372013b2\") " pod="openshift-ingress-canary/ingress-canary-j5jnw" May 21 20:38:54.724011 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:54.723974 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/19a963d1-f89b-4cee-8b37-3205095efa67-metrics-tls\") pod \"dns-default-x7nft\" (UID: \"19a963d1-f89b-4cee-8b37-3205095efa67\") " pod="openshift-dns/dns-default-x7nft" May 21 20:38:54.724163 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:54.724039 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d7d41f03-d42a-434d-b1a0-fb94372013b2-cert\") pod \"ingress-canary-j5jnw\" (UID: \"d7d41f03-d42a-434d-b1a0-fb94372013b2\") " pod="openshift-ingress-canary/ingress-canary-j5jnw" May 21 20:38:54.724163 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:54.724120 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 20:38:54.724270 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:54.724182 2570 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 20:38:54.724270 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:54.724197 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19a963d1-f89b-4cee-8b37-3205095efa67-metrics-tls podName:19a963d1-f89b-4cee-8b37-3205095efa67 nodeName:}" failed. No retries permitted until 2026-05-21 20:38:55.724175837 +0000 UTC m=+36.106355888 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/19a963d1-f89b-4cee-8b37-3205095efa67-metrics-tls") pod "dns-default-x7nft" (UID: "19a963d1-f89b-4cee-8b37-3205095efa67") : secret "dns-default-metrics-tls" not found May 21 20:38:54.724270 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:54.724233 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7d41f03-d42a-434d-b1a0-fb94372013b2-cert podName:d7d41f03-d42a-434d-b1a0-fb94372013b2 nodeName:}" failed. No retries permitted until 2026-05-21 20:38:55.724218867 +0000 UTC m=+36.106398920 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d7d41f03-d42a-434d-b1a0-fb94372013b2-cert") pod "ingress-canary-j5jnw" (UID: "d7d41f03-d42a-434d-b1a0-fb94372013b2") : secret "canary-serving-cert" not found May 21 20:38:55.262334 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:55.262291 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ggpmx" May 21 20:38:55.262334 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:55.262321 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqwhq" May 21 20:38:55.262847 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:55.262344 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lhdn" May 21 20:38:55.264658 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:55.264640 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 21 20:38:55.265046 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:55.265018 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 20:38:55.265046 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:55.265057 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 20:38:55.265212 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:55.265076 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 20:38:55.265212 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:55.265121 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cjf7l\"" May 21 20:38:55.265212 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:55.265057 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hrp5p\"" May 21 20:38:55.442073 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:55.442041 2570 generic.go:358] "Generic (PLEG): container finished" podID="5404da1c-65ab-46a6-8824-6a1eb233b16a" containerID="a0e287448adbd5b0c38cfb2b1ca32925fe91301a30c373a6edd27973af8193e7" exitCode=0 May 21 20:38:55.442257 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:55.442102 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8zgxn" event={"ID":"5404da1c-65ab-46a6-8824-6a1eb233b16a","Type":"ContainerDied","Data":"a0e287448adbd5b0c38cfb2b1ca32925fe91301a30c373a6edd27973af8193e7"} May 21 20:38:55.730019 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:55.729977 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/19a963d1-f89b-4cee-8b37-3205095efa67-metrics-tls\") pod \"dns-default-x7nft\" (UID: \"19a963d1-f89b-4cee-8b37-3205095efa67\") " pod="openshift-dns/dns-default-x7nft" May 21 20:38:55.730225 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:55.730029 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d7d41f03-d42a-434d-b1a0-fb94372013b2-cert\") pod \"ingress-canary-j5jnw\" (UID: \"d7d41f03-d42a-434d-b1a0-fb94372013b2\") " pod="openshift-ingress-canary/ingress-canary-j5jnw" May 21 20:38:55.730225 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:55.730126 2570 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 20:38:55.730225 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:55.730129 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 20:38:55.730225 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:55.730181 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7d41f03-d42a-434d-b1a0-fb94372013b2-cert podName:d7d41f03-d42a-434d-b1a0-fb94372013b2 nodeName:}" failed. No retries permitted until 2026-05-21 20:38:57.730164763 +0000 UTC m=+38.112344813 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d7d41f03-d42a-434d-b1a0-fb94372013b2-cert") pod "ingress-canary-j5jnw" (UID: "d7d41f03-d42a-434d-b1a0-fb94372013b2") : secret "canary-serving-cert" not found May 21 20:38:55.730225 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:55.730193 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19a963d1-f89b-4cee-8b37-3205095efa67-metrics-tls podName:19a963d1-f89b-4cee-8b37-3205095efa67 nodeName:}" failed. No retries permitted until 2026-05-21 20:38:57.730187831 +0000 UTC m=+38.112367881 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/19a963d1-f89b-4cee-8b37-3205095efa67-metrics-tls") pod "dns-default-x7nft" (UID: "19a963d1-f89b-4cee-8b37-3205095efa67") : secret "dns-default-metrics-tls" not found May 21 20:38:56.446381 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:56.446352 2570 generic.go:358] "Generic (PLEG): container finished" podID="5404da1c-65ab-46a6-8824-6a1eb233b16a" containerID="a4623c6f355f11753fc1c3dc396ae7e505a9755afc79ef6c928064d75a0fc7a6" exitCode=0 May 21 20:38:56.446793 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:56.446404 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8zgxn" event={"ID":"5404da1c-65ab-46a6-8824-6a1eb233b16a","Type":"ContainerDied","Data":"a4623c6f355f11753fc1c3dc396ae7e505a9755afc79ef6c928064d75a0fc7a6"} May 21 20:38:57.451442 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:57.451408 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8zgxn" event={"ID":"5404da1c-65ab-46a6-8824-6a1eb233b16a","Type":"ContainerStarted","Data":"554cac5ae3b2885f25414a69ac47de3829e2b52f3d06f849c9f4b973ea41eae8"} May 21 20:38:57.475993 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:57.475936 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8zgxn" podStartSLOduration=5.981788315 podStartE2EDuration="37.475919919s" podCreationTimestamp="2026-05-21 20:38:20 +0000 UTC" firstStartedPulling="2026-05-21 20:38:22.92527873 +0000 UTC m=+3.307458783" lastFinishedPulling="2026-05-21 20:38:54.419410337 +0000 UTC m=+34.801590387" observedRunningTime="2026-05-21 20:38:57.474560616 +0000 UTC m=+37.856740690" watchObservedRunningTime="2026-05-21 20:38:57.475919919 +0000 UTC m=+37.858099991" May 21 20:38:57.747842 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:57.747756 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/19a963d1-f89b-4cee-8b37-3205095efa67-metrics-tls\") pod \"dns-default-x7nft\" (UID: \"19a963d1-f89b-4cee-8b37-3205095efa67\") " pod="openshift-dns/dns-default-x7nft" May 21 20:38:57.747842 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:38:57.747809 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d7d41f03-d42a-434d-b1a0-fb94372013b2-cert\") pod \"ingress-canary-j5jnw\" (UID: \"d7d41f03-d42a-434d-b1a0-fb94372013b2\") " pod="openshift-ingress-canary/ingress-canary-j5jnw" May 21 20:38:57.748008 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:57.747909 2570 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 20:38:57.748008 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:57.747916 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 20:38:57.748008 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:57.747962 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7d41f03-d42a-434d-b1a0-fb94372013b2-cert podName:d7d41f03-d42a-434d-b1a0-fb94372013b2 nodeName:}" failed. No retries permitted until 2026-05-21 20:39:01.747948383 +0000 UTC m=+42.130128437 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d7d41f03-d42a-434d-b1a0-fb94372013b2-cert") pod "ingress-canary-j5jnw" (UID: "d7d41f03-d42a-434d-b1a0-fb94372013b2") : secret "canary-serving-cert" not found May 21 20:38:57.748008 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:38:57.747976 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19a963d1-f89b-4cee-8b37-3205095efa67-metrics-tls podName:19a963d1-f89b-4cee-8b37-3205095efa67 nodeName:}" failed. No retries permitted until 2026-05-21 20:39:01.747969073 +0000 UTC m=+42.130149123 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/19a963d1-f89b-4cee-8b37-3205095efa67-metrics-tls") pod "dns-default-x7nft" (UID: "19a963d1-f89b-4cee-8b37-3205095efa67") : secret "dns-default-metrics-tls" not found May 21 20:39:01.677148 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:01.677105 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a8a570de-2345-412f-ab88-790c20e290ac-original-pull-secret\") pod \"global-pull-secret-syncer-ggpmx\" (UID: \"a8a570de-2345-412f-ab88-790c20e290ac\") " pod="kube-system/global-pull-secret-syncer-ggpmx" May 21 20:39:01.680575 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:01.680553 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a8a570de-2345-412f-ab88-790c20e290ac-original-pull-secret\") pod \"global-pull-secret-syncer-ggpmx\" (UID: \"a8a570de-2345-412f-ab88-790c20e290ac\") " pod="kube-system/global-pull-secret-syncer-ggpmx" May 21 20:39:01.777846 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:01.777804 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/19a963d1-f89b-4cee-8b37-3205095efa67-metrics-tls\") pod \"dns-default-x7nft\" (UID: \"19a963d1-f89b-4cee-8b37-3205095efa67\") " pod="openshift-dns/dns-default-x7nft" May 21 20:39:01.777846 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:01.777853 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d7d41f03-d42a-434d-b1a0-fb94372013b2-cert\") pod \"ingress-canary-j5jnw\" (UID: \"d7d41f03-d42a-434d-b1a0-fb94372013b2\") " pod="openshift-ingress-canary/ingress-canary-j5jnw" May 21 20:39:01.778047 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:39:01.777948 2570 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 20:39:01.778047 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:39:01.777962 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 20:39:01.778047 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:39:01.777998 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7d41f03-d42a-434d-b1a0-fb94372013b2-cert podName:d7d41f03-d42a-434d-b1a0-fb94372013b2 nodeName:}" failed. No retries permitted until 2026-05-21 20:39:09.777984536 +0000 UTC m=+50.160164586 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d7d41f03-d42a-434d-b1a0-fb94372013b2-cert") pod "ingress-canary-j5jnw" (UID: "d7d41f03-d42a-434d-b1a0-fb94372013b2") : secret "canary-serving-cert" not found May 21 20:39:01.778047 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:39:01.778043 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19a963d1-f89b-4cee-8b37-3205095efa67-metrics-tls podName:19a963d1-f89b-4cee-8b37-3205095efa67 nodeName:}" failed. No retries permitted until 2026-05-21 20:39:09.778004424 +0000 UTC m=+50.160184478 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/19a963d1-f89b-4cee-8b37-3205095efa67-metrics-tls") pod "dns-default-x7nft" (UID: "19a963d1-f89b-4cee-8b37-3205095efa67") : secret "dns-default-metrics-tls" not found May 21 20:39:01.871957 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:01.871914 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ggpmx" May 21 20:39:02.007159 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:02.007117 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ggpmx"] May 21 20:39:02.012211 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:39:02.012182 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8a570de_2345_412f_ab88_790c20e290ac.slice/crio-1f7c120f35f874e66d89321d942e36f12a7263f860c5b28c53aeb1ca6496f0cc WatchSource:0}: Error finding container 1f7c120f35f874e66d89321d942e36f12a7263f860c5b28c53aeb1ca6496f0cc: Status 404 returned error can't find the container with id 1f7c120f35f874e66d89321d942e36f12a7263f860c5b28c53aeb1ca6496f0cc May 21 20:39:02.461709 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:02.461667 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ggpmx" event={"ID":"a8a570de-2345-412f-ab88-790c20e290ac","Type":"ContainerStarted","Data":"1f7c120f35f874e66d89321d942e36f12a7263f860c5b28c53aeb1ca6496f0cc"} May 21 20:39:06.470339 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:06.470302 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ggpmx" event={"ID":"a8a570de-2345-412f-ab88-790c20e290ac","Type":"ContainerStarted","Data":"a2cdf532d8f11367281ead96cabc01ad884a72cf4300f5b57ced8fb52c123543"} May 21 20:39:06.484749 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:06.484678 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-ggpmx" podStartSLOduration=33.686667967 podStartE2EDuration="37.484662569s" podCreationTimestamp="2026-05-21 20:38:29 +0000 UTC" firstStartedPulling="2026-05-21 20:39:02.013973874 +0000 UTC m=+42.396153923" lastFinishedPulling="2026-05-21 20:39:05.811968463 +0000 UTC m=+46.194148525" observedRunningTime="2026-05-21 20:39:06.484281074 +0000 UTC m=+46.866461148" watchObservedRunningTime="2026-05-21 20:39:06.484662569 +0000 UTC m=+46.866842645" May 21 20:39:09.843183 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:09.843147 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/19a963d1-f89b-4cee-8b37-3205095efa67-metrics-tls\") pod \"dns-default-x7nft\" (UID: \"19a963d1-f89b-4cee-8b37-3205095efa67\") " pod="openshift-dns/dns-default-x7nft" May 21 20:39:09.843183 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:09.843197 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d7d41f03-d42a-434d-b1a0-fb94372013b2-cert\") pod \"ingress-canary-j5jnw\" (UID: \"d7d41f03-d42a-434d-b1a0-fb94372013b2\") " pod="openshift-ingress-canary/ingress-canary-j5jnw" May 21 20:39:09.843784 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:39:09.843299 2570 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 20:39:09.843784 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:39:09.843312 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 20:39:09.843784 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:39:09.843350 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7d41f03-d42a-434d-b1a0-fb94372013b2-cert podName:d7d41f03-d42a-434d-b1a0-fb94372013b2 nodeName:}" failed. No retries permitted until 2026-05-21 20:39:25.843335827 +0000 UTC m=+66.225515876 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d7d41f03-d42a-434d-b1a0-fb94372013b2-cert") pod "ingress-canary-j5jnw" (UID: "d7d41f03-d42a-434d-b1a0-fb94372013b2") : secret "canary-serving-cert" not found May 21 20:39:09.843784 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:39:09.843370 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19a963d1-f89b-4cee-8b37-3205095efa67-metrics-tls podName:19a963d1-f89b-4cee-8b37-3205095efa67 nodeName:}" failed. No retries permitted until 2026-05-21 20:39:25.843355588 +0000 UTC m=+66.225535637 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/19a963d1-f89b-4cee-8b37-3205095efa67-metrics-tls") pod "dns-default-x7nft" (UID: "19a963d1-f89b-4cee-8b37-3205095efa67") : secret "dns-default-metrics-tls" not found May 21 20:39:17.640410 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:17.640366 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bcc69bb-lm29p"] May 21 20:39:17.643184 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:17.643166 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-677b54cc6d-jld6s"] May 21 20:39:17.643334 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:17.643315 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bcc69bb-lm29p" May 21 20:39:17.644836 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:17.644816 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-677b54cc6d-jld6s" May 21 20:39:17.645755 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:17.645730 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" May 21 20:39:17.645755 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:17.645752 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" May 21 20:39:17.646051 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:17.645787 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" May 21 20:39:17.646051 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:17.645817 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" May 21 20:39:17.646051 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:17.646017 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" May 21 20:39:17.646354 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:17.646262 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" May 21 20:39:17.646354 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:17.646271 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" May 21 20:39:17.646513 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:17.646409 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" May 21 20:39:17.652953 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:17.652931 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bcc69bb-lm29p"] May 21 20:39:17.664975 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:17.664943 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-677b54cc6d-jld6s"] May 21 20:39:17.695238 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:17.695205 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a8d101f0-3af9-4e71-bafc-2cbe35f289a4-ca\") pod \"cluster-proxy-proxy-agent-55bcc69bb-lm29p\" (UID: \"a8d101f0-3af9-4e71-bafc-2cbe35f289a4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bcc69bb-lm29p" May 21 20:39:17.695238 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:17.695238 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a8d101f0-3af9-4e71-bafc-2cbe35f289a4-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-55bcc69bb-lm29p\" (UID: \"a8d101f0-3af9-4e71-bafc-2cbe35f289a4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bcc69bb-lm29p" May 21 20:39:17.695418 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:17.695266 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/97806640-fdd8-4f95-b570-505c717afe41-klusterlet-config\") pod \"klusterlet-addon-workmgr-677b54cc6d-jld6s\" (UID: \"97806640-fdd8-4f95-b570-505c717afe41\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-677b54cc6d-jld6s" May 21 20:39:17.695418 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:17.695355 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/97806640-fdd8-4f95-b570-505c717afe41-tmp\") pod \"klusterlet-addon-workmgr-677b54cc6d-jld6s\" (UID: \"97806640-fdd8-4f95-b570-505c717afe41\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-677b54cc6d-jld6s" May 21 20:39:17.695418 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:17.695378 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a8d101f0-3af9-4e71-bafc-2cbe35f289a4-hub\") pod \"cluster-proxy-proxy-agent-55bcc69bb-lm29p\" (UID: \"a8d101f0-3af9-4e71-bafc-2cbe35f289a4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bcc69bb-lm29p" May 21 20:39:17.695418 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:17.695396 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a8d101f0-3af9-4e71-bafc-2cbe35f289a4-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-55bcc69bb-lm29p\" (UID: \"a8d101f0-3af9-4e71-bafc-2cbe35f289a4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bcc69bb-lm29p" May 21 20:39:17.695569 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:17.695456 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfl6h\" (UniqueName: \"kubernetes.io/projected/97806640-fdd8-4f95-b570-505c717afe41-kube-api-access-wfl6h\") pod \"klusterlet-addon-workmgr-677b54cc6d-jld6s\" (UID: \"97806640-fdd8-4f95-b570-505c717afe41\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-677b54cc6d-jld6s" May 21 20:39:17.695569 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:17.695503 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsdqd\" (UniqueName: \"kubernetes.io/projected/a8d101f0-3af9-4e71-bafc-2cbe35f289a4-kube-api-access-qsdqd\") pod \"cluster-proxy-proxy-agent-55bcc69bb-lm29p\" (UID: \"a8d101f0-3af9-4e71-bafc-2cbe35f289a4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bcc69bb-lm29p" May 21 20:39:17.695569 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:17.695531 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/a8d101f0-3af9-4e71-bafc-2cbe35f289a4-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-55bcc69bb-lm29p\" (UID: \"a8d101f0-3af9-4e71-bafc-2cbe35f289a4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bcc69bb-lm29p" May 21 20:39:17.796574 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:17.796539 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/a8d101f0-3af9-4e71-bafc-2cbe35f289a4-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-55bcc69bb-lm29p\" (UID: \"a8d101f0-3af9-4e71-bafc-2cbe35f289a4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bcc69bb-lm29p" May 21 20:39:17.796720 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:17.796595 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a8d101f0-3af9-4e71-bafc-2cbe35f289a4-ca\") pod \"cluster-proxy-proxy-agent-55bcc69bb-lm29p\" (UID: \"a8d101f0-3af9-4e71-bafc-2cbe35f289a4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bcc69bb-lm29p" May 21 20:39:17.796720 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:17.796613 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a8d101f0-3af9-4e71-bafc-2cbe35f289a4-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-55bcc69bb-lm29p\" (UID: \"a8d101f0-3af9-4e71-bafc-2cbe35f289a4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bcc69bb-lm29p" May 21 20:39:17.796720 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:17.796631 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/97806640-fdd8-4f95-b570-505c717afe41-klusterlet-config\") pod \"klusterlet-addon-workmgr-677b54cc6d-jld6s\" (UID: \"97806640-fdd8-4f95-b570-505c717afe41\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-677b54cc6d-jld6s" May 21 20:39:17.796866 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:17.796766 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/97806640-fdd8-4f95-b570-505c717afe41-tmp\") pod \"klusterlet-addon-workmgr-677b54cc6d-jld6s\" (UID: \"97806640-fdd8-4f95-b570-505c717afe41\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-677b54cc6d-jld6s" May 21 20:39:17.796866 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:17.796796 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a8d101f0-3af9-4e71-bafc-2cbe35f289a4-hub\") pod \"cluster-proxy-proxy-agent-55bcc69bb-lm29p\" (UID: \"a8d101f0-3af9-4e71-bafc-2cbe35f289a4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bcc69bb-lm29p" May 21 20:39:17.796866 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:17.796825 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a8d101f0-3af9-4e71-bafc-2cbe35f289a4-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-55bcc69bb-lm29p\" (UID: \"a8d101f0-3af9-4e71-bafc-2cbe35f289a4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bcc69bb-lm29p" May 21 20:39:17.797201 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:17.797152 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wfl6h\" (UniqueName: \"kubernetes.io/projected/97806640-fdd8-4f95-b570-505c717afe41-kube-api-access-wfl6h\") pod \"klusterlet-addon-workmgr-677b54cc6d-jld6s\" (UID: \"97806640-fdd8-4f95-b570-505c717afe41\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-677b54cc6d-jld6s" May 21 20:39:17.797336 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:17.797202 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qsdqd\" (UniqueName: \"kubernetes.io/projected/a8d101f0-3af9-4e71-bafc-2cbe35f289a4-kube-api-access-qsdqd\") pod \"cluster-proxy-proxy-agent-55bcc69bb-lm29p\" (UID: \"a8d101f0-3af9-4e71-bafc-2cbe35f289a4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bcc69bb-lm29p" May 21 20:39:17.797336 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:17.797240 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/97806640-fdd8-4f95-b570-505c717afe41-tmp\") pod \"klusterlet-addon-workmgr-677b54cc6d-jld6s\" (UID: \"97806640-fdd8-4f95-b570-505c717afe41\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-677b54cc6d-jld6s" May 21 20:39:17.797451 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:17.797419 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/a8d101f0-3af9-4e71-bafc-2cbe35f289a4-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-55bcc69bb-lm29p\" (UID: \"a8d101f0-3af9-4e71-bafc-2cbe35f289a4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bcc69bb-lm29p" May 21 20:39:17.799525 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:17.799493 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a8d101f0-3af9-4e71-bafc-2cbe35f289a4-hub\") pod \"cluster-proxy-proxy-agent-55bcc69bb-lm29p\" (UID: \"a8d101f0-3af9-4e71-bafc-2cbe35f289a4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bcc69bb-lm29p" May 21 20:39:17.799714 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:17.799689 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a8d101f0-3af9-4e71-bafc-2cbe35f289a4-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-55bcc69bb-lm29p\" (UID: \"a8d101f0-3af9-4e71-bafc-2cbe35f289a4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bcc69bb-lm29p" May 21 20:39:17.799824 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:17.799806 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a8d101f0-3af9-4e71-bafc-2cbe35f289a4-ca\") pod \"cluster-proxy-proxy-agent-55bcc69bb-lm29p\" (UID: \"a8d101f0-3af9-4e71-bafc-2cbe35f289a4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bcc69bb-lm29p" May 21 20:39:17.800053 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:17.800034 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a8d101f0-3af9-4e71-bafc-2cbe35f289a4-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-55bcc69bb-lm29p\" (UID: \"a8d101f0-3af9-4e71-bafc-2cbe35f289a4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bcc69bb-lm29p" May 21 20:39:17.800151 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:17.800133 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/97806640-fdd8-4f95-b570-505c717afe41-klusterlet-config\") pod \"klusterlet-addon-workmgr-677b54cc6d-jld6s\" (UID: \"97806640-fdd8-4f95-b570-505c717afe41\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-677b54cc6d-jld6s" May 21 20:39:17.804775 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:17.804756 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsdqd\" (UniqueName: \"kubernetes.io/projected/a8d101f0-3af9-4e71-bafc-2cbe35f289a4-kube-api-access-qsdqd\") pod \"cluster-proxy-proxy-agent-55bcc69bb-lm29p\" (UID: \"a8d101f0-3af9-4e71-bafc-2cbe35f289a4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bcc69bb-lm29p" May 21 20:39:17.804892 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:17.804855 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfl6h\" (UniqueName: \"kubernetes.io/projected/97806640-fdd8-4f95-b570-505c717afe41-kube-api-access-wfl6h\") pod \"klusterlet-addon-workmgr-677b54cc6d-jld6s\" (UID: \"97806640-fdd8-4f95-b570-505c717afe41\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-677b54cc6d-jld6s" May 21 20:39:17.969610 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:17.969576 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bcc69bb-lm29p" May 21 20:39:17.976506 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:17.976462 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-677b54cc6d-jld6s" May 21 20:39:18.120119 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:18.120090 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bcc69bb-lm29p"] May 21 20:39:18.122990 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:39:18.122962 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda8d101f0_3af9_4e71_bafc_2cbe35f289a4.slice/crio-735a586a7390abb0dab9edc4251ceb62ae8e577569ee2e95f52fca5271e12b29 WatchSource:0}: Error finding container 735a586a7390abb0dab9edc4251ceb62ae8e577569ee2e95f52fca5271e12b29: Status 404 returned error can't find the container with id 735a586a7390abb0dab9edc4251ceb62ae8e577569ee2e95f52fca5271e12b29 May 21 20:39:18.129943 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:18.129919 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-677b54cc6d-jld6s"] May 21 20:39:18.132916 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:39:18.132895 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97806640_fdd8_4f95_b570_505c717afe41.slice/crio-1d27bb797057ff3ea69cfc9cbba199f04a7e7faecb3f29dd7cb7dd2551b69880 WatchSource:0}: Error finding container 1d27bb797057ff3ea69cfc9cbba199f04a7e7faecb3f29dd7cb7dd2551b69880: Status 404 returned error can't find the container with id 1d27bb797057ff3ea69cfc9cbba199f04a7e7faecb3f29dd7cb7dd2551b69880 May 21 20:39:18.492641 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:18.492604 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-677b54cc6d-jld6s" event={"ID":"97806640-fdd8-4f95-b570-505c717afe41","Type":"ContainerStarted","Data":"1d27bb797057ff3ea69cfc9cbba199f04a7e7faecb3f29dd7cb7dd2551b69880"} May 21 20:39:18.493604 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:18.493578 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bcc69bb-lm29p" event={"ID":"a8d101f0-3af9-4e71-bafc-2cbe35f289a4","Type":"ContainerStarted","Data":"735a586a7390abb0dab9edc4251ceb62ae8e577569ee2e95f52fca5271e12b29"} May 21 20:39:21.445399 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:21.445367 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7krlb" May 21 20:39:24.506326 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:24.506289 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-677b54cc6d-jld6s" event={"ID":"97806640-fdd8-4f95-b570-505c717afe41","Type":"ContainerStarted","Data":"0a1027d5b29d99032db0e7709f96bb57bd56c322d4dc7b47c7e7b6c6034d8acb"} May 21 20:39:24.506762 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:24.506492 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-677b54cc6d-jld6s" May 21 20:39:24.507706 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:24.507674 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bcc69bb-lm29p" event={"ID":"a8d101f0-3af9-4e71-bafc-2cbe35f289a4","Type":"ContainerStarted","Data":"4ede2787b92650bac9081fd312775b55077d47ceb7744fb88494e38f73cc4385"} May 21 20:39:24.508258 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:24.508231 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-677b54cc6d-jld6s" May 21 20:39:24.522422 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:24.522374 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-677b54cc6d-jld6s" podStartSLOduration=1.9896314290000001 podStartE2EDuration="7.522361132s" podCreationTimestamp="2026-05-21 20:39:17 +0000 UTC" firstStartedPulling="2026-05-21 20:39:18.134564604 +0000 UTC m=+58.516744654" lastFinishedPulling="2026-05-21 20:39:23.667294307 +0000 UTC m=+64.049474357" observedRunningTime="2026-05-21 20:39:24.521564243 +0000 UTC m=+64.903744314" watchObservedRunningTime="2026-05-21 20:39:24.522361132 +0000 UTC m=+64.904541241" May 21 20:39:25.861997 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:25.861953 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d7d41f03-d42a-434d-b1a0-fb94372013b2-cert\") pod \"ingress-canary-j5jnw\" (UID: \"d7d41f03-d42a-434d-b1a0-fb94372013b2\") " pod="openshift-ingress-canary/ingress-canary-j5jnw" May 21 20:39:25.862493 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:25.862074 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/19a963d1-f89b-4cee-8b37-3205095efa67-metrics-tls\") pod \"dns-default-x7nft\" (UID: \"19a963d1-f89b-4cee-8b37-3205095efa67\") " pod="openshift-dns/dns-default-x7nft" May 21 20:39:25.862493 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:39:25.862144 2570 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 20:39:25.862493 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:39:25.862209 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 20:39:25.862493 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:39:25.862224 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7d41f03-d42a-434d-b1a0-fb94372013b2-cert podName:d7d41f03-d42a-434d-b1a0-fb94372013b2 nodeName:}" failed. No retries permitted until 2026-05-21 20:39:57.862206142 +0000 UTC m=+98.244386214 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d7d41f03-d42a-434d-b1a0-fb94372013b2-cert") pod "ingress-canary-j5jnw" (UID: "d7d41f03-d42a-434d-b1a0-fb94372013b2") : secret "canary-serving-cert" not found May 21 20:39:25.862493 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:39:25.862270 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19a963d1-f89b-4cee-8b37-3205095efa67-metrics-tls podName:19a963d1-f89b-4cee-8b37-3205095efa67 nodeName:}" failed. No retries permitted until 2026-05-21 20:39:57.862251908 +0000 UTC m=+98.244431959 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/19a963d1-f89b-4cee-8b37-3205095efa67-metrics-tls") pod "dns-default-x7nft" (UID: "19a963d1-f89b-4cee-8b37-3205095efa67") : secret "dns-default-metrics-tls" not found May 21 20:39:25.962979 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:25.962933 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23d4cc46-4752-4afd-a726-67d9eced1af9-metrics-certs\") pod \"network-metrics-daemon-7lhdn\" (UID: \"23d4cc46-4752-4afd-a726-67d9eced1af9\") " pod="openshift-multus/network-metrics-daemon-7lhdn" May 21 20:39:25.965273 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:25.965245 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 20:39:25.974022 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:39:25.973992 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 20:39:25.974198 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:39:25.974073 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23d4cc46-4752-4afd-a726-67d9eced1af9-metrics-certs podName:23d4cc46-4752-4afd-a726-67d9eced1af9 nodeName:}" failed. No retries permitted until 2026-05-21 20:40:29.974051501 +0000 UTC m=+130.356231553 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23d4cc46-4752-4afd-a726-67d9eced1af9-metrics-certs") pod "network-metrics-daemon-7lhdn" (UID: "23d4cc46-4752-4afd-a726-67d9eced1af9") : secret "metrics-daemon-secret" not found May 21 20:39:26.063711 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:26.063669 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-crm28\" (UniqueName: \"kubernetes.io/projected/0a50c0b1-eccc-4bdf-a7d7-eca75843e83b-kube-api-access-crm28\") pod \"network-check-target-lqwhq\" (UID: \"0a50c0b1-eccc-4bdf-a7d7-eca75843e83b\") " pod="openshift-network-diagnostics/network-check-target-lqwhq" May 21 20:39:26.065900 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:26.065881 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 20:39:26.076754 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:26.076730 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 20:39:26.087799 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:26.087773 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crm28\" (UniqueName: \"kubernetes.io/projected/0a50c0b1-eccc-4bdf-a7d7-eca75843e83b-kube-api-access-crm28\") pod \"network-check-target-lqwhq\" (UID: \"0a50c0b1-eccc-4bdf-a7d7-eca75843e83b\") " pod="openshift-network-diagnostics/network-check-target-lqwhq" May 21 20:39:26.184622 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:26.184541 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hrp5p\"" May 21 20:39:26.193065 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:26.193035 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqwhq" May 21 20:39:26.319661 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:26.319632 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lqwhq"] May 21 20:39:26.323008 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:39:26.322979 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a50c0b1_eccc_4bdf_a7d7_eca75843e83b.slice/crio-059ae2e8fdaafdcba02b915dad3b17ee932e37877e0ce20659e516b93d3826b1 WatchSource:0}: Error finding container 059ae2e8fdaafdcba02b915dad3b17ee932e37877e0ce20659e516b93d3826b1: Status 404 returned error can't find the container with id 059ae2e8fdaafdcba02b915dad3b17ee932e37877e0ce20659e516b93d3826b1 May 21 20:39:26.512745 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:26.512707 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lqwhq" event={"ID":"0a50c0b1-eccc-4bdf-a7d7-eca75843e83b","Type":"ContainerStarted","Data":"059ae2e8fdaafdcba02b915dad3b17ee932e37877e0ce20659e516b93d3826b1"} May 21 20:39:26.514543 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:26.514516 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bcc69bb-lm29p" event={"ID":"a8d101f0-3af9-4e71-bafc-2cbe35f289a4","Type":"ContainerStarted","Data":"20a9eb8302793012d3191ecc8a9cf7f2667326a0ba36637d874c4a1746336c40"} May 21 20:39:26.514683 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:26.514549 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bcc69bb-lm29p" event={"ID":"a8d101f0-3af9-4e71-bafc-2cbe35f289a4","Type":"ContainerStarted","Data":"cba0585ca4745665a5740fbdda5afe5a9896d9418eb066380d9022a53df0bb9e"} May 21 20:39:26.530796 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:26.530747 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bcc69bb-lm29p" podStartSLOduration=1.405079297 podStartE2EDuration="9.530730417s" podCreationTimestamp="2026-05-21 20:39:17 +0000 UTC" firstStartedPulling="2026-05-21 20:39:18.124741831 +0000 UTC m=+58.506921881" lastFinishedPulling="2026-05-21 20:39:26.250392937 +0000 UTC m=+66.632573001" observedRunningTime="2026-05-21 20:39:26.53008718 +0000 UTC m=+66.912267251" watchObservedRunningTime="2026-05-21 20:39:26.530730417 +0000 UTC m=+66.912910490" May 21 20:39:29.522314 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:29.522278 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lqwhq" event={"ID":"0a50c0b1-eccc-4bdf-a7d7-eca75843e83b","Type":"ContainerStarted","Data":"f06570b3fa77a580c92c4d6d955c42aea60b21eb21197dcb39e0cf2d0b86477e"} May 21 20:39:29.522762 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:29.522496 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lqwhq" May 21 20:39:29.536333 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:29.536287 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lqwhq" podStartSLOduration=67.012784781 podStartE2EDuration="1m9.536274185s" podCreationTimestamp="2026-05-21 20:38:20 +0000 UTC" firstStartedPulling="2026-05-21 20:39:26.325574459 +0000 UTC m=+66.707754522" lastFinishedPulling="2026-05-21 20:39:28.849063872 +0000 UTC m=+69.231243926" observedRunningTime="2026-05-21 20:39:29.535652685 +0000 UTC m=+69.917832757" watchObservedRunningTime="2026-05-21 20:39:29.536274185 +0000 UTC m=+69.918454257" May 21 20:39:57.897446 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:57.897316 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d7d41f03-d42a-434d-b1a0-fb94372013b2-cert\") pod \"ingress-canary-j5jnw\" (UID: \"d7d41f03-d42a-434d-b1a0-fb94372013b2\") " pod="openshift-ingress-canary/ingress-canary-j5jnw" May 21 20:39:57.897446 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:39:57.897398 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/19a963d1-f89b-4cee-8b37-3205095efa67-metrics-tls\") pod \"dns-default-x7nft\" (UID: \"19a963d1-f89b-4cee-8b37-3205095efa67\") " pod="openshift-dns/dns-default-x7nft" May 21 20:39:57.898000 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:39:57.897496 2570 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 20:39:57.898000 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:39:57.897502 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 20:39:57.898000 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:39:57.897576 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7d41f03-d42a-434d-b1a0-fb94372013b2-cert podName:d7d41f03-d42a-434d-b1a0-fb94372013b2 nodeName:}" failed. No retries permitted until 2026-05-21 20:41:01.897555254 +0000 UTC m=+162.279735304 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d7d41f03-d42a-434d-b1a0-fb94372013b2-cert") pod "ingress-canary-j5jnw" (UID: "d7d41f03-d42a-434d-b1a0-fb94372013b2") : secret "canary-serving-cert" not found May 21 20:39:57.898000 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:39:57.897593 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19a963d1-f89b-4cee-8b37-3205095efa67-metrics-tls podName:19a963d1-f89b-4cee-8b37-3205095efa67 nodeName:}" failed. No retries permitted until 2026-05-21 20:41:01.897585451 +0000 UTC m=+162.279765505 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/19a963d1-f89b-4cee-8b37-3205095efa67-metrics-tls") pod "dns-default-x7nft" (UID: "19a963d1-f89b-4cee-8b37-3205095efa67") : secret "dns-default-metrics-tls" not found May 21 20:40:00.528218 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:40:00.528189 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lqwhq" May 21 20:40:30.042074 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:40:30.042027 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23d4cc46-4752-4afd-a726-67d9eced1af9-metrics-certs\") pod \"network-metrics-daemon-7lhdn\" (UID: \"23d4cc46-4752-4afd-a726-67d9eced1af9\") " pod="openshift-multus/network-metrics-daemon-7lhdn" May 21 20:40:30.042718 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:40:30.042154 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 20:40:30.042718 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:40:30.042210 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23d4cc46-4752-4afd-a726-67d9eced1af9-metrics-certs podName:23d4cc46-4752-4afd-a726-67d9eced1af9 nodeName:}" failed. No retries permitted until 2026-05-21 20:42:32.042196556 +0000 UTC m=+252.424376606 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23d4cc46-4752-4afd-a726-67d9eced1af9-metrics-certs") pod "network-metrics-daemon-7lhdn" (UID: "23d4cc46-4752-4afd-a726-67d9eced1af9") : secret "metrics-daemon-secret" not found May 21 20:40:57.009918 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:40:57.009864 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-x7nft" podUID="19a963d1-f89b-4cee-8b37-3205095efa67" May 21 20:40:57.022062 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:40:57.022026 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-j5jnw" podUID="d7d41f03-d42a-434d-b1a0-fb94372013b2" May 21 20:40:57.723460 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:40:57.723428 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x7nft" May 21 20:40:58.278043 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:40:58.277993 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-7lhdn" podUID="23d4cc46-4752-4afd-a726-67d9eced1af9" May 21 20:41:01.964683 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:01.964635 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d7d41f03-d42a-434d-b1a0-fb94372013b2-cert\") pod \"ingress-canary-j5jnw\" (UID: \"d7d41f03-d42a-434d-b1a0-fb94372013b2\") " pod="openshift-ingress-canary/ingress-canary-j5jnw" May 21 20:41:01.965076 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:01.964701 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/19a963d1-f89b-4cee-8b37-3205095efa67-metrics-tls\") pod \"dns-default-x7nft\" (UID: \"19a963d1-f89b-4cee-8b37-3205095efa67\") " pod="openshift-dns/dns-default-x7nft" May 21 20:41:01.965076 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:41:01.964783 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 20:41:01.965076 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:41:01.964786 2570 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 20:41:01.965076 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:41:01.964846 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19a963d1-f89b-4cee-8b37-3205095efa67-metrics-tls podName:19a963d1-f89b-4cee-8b37-3205095efa67 nodeName:}" failed. No retries permitted until 2026-05-21 20:43:03.96483097 +0000 UTC m=+284.347011019 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/19a963d1-f89b-4cee-8b37-3205095efa67-metrics-tls") pod "dns-default-x7nft" (UID: "19a963d1-f89b-4cee-8b37-3205095efa67") : secret "dns-default-metrics-tls" not found May 21 20:41:01.965076 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:41:01.964860 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7d41f03-d42a-434d-b1a0-fb94372013b2-cert podName:d7d41f03-d42a-434d-b1a0-fb94372013b2 nodeName:}" failed. No retries permitted until 2026-05-21 20:43:03.964853792 +0000 UTC m=+284.347033843 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d7d41f03-d42a-434d-b1a0-fb94372013b2-cert") pod "ingress-canary-j5jnw" (UID: "d7d41f03-d42a-434d-b1a0-fb94372013b2") : secret "canary-serving-cert" not found May 21 20:41:03.152686 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:03.152657 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jfdql_e4184fd4-d71d-4bda-bda1-e40fa42e76d7/dns-node-resolver/0.log" May 21 20:41:04.353067 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:04.353038 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vfm2z_bb9b42e0-e4e2-4738-b497-dbed3b79ec9f/node-ca/0.log" May 21 20:41:11.262887 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:11.262783 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j5jnw" May 21 20:41:12.263289 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:12.263247 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lhdn" May 21 20:41:23.803141 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:23.801248 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cpl7g"] May 21 20:41:23.804608 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:23.804585 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cpl7g" May 21 20:41:23.806514 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:23.806490 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 21 20:41:23.806632 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:23.806592 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-f9jgq\"" May 21 20:41:23.807133 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:23.807116 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 21 20:41:23.807133 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:23.807124 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 21 20:41:23.807264 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:23.807231 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 21 20:41:23.813323 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:23.813299 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cpl7g"] May 21 20:41:23.930121 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:23.930080 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/228052a6-9af1-4317-b2f0-377729a9ed45-crio-socket\") pod \"insights-runtime-extractor-cpl7g\" (UID: \"228052a6-9af1-4317-b2f0-377729a9ed45\") " pod="openshift-insights/insights-runtime-extractor-cpl7g" May 21 20:41:23.930121 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:23.930120 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/228052a6-9af1-4317-b2f0-377729a9ed45-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cpl7g\" (UID: \"228052a6-9af1-4317-b2f0-377729a9ed45\") " pod="openshift-insights/insights-runtime-extractor-cpl7g" May 21 20:41:23.930515 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:23.930152 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/228052a6-9af1-4317-b2f0-377729a9ed45-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cpl7g\" (UID: \"228052a6-9af1-4317-b2f0-377729a9ed45\") " pod="openshift-insights/insights-runtime-extractor-cpl7g" May 21 20:41:23.930515 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:23.930231 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/228052a6-9af1-4317-b2f0-377729a9ed45-data-volume\") pod \"insights-runtime-extractor-cpl7g\" (UID: \"228052a6-9af1-4317-b2f0-377729a9ed45\") " pod="openshift-insights/insights-runtime-extractor-cpl7g" May 21 20:41:23.930515 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:23.930263 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbfkq\" (UniqueName: \"kubernetes.io/projected/228052a6-9af1-4317-b2f0-377729a9ed45-kube-api-access-wbfkq\") pod \"insights-runtime-extractor-cpl7g\" (UID: \"228052a6-9af1-4317-b2f0-377729a9ed45\") " pod="openshift-insights/insights-runtime-extractor-cpl7g" May 21 20:41:23.931119 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:23.931091 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7547f88c84-bd29v"] May 21 20:41:23.932929 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:23.932910 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7547f88c84-bd29v" May 21 20:41:23.934919 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:23.934897 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-f29vq\"" May 21 20:41:23.935340 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:23.935322 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 21 20:41:23.935421 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:23.935405 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 21 20:41:23.935642 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:23.935624 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 21 20:41:23.940461 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:23.940443 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 21 20:41:23.947135 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:23.947111 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7547f88c84-bd29v"] May 21 20:41:24.030906 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:24.030868 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/16e49620-1ddc-4037-800d-1af5a0184d63-installation-pull-secrets\") pod \"image-registry-7547f88c84-bd29v\" (UID: \"16e49620-1ddc-4037-800d-1af5a0184d63\") " pod="openshift-image-registry/image-registry-7547f88c84-bd29v" May 21 20:41:24.031099 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:24.030914 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/228052a6-9af1-4317-b2f0-377729a9ed45-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cpl7g\" (UID: \"228052a6-9af1-4317-b2f0-377729a9ed45\") " pod="openshift-insights/insights-runtime-extractor-cpl7g" May 21 20:41:24.031099 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:24.030939 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/228052a6-9af1-4317-b2f0-377729a9ed45-crio-socket\") pod \"insights-runtime-extractor-cpl7g\" (UID: \"228052a6-9af1-4317-b2f0-377729a9ed45\") " pod="openshift-insights/insights-runtime-extractor-cpl7g" May 21 20:41:24.031099 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:24.031026 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/16e49620-1ddc-4037-800d-1af5a0184d63-registry-certificates\") pod \"image-registry-7547f88c84-bd29v\" (UID: \"16e49620-1ddc-4037-800d-1af5a0184d63\") " pod="openshift-image-registry/image-registry-7547f88c84-bd29v" May 21 20:41:24.031099 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:24.031026 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/228052a6-9af1-4317-b2f0-377729a9ed45-crio-socket\") pod \"insights-runtime-extractor-cpl7g\" (UID: \"228052a6-9af1-4317-b2f0-377729a9ed45\") " pod="openshift-insights/insights-runtime-extractor-cpl7g" May 21 20:41:24.031311 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:24.031085 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/228052a6-9af1-4317-b2f0-377729a9ed45-data-volume\") pod \"insights-runtime-extractor-cpl7g\" (UID: \"228052a6-9af1-4317-b2f0-377729a9ed45\") " pod="openshift-insights/insights-runtime-extractor-cpl7g" May 21 20:41:24.031311 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:24.031156 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wbfkq\" (UniqueName: \"kubernetes.io/projected/228052a6-9af1-4317-b2f0-377729a9ed45-kube-api-access-wbfkq\") pod \"insights-runtime-extractor-cpl7g\" (UID: \"228052a6-9af1-4317-b2f0-377729a9ed45\") " pod="openshift-insights/insights-runtime-extractor-cpl7g" May 21 20:41:24.031311 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:24.031189 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqtsq\" (UniqueName: \"kubernetes.io/projected/16e49620-1ddc-4037-800d-1af5a0184d63-kube-api-access-lqtsq\") pod \"image-registry-7547f88c84-bd29v\" (UID: \"16e49620-1ddc-4037-800d-1af5a0184d63\") " pod="openshift-image-registry/image-registry-7547f88c84-bd29v" May 21 20:41:24.031311 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:24.031226 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/16e49620-1ddc-4037-800d-1af5a0184d63-ca-trust-extracted\") pod \"image-registry-7547f88c84-bd29v\" (UID: \"16e49620-1ddc-4037-800d-1af5a0184d63\") " pod="openshift-image-registry/image-registry-7547f88c84-bd29v" May 21 20:41:24.031311 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:24.031282 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/228052a6-9af1-4317-b2f0-377729a9ed45-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cpl7g\" (UID: \"228052a6-9af1-4317-b2f0-377729a9ed45\") " pod="openshift-insights/insights-runtime-extractor-cpl7g" May 21 20:41:24.031570 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:24.031309 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/16e49620-1ddc-4037-800d-1af5a0184d63-trusted-ca\") pod \"image-registry-7547f88c84-bd29v\" (UID: \"16e49620-1ddc-4037-800d-1af5a0184d63\") " pod="openshift-image-registry/image-registry-7547f88c84-bd29v" May 21 20:41:24.031570 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:24.031343 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/16e49620-1ddc-4037-800d-1af5a0184d63-image-registry-private-configuration\") pod \"image-registry-7547f88c84-bd29v\" (UID: \"16e49620-1ddc-4037-800d-1af5a0184d63\") " pod="openshift-image-registry/image-registry-7547f88c84-bd29v" May 21 20:41:24.031570 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:24.031389 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/16e49620-1ddc-4037-800d-1af5a0184d63-bound-sa-token\") pod \"image-registry-7547f88c84-bd29v\" (UID: \"16e49620-1ddc-4037-800d-1af5a0184d63\") " pod="openshift-image-registry/image-registry-7547f88c84-bd29v" May 21 20:41:24.031570 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:24.031388 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/228052a6-9af1-4317-b2f0-377729a9ed45-data-volume\") pod \"insights-runtime-extractor-cpl7g\" (UID: \"228052a6-9af1-4317-b2f0-377729a9ed45\") " pod="openshift-insights/insights-runtime-extractor-cpl7g" May 21 20:41:24.031570 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:24.031417 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/16e49620-1ddc-4037-800d-1af5a0184d63-registry-tls\") pod \"image-registry-7547f88c84-bd29v\" (UID: \"16e49620-1ddc-4037-800d-1af5a0184d63\") " pod="openshift-image-registry/image-registry-7547f88c84-bd29v" May 21 20:41:24.031781 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:24.031764 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/228052a6-9af1-4317-b2f0-377729a9ed45-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cpl7g\" (UID: \"228052a6-9af1-4317-b2f0-377729a9ed45\") " pod="openshift-insights/insights-runtime-extractor-cpl7g" May 21 20:41:24.033534 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:24.033519 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/228052a6-9af1-4317-b2f0-377729a9ed45-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cpl7g\" (UID: \"228052a6-9af1-4317-b2f0-377729a9ed45\") " pod="openshift-insights/insights-runtime-extractor-cpl7g" May 21 20:41:24.038803 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:24.038779 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbfkq\" (UniqueName: \"kubernetes.io/projected/228052a6-9af1-4317-b2f0-377729a9ed45-kube-api-access-wbfkq\") pod \"insights-runtime-extractor-cpl7g\" (UID: \"228052a6-9af1-4317-b2f0-377729a9ed45\") " pod="openshift-insights/insights-runtime-extractor-cpl7g" May 21 20:41:24.114536 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:24.114438 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cpl7g" May 21 20:41:24.132781 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:24.132752 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lqtsq\" (UniqueName: \"kubernetes.io/projected/16e49620-1ddc-4037-800d-1af5a0184d63-kube-api-access-lqtsq\") pod \"image-registry-7547f88c84-bd29v\" (UID: \"16e49620-1ddc-4037-800d-1af5a0184d63\") " pod="openshift-image-registry/image-registry-7547f88c84-bd29v" May 21 20:41:24.132928 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:24.132795 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/16e49620-1ddc-4037-800d-1af5a0184d63-ca-trust-extracted\") pod \"image-registry-7547f88c84-bd29v\" (UID: \"16e49620-1ddc-4037-800d-1af5a0184d63\") " pod="openshift-image-registry/image-registry-7547f88c84-bd29v" May 21 20:41:24.132980 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:24.132953 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/16e49620-1ddc-4037-800d-1af5a0184d63-trusted-ca\") pod \"image-registry-7547f88c84-bd29v\" (UID: \"16e49620-1ddc-4037-800d-1af5a0184d63\") " pod="openshift-image-registry/image-registry-7547f88c84-bd29v" May 21 20:41:24.133028 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:24.132985 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/16e49620-1ddc-4037-800d-1af5a0184d63-image-registry-private-configuration\") pod \"image-registry-7547f88c84-bd29v\" (UID: \"16e49620-1ddc-4037-800d-1af5a0184d63\") " pod="openshift-image-registry/image-registry-7547f88c84-bd29v" May 21 20:41:24.133028 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:24.133023 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/16e49620-1ddc-4037-800d-1af5a0184d63-bound-sa-token\") pod \"image-registry-7547f88c84-bd29v\" (UID: \"16e49620-1ddc-4037-800d-1af5a0184d63\") " pod="openshift-image-registry/image-registry-7547f88c84-bd29v" May 21 20:41:24.133126 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:24.133051 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/16e49620-1ddc-4037-800d-1af5a0184d63-registry-tls\") pod \"image-registry-7547f88c84-bd29v\" (UID: \"16e49620-1ddc-4037-800d-1af5a0184d63\") " pod="openshift-image-registry/image-registry-7547f88c84-bd29v" May 21 20:41:24.133126 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:24.133105 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/16e49620-1ddc-4037-800d-1af5a0184d63-installation-pull-secrets\") pod \"image-registry-7547f88c84-bd29v\" (UID: \"16e49620-1ddc-4037-800d-1af5a0184d63\") " pod="openshift-image-registry/image-registry-7547f88c84-bd29v" May 21 20:41:24.133235 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:24.133159 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/16e49620-1ddc-4037-800d-1af5a0184d63-registry-certificates\") pod \"image-registry-7547f88c84-bd29v\" (UID: \"16e49620-1ddc-4037-800d-1af5a0184d63\") " pod="openshift-image-registry/image-registry-7547f88c84-bd29v" May 21 20:41:24.133235 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:24.133167 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/16e49620-1ddc-4037-800d-1af5a0184d63-ca-trust-extracted\") pod \"image-registry-7547f88c84-bd29v\" (UID: \"16e49620-1ddc-4037-800d-1af5a0184d63\") " pod="openshift-image-registry/image-registry-7547f88c84-bd29v" May 21 20:41:24.134255 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:24.134218 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/16e49620-1ddc-4037-800d-1af5a0184d63-registry-certificates\") pod \"image-registry-7547f88c84-bd29v\" (UID: \"16e49620-1ddc-4037-800d-1af5a0184d63\") " pod="openshift-image-registry/image-registry-7547f88c84-bd29v" May 21 20:41:24.134405 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:24.134357 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/16e49620-1ddc-4037-800d-1af5a0184d63-trusted-ca\") pod \"image-registry-7547f88c84-bd29v\" (UID: \"16e49620-1ddc-4037-800d-1af5a0184d63\") " pod="openshift-image-registry/image-registry-7547f88c84-bd29v" May 21 20:41:24.135727 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:24.135706 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/16e49620-1ddc-4037-800d-1af5a0184d63-image-registry-private-configuration\") pod \"image-registry-7547f88c84-bd29v\" (UID: \"16e49620-1ddc-4037-800d-1af5a0184d63\") " pod="openshift-image-registry/image-registry-7547f88c84-bd29v" May 21 20:41:24.135832 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:24.135732 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/16e49620-1ddc-4037-800d-1af5a0184d63-installation-pull-secrets\") pod \"image-registry-7547f88c84-bd29v\" (UID: \"16e49620-1ddc-4037-800d-1af5a0184d63\") " pod="openshift-image-registry/image-registry-7547f88c84-bd29v" May 21 20:41:24.135990 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:24.135969 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/16e49620-1ddc-4037-800d-1af5a0184d63-registry-tls\") pod \"image-registry-7547f88c84-bd29v\" (UID: \"16e49620-1ddc-4037-800d-1af5a0184d63\") " pod="openshift-image-registry/image-registry-7547f88c84-bd29v" May 21 20:41:24.142062 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:24.142033 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqtsq\" (UniqueName: \"kubernetes.io/projected/16e49620-1ddc-4037-800d-1af5a0184d63-kube-api-access-lqtsq\") pod \"image-registry-7547f88c84-bd29v\" (UID: \"16e49620-1ddc-4037-800d-1af5a0184d63\") " pod="openshift-image-registry/image-registry-7547f88c84-bd29v" May 21 20:41:24.142220 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:24.142204 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/16e49620-1ddc-4037-800d-1af5a0184d63-bound-sa-token\") pod \"image-registry-7547f88c84-bd29v\" (UID: \"16e49620-1ddc-4037-800d-1af5a0184d63\") " pod="openshift-image-registry/image-registry-7547f88c84-bd29v" May 21 20:41:24.239554 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:24.239513 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cpl7g"] May 21 20:41:24.241552 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:24.241528 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7547f88c84-bd29v" May 21 20:41:24.244564 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:41:24.244532 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod228052a6_9af1_4317_b2f0_377729a9ed45.slice/crio-0fa74a7d00856108ba7aff0ba6c799667dd2d330254b484498e3b128391d80fb WatchSource:0}: Error finding container 0fa74a7d00856108ba7aff0ba6c799667dd2d330254b484498e3b128391d80fb: Status 404 returned error can't find the container with id 0fa74a7d00856108ba7aff0ba6c799667dd2d330254b484498e3b128391d80fb May 21 20:41:24.376869 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:24.376791 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7547f88c84-bd29v"] May 21 20:41:24.379876 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:41:24.379846 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16e49620_1ddc_4037_800d_1af5a0184d63.slice/crio-e0979699bfef1f86abbcfe9e32d540079ab4e0d850651c1c90667ca09ec70bb0 WatchSource:0}: Error finding container e0979699bfef1f86abbcfe9e32d540079ab4e0d850651c1c90667ca09ec70bb0: Status 404 returned error can't find the container with id e0979699bfef1f86abbcfe9e32d540079ab4e0d850651c1c90667ca09ec70bb0 May 21 20:41:24.507305 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:24.507251 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-677b54cc6d-jld6s" podUID="97806640-fdd8-4f95-b570-505c717afe41" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.9:8000/readyz\": dial tcp 10.133.0.9:8000: connect: connection refused" May 21 20:41:24.787221 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:24.787188 2570 generic.go:358] "Generic (PLEG): container finished" podID="97806640-fdd8-4f95-b570-505c717afe41" containerID="0a1027d5b29d99032db0e7709f96bb57bd56c322d4dc7b47c7e7b6c6034d8acb" exitCode=1 May 21 20:41:24.787418 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:24.787260 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-677b54cc6d-jld6s" event={"ID":"97806640-fdd8-4f95-b570-505c717afe41","Type":"ContainerDied","Data":"0a1027d5b29d99032db0e7709f96bb57bd56c322d4dc7b47c7e7b6c6034d8acb"} May 21 20:41:24.787713 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:24.787688 2570 scope.go:117] "RemoveContainer" containerID="0a1027d5b29d99032db0e7709f96bb57bd56c322d4dc7b47c7e7b6c6034d8acb" May 21 20:41:24.788673 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:24.788647 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7547f88c84-bd29v" event={"ID":"16e49620-1ddc-4037-800d-1af5a0184d63","Type":"ContainerStarted","Data":"fa4a14ff9efcce02e9900e8eb229cb487ca773784e3c48eb6075caffc69007f1"} May 21 20:41:24.788795 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:24.788683 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7547f88c84-bd29v" event={"ID":"16e49620-1ddc-4037-800d-1af5a0184d63","Type":"ContainerStarted","Data":"e0979699bfef1f86abbcfe9e32d540079ab4e0d850651c1c90667ca09ec70bb0"} May 21 20:41:24.788795 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:24.788776 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7547f88c84-bd29v" May 21 20:41:24.790603 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:24.790140 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cpl7g" event={"ID":"228052a6-9af1-4317-b2f0-377729a9ed45","Type":"ContainerStarted","Data":"a2143feef0aae8fd4e62d90046a9304b75c6e55ec778991c00889cc705818ecc"} May 21 20:41:24.790603 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:24.790180 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cpl7g" event={"ID":"228052a6-9af1-4317-b2f0-377729a9ed45","Type":"ContainerStarted","Data":"0fa74a7d00856108ba7aff0ba6c799667dd2d330254b484498e3b128391d80fb"} May 21 20:41:24.824227 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:24.824178 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7547f88c84-bd29v" podStartSLOduration=1.8241619629999999 podStartE2EDuration="1.824161963s" podCreationTimestamp="2026-05-21 20:41:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 20:41:24.823574125 +0000 UTC m=+185.205754198" watchObservedRunningTime="2026-05-21 20:41:24.824161963 +0000 UTC m=+185.206342034" May 21 20:41:25.794390 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:25.794348 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-677b54cc6d-jld6s" event={"ID":"97806640-fdd8-4f95-b570-505c717afe41","Type":"ContainerStarted","Data":"46e00efb55789d121896096fbec26f4cf37e711354eb8439a681104d11d696c3"} May 21 20:41:25.794673 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:25.794655 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-677b54cc6d-jld6s" May 21 20:41:25.795331 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:25.795300 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-677b54cc6d-jld6s" May 21 20:41:25.796662 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:25.796638 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cpl7g" event={"ID":"228052a6-9af1-4317-b2f0-377729a9ed45","Type":"ContainerStarted","Data":"13f915f137c2789d0b0ba6131bce3a0e3dfd09c38fbf414e237c79444e29f8bc"} May 21 20:41:26.800416 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:26.800378 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cpl7g" event={"ID":"228052a6-9af1-4317-b2f0-377729a9ed45","Type":"ContainerStarted","Data":"3e909aa27880e8c2b71b617afe0cb08dd828e7f3d48d414ac4ad18f314518d8c"} May 21 20:41:26.817367 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:26.817315 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cpl7g" podStartSLOduration=1.762498507 podStartE2EDuration="3.8173009s" podCreationTimestamp="2026-05-21 20:41:23 +0000 UTC" firstStartedPulling="2026-05-21 20:41:24.310352263 +0000 UTC m=+184.692532319" lastFinishedPulling="2026-05-21 20:41:26.365154662 +0000 UTC m=+186.747334712" observedRunningTime="2026-05-21 20:41:26.815968591 +0000 UTC m=+187.198148663" watchObservedRunningTime="2026-05-21 20:41:26.8173009 +0000 UTC m=+187.199480973" May 21 20:41:39.373687 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.373646 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-qmgjj"] May 21 20:41:39.376741 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.376720 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qmgjj" May 21 20:41:39.379362 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.379334 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 21 20:41:39.379527 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.379384 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-wmjts\"" May 21 20:41:39.379527 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.379440 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" May 21 20:41:39.379527 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.379448 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 21 20:41:39.379783 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.379745 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 21 20:41:39.379923 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.379842 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" May 21 20:41:39.379923 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.379843 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" May 21 20:41:39.380770 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.380749 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-b99ll"] May 21 20:41:39.383699 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.383684 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-b99ll" May 21 20:41:39.386277 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.385840 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-p456j\"" May 21 20:41:39.386277 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.386158 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 21 20:41:39.386277 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.386192 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 21 20:41:39.386277 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.386158 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 21 20:41:39.386592 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.386500 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-qmgjj"] May 21 20:41:39.452740 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.452710 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3b5b2738-69cc-420b-a3e6-a2f42e585417-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-qmgjj\" (UID: \"3b5b2738-69cc-420b-a3e6-a2f42e585417\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qmgjj" May 21 20:41:39.452907 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.452769 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b5b2738-69cc-420b-a3e6-a2f42e585417-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-qmgjj\" (UID: \"3b5b2738-69cc-420b-a3e6-a2f42e585417\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qmgjj" May 21 20:41:39.452907 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.452842 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjh7m\" (UniqueName: \"kubernetes.io/projected/3b5b2738-69cc-420b-a3e6-a2f42e585417-kube-api-access-vjh7m\") pod \"kube-state-metrics-54fd6bc5c4-qmgjj\" (UID: \"3b5b2738-69cc-420b-a3e6-a2f42e585417\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qmgjj" May 21 20:41:39.452907 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.452879 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b5b2738-69cc-420b-a3e6-a2f42e585417-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-qmgjj\" (UID: \"3b5b2738-69cc-420b-a3e6-a2f42e585417\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qmgjj" May 21 20:41:39.453024 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.452956 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b5b2738-69cc-420b-a3e6-a2f42e585417-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-qmgjj\" (UID: \"3b5b2738-69cc-420b-a3e6-a2f42e585417\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qmgjj" May 21 20:41:39.453024 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.452998 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3b5b2738-69cc-420b-a3e6-a2f42e585417-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-qmgjj\" (UID: \"3b5b2738-69cc-420b-a3e6-a2f42e585417\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qmgjj" May 21 20:41:39.554260 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.554211 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/84e51d81-6646-4b28-b700-e510a7922240-node-exporter-textfile\") pod \"node-exporter-b99ll\" (UID: \"84e51d81-6646-4b28-b700-e510a7922240\") " pod="openshift-monitoring/node-exporter-b99ll" May 21 20:41:39.554260 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.554257 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84e51d81-6646-4b28-b700-e510a7922240-metrics-client-ca\") pod \"node-exporter-b99ll\" (UID: \"84e51d81-6646-4b28-b700-e510a7922240\") " pod="openshift-monitoring/node-exporter-b99ll" May 21 20:41:39.554504 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.554282 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b5b2738-69cc-420b-a3e6-a2f42e585417-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-qmgjj\" (UID: \"3b5b2738-69cc-420b-a3e6-a2f42e585417\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qmgjj" May 21 20:41:39.554504 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.554336 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/84e51d81-6646-4b28-b700-e510a7922240-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b99ll\" (UID: \"84e51d81-6646-4b28-b700-e510a7922240\") " pod="openshift-monitoring/node-exporter-b99ll" May 21 20:41:39.554504 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.554378 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84e51d81-6646-4b28-b700-e510a7922240-sys\") pod \"node-exporter-b99ll\" (UID: \"84e51d81-6646-4b28-b700-e510a7922240\") " pod="openshift-monitoring/node-exporter-b99ll" May 21 20:41:39.554504 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.554409 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/84e51d81-6646-4b28-b700-e510a7922240-node-exporter-accelerators-collector-config\") pod \"node-exporter-b99ll\" (UID: \"84e51d81-6646-4b28-b700-e510a7922240\") " pod="openshift-monitoring/node-exporter-b99ll" May 21 20:41:39.554504 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.554432 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th994\" (UniqueName: \"kubernetes.io/projected/84e51d81-6646-4b28-b700-e510a7922240-kube-api-access-th994\") pod \"node-exporter-b99ll\" (UID: \"84e51d81-6646-4b28-b700-e510a7922240\") " pod="openshift-monitoring/node-exporter-b99ll" May 21 20:41:39.554504 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.554494 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b5b2738-69cc-420b-a3e6-a2f42e585417-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-qmgjj\" (UID: \"3b5b2738-69cc-420b-a3e6-a2f42e585417\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qmgjj" May 21 20:41:39.554710 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.554516 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/84e51d81-6646-4b28-b700-e510a7922240-root\") pod \"node-exporter-b99ll\" (UID: \"84e51d81-6646-4b28-b700-e510a7922240\") " pod="openshift-monitoring/node-exporter-b99ll" May 21 20:41:39.554710 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.554537 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3b5b2738-69cc-420b-a3e6-a2f42e585417-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-qmgjj\" (UID: \"3b5b2738-69cc-420b-a3e6-a2f42e585417\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qmgjj" May 21 20:41:39.554710 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.554570 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3b5b2738-69cc-420b-a3e6-a2f42e585417-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-qmgjj\" (UID: \"3b5b2738-69cc-420b-a3e6-a2f42e585417\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qmgjj" May 21 20:41:39.554710 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.554667 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b5b2738-69cc-420b-a3e6-a2f42e585417-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-qmgjj\" (UID: \"3b5b2738-69cc-420b-a3e6-a2f42e585417\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qmgjj" May 21 20:41:39.554838 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.554707 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/84e51d81-6646-4b28-b700-e510a7922240-node-exporter-wtmp\") pod \"node-exporter-b99ll\" (UID: \"84e51d81-6646-4b28-b700-e510a7922240\") " pod="openshift-monitoring/node-exporter-b99ll" May 21 20:41:39.554838 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.554741 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/84e51d81-6646-4b28-b700-e510a7922240-node-exporter-tls\") pod \"node-exporter-b99ll\" (UID: \"84e51d81-6646-4b28-b700-e510a7922240\") " pod="openshift-monitoring/node-exporter-b99ll" May 21 20:41:39.554838 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.554786 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vjh7m\" (UniqueName: \"kubernetes.io/projected/3b5b2738-69cc-420b-a3e6-a2f42e585417-kube-api-access-vjh7m\") pod \"kube-state-metrics-54fd6bc5c4-qmgjj\" (UID: \"3b5b2738-69cc-420b-a3e6-a2f42e585417\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qmgjj" May 21 20:41:39.554838 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:41:39.554816 2570 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found May 21 20:41:39.554990 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:41:39.554881 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b5b2738-69cc-420b-a3e6-a2f42e585417-kube-state-metrics-tls podName:3b5b2738-69cc-420b-a3e6-a2f42e585417 nodeName:}" failed. No retries permitted until 2026-05-21 20:41:40.054859756 +0000 UTC m=+200.437039807 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/3b5b2738-69cc-420b-a3e6-a2f42e585417-kube-state-metrics-tls") pod "kube-state-metrics-54fd6bc5c4-qmgjj" (UID: "3b5b2738-69cc-420b-a3e6-a2f42e585417") : secret "kube-state-metrics-tls" not found May 21 20:41:39.554990 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.554906 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3b5b2738-69cc-420b-a3e6-a2f42e585417-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-qmgjj\" (UID: \"3b5b2738-69cc-420b-a3e6-a2f42e585417\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qmgjj" May 21 20:41:39.554990 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.554939 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b5b2738-69cc-420b-a3e6-a2f42e585417-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-qmgjj\" (UID: \"3b5b2738-69cc-420b-a3e6-a2f42e585417\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qmgjj" May 21 20:41:39.555177 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.555156 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3b5b2738-69cc-420b-a3e6-a2f42e585417-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-qmgjj\" (UID: \"3b5b2738-69cc-420b-a3e6-a2f42e585417\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qmgjj" May 21 20:41:39.557076 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.557058 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b5b2738-69cc-420b-a3e6-a2f42e585417-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-qmgjj\" (UID: \"3b5b2738-69cc-420b-a3e6-a2f42e585417\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qmgjj" May 21 20:41:39.563893 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.563874 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjh7m\" (UniqueName: \"kubernetes.io/projected/3b5b2738-69cc-420b-a3e6-a2f42e585417-kube-api-access-vjh7m\") pod \"kube-state-metrics-54fd6bc5c4-qmgjj\" (UID: \"3b5b2738-69cc-420b-a3e6-a2f42e585417\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qmgjj" May 21 20:41:39.655776 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.655682 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84e51d81-6646-4b28-b700-e510a7922240-sys\") pod \"node-exporter-b99ll\" (UID: \"84e51d81-6646-4b28-b700-e510a7922240\") " pod="openshift-monitoring/node-exporter-b99ll" May 21 20:41:39.655776 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.655723 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/84e51d81-6646-4b28-b700-e510a7922240-node-exporter-accelerators-collector-config\") pod \"node-exporter-b99ll\" (UID: \"84e51d81-6646-4b28-b700-e510a7922240\") " pod="openshift-monitoring/node-exporter-b99ll" May 21 20:41:39.655776 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.655743 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-th994\" (UniqueName: \"kubernetes.io/projected/84e51d81-6646-4b28-b700-e510a7922240-kube-api-access-th994\") pod \"node-exporter-b99ll\" (UID: \"84e51d81-6646-4b28-b700-e510a7922240\") " pod="openshift-monitoring/node-exporter-b99ll" May 21 20:41:39.656042 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.655789 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84e51d81-6646-4b28-b700-e510a7922240-sys\") pod \"node-exporter-b99ll\" (UID: \"84e51d81-6646-4b28-b700-e510a7922240\") " pod="openshift-monitoring/node-exporter-b99ll" May 21 20:41:39.656042 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.655860 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/84e51d81-6646-4b28-b700-e510a7922240-root\") pod \"node-exporter-b99ll\" (UID: \"84e51d81-6646-4b28-b700-e510a7922240\") " pod="openshift-monitoring/node-exporter-b99ll" May 21 20:41:39.656042 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.655948 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/84e51d81-6646-4b28-b700-e510a7922240-node-exporter-wtmp\") pod \"node-exporter-b99ll\" (UID: \"84e51d81-6646-4b28-b700-e510a7922240\") " pod="openshift-monitoring/node-exporter-b99ll" May 21 20:41:39.656042 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.655971 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/84e51d81-6646-4b28-b700-e510a7922240-node-exporter-tls\") pod \"node-exporter-b99ll\" (UID: \"84e51d81-6646-4b28-b700-e510a7922240\") " pod="openshift-monitoring/node-exporter-b99ll" May 21 20:41:39.656042 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.655982 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/84e51d81-6646-4b28-b700-e510a7922240-root\") pod \"node-exporter-b99ll\" (UID: \"84e51d81-6646-4b28-b700-e510a7922240\") " pod="openshift-monitoring/node-exporter-b99ll" May 21 20:41:39.656042 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.656020 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/84e51d81-6646-4b28-b700-e510a7922240-node-exporter-textfile\") pod \"node-exporter-b99ll\" (UID: \"84e51d81-6646-4b28-b700-e510a7922240\") " pod="openshift-monitoring/node-exporter-b99ll" May 21 20:41:39.656325 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.656048 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84e51d81-6646-4b28-b700-e510a7922240-metrics-client-ca\") pod \"node-exporter-b99ll\" (UID: \"84e51d81-6646-4b28-b700-e510a7922240\") " pod="openshift-monitoring/node-exporter-b99ll" May 21 20:41:39.656325 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.656084 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/84e51d81-6646-4b28-b700-e510a7922240-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b99ll\" (UID: \"84e51d81-6646-4b28-b700-e510a7922240\") " pod="openshift-monitoring/node-exporter-b99ll" May 21 20:41:39.656325 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.656115 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/84e51d81-6646-4b28-b700-e510a7922240-node-exporter-wtmp\") pod \"node-exporter-b99ll\" (UID: \"84e51d81-6646-4b28-b700-e510a7922240\") " pod="openshift-monitoring/node-exporter-b99ll" May 21 20:41:39.656500 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.656368 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/84e51d81-6646-4b28-b700-e510a7922240-node-exporter-textfile\") pod \"node-exporter-b99ll\" (UID: \"84e51d81-6646-4b28-b700-e510a7922240\") " pod="openshift-monitoring/node-exporter-b99ll" May 21 20:41:39.656500 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.656417 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/84e51d81-6646-4b28-b700-e510a7922240-node-exporter-accelerators-collector-config\") pod \"node-exporter-b99ll\" (UID: \"84e51d81-6646-4b28-b700-e510a7922240\") " pod="openshift-monitoring/node-exporter-b99ll" May 21 20:41:39.656640 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.656623 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84e51d81-6646-4b28-b700-e510a7922240-metrics-client-ca\") pod \"node-exporter-b99ll\" (UID: \"84e51d81-6646-4b28-b700-e510a7922240\") " pod="openshift-monitoring/node-exporter-b99ll" May 21 20:41:39.658542 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.658520 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/84e51d81-6646-4b28-b700-e510a7922240-node-exporter-tls\") pod \"node-exporter-b99ll\" (UID: \"84e51d81-6646-4b28-b700-e510a7922240\") " pod="openshift-monitoring/node-exporter-b99ll" May 21 20:41:39.658701 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.658563 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/84e51d81-6646-4b28-b700-e510a7922240-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b99ll\" (UID: \"84e51d81-6646-4b28-b700-e510a7922240\") " pod="openshift-monitoring/node-exporter-b99ll" May 21 20:41:39.664808 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.664778 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-th994\" (UniqueName: \"kubernetes.io/projected/84e51d81-6646-4b28-b700-e510a7922240-kube-api-access-th994\") pod \"node-exporter-b99ll\" (UID: \"84e51d81-6646-4b28-b700-e510a7922240\") " pod="openshift-monitoring/node-exporter-b99ll" May 21 20:41:39.693492 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.693436 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-b99ll" May 21 20:41:39.702719 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:41:39.702687 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84e51d81_6646_4b28_b700_e510a7922240.slice/crio-9704519102e10152d232316aaf77182ed3b64cd0ea4a3271327dc6b26b9b7a01 WatchSource:0}: Error finding container 9704519102e10152d232316aaf77182ed3b64cd0ea4a3271327dc6b26b9b7a01: Status 404 returned error can't find the container with id 9704519102e10152d232316aaf77182ed3b64cd0ea4a3271327dc6b26b9b7a01 May 21 20:41:39.834100 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:39.834057 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b99ll" event={"ID":"84e51d81-6646-4b28-b700-e510a7922240","Type":"ContainerStarted","Data":"9704519102e10152d232316aaf77182ed3b64cd0ea4a3271327dc6b26b9b7a01"} May 21 20:41:40.059862 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:40.059813 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b5b2738-69cc-420b-a3e6-a2f42e585417-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-qmgjj\" (UID: \"3b5b2738-69cc-420b-a3e6-a2f42e585417\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qmgjj" May 21 20:41:40.062397 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:40.062369 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b5b2738-69cc-420b-a3e6-a2f42e585417-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-qmgjj\" (UID: \"3b5b2738-69cc-420b-a3e6-a2f42e585417\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qmgjj" May 21 20:41:40.285885 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:40.285851 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qmgjj" May 21 20:41:40.436388 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:40.436322 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-qmgjj"] May 21 20:41:40.523177 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:41:40.523138 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b5b2738_69cc_420b_a3e6_a2f42e585417.slice/crio-57604f31574646b80afc7299e41b02f9718f56a8f9e777911fb218b8643b5922 WatchSource:0}: Error finding container 57604f31574646b80afc7299e41b02f9718f56a8f9e777911fb218b8643b5922: Status 404 returned error can't find the container with id 57604f31574646b80afc7299e41b02f9718f56a8f9e777911fb218b8643b5922 May 21 20:41:40.837968 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:40.837922 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qmgjj" event={"ID":"3b5b2738-69cc-420b-a3e6-a2f42e585417","Type":"ContainerStarted","Data":"57604f31574646b80afc7299e41b02f9718f56a8f9e777911fb218b8643b5922"} May 21 20:41:40.839330 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:40.839299 2570 generic.go:358] "Generic (PLEG): container finished" podID="84e51d81-6646-4b28-b700-e510a7922240" containerID="950a1a159c003f8c9c30ff9186375ddefeb9b27c402abd79a5e726950c0ae98d" exitCode=0 May 21 20:41:40.839461 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:40.839355 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b99ll" event={"ID":"84e51d81-6646-4b28-b700-e510a7922240","Type":"ContainerDied","Data":"950a1a159c003f8c9c30ff9186375ddefeb9b27c402abd79a5e726950c0ae98d"} May 21 20:41:41.846300 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:41.845873 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qmgjj" event={"ID":"3b5b2738-69cc-420b-a3e6-a2f42e585417","Type":"ContainerStarted","Data":"20f869dfa805fd6b381eb0f6085f7f2ddb54178082bbe4d24c02d8fec16c2daa"} May 21 20:41:41.846300 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:41.845917 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qmgjj" event={"ID":"3b5b2738-69cc-420b-a3e6-a2f42e585417","Type":"ContainerStarted","Data":"1e05cca6e5de6523948fdccbc8a3f4241ffc1c6435c671199d8bd4690c55255b"} May 21 20:41:41.850138 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:41.849302 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b99ll" event={"ID":"84e51d81-6646-4b28-b700-e510a7922240","Type":"ContainerStarted","Data":"5c8acfa9e6b4693192f0968d17d1171b2fd789c973b0e9f6d80066c75d0129c5"} May 21 20:41:41.850138 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:41.849342 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b99ll" event={"ID":"84e51d81-6646-4b28-b700-e510a7922240","Type":"ContainerStarted","Data":"b6f20c98bfb84116c4221bfd8cb082d489886054752479a3b01165cc299ade93"} May 21 20:41:41.887557 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:41.887235 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-b99ll" podStartSLOduration=2.022542936 podStartE2EDuration="2.887218172s" podCreationTimestamp="2026-05-21 20:41:39 +0000 UTC" firstStartedPulling="2026-05-21 20:41:39.704305692 +0000 UTC m=+200.086485743" lastFinishedPulling="2026-05-21 20:41:40.568980929 +0000 UTC m=+200.951160979" observedRunningTime="2026-05-21 20:41:41.886220801 +0000 UTC m=+202.268400888" watchObservedRunningTime="2026-05-21 20:41:41.887218172 +0000 UTC m=+202.269398243" May 21 20:41:42.854218 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:42.854183 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qmgjj" event={"ID":"3b5b2738-69cc-420b-a3e6-a2f42e585417","Type":"ContainerStarted","Data":"767aaf9d7f9106123e8486837ba5c9d6b5c020a5a3e644c375a8b41da013d74d"} May 21 20:41:42.870687 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:42.870636 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qmgjj" podStartSLOduration=2.700607798 podStartE2EDuration="3.87061991s" podCreationTimestamp="2026-05-21 20:41:39 +0000 UTC" firstStartedPulling="2026-05-21 20:41:40.525059268 +0000 UTC m=+200.907239318" lastFinishedPulling="2026-05-21 20:41:41.695071377 +0000 UTC m=+202.077251430" observedRunningTime="2026-05-21 20:41:42.869767257 +0000 UTC m=+203.251947329" watchObservedRunningTime="2026-05-21 20:41:42.87061991 +0000 UTC m=+203.252799982" May 21 20:41:44.595070 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:44.595034 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-d676847ff-tqvh7"] May 21 20:41:44.601211 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:44.601180 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-d676847ff-tqvh7" May 21 20:41:44.603268 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:44.603245 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-46fcn\"" May 21 20:41:44.603575 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:44.603237 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" May 21 20:41:44.603575 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:44.603342 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" May 21 20:41:44.603771 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:44.603362 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" May 21 20:41:44.603771 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:44.603415 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" May 21 20:41:44.603771 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:44.603421 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" May 21 20:41:44.608705 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:44.608669 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" May 21 20:41:44.609269 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:44.609247 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-d676847ff-tqvh7"] May 21 20:41:44.701184 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:44.701149 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/474f72a0-cadd-454f-8375-774d1d4b4831-federate-client-tls\") pod \"telemeter-client-d676847ff-tqvh7\" (UID: \"474f72a0-cadd-454f-8375-774d1d4b4831\") " pod="openshift-monitoring/telemeter-client-d676847ff-tqvh7" May 21 20:41:44.701184 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:44.701196 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/474f72a0-cadd-454f-8375-774d1d4b4831-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d676847ff-tqvh7\" (UID: \"474f72a0-cadd-454f-8375-774d1d4b4831\") " pod="openshift-monitoring/telemeter-client-d676847ff-tqvh7" May 21 20:41:44.701441 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:44.701231 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/474f72a0-cadd-454f-8375-774d1d4b4831-serving-certs-ca-bundle\") pod \"telemeter-client-d676847ff-tqvh7\" (UID: \"474f72a0-cadd-454f-8375-774d1d4b4831\") " pod="openshift-monitoring/telemeter-client-d676847ff-tqvh7" May 21 20:41:44.701441 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:44.701297 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/474f72a0-cadd-454f-8375-774d1d4b4831-secret-telemeter-client\") pod \"telemeter-client-d676847ff-tqvh7\" (UID: \"474f72a0-cadd-454f-8375-774d1d4b4831\") " pod="openshift-monitoring/telemeter-client-d676847ff-tqvh7" May 21 20:41:44.701441 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:44.701316 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzcng\" (UniqueName: \"kubernetes.io/projected/474f72a0-cadd-454f-8375-774d1d4b4831-kube-api-access-tzcng\") pod \"telemeter-client-d676847ff-tqvh7\" (UID: \"474f72a0-cadd-454f-8375-774d1d4b4831\") " pod="openshift-monitoring/telemeter-client-d676847ff-tqvh7" May 21 20:41:44.701441 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:44.701378 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/474f72a0-cadd-454f-8375-774d1d4b4831-telemeter-client-tls\") pod \"telemeter-client-d676847ff-tqvh7\" (UID: \"474f72a0-cadd-454f-8375-774d1d4b4831\") " pod="openshift-monitoring/telemeter-client-d676847ff-tqvh7" May 21 20:41:44.701441 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:44.701407 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/474f72a0-cadd-454f-8375-774d1d4b4831-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d676847ff-tqvh7\" (UID: \"474f72a0-cadd-454f-8375-774d1d4b4831\") " pod="openshift-monitoring/telemeter-client-d676847ff-tqvh7" May 21 20:41:44.701680 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:44.701495 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/474f72a0-cadd-454f-8375-774d1d4b4831-metrics-client-ca\") pod \"telemeter-client-d676847ff-tqvh7\" (UID: \"474f72a0-cadd-454f-8375-774d1d4b4831\") " pod="openshift-monitoring/telemeter-client-d676847ff-tqvh7" May 21 20:41:44.802221 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:44.802169 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/474f72a0-cadd-454f-8375-774d1d4b4831-serving-certs-ca-bundle\") pod \"telemeter-client-d676847ff-tqvh7\" (UID: \"474f72a0-cadd-454f-8375-774d1d4b4831\") " pod="openshift-monitoring/telemeter-client-d676847ff-tqvh7" May 21 20:41:44.802420 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:44.802255 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/474f72a0-cadd-454f-8375-774d1d4b4831-secret-telemeter-client\") pod \"telemeter-client-d676847ff-tqvh7\" (UID: \"474f72a0-cadd-454f-8375-774d1d4b4831\") " pod="openshift-monitoring/telemeter-client-d676847ff-tqvh7" May 21 20:41:44.802420 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:44.802279 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tzcng\" (UniqueName: \"kubernetes.io/projected/474f72a0-cadd-454f-8375-774d1d4b4831-kube-api-access-tzcng\") pod \"telemeter-client-d676847ff-tqvh7\" (UID: \"474f72a0-cadd-454f-8375-774d1d4b4831\") " pod="openshift-monitoring/telemeter-client-d676847ff-tqvh7" May 21 20:41:44.802420 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:44.802296 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/474f72a0-cadd-454f-8375-774d1d4b4831-telemeter-client-tls\") pod \"telemeter-client-d676847ff-tqvh7\" (UID: \"474f72a0-cadd-454f-8375-774d1d4b4831\") " pod="openshift-monitoring/telemeter-client-d676847ff-tqvh7" May 21 20:41:44.802420 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:44.802360 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/474f72a0-cadd-454f-8375-774d1d4b4831-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d676847ff-tqvh7\" (UID: \"474f72a0-cadd-454f-8375-774d1d4b4831\") " pod="openshift-monitoring/telemeter-client-d676847ff-tqvh7" May 21 20:41:44.802420 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:44.802391 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/474f72a0-cadd-454f-8375-774d1d4b4831-metrics-client-ca\") pod \"telemeter-client-d676847ff-tqvh7\" (UID: \"474f72a0-cadd-454f-8375-774d1d4b4831\") " pod="openshift-monitoring/telemeter-client-d676847ff-tqvh7" May 21 20:41:44.802709 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:44.802437 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/474f72a0-cadd-454f-8375-774d1d4b4831-federate-client-tls\") pod \"telemeter-client-d676847ff-tqvh7\" (UID: \"474f72a0-cadd-454f-8375-774d1d4b4831\") " pod="openshift-monitoring/telemeter-client-d676847ff-tqvh7" May 21 20:41:44.802709 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:44.802510 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/474f72a0-cadd-454f-8375-774d1d4b4831-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d676847ff-tqvh7\" (UID: \"474f72a0-cadd-454f-8375-774d1d4b4831\") " pod="openshift-monitoring/telemeter-client-d676847ff-tqvh7" May 21 20:41:44.803211 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:44.803185 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/474f72a0-cadd-454f-8375-774d1d4b4831-serving-certs-ca-bundle\") pod \"telemeter-client-d676847ff-tqvh7\" (UID: \"474f72a0-cadd-454f-8375-774d1d4b4831\") " pod="openshift-monitoring/telemeter-client-d676847ff-tqvh7" May 21 20:41:44.803408 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:44.803384 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/474f72a0-cadd-454f-8375-774d1d4b4831-metrics-client-ca\") pod \"telemeter-client-d676847ff-tqvh7\" (UID: \"474f72a0-cadd-454f-8375-774d1d4b4831\") " pod="openshift-monitoring/telemeter-client-d676847ff-tqvh7" May 21 20:41:44.803558 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:44.803535 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/474f72a0-cadd-454f-8375-774d1d4b4831-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d676847ff-tqvh7\" (UID: \"474f72a0-cadd-454f-8375-774d1d4b4831\") " pod="openshift-monitoring/telemeter-client-d676847ff-tqvh7" May 21 20:41:44.805113 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:44.805084 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/474f72a0-cadd-454f-8375-774d1d4b4831-telemeter-client-tls\") pod \"telemeter-client-d676847ff-tqvh7\" (UID: \"474f72a0-cadd-454f-8375-774d1d4b4831\") " pod="openshift-monitoring/telemeter-client-d676847ff-tqvh7" May 21 20:41:44.805205 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:44.805152 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/474f72a0-cadd-454f-8375-774d1d4b4831-federate-client-tls\") pod \"telemeter-client-d676847ff-tqvh7\" (UID: \"474f72a0-cadd-454f-8375-774d1d4b4831\") " pod="openshift-monitoring/telemeter-client-d676847ff-tqvh7" May 21 20:41:44.805432 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:44.805412 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/474f72a0-cadd-454f-8375-774d1d4b4831-secret-telemeter-client\") pod \"telemeter-client-d676847ff-tqvh7\" (UID: \"474f72a0-cadd-454f-8375-774d1d4b4831\") " pod="openshift-monitoring/telemeter-client-d676847ff-tqvh7" May 21 20:41:44.805532 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:44.805454 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/474f72a0-cadd-454f-8375-774d1d4b4831-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d676847ff-tqvh7\" (UID: \"474f72a0-cadd-454f-8375-774d1d4b4831\") " pod="openshift-monitoring/telemeter-client-d676847ff-tqvh7" May 21 20:41:44.810804 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:44.810764 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzcng\" (UniqueName: \"kubernetes.io/projected/474f72a0-cadd-454f-8375-774d1d4b4831-kube-api-access-tzcng\") pod \"telemeter-client-d676847ff-tqvh7\" (UID: \"474f72a0-cadd-454f-8375-774d1d4b4831\") " pod="openshift-monitoring/telemeter-client-d676847ff-tqvh7" May 21 20:41:44.911844 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:44.911750 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-d676847ff-tqvh7" May 21 20:41:45.045015 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:45.044980 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-d676847ff-tqvh7"] May 21 20:41:45.048272 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:41:45.048246 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod474f72a0_cadd_454f_8375_774d1d4b4831.slice/crio-e16cb1c57c32ab109a761c8680517cd56b480abf1a6f426db083c294a7d42215 WatchSource:0}: Error finding container e16cb1c57c32ab109a761c8680517cd56b480abf1a6f426db083c294a7d42215: Status 404 returned error can't find the container with id e16cb1c57c32ab109a761c8680517cd56b480abf1a6f426db083c294a7d42215 May 21 20:41:45.801319 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:45.801288 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7547f88c84-bd29v" May 21 20:41:45.864326 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:45.864285 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d676847ff-tqvh7" event={"ID":"474f72a0-cadd-454f-8375-774d1d4b4831","Type":"ContainerStarted","Data":"e16cb1c57c32ab109a761c8680517cd56b480abf1a6f426db083c294a7d42215"} May 21 20:41:47.871342 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:47.871303 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d676847ff-tqvh7" event={"ID":"474f72a0-cadd-454f-8375-774d1d4b4831","Type":"ContainerStarted","Data":"a665e3552ea3aa5cd7ff0d74b2cda2f7083af8aad7acceb011e3cb6622e0cb5f"} May 21 20:41:48.875555 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:48.875522 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d676847ff-tqvh7" event={"ID":"474f72a0-cadd-454f-8375-774d1d4b4831","Type":"ContainerStarted","Data":"ee1dad88998739462ced51d28b5fa86937cc026d38636ce5a333b39017c3dfdd"} May 21 20:41:48.875555 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:48.875559 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d676847ff-tqvh7" event={"ID":"474f72a0-cadd-454f-8375-774d1d4b4831","Type":"ContainerStarted","Data":"66b9475eed343a31d4edf5d8f6130ef3bf4afde43a9b1494848523106a1c2cf7"} May 21 20:41:48.895278 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:41:48.895210 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-d676847ff-tqvh7" podStartSLOduration=1.640961272 podStartE2EDuration="4.895190804s" podCreationTimestamp="2026-05-21 20:41:44 +0000 UTC" firstStartedPulling="2026-05-21 20:41:45.050124329 +0000 UTC m=+205.432304380" lastFinishedPulling="2026-05-21 20:41:48.304353863 +0000 UTC m=+208.686533912" observedRunningTime="2026-05-21 20:41:48.893593997 +0000 UTC m=+209.275774068" watchObservedRunningTime="2026-05-21 20:41:48.895190804 +0000 UTC m=+209.277370878" May 21 20:42:26.433681 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:42:26.433653 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jfdql_e4184fd4-d71d-4bda-bda1-e40fa42e76d7/dns-node-resolver/0.log" May 21 20:42:27.971421 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:42:27.971382 2570 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bcc69bb-lm29p" podUID="a8d101f0-3af9-4e71-bafc-2cbe35f289a4" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 21 20:42:32.070572 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:42:32.070525 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23d4cc46-4752-4afd-a726-67d9eced1af9-metrics-certs\") pod \"network-metrics-daemon-7lhdn\" (UID: \"23d4cc46-4752-4afd-a726-67d9eced1af9\") " pod="openshift-multus/network-metrics-daemon-7lhdn" May 21 20:42:32.072981 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:42:32.072958 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23d4cc46-4752-4afd-a726-67d9eced1af9-metrics-certs\") pod \"network-metrics-daemon-7lhdn\" (UID: \"23d4cc46-4752-4afd-a726-67d9eced1af9\") " pod="openshift-multus/network-metrics-daemon-7lhdn" May 21 20:42:32.366312 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:42:32.366218 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cjf7l\"" May 21 20:42:32.375029 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:42:32.375001 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7lhdn" May 21 20:42:32.501889 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:42:32.501854 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7lhdn"] May 21 20:42:32.504789 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:42:32.504759 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23d4cc46_4752_4afd_a726_67d9eced1af9.slice/crio-7ea8f08d536bb5f99e5aa452d5ca37f3681dfb34597319f1038cfd00e1acea8e WatchSource:0}: Error finding container 7ea8f08d536bb5f99e5aa452d5ca37f3681dfb34597319f1038cfd00e1acea8e: Status 404 returned error can't find the container with id 7ea8f08d536bb5f99e5aa452d5ca37f3681dfb34597319f1038cfd00e1acea8e May 21 20:42:32.985887 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:42:32.985848 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7lhdn" event={"ID":"23d4cc46-4752-4afd-a726-67d9eced1af9","Type":"ContainerStarted","Data":"7ea8f08d536bb5f99e5aa452d5ca37f3681dfb34597319f1038cfd00e1acea8e"} May 21 20:42:33.989579 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:42:33.989543 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7lhdn" event={"ID":"23d4cc46-4752-4afd-a726-67d9eced1af9","Type":"ContainerStarted","Data":"13dd7220a29e90fccc06b76ad06a0a3512a9db0f0356712fbbed06a26e6343a3"} May 21 20:42:33.989579 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:42:33.989579 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7lhdn" event={"ID":"23d4cc46-4752-4afd-a726-67d9eced1af9","Type":"ContainerStarted","Data":"0fa785c7b86ba57b348f188d5a42da1cc1485bf6a1bcec6d96c6c8bc6cbe22b5"} May 21 20:42:34.009832 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:42:34.007308 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7lhdn" podStartSLOduration=253.020925585 podStartE2EDuration="4m14.007286132s" podCreationTimestamp="2026-05-21 20:38:20 +0000 UTC" firstStartedPulling="2026-05-21 20:42:32.506617883 +0000 UTC m=+252.888797933" lastFinishedPulling="2026-05-21 20:42:33.492978411 +0000 UTC m=+253.875158480" observedRunningTime="2026-05-21 20:42:34.004375347 +0000 UTC m=+254.386555423" watchObservedRunningTime="2026-05-21 20:42:34.007286132 +0000 UTC m=+254.389466205" May 21 20:42:37.971615 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:42:37.971519 2570 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bcc69bb-lm29p" podUID="a8d101f0-3af9-4e71-bafc-2cbe35f289a4" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 21 20:42:47.970805 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:42:47.970766 2570 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bcc69bb-lm29p" podUID="a8d101f0-3af9-4e71-bafc-2cbe35f289a4" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 21 20:42:47.971180 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:42:47.970849 2570 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bcc69bb-lm29p" May 21 20:42:47.971356 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:42:47.971316 2570 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"20a9eb8302793012d3191ecc8a9cf7f2667326a0ba36637d874c4a1746336c40"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bcc69bb-lm29p" containerMessage="Container service-proxy failed liveness probe, will be restarted" May 21 20:42:47.971500 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:42:47.971391 2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bcc69bb-lm29p" podUID="a8d101f0-3af9-4e71-bafc-2cbe35f289a4" containerName="service-proxy" containerID="cri-o://20a9eb8302793012d3191ecc8a9cf7f2667326a0ba36637d874c4a1746336c40" gracePeriod=30 May 21 20:42:49.035763 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:42:49.035726 2570 generic.go:358] "Generic (PLEG): container finished" podID="a8d101f0-3af9-4e71-bafc-2cbe35f289a4" containerID="20a9eb8302793012d3191ecc8a9cf7f2667326a0ba36637d874c4a1746336c40" exitCode=2 May 21 20:42:49.035763 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:42:49.035774 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bcc69bb-lm29p" event={"ID":"a8d101f0-3af9-4e71-bafc-2cbe35f289a4","Type":"ContainerDied","Data":"20a9eb8302793012d3191ecc8a9cf7f2667326a0ba36637d874c4a1746336c40"} May 21 20:42:49.036179 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:42:49.035803 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55bcc69bb-lm29p" event={"ID":"a8d101f0-3af9-4e71-bafc-2cbe35f289a4","Type":"ContainerStarted","Data":"d45e5860af673b227fc7b80d1966e29b8991f346add1fdd9b75c638ac858cbec"} May 21 20:43:00.724286 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:43:00.724225 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-x7nft" podUID="19a963d1-f89b-4cee-8b37-3205095efa67" May 21 20:43:01.068166 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:43:01.068081 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x7nft" May 21 20:43:04.027217 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:43:04.027178 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/19a963d1-f89b-4cee-8b37-3205095efa67-metrics-tls\") pod \"dns-default-x7nft\" (UID: \"19a963d1-f89b-4cee-8b37-3205095efa67\") " pod="openshift-dns/dns-default-x7nft" May 21 20:43:04.027624 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:43:04.027257 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d7d41f03-d42a-434d-b1a0-fb94372013b2-cert\") pod \"ingress-canary-j5jnw\" (UID: \"d7d41f03-d42a-434d-b1a0-fb94372013b2\") " pod="openshift-ingress-canary/ingress-canary-j5jnw" May 21 20:43:04.029739 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:43:04.029716 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/19a963d1-f89b-4cee-8b37-3205095efa67-metrics-tls\") pod \"dns-default-x7nft\" (UID: \"19a963d1-f89b-4cee-8b37-3205095efa67\") " pod="openshift-dns/dns-default-x7nft" May 21 20:43:04.029839 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:43:04.029821 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d7d41f03-d42a-434d-b1a0-fb94372013b2-cert\") pod \"ingress-canary-j5jnw\" (UID: \"d7d41f03-d42a-434d-b1a0-fb94372013b2\") " pod="openshift-ingress-canary/ingress-canary-j5jnw" May 21 20:43:04.065894 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:43:04.065865 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-f4n69\"" May 21 20:43:04.070615 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:43:04.070598 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-25972\"" May 21 20:43:04.074158 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:43:04.074136 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j5jnw" May 21 20:43:04.079341 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:43:04.079313 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x7nft" May 21 20:43:04.214831 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:43:04.214797 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j5jnw"] May 21 20:43:04.218206 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:43:04.218171 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7d41f03_d42a_434d_b1a0_fb94372013b2.slice/crio-2acf565230fb3f49c55c0edc92c35892b01450183f9015992eb39d520b8008ce WatchSource:0}: Error finding container 2acf565230fb3f49c55c0edc92c35892b01450183f9015992eb39d520b8008ce: Status 404 returned error can't find the container with id 2acf565230fb3f49c55c0edc92c35892b01450183f9015992eb39d520b8008ce May 21 20:43:04.235025 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:43:04.234959 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x7nft"] May 21 20:43:04.237074 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:43:04.237051 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19a963d1_f89b_4cee_8b37_3205095efa67.slice/crio-143f67cccb5a2c4516bef74aeaae51a35540281c7e0ddb8d3a431609b50ed5b5 WatchSource:0}: Error finding container 143f67cccb5a2c4516bef74aeaae51a35540281c7e0ddb8d3a431609b50ed5b5: Status 404 returned error can't find the container with id 143f67cccb5a2c4516bef74aeaae51a35540281c7e0ddb8d3a431609b50ed5b5 May 21 20:43:05.080933 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:43:05.080889 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j5jnw" event={"ID":"d7d41f03-d42a-434d-b1a0-fb94372013b2","Type":"ContainerStarted","Data":"2acf565230fb3f49c55c0edc92c35892b01450183f9015992eb39d520b8008ce"} May 21 20:43:05.082223 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:43:05.082184 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x7nft" event={"ID":"19a963d1-f89b-4cee-8b37-3205095efa67","Type":"ContainerStarted","Data":"143f67cccb5a2c4516bef74aeaae51a35540281c7e0ddb8d3a431609b50ed5b5"} May 21 20:43:07.090150 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:43:07.090114 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x7nft" event={"ID":"19a963d1-f89b-4cee-8b37-3205095efa67","Type":"ContainerStarted","Data":"0dc47e14f6ac05346f3b3508d686061b138d00798f9ffba505ceda7b73d13a78"} May 21 20:43:07.090150 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:43:07.090154 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x7nft" event={"ID":"19a963d1-f89b-4cee-8b37-3205095efa67","Type":"ContainerStarted","Data":"c398cf3b87484909cd760aeb97ce7aad7f02747352c1ed984943cdd2537abe2f"} May 21 20:43:07.090701 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:43:07.090224 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-x7nft" May 21 20:43:07.091461 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:43:07.091429 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j5jnw" event={"ID":"d7d41f03-d42a-434d-b1a0-fb94372013b2","Type":"ContainerStarted","Data":"0305fc5d6ee8f187297d6fa2fd6c04971311f4f4e747c28fc871b926b2673300"} May 21 20:43:07.107237 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:43:07.107178 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-x7nft" podStartSLOduration=252.189009155 podStartE2EDuration="4m14.107159301s" podCreationTimestamp="2026-05-21 20:38:53 +0000 UTC" firstStartedPulling="2026-05-21 20:43:04.238897179 +0000 UTC m=+284.621077228" lastFinishedPulling="2026-05-21 20:43:06.157047321 +0000 UTC m=+286.539227374" observedRunningTime="2026-05-21 20:43:07.105626828 +0000 UTC m=+287.487806901" watchObservedRunningTime="2026-05-21 20:43:07.107159301 +0000 UTC m=+287.489339374" May 21 20:43:07.120648 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:43:07.120591 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-j5jnw" podStartSLOduration=252.185228263 podStartE2EDuration="4m14.120577217s" podCreationTimestamp="2026-05-21 20:38:53 +0000 UTC" firstStartedPulling="2026-05-21 20:43:04.220160214 +0000 UTC m=+284.602340264" lastFinishedPulling="2026-05-21 20:43:06.155509168 +0000 UTC m=+286.537689218" observedRunningTime="2026-05-21 20:43:07.119507868 +0000 UTC m=+287.501687939" watchObservedRunningTime="2026-05-21 20:43:07.120577217 +0000 UTC m=+287.502757289" May 21 20:43:17.096808 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:43:17.096774 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-x7nft" May 21 20:43:20.169288 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:43:20.169253 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7krlb_d8463ad6-6f3b-4984-ab32-781d1507d42d/ovn-acl-logging/0.log" May 21 20:43:20.169722 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:43:20.169687 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7krlb_d8463ad6-6f3b-4984-ab32-781d1507d42d/ovn-acl-logging/0.log" May 21 20:43:20.172051 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:43:20.172031 2570 kubelet.go:1628] "Image garbage collection succeeded" May 21 20:48:20.190614 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:48:20.190584 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7krlb_d8463ad6-6f3b-4984-ab32-781d1507d42d/ovn-acl-logging/0.log" May 21 20:48:20.192869 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:48:20.192846 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7krlb_d8463ad6-6f3b-4984-ab32-781d1507d42d/ovn-acl-logging/0.log" May 21 20:49:16.866086 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:16.866051 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76cc84b65c-mjz2c"] May 21 20:49:16.874675 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:16.874628 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-76cc84b65c-mjz2c" May 21 20:49:16.876582 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:16.876557 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 21 20:49:16.876582 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:16.876578 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 21 20:49:16.876767 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:16.876611 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 21 20:49:16.876767 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:16.876559 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-8hv5g\"" May 21 20:49:16.876874 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:16.876861 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 21 20:49:16.881645 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:16.881619 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76cc84b65c-mjz2c"] May 21 20:49:16.917524 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:16.917489 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/611f1d12-d17d-40ea-b481-aeb14ca32acb-webhook-cert\") pod \"opendatahub-operator-controller-manager-76cc84b65c-mjz2c\" (UID: \"611f1d12-d17d-40ea-b481-aeb14ca32acb\") " pod="opendatahub/opendatahub-operator-controller-manager-76cc84b65c-mjz2c" May 21 20:49:16.917689 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:16.917551 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/611f1d12-d17d-40ea-b481-aeb14ca32acb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76cc84b65c-mjz2c\" (UID: \"611f1d12-d17d-40ea-b481-aeb14ca32acb\") " pod="opendatahub/opendatahub-operator-controller-manager-76cc84b65c-mjz2c" May 21 20:49:16.917689 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:16.917567 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67nwn\" (UniqueName: \"kubernetes.io/projected/611f1d12-d17d-40ea-b481-aeb14ca32acb-kube-api-access-67nwn\") pod \"opendatahub-operator-controller-manager-76cc84b65c-mjz2c\" (UID: \"611f1d12-d17d-40ea-b481-aeb14ca32acb\") " pod="opendatahub/opendatahub-operator-controller-manager-76cc84b65c-mjz2c" May 21 20:49:17.018522 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:17.018453 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/611f1d12-d17d-40ea-b481-aeb14ca32acb-webhook-cert\") pod \"opendatahub-operator-controller-manager-76cc84b65c-mjz2c\" (UID: \"611f1d12-d17d-40ea-b481-aeb14ca32acb\") " pod="opendatahub/opendatahub-operator-controller-manager-76cc84b65c-mjz2c" May 21 20:49:17.018697 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:17.018559 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/611f1d12-d17d-40ea-b481-aeb14ca32acb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76cc84b65c-mjz2c\" (UID: \"611f1d12-d17d-40ea-b481-aeb14ca32acb\") " pod="opendatahub/opendatahub-operator-controller-manager-76cc84b65c-mjz2c" May 21 20:49:17.018697 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:17.018584 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-67nwn\" (UniqueName: \"kubernetes.io/projected/611f1d12-d17d-40ea-b481-aeb14ca32acb-kube-api-access-67nwn\") pod \"opendatahub-operator-controller-manager-76cc84b65c-mjz2c\" (UID: \"611f1d12-d17d-40ea-b481-aeb14ca32acb\") " pod="opendatahub/opendatahub-operator-controller-manager-76cc84b65c-mjz2c" May 21 20:49:17.021072 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:17.021046 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/611f1d12-d17d-40ea-b481-aeb14ca32acb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76cc84b65c-mjz2c\" (UID: \"611f1d12-d17d-40ea-b481-aeb14ca32acb\") " pod="opendatahub/opendatahub-operator-controller-manager-76cc84b65c-mjz2c" May 21 20:49:17.021197 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:17.021074 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/611f1d12-d17d-40ea-b481-aeb14ca32acb-webhook-cert\") pod \"opendatahub-operator-controller-manager-76cc84b65c-mjz2c\" (UID: \"611f1d12-d17d-40ea-b481-aeb14ca32acb\") " pod="opendatahub/opendatahub-operator-controller-manager-76cc84b65c-mjz2c" May 21 20:49:17.026264 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:17.026228 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67nwn\" (UniqueName: \"kubernetes.io/projected/611f1d12-d17d-40ea-b481-aeb14ca32acb-kube-api-access-67nwn\") pod \"opendatahub-operator-controller-manager-76cc84b65c-mjz2c\" (UID: \"611f1d12-d17d-40ea-b481-aeb14ca32acb\") " pod="opendatahub/opendatahub-operator-controller-manager-76cc84b65c-mjz2c" May 21 20:49:17.186529 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:17.186413 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-76cc84b65c-mjz2c" May 21 20:49:17.316269 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:17.316237 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76cc84b65c-mjz2c"] May 21 20:49:17.320021 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:49:17.319989 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod611f1d12_d17d_40ea_b481_aeb14ca32acb.slice/crio-3044d12b45d90e7769a5f1e4a7702d8ed8ac033afe3d04631974c67fa8f72dc3 WatchSource:0}: Error finding container 3044d12b45d90e7769a5f1e4a7702d8ed8ac033afe3d04631974c67fa8f72dc3: Status 404 returned error can't find the container with id 3044d12b45d90e7769a5f1e4a7702d8ed8ac033afe3d04631974c67fa8f72dc3 May 21 20:49:17.321565 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:17.321549 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 20:49:18.089064 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:18.089016 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76cc84b65c-mjz2c" event={"ID":"611f1d12-d17d-40ea-b481-aeb14ca32acb","Type":"ContainerStarted","Data":"3044d12b45d90e7769a5f1e4a7702d8ed8ac033afe3d04631974c67fa8f72dc3"} May 21 20:49:19.849673 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:19.849636 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5465c6b7f8-nh8kx"] May 21 20:49:19.852872 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:19.852841 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5465c6b7f8-nh8kx" May 21 20:49:19.855093 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:19.855059 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 21 20:49:19.855402 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:19.855103 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 21 20:49:19.855402 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:19.855065 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 21 20:49:19.855633 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:19.855618 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 21 20:49:19.855707 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:19.855657 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 21 20:49:19.855763 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:19.855707 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-pj8tj\"" May 21 20:49:19.862632 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:19.862604 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5465c6b7f8-nh8kx"] May 21 20:49:19.947139 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:19.947112 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f379809b-9d00-4ea0-ad55-2da51a5a4cb8-manager-config\") pod \"lws-controller-manager-5465c6b7f8-nh8kx\" (UID: \"f379809b-9d00-4ea0-ad55-2da51a5a4cb8\") " pod="openshift-lws-operator/lws-controller-manager-5465c6b7f8-nh8kx" May 21 20:49:19.947310 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:19.947176 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f379809b-9d00-4ea0-ad55-2da51a5a4cb8-cert\") pod \"lws-controller-manager-5465c6b7f8-nh8kx\" (UID: \"f379809b-9d00-4ea0-ad55-2da51a5a4cb8\") " pod="openshift-lws-operator/lws-controller-manager-5465c6b7f8-nh8kx" May 21 20:49:19.947310 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:19.947239 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f379809b-9d00-4ea0-ad55-2da51a5a4cb8-metrics-cert\") pod \"lws-controller-manager-5465c6b7f8-nh8kx\" (UID: \"f379809b-9d00-4ea0-ad55-2da51a5a4cb8\") " pod="openshift-lws-operator/lws-controller-manager-5465c6b7f8-nh8kx" May 21 20:49:19.947310 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:19.947272 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pf6b\" (UniqueName: \"kubernetes.io/projected/f379809b-9d00-4ea0-ad55-2da51a5a4cb8-kube-api-access-8pf6b\") pod \"lws-controller-manager-5465c6b7f8-nh8kx\" (UID: \"f379809b-9d00-4ea0-ad55-2da51a5a4cb8\") " pod="openshift-lws-operator/lws-controller-manager-5465c6b7f8-nh8kx" May 21 20:49:20.047626 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:20.047594 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f379809b-9d00-4ea0-ad55-2da51a5a4cb8-cert\") pod \"lws-controller-manager-5465c6b7f8-nh8kx\" (UID: \"f379809b-9d00-4ea0-ad55-2da51a5a4cb8\") " pod="openshift-lws-operator/lws-controller-manager-5465c6b7f8-nh8kx" May 21 20:49:20.047800 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:20.047648 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f379809b-9d00-4ea0-ad55-2da51a5a4cb8-metrics-cert\") pod \"lws-controller-manager-5465c6b7f8-nh8kx\" (UID: \"f379809b-9d00-4ea0-ad55-2da51a5a4cb8\") " pod="openshift-lws-operator/lws-controller-manager-5465c6b7f8-nh8kx" May 21 20:49:20.047800 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:20.047688 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8pf6b\" (UniqueName: \"kubernetes.io/projected/f379809b-9d00-4ea0-ad55-2da51a5a4cb8-kube-api-access-8pf6b\") pod \"lws-controller-manager-5465c6b7f8-nh8kx\" (UID: \"f379809b-9d00-4ea0-ad55-2da51a5a4cb8\") " pod="openshift-lws-operator/lws-controller-manager-5465c6b7f8-nh8kx" May 21 20:49:20.047800 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:20.047711 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f379809b-9d00-4ea0-ad55-2da51a5a4cb8-manager-config\") pod \"lws-controller-manager-5465c6b7f8-nh8kx\" (UID: \"f379809b-9d00-4ea0-ad55-2da51a5a4cb8\") " pod="openshift-lws-operator/lws-controller-manager-5465c6b7f8-nh8kx" May 21 20:49:20.048449 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:20.048357 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f379809b-9d00-4ea0-ad55-2da51a5a4cb8-manager-config\") pod \"lws-controller-manager-5465c6b7f8-nh8kx\" (UID: \"f379809b-9d00-4ea0-ad55-2da51a5a4cb8\") " pod="openshift-lws-operator/lws-controller-manager-5465c6b7f8-nh8kx" May 21 20:49:20.050298 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:20.050256 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f379809b-9d00-4ea0-ad55-2da51a5a4cb8-metrics-cert\") pod \"lws-controller-manager-5465c6b7f8-nh8kx\" (UID: \"f379809b-9d00-4ea0-ad55-2da51a5a4cb8\") " pod="openshift-lws-operator/lws-controller-manager-5465c6b7f8-nh8kx" May 21 20:49:20.050463 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:20.050343 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f379809b-9d00-4ea0-ad55-2da51a5a4cb8-cert\") pod \"lws-controller-manager-5465c6b7f8-nh8kx\" (UID: \"f379809b-9d00-4ea0-ad55-2da51a5a4cb8\") " pod="openshift-lws-operator/lws-controller-manager-5465c6b7f8-nh8kx" May 21 20:49:20.061684 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:20.061658 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pf6b\" (UniqueName: \"kubernetes.io/projected/f379809b-9d00-4ea0-ad55-2da51a5a4cb8-kube-api-access-8pf6b\") pod \"lws-controller-manager-5465c6b7f8-nh8kx\" (UID: \"f379809b-9d00-4ea0-ad55-2da51a5a4cb8\") " pod="openshift-lws-operator/lws-controller-manager-5465c6b7f8-nh8kx" May 21 20:49:20.096665 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:20.096630 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76cc84b65c-mjz2c" event={"ID":"611f1d12-d17d-40ea-b481-aeb14ca32acb","Type":"ContainerStarted","Data":"19f4a65fa35fa6f6b0f75a1788d2307f7708980e5d1935df1ed348de795cd537"} May 21 20:49:20.096867 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:20.096773 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-76cc84b65c-mjz2c" May 21 20:49:20.121412 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:20.121310 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-76cc84b65c-mjz2c" podStartSLOduration=1.5520515559999999 podStartE2EDuration="4.121293858s" podCreationTimestamp="2026-05-21 20:49:16 +0000 UTC" firstStartedPulling="2026-05-21 20:49:17.32167136 +0000 UTC m=+657.703851410" lastFinishedPulling="2026-05-21 20:49:19.890913655 +0000 UTC m=+660.273093712" observedRunningTime="2026-05-21 20:49:20.119683204 +0000 UTC m=+660.501863277" watchObservedRunningTime="2026-05-21 20:49:20.121293858 +0000 UTC m=+660.503473933" May 21 20:49:20.167377 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:20.167346 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-pj8tj\"" May 21 20:49:20.175981 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:20.175952 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5465c6b7f8-nh8kx" May 21 20:49:20.300675 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:20.300638 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5465c6b7f8-nh8kx"] May 21 20:49:20.303543 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:49:20.303517 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf379809b_9d00_4ea0_ad55_2da51a5a4cb8.slice/crio-9690516d26906dcb27f3d606071befef3c0e295c37534a1135fc7532855eb06a WatchSource:0}: Error finding container 9690516d26906dcb27f3d606071befef3c0e295c37534a1135fc7532855eb06a: Status 404 returned error can't find the container with id 9690516d26906dcb27f3d606071befef3c0e295c37534a1135fc7532855eb06a May 21 20:49:21.100989 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:21.100946 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5465c6b7f8-nh8kx" event={"ID":"f379809b-9d00-4ea0-ad55-2da51a5a4cb8","Type":"ContainerStarted","Data":"9690516d26906dcb27f3d606071befef3c0e295c37534a1135fc7532855eb06a"} May 21 20:49:24.110982 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:24.110941 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5465c6b7f8-nh8kx" event={"ID":"f379809b-9d00-4ea0-ad55-2da51a5a4cb8","Type":"ContainerStarted","Data":"7a33f9148319705a1d7794014f5ad4c662791b6185d15ae13a3fde6b7ce5a895"} May 21 20:49:24.111378 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:24.111070 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5465c6b7f8-nh8kx" May 21 20:49:24.127130 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:24.127066 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5465c6b7f8-nh8kx" podStartSLOduration=2.356186792 podStartE2EDuration="5.127047734s" podCreationTimestamp="2026-05-21 20:49:19 +0000 UTC" firstStartedPulling="2026-05-21 20:49:20.305432125 +0000 UTC m=+660.687612174" lastFinishedPulling="2026-05-21 20:49:23.076293052 +0000 UTC m=+663.458473116" observedRunningTime="2026-05-21 20:49:24.12666991 +0000 UTC m=+664.508849979" watchObservedRunningTime="2026-05-21 20:49:24.127047734 +0000 UTC m=+664.509227806" May 21 20:49:31.103265 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:31.103229 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-76cc84b65c-mjz2c" May 21 20:49:35.115881 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:35.115850 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5465c6b7f8-nh8kx" May 21 20:49:46.608832 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:46.608799 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-c9f76b4c5-cn4nx"] May 21 20:49:46.611942 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:46.611919 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-c9f76b4c5-cn4nx" May 21 20:49:46.613773 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:46.613748 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-tw9sk\"" May 21 20:49:46.613773 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:46.613764 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 21 20:49:46.613939 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:46.613769 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 21 20:49:46.614273 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:46.614253 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 21 20:49:46.614333 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:46.614318 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 21 20:49:46.620394 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:46.620104 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-c9f76b4c5-cn4nx"] May 21 20:49:46.766056 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:46.766018 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ddcebb69-59cd-4e3d-bba7-49f9b1abdad1-tmp\") pod \"kube-auth-proxy-c9f76b4c5-cn4nx\" (UID: \"ddcebb69-59cd-4e3d-bba7-49f9b1abdad1\") " pod="openshift-ingress/kube-auth-proxy-c9f76b4c5-cn4nx" May 21 20:49:46.766056 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:46.766059 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glqjz\" (UniqueName: \"kubernetes.io/projected/ddcebb69-59cd-4e3d-bba7-49f9b1abdad1-kube-api-access-glqjz\") pod \"kube-auth-proxy-c9f76b4c5-cn4nx\" (UID: \"ddcebb69-59cd-4e3d-bba7-49f9b1abdad1\") " pod="openshift-ingress/kube-auth-proxy-c9f76b4c5-cn4nx" May 21 20:49:46.766298 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:46.766138 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ddcebb69-59cd-4e3d-bba7-49f9b1abdad1-tls-certs\") pod \"kube-auth-proxy-c9f76b4c5-cn4nx\" (UID: \"ddcebb69-59cd-4e3d-bba7-49f9b1abdad1\") " pod="openshift-ingress/kube-auth-proxy-c9f76b4c5-cn4nx" May 21 20:49:46.867071 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:46.866989 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ddcebb69-59cd-4e3d-bba7-49f9b1abdad1-tls-certs\") pod \"kube-auth-proxy-c9f76b4c5-cn4nx\" (UID: \"ddcebb69-59cd-4e3d-bba7-49f9b1abdad1\") " pod="openshift-ingress/kube-auth-proxy-c9f76b4c5-cn4nx" May 21 20:49:46.867071 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:46.867046 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ddcebb69-59cd-4e3d-bba7-49f9b1abdad1-tmp\") pod \"kube-auth-proxy-c9f76b4c5-cn4nx\" (UID: \"ddcebb69-59cd-4e3d-bba7-49f9b1abdad1\") " pod="openshift-ingress/kube-auth-proxy-c9f76b4c5-cn4nx" May 21 20:49:46.867263 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:46.867067 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-glqjz\" (UniqueName: \"kubernetes.io/projected/ddcebb69-59cd-4e3d-bba7-49f9b1abdad1-kube-api-access-glqjz\") pod \"kube-auth-proxy-c9f76b4c5-cn4nx\" (UID: \"ddcebb69-59cd-4e3d-bba7-49f9b1abdad1\") " pod="openshift-ingress/kube-auth-proxy-c9f76b4c5-cn4nx" May 21 20:49:46.870804 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:46.870765 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ddcebb69-59cd-4e3d-bba7-49f9b1abdad1-tmp\") pod \"kube-auth-proxy-c9f76b4c5-cn4nx\" (UID: \"ddcebb69-59cd-4e3d-bba7-49f9b1abdad1\") " pod="openshift-ingress/kube-auth-proxy-c9f76b4c5-cn4nx" May 21 20:49:46.870996 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:46.870975 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ddcebb69-59cd-4e3d-bba7-49f9b1abdad1-tls-certs\") pod \"kube-auth-proxy-c9f76b4c5-cn4nx\" (UID: \"ddcebb69-59cd-4e3d-bba7-49f9b1abdad1\") " pod="openshift-ingress/kube-auth-proxy-c9f76b4c5-cn4nx" May 21 20:49:46.875340 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:46.875314 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glqjz\" (UniqueName: \"kubernetes.io/projected/ddcebb69-59cd-4e3d-bba7-49f9b1abdad1-kube-api-access-glqjz\") pod \"kube-auth-proxy-c9f76b4c5-cn4nx\" (UID: \"ddcebb69-59cd-4e3d-bba7-49f9b1abdad1\") " pod="openshift-ingress/kube-auth-proxy-c9f76b4c5-cn4nx" May 21 20:49:46.923499 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:46.923436 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-c9f76b4c5-cn4nx" May 21 20:49:47.050929 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:47.050897 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-c9f76b4c5-cn4nx"] May 21 20:49:47.053528 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:49:47.053502 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddcebb69_59cd_4e3d_bba7_49f9b1abdad1.slice/crio-8281f1ed30609c9be6f0e804459d28b9080f4ce0d1c7b7f23318a7241aa53d24 WatchSource:0}: Error finding container 8281f1ed30609c9be6f0e804459d28b9080f4ce0d1c7b7f23318a7241aa53d24: Status 404 returned error can't find the container with id 8281f1ed30609c9be6f0e804459d28b9080f4ce0d1c7b7f23318a7241aa53d24 May 21 20:49:47.172699 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:47.172606 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-c9f76b4c5-cn4nx" event={"ID":"ddcebb69-59cd-4e3d-bba7-49f9b1abdad1","Type":"ContainerStarted","Data":"8281f1ed30609c9be6f0e804459d28b9080f4ce0d1c7b7f23318a7241aa53d24"} May 21 20:49:51.185116 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:51.185021 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-c9f76b4c5-cn4nx" event={"ID":"ddcebb69-59cd-4e3d-bba7-49f9b1abdad1","Type":"ContainerStarted","Data":"5bdde9e50ac39a4996e3accbaa116fe0c6deaaf46300ccb18d56ed7eed682e30"} May 21 20:49:51.200345 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:49:51.200295 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-c9f76b4c5-cn4nx" podStartSLOduration=1.451645098 podStartE2EDuration="5.200278554s" podCreationTimestamp="2026-05-21 20:49:46 +0000 UTC" firstStartedPulling="2026-05-21 20:49:47.055658436 +0000 UTC m=+687.437838486" lastFinishedPulling="2026-05-21 20:49:50.804291893 +0000 UTC m=+691.186471942" observedRunningTime="2026-05-21 20:49:51.198904685 +0000 UTC m=+691.581084758" watchObservedRunningTime="2026-05-21 20:49:51.200278554 +0000 UTC m=+691.582458626" May 21 20:51:23.142808 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:51:23.142772 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4kkcr"] May 21 20:51:23.145922 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:51:23.145904 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4kkcr" May 21 20:51:23.148015 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:51:23.147990 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 21 20:51:23.148129 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:51:23.147993 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2zgxl\"" May 21 20:51:23.148129 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:51:23.148042 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 21 20:51:23.148370 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:51:23.148352 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" May 21 20:51:23.148488 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:51:23.148370 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" May 21 20:51:23.152233 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:51:23.152212 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4kkcr"] May 21 20:51:23.215801 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:51:23.215770 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a21b94ff-b121-45a3-88a1-5ccd3d87027d-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-4kkcr\" (UID: \"a21b94ff-b121-45a3-88a1-5ccd3d87027d\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4kkcr" May 21 20:51:23.215801 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:51:23.215804 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbwnf\" (UniqueName: \"kubernetes.io/projected/a21b94ff-b121-45a3-88a1-5ccd3d87027d-kube-api-access-gbwnf\") pod \"kuadrant-console-plugin-6cb54b5c86-4kkcr\" (UID: \"a21b94ff-b121-45a3-88a1-5ccd3d87027d\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4kkcr" May 21 20:51:23.216084 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:51:23.215876 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a21b94ff-b121-45a3-88a1-5ccd3d87027d-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-4kkcr\" (UID: \"a21b94ff-b121-45a3-88a1-5ccd3d87027d\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4kkcr" May 21 20:51:23.317003 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:51:23.316967 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a21b94ff-b121-45a3-88a1-5ccd3d87027d-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-4kkcr\" (UID: \"a21b94ff-b121-45a3-88a1-5ccd3d87027d\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4kkcr" May 21 20:51:23.317003 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:51:23.317009 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gbwnf\" (UniqueName: \"kubernetes.io/projected/a21b94ff-b121-45a3-88a1-5ccd3d87027d-kube-api-access-gbwnf\") pod \"kuadrant-console-plugin-6cb54b5c86-4kkcr\" (UID: \"a21b94ff-b121-45a3-88a1-5ccd3d87027d\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4kkcr" May 21 20:51:23.317243 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:51:23.317047 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a21b94ff-b121-45a3-88a1-5ccd3d87027d-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-4kkcr\" (UID: \"a21b94ff-b121-45a3-88a1-5ccd3d87027d\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4kkcr" May 21 20:51:23.317805 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:51:23.317787 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a21b94ff-b121-45a3-88a1-5ccd3d87027d-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-4kkcr\" (UID: \"a21b94ff-b121-45a3-88a1-5ccd3d87027d\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4kkcr" May 21 20:51:23.319602 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:51:23.319582 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a21b94ff-b121-45a3-88a1-5ccd3d87027d-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-4kkcr\" (UID: \"a21b94ff-b121-45a3-88a1-5ccd3d87027d\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4kkcr" May 21 20:51:23.327225 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:51:23.327198 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbwnf\" (UniqueName: \"kubernetes.io/projected/a21b94ff-b121-45a3-88a1-5ccd3d87027d-kube-api-access-gbwnf\") pod \"kuadrant-console-plugin-6cb54b5c86-4kkcr\" (UID: \"a21b94ff-b121-45a3-88a1-5ccd3d87027d\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4kkcr" May 21 20:51:23.456068 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:51:23.456031 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4kkcr" May 21 20:51:23.590536 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:51:23.590344 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4kkcr"] May 21 20:51:23.593377 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:51:23.593343 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda21b94ff_b121_45a3_88a1_5ccd3d87027d.slice/crio-81849f83c61f06d1d1a7c2225517f63964e0a1261eadd247b569b837a986b28c WatchSource:0}: Error finding container 81849f83c61f06d1d1a7c2225517f63964e0a1261eadd247b569b837a986b28c: Status 404 returned error can't find the container with id 81849f83c61f06d1d1a7c2225517f63964e0a1261eadd247b569b837a986b28c May 21 20:51:24.442166 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:51:24.442125 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4kkcr" event={"ID":"a21b94ff-b121-45a3-88a1-5ccd3d87027d","Type":"ContainerStarted","Data":"81849f83c61f06d1d1a7c2225517f63964e0a1261eadd247b569b837a986b28c"} May 21 20:51:46.519782 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:51:46.519745 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4kkcr" event={"ID":"a21b94ff-b121-45a3-88a1-5ccd3d87027d","Type":"ContainerStarted","Data":"2499334fea1ded9c3502c04f70bae34316d30a7629c7b098978e6e1b70852852"} May 21 20:51:46.534320 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:51:46.534257 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4kkcr" podStartSLOduration=0.940713513 podStartE2EDuration="23.534232473s" podCreationTimestamp="2026-05-21 20:51:23 +0000 UTC" firstStartedPulling="2026-05-21 20:51:23.594643606 +0000 UTC m=+783.976823656" lastFinishedPulling="2026-05-21 20:51:46.188162546 +0000 UTC m=+806.570342616" observedRunningTime="2026-05-21 20:51:46.533704994 +0000 UTC m=+806.915885067" watchObservedRunningTime="2026-05-21 20:51:46.534232473 +0000 UTC m=+806.916412545" May 21 20:52:12.550515 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:12.550458 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-xbdcr"] May 21 20:52:12.552419 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:12.552402 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-xbdcr" May 21 20:52:12.554074 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:12.554055 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-7r5c2\"" May 21 20:52:12.561124 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:12.561097 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-xbdcr"] May 21 20:52:12.686169 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:12.686135 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-l2qlh"] May 21 20:52:12.688302 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:12.688279 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-l2qlh" May 21 20:52:12.694055 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:12.694029 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-l2qlh"] May 21 20:52:12.739828 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:12.739788 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldj6q\" (UniqueName: \"kubernetes.io/projected/f8232825-cfaa-4bcc-ab88-6c0b44033051-kube-api-access-ldj6q\") pod \"authorino-f99f4b5cd-xbdcr\" (UID: \"f8232825-cfaa-4bcc-ab88-6c0b44033051\") " pod="kuadrant-system/authorino-f99f4b5cd-xbdcr" May 21 20:52:12.840818 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:12.840720 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ldj6q\" (UniqueName: \"kubernetes.io/projected/f8232825-cfaa-4bcc-ab88-6c0b44033051-kube-api-access-ldj6q\") pod \"authorino-f99f4b5cd-xbdcr\" (UID: \"f8232825-cfaa-4bcc-ab88-6c0b44033051\") " pod="kuadrant-system/authorino-f99f4b5cd-xbdcr" May 21 20:52:12.840818 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:12.840772 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt5kn\" (UniqueName: \"kubernetes.io/projected/6d44e873-1123-4d5c-b2a2-6a1dba8230ab-kube-api-access-qt5kn\") pod \"authorino-7498df8756-l2qlh\" (UID: \"6d44e873-1123-4d5c-b2a2-6a1dba8230ab\") " pod="kuadrant-system/authorino-7498df8756-l2qlh" May 21 20:52:12.847889 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:12.847861 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldj6q\" (UniqueName: \"kubernetes.io/projected/f8232825-cfaa-4bcc-ab88-6c0b44033051-kube-api-access-ldj6q\") pod \"authorino-f99f4b5cd-xbdcr\" (UID: \"f8232825-cfaa-4bcc-ab88-6c0b44033051\") " pod="kuadrant-system/authorino-f99f4b5cd-xbdcr" May 21 20:52:12.861642 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:12.861619 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-xbdcr" May 21 20:52:12.941665 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:12.941630 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qt5kn\" (UniqueName: \"kubernetes.io/projected/6d44e873-1123-4d5c-b2a2-6a1dba8230ab-kube-api-access-qt5kn\") pod \"authorino-7498df8756-l2qlh\" (UID: \"6d44e873-1123-4d5c-b2a2-6a1dba8230ab\") " pod="kuadrant-system/authorino-7498df8756-l2qlh" May 21 20:52:12.948914 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:12.948886 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt5kn\" (UniqueName: \"kubernetes.io/projected/6d44e873-1123-4d5c-b2a2-6a1dba8230ab-kube-api-access-qt5kn\") pod \"authorino-7498df8756-l2qlh\" (UID: \"6d44e873-1123-4d5c-b2a2-6a1dba8230ab\") " pod="kuadrant-system/authorino-7498df8756-l2qlh" May 21 20:52:12.988983 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:12.988946 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-xbdcr"] May 21 20:52:12.992315 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:52:12.992283 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf8232825_cfaa_4bcc_ab88_6c0b44033051.slice/crio-ad53d22d067b8c9309aad1b12b6c730637f95ac0e347e0de53c6467ebf5338f3 WatchSource:0}: Error finding container ad53d22d067b8c9309aad1b12b6c730637f95ac0e347e0de53c6467ebf5338f3: Status 404 returned error can't find the container with id ad53d22d067b8c9309aad1b12b6c730637f95ac0e347e0de53c6467ebf5338f3 May 21 20:52:12.997864 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:12.997838 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-l2qlh" May 21 20:52:13.117113 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:13.117024 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-l2qlh"] May 21 20:52:13.119836 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:52:13.119807 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6d44e873_1123_4d5c_b2a2_6a1dba8230ab.slice/crio-4a52cf2d00d02ae2fcb60c182767a1429cef231995f7948251fe29c87c862992 WatchSource:0}: Error finding container 4a52cf2d00d02ae2fcb60c182767a1429cef231995f7948251fe29c87c862992: Status 404 returned error can't find the container with id 4a52cf2d00d02ae2fcb60c182767a1429cef231995f7948251fe29c87c862992 May 21 20:52:13.601201 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:13.601153 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-xbdcr" event={"ID":"f8232825-cfaa-4bcc-ab88-6c0b44033051","Type":"ContainerStarted","Data":"ad53d22d067b8c9309aad1b12b6c730637f95ac0e347e0de53c6467ebf5338f3"} May 21 20:52:13.602120 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:13.602100 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-l2qlh" event={"ID":"6d44e873-1123-4d5c-b2a2-6a1dba8230ab","Type":"ContainerStarted","Data":"4a52cf2d00d02ae2fcb60c182767a1429cef231995f7948251fe29c87c862992"} May 21 20:52:17.618837 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:17.618799 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-l2qlh" event={"ID":"6d44e873-1123-4d5c-b2a2-6a1dba8230ab","Type":"ContainerStarted","Data":"e72b2adca03e413d4c48b8cac00d2e00c6378b99f99af6b9c81168a1ab5aa8f9"} May 21 20:52:17.619985 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:17.619961 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-xbdcr" event={"ID":"f8232825-cfaa-4bcc-ab88-6c0b44033051","Type":"ContainerStarted","Data":"bd71b9d82ff28055cfa2ef4f7e355bb33d64b0001374b3a985d22e115710b88b"} May 21 20:52:17.632405 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:17.632352 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-l2qlh" podStartSLOduration=2.08785229 podStartE2EDuration="5.63233711s" podCreationTimestamp="2026-05-21 20:52:12 +0000 UTC" firstStartedPulling="2026-05-21 20:52:13.121229953 +0000 UTC m=+833.503410002" lastFinishedPulling="2026-05-21 20:52:16.665714764 +0000 UTC m=+837.047894822" observedRunningTime="2026-05-21 20:52:17.63109475 +0000 UTC m=+838.013274822" watchObservedRunningTime="2026-05-21 20:52:17.63233711 +0000 UTC m=+838.014517176" May 21 20:52:17.645853 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:17.645802 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-xbdcr" podStartSLOduration=1.985729989 podStartE2EDuration="5.645786258s" podCreationTimestamp="2026-05-21 20:52:12 +0000 UTC" firstStartedPulling="2026-05-21 20:52:12.993404671 +0000 UTC m=+833.375584722" lastFinishedPulling="2026-05-21 20:52:16.653460937 +0000 UTC m=+837.035640991" observedRunningTime="2026-05-21 20:52:17.644109863 +0000 UTC m=+838.026289937" watchObservedRunningTime="2026-05-21 20:52:17.645786258 +0000 UTC m=+838.027966347" May 21 20:52:17.669151 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:17.669116 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-xbdcr"] May 21 20:52:19.625675 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:19.625604 2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-xbdcr" podUID="f8232825-cfaa-4bcc-ab88-6c0b44033051" containerName="authorino" containerID="cri-o://bd71b9d82ff28055cfa2ef4f7e355bb33d64b0001374b3a985d22e115710b88b" gracePeriod=30 May 21 20:52:19.871116 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:19.871092 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-xbdcr" May 21 20:52:19.895792 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:19.895702 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ldj6q\" (UniqueName: \"kubernetes.io/projected/f8232825-cfaa-4bcc-ab88-6c0b44033051-kube-api-access-ldj6q\") pod \"f8232825-cfaa-4bcc-ab88-6c0b44033051\" (UID: \"f8232825-cfaa-4bcc-ab88-6c0b44033051\") " May 21 20:52:19.898185 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:19.898141 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8232825-cfaa-4bcc-ab88-6c0b44033051-kube-api-access-ldj6q" (OuterVolumeSpecName: "kube-api-access-ldj6q") pod "f8232825-cfaa-4bcc-ab88-6c0b44033051" (UID: "f8232825-cfaa-4bcc-ab88-6c0b44033051"). InnerVolumeSpecName "kube-api-access-ldj6q". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:52:19.996752 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:19.996712 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldj6q\" (UniqueName: \"kubernetes.io/projected/f8232825-cfaa-4bcc-ab88-6c0b44033051-kube-api-access-ldj6q\") on node \"ip-10-0-131-158.ec2.internal\" DevicePath \"\"" May 21 20:52:20.629955 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:20.629859 2570 generic.go:358] "Generic (PLEG): container finished" podID="f8232825-cfaa-4bcc-ab88-6c0b44033051" containerID="bd71b9d82ff28055cfa2ef4f7e355bb33d64b0001374b3a985d22e115710b88b" exitCode=0 May 21 20:52:20.629955 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:20.629930 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-xbdcr" May 21 20:52:20.630496 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:20.629928 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-xbdcr" event={"ID":"f8232825-cfaa-4bcc-ab88-6c0b44033051","Type":"ContainerDied","Data":"bd71b9d82ff28055cfa2ef4f7e355bb33d64b0001374b3a985d22e115710b88b"} May 21 20:52:20.630496 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:20.630042 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-xbdcr" event={"ID":"f8232825-cfaa-4bcc-ab88-6c0b44033051","Type":"ContainerDied","Data":"ad53d22d067b8c9309aad1b12b6c730637f95ac0e347e0de53c6467ebf5338f3"} May 21 20:52:20.630496 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:20.630067 2570 scope.go:117] "RemoveContainer" containerID="bd71b9d82ff28055cfa2ef4f7e355bb33d64b0001374b3a985d22e115710b88b" May 21 20:52:20.638094 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:20.638075 2570 scope.go:117] "RemoveContainer" containerID="bd71b9d82ff28055cfa2ef4f7e355bb33d64b0001374b3a985d22e115710b88b" May 21 20:52:20.638415 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:52:20.638394 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd71b9d82ff28055cfa2ef4f7e355bb33d64b0001374b3a985d22e115710b88b\": container with ID starting with bd71b9d82ff28055cfa2ef4f7e355bb33d64b0001374b3a985d22e115710b88b not found: ID does not exist" containerID="bd71b9d82ff28055cfa2ef4f7e355bb33d64b0001374b3a985d22e115710b88b" May 21 20:52:20.638498 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:20.638427 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd71b9d82ff28055cfa2ef4f7e355bb33d64b0001374b3a985d22e115710b88b"} err="failed to get container status \"bd71b9d82ff28055cfa2ef4f7e355bb33d64b0001374b3a985d22e115710b88b\": rpc error: code = NotFound desc = could not find container \"bd71b9d82ff28055cfa2ef4f7e355bb33d64b0001374b3a985d22e115710b88b\": container with ID starting with bd71b9d82ff28055cfa2ef4f7e355bb33d64b0001374b3a985d22e115710b88b not found: ID does not exist" May 21 20:52:20.642751 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:20.642276 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-xbdcr"] May 21 20:52:20.644573 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:20.644549 2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-xbdcr"] May 21 20:52:22.266112 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:22.266076 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8232825-cfaa-4bcc-ab88-6c0b44033051" path="/var/lib/kubelet/pods/f8232825-cfaa-4bcc-ab88-6c0b44033051/volumes" May 21 20:52:41.122747 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:41.122707 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-lgzk2"] May 21 20:52:41.123149 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:41.123033 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8232825-cfaa-4bcc-ab88-6c0b44033051" containerName="authorino" May 21 20:52:41.123149 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:41.123047 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8232825-cfaa-4bcc-ab88-6c0b44033051" containerName="authorino" May 21 20:52:41.123149 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:41.123119 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="f8232825-cfaa-4bcc-ab88-6c0b44033051" containerName="authorino" May 21 20:52:41.125922 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:41.125901 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-lgzk2" May 21 20:52:41.131853 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:41.131824 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-lgzk2"] May 21 20:52:41.146632 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:41.146603 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvdcr\" (UniqueName: \"kubernetes.io/projected/ea1923d8-0742-4e87-8348-432f56368cd5-kube-api-access-lvdcr\") pod \"authorino-8b475cf9f-lgzk2\" (UID: \"ea1923d8-0742-4e87-8348-432f56368cd5\") " pod="kuadrant-system/authorino-8b475cf9f-lgzk2" May 21 20:52:41.247366 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:41.247325 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lvdcr\" (UniqueName: \"kubernetes.io/projected/ea1923d8-0742-4e87-8348-432f56368cd5-kube-api-access-lvdcr\") pod \"authorino-8b475cf9f-lgzk2\" (UID: \"ea1923d8-0742-4e87-8348-432f56368cd5\") " pod="kuadrant-system/authorino-8b475cf9f-lgzk2" May 21 20:52:41.254971 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:41.254940 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvdcr\" (UniqueName: \"kubernetes.io/projected/ea1923d8-0742-4e87-8348-432f56368cd5-kube-api-access-lvdcr\") pod \"authorino-8b475cf9f-lgzk2\" (UID: \"ea1923d8-0742-4e87-8348-432f56368cd5\") " pod="kuadrant-system/authorino-8b475cf9f-lgzk2" May 21 20:52:41.347617 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:41.347575 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-lgzk2"] May 21 20:52:41.347809 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:41.347782 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-lgzk2" May 21 20:52:41.371206 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:41.371161 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-67dcd9ffc6-6x279"] May 21 20:52:41.375584 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:41.375534 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67dcd9ffc6-6x279" May 21 20:52:41.379215 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:41.379190 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-67dcd9ffc6-6x279"] May 21 20:52:41.449233 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:41.449187 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7zgm\" (UniqueName: \"kubernetes.io/projected/244f67ec-b292-4db6-82fe-14c90c916dd9-kube-api-access-k7zgm\") pod \"authorino-67dcd9ffc6-6x279\" (UID: \"244f67ec-b292-4db6-82fe-14c90c916dd9\") " pod="kuadrant-system/authorino-67dcd9ffc6-6x279" May 21 20:52:41.481061 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:41.481033 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-lgzk2"] May 21 20:52:41.483164 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:52:41.483139 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podea1923d8_0742_4e87_8348_432f56368cd5.slice/crio-60be363da39285751582a3ad506cb6c2da477638f7ba1f6f3b4e304889c16b73 WatchSource:0}: Error finding container 60be363da39285751582a3ad506cb6c2da477638f7ba1f6f3b4e304889c16b73: Status 404 returned error can't find the container with id 60be363da39285751582a3ad506cb6c2da477638f7ba1f6f3b4e304889c16b73 May 21 20:52:41.550437 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:41.550385 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k7zgm\" (UniqueName: \"kubernetes.io/projected/244f67ec-b292-4db6-82fe-14c90c916dd9-kube-api-access-k7zgm\") pod \"authorino-67dcd9ffc6-6x279\" (UID: \"244f67ec-b292-4db6-82fe-14c90c916dd9\") " pod="kuadrant-system/authorino-67dcd9ffc6-6x279" May 21 20:52:41.557281 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:41.557254 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7zgm\" (UniqueName: \"kubernetes.io/projected/244f67ec-b292-4db6-82fe-14c90c916dd9-kube-api-access-k7zgm\") pod \"authorino-67dcd9ffc6-6x279\" (UID: \"244f67ec-b292-4db6-82fe-14c90c916dd9\") " pod="kuadrant-system/authorino-67dcd9ffc6-6x279" May 21 20:52:41.587935 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:41.587902 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-67dcd9ffc6-6x279"] May 21 20:52:41.588127 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:41.588116 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67dcd9ffc6-6x279" May 21 20:52:41.611998 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:41.611965 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-569b9d6d-2pkvt"] May 21 20:52:41.616362 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:41.616337 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-569b9d6d-2pkvt" May 21 20:52:41.618097 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:41.618075 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" May 21 20:52:41.621668 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:41.621643 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-569b9d6d-2pkvt"] May 21 20:52:41.651655 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:41.651622 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/20446060-30f8-442a-add9-6b9e1e1ae24a-tls-cert\") pod \"authorino-569b9d6d-2pkvt\" (UID: \"20446060-30f8-442a-add9-6b9e1e1ae24a\") " pod="kuadrant-system/authorino-569b9d6d-2pkvt" May 21 20:52:41.651824 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:41.651799 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6kth\" (UniqueName: \"kubernetes.io/projected/20446060-30f8-442a-add9-6b9e1e1ae24a-kube-api-access-t6kth\") pod \"authorino-569b9d6d-2pkvt\" (UID: \"20446060-30f8-442a-add9-6b9e1e1ae24a\") " pod="kuadrant-system/authorino-569b9d6d-2pkvt" May 21 20:52:41.693856 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:41.693827 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-lgzk2" event={"ID":"ea1923d8-0742-4e87-8348-432f56368cd5","Type":"ContainerStarted","Data":"60be363da39285751582a3ad506cb6c2da477638f7ba1f6f3b4e304889c16b73"} May 21 20:52:41.714346 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:41.714311 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-67dcd9ffc6-6x279"] May 21 20:52:41.717045 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:52:41.717020 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod244f67ec_b292_4db6_82fe_14c90c916dd9.slice/crio-d7b8a5a488e754cd12efc0c549ac009cee90c1ad9ab034c0c8c8bfdeaee2b084 WatchSource:0}: Error finding container d7b8a5a488e754cd12efc0c549ac009cee90c1ad9ab034c0c8c8bfdeaee2b084: Status 404 returned error can't find the container with id d7b8a5a488e754cd12efc0c549ac009cee90c1ad9ab034c0c8c8bfdeaee2b084 May 21 20:52:41.752415 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:41.752381 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t6kth\" (UniqueName: \"kubernetes.io/projected/20446060-30f8-442a-add9-6b9e1e1ae24a-kube-api-access-t6kth\") pod \"authorino-569b9d6d-2pkvt\" (UID: \"20446060-30f8-442a-add9-6b9e1e1ae24a\") " pod="kuadrant-system/authorino-569b9d6d-2pkvt" May 21 20:52:41.752415 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:41.752424 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/20446060-30f8-442a-add9-6b9e1e1ae24a-tls-cert\") pod \"authorino-569b9d6d-2pkvt\" (UID: \"20446060-30f8-442a-add9-6b9e1e1ae24a\") " pod="kuadrant-system/authorino-569b9d6d-2pkvt" May 21 20:52:41.755061 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:41.755040 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/20446060-30f8-442a-add9-6b9e1e1ae24a-tls-cert\") pod \"authorino-569b9d6d-2pkvt\" (UID: \"20446060-30f8-442a-add9-6b9e1e1ae24a\") " pod="kuadrant-system/authorino-569b9d6d-2pkvt" May 21 20:52:41.760836 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:41.760815 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6kth\" (UniqueName: \"kubernetes.io/projected/20446060-30f8-442a-add9-6b9e1e1ae24a-kube-api-access-t6kth\") pod \"authorino-569b9d6d-2pkvt\" (UID: \"20446060-30f8-442a-add9-6b9e1e1ae24a\") " pod="kuadrant-system/authorino-569b9d6d-2pkvt" May 21 20:52:41.928019 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:41.927976 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-569b9d6d-2pkvt" May 21 20:52:42.057345 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:42.057278 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-569b9d6d-2pkvt"] May 21 20:52:42.059945 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:52:42.059915 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod20446060_30f8_442a_add9_6b9e1e1ae24a.slice/crio-d407696ce5b69e8aea176a4b2b0e455e079a7cc1ef8fa010a6a3c9aeedf7b9ee WatchSource:0}: Error finding container d407696ce5b69e8aea176a4b2b0e455e079a7cc1ef8fa010a6a3c9aeedf7b9ee: Status 404 returned error can't find the container with id d407696ce5b69e8aea176a4b2b0e455e079a7cc1ef8fa010a6a3c9aeedf7b9ee May 21 20:52:42.698521 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:42.698405 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-lgzk2" event={"ID":"ea1923d8-0742-4e87-8348-432f56368cd5","Type":"ContainerStarted","Data":"c1b0547d87c39f386ed1afc0abd82b3b030be3b3e58d7ca90b62dcb2e2efce59"} May 21 20:52:42.698521 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:42.698503 2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-8b475cf9f-lgzk2" podUID="ea1923d8-0742-4e87-8348-432f56368cd5" containerName="authorino" containerID="cri-o://c1b0547d87c39f386ed1afc0abd82b3b030be3b3e58d7ca90b62dcb2e2efce59" gracePeriod=30 May 21 20:52:42.699868 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:42.699839 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67dcd9ffc6-6x279" event={"ID":"244f67ec-b292-4db6-82fe-14c90c916dd9","Type":"ContainerStarted","Data":"72b8e30f0cd6a45c56589fbe88aae8b32c3d89778d7bb7374c0439d6dd5daaac"} May 21 20:52:42.699984 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:42.699882 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67dcd9ffc6-6x279" event={"ID":"244f67ec-b292-4db6-82fe-14c90c916dd9","Type":"ContainerStarted","Data":"d7b8a5a488e754cd12efc0c549ac009cee90c1ad9ab034c0c8c8bfdeaee2b084"} May 21 20:52:42.699984 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:42.699845 2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-67dcd9ffc6-6x279" podUID="244f67ec-b292-4db6-82fe-14c90c916dd9" containerName="authorino" containerID="cri-o://72b8e30f0cd6a45c56589fbe88aae8b32c3d89778d7bb7374c0439d6dd5daaac" gracePeriod=30 May 21 20:52:42.701275 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:42.701239 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-569b9d6d-2pkvt" event={"ID":"20446060-30f8-442a-add9-6b9e1e1ae24a","Type":"ContainerStarted","Data":"8f733f478073050efec3e3376066736ef3172eb620c2db2c23ef63f8c4d7e796"} May 21 20:52:42.701275 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:42.701273 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-569b9d6d-2pkvt" event={"ID":"20446060-30f8-442a-add9-6b9e1e1ae24a","Type":"ContainerStarted","Data":"d407696ce5b69e8aea176a4b2b0e455e079a7cc1ef8fa010a6a3c9aeedf7b9ee"} May 21 20:52:42.712594 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:42.712541 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-8b475cf9f-lgzk2" podStartSLOduration=1.345585815 podStartE2EDuration="1.712523526s" podCreationTimestamp="2026-05-21 20:52:41 +0000 UTC" firstStartedPulling="2026-05-21 20:52:41.484404915 +0000 UTC m=+861.866584965" lastFinishedPulling="2026-05-21 20:52:41.851342607 +0000 UTC m=+862.233522676" observedRunningTime="2026-05-21 20:52:42.710642255 +0000 UTC m=+863.092822327" watchObservedRunningTime="2026-05-21 20:52:42.712523526 +0000 UTC m=+863.094703600" May 21 20:52:42.723580 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:42.723529 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-67dcd9ffc6-6x279" podStartSLOduration=1.381306094 podStartE2EDuration="1.723513065s" podCreationTimestamp="2026-05-21 20:52:41 +0000 UTC" firstStartedPulling="2026-05-21 20:52:41.718217721 +0000 UTC m=+862.100397770" lastFinishedPulling="2026-05-21 20:52:42.060424691 +0000 UTC m=+862.442604741" observedRunningTime="2026-05-21 20:52:42.72311679 +0000 UTC m=+863.105296863" watchObservedRunningTime="2026-05-21 20:52:42.723513065 +0000 UTC m=+863.105693137" May 21 20:52:42.735543 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:42.735483 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-569b9d6d-2pkvt" podStartSLOduration=1.424946019 podStartE2EDuration="1.735444443s" podCreationTimestamp="2026-05-21 20:52:41 +0000 UTC" firstStartedPulling="2026-05-21 20:52:42.061275982 +0000 UTC m=+862.443456035" lastFinishedPulling="2026-05-21 20:52:42.371774408 +0000 UTC m=+862.753954459" observedRunningTime="2026-05-21 20:52:42.734929934 +0000 UTC m=+863.117110006" watchObservedRunningTime="2026-05-21 20:52:42.735444443 +0000 UTC m=+863.117624515" May 21 20:52:42.757071 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:42.757037 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-l2qlh"] May 21 20:52:42.757325 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:42.757292 2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-l2qlh" podUID="6d44e873-1123-4d5c-b2a2-6a1dba8230ab" containerName="authorino" containerID="cri-o://e72b2adca03e413d4c48b8cac00d2e00c6378b99f99af6b9c81168a1ab5aa8f9" gracePeriod=30 May 21 20:52:42.986542 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:42.986421 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-lgzk2" May 21 20:52:43.033556 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:43.033531 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67dcd9ffc6-6x279" May 21 20:52:43.041700 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:43.041680 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-l2qlh" May 21 20:52:43.063378 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:43.063341 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qt5kn\" (UniqueName: \"kubernetes.io/projected/6d44e873-1123-4d5c-b2a2-6a1dba8230ab-kube-api-access-qt5kn\") pod \"6d44e873-1123-4d5c-b2a2-6a1dba8230ab\" (UID: \"6d44e873-1123-4d5c-b2a2-6a1dba8230ab\") " May 21 20:52:43.063574 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:43.063384 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvdcr\" (UniqueName: \"kubernetes.io/projected/ea1923d8-0742-4e87-8348-432f56368cd5-kube-api-access-lvdcr\") pod \"ea1923d8-0742-4e87-8348-432f56368cd5\" (UID: \"ea1923d8-0742-4e87-8348-432f56368cd5\") " May 21 20:52:43.063574 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:43.063428 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k7zgm\" (UniqueName: \"kubernetes.io/projected/244f67ec-b292-4db6-82fe-14c90c916dd9-kube-api-access-k7zgm\") pod \"244f67ec-b292-4db6-82fe-14c90c916dd9\" (UID: \"244f67ec-b292-4db6-82fe-14c90c916dd9\") " May 21 20:52:43.066121 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:43.066082 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d44e873-1123-4d5c-b2a2-6a1dba8230ab-kube-api-access-qt5kn" (OuterVolumeSpecName: "kube-api-access-qt5kn") pod "6d44e873-1123-4d5c-b2a2-6a1dba8230ab" (UID: "6d44e873-1123-4d5c-b2a2-6a1dba8230ab"). InnerVolumeSpecName "kube-api-access-qt5kn". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:52:43.066623 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:43.066590 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/244f67ec-b292-4db6-82fe-14c90c916dd9-kube-api-access-k7zgm" (OuterVolumeSpecName: "kube-api-access-k7zgm") pod "244f67ec-b292-4db6-82fe-14c90c916dd9" (UID: "244f67ec-b292-4db6-82fe-14c90c916dd9"). InnerVolumeSpecName "kube-api-access-k7zgm". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:52:43.066806 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:43.066788 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea1923d8-0742-4e87-8348-432f56368cd5-kube-api-access-lvdcr" (OuterVolumeSpecName: "kube-api-access-lvdcr") pod "ea1923d8-0742-4e87-8348-432f56368cd5" (UID: "ea1923d8-0742-4e87-8348-432f56368cd5"). InnerVolumeSpecName "kube-api-access-lvdcr". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:52:43.165017 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:43.164981 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qt5kn\" (UniqueName: \"kubernetes.io/projected/6d44e873-1123-4d5c-b2a2-6a1dba8230ab-kube-api-access-qt5kn\") on node \"ip-10-0-131-158.ec2.internal\" DevicePath \"\"" May 21 20:52:43.165017 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:43.165011 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvdcr\" (UniqueName: \"kubernetes.io/projected/ea1923d8-0742-4e87-8348-432f56368cd5-kube-api-access-lvdcr\") on node \"ip-10-0-131-158.ec2.internal\" DevicePath \"\"" May 21 20:52:43.165017 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:43.165021 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7zgm\" (UniqueName: \"kubernetes.io/projected/244f67ec-b292-4db6-82fe-14c90c916dd9-kube-api-access-k7zgm\") on node \"ip-10-0-131-158.ec2.internal\" DevicePath \"\"" May 21 20:52:43.704810 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:43.704772 2570 generic.go:358] "Generic (PLEG): container finished" podID="ea1923d8-0742-4e87-8348-432f56368cd5" containerID="c1b0547d87c39f386ed1afc0abd82b3b030be3b3e58d7ca90b62dcb2e2efce59" exitCode=0 May 21 20:52:43.705262 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:43.704847 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-lgzk2" May 21 20:52:43.705262 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:43.704856 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-lgzk2" event={"ID":"ea1923d8-0742-4e87-8348-432f56368cd5","Type":"ContainerDied","Data":"c1b0547d87c39f386ed1afc0abd82b3b030be3b3e58d7ca90b62dcb2e2efce59"} May 21 20:52:43.705262 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:43.704900 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-lgzk2" event={"ID":"ea1923d8-0742-4e87-8348-432f56368cd5","Type":"ContainerDied","Data":"60be363da39285751582a3ad506cb6c2da477638f7ba1f6f3b4e304889c16b73"} May 21 20:52:43.705262 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:43.704916 2570 scope.go:117] "RemoveContainer" containerID="c1b0547d87c39f386ed1afc0abd82b3b030be3b3e58d7ca90b62dcb2e2efce59" May 21 20:52:43.706079 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:43.705983 2570 generic.go:358] "Generic (PLEG): container finished" podID="244f67ec-b292-4db6-82fe-14c90c916dd9" containerID="72b8e30f0cd6a45c56589fbe88aae8b32c3d89778d7bb7374c0439d6dd5daaac" exitCode=0 May 21 20:52:43.706079 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:43.706046 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67dcd9ffc6-6x279" May 21 20:52:43.706198 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:43.706075 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67dcd9ffc6-6x279" event={"ID":"244f67ec-b292-4db6-82fe-14c90c916dd9","Type":"ContainerDied","Data":"72b8e30f0cd6a45c56589fbe88aae8b32c3d89778d7bb7374c0439d6dd5daaac"} May 21 20:52:43.706198 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:43.706110 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67dcd9ffc6-6x279" event={"ID":"244f67ec-b292-4db6-82fe-14c90c916dd9","Type":"ContainerDied","Data":"d7b8a5a488e754cd12efc0c549ac009cee90c1ad9ab034c0c8c8bfdeaee2b084"} May 21 20:52:43.707271 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:43.707246 2570 generic.go:358] "Generic (PLEG): container finished" podID="6d44e873-1123-4d5c-b2a2-6a1dba8230ab" containerID="e72b2adca03e413d4c48b8cac00d2e00c6378b99f99af6b9c81168a1ab5aa8f9" exitCode=0 May 21 20:52:43.707390 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:43.707347 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-l2qlh" May 21 20:52:43.707497 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:43.707353 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-l2qlh" event={"ID":"6d44e873-1123-4d5c-b2a2-6a1dba8230ab","Type":"ContainerDied","Data":"e72b2adca03e413d4c48b8cac00d2e00c6378b99f99af6b9c81168a1ab5aa8f9"} May 21 20:52:43.707553 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:43.707529 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-l2qlh" event={"ID":"6d44e873-1123-4d5c-b2a2-6a1dba8230ab","Type":"ContainerDied","Data":"4a52cf2d00d02ae2fcb60c182767a1429cef231995f7948251fe29c87c862992"} May 21 20:52:43.714058 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:43.714031 2570 scope.go:117] "RemoveContainer" containerID="c1b0547d87c39f386ed1afc0abd82b3b030be3b3e58d7ca90b62dcb2e2efce59" May 21 20:52:43.714409 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:52:43.714382 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1b0547d87c39f386ed1afc0abd82b3b030be3b3e58d7ca90b62dcb2e2efce59\": container with ID starting with c1b0547d87c39f386ed1afc0abd82b3b030be3b3e58d7ca90b62dcb2e2efce59 not found: ID does not exist" containerID="c1b0547d87c39f386ed1afc0abd82b3b030be3b3e58d7ca90b62dcb2e2efce59" May 21 20:52:43.714534 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:43.714424 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1b0547d87c39f386ed1afc0abd82b3b030be3b3e58d7ca90b62dcb2e2efce59"} err="failed to get container status \"c1b0547d87c39f386ed1afc0abd82b3b030be3b3e58d7ca90b62dcb2e2efce59\": rpc error: code = NotFound desc = could not find container \"c1b0547d87c39f386ed1afc0abd82b3b030be3b3e58d7ca90b62dcb2e2efce59\": container with ID starting with c1b0547d87c39f386ed1afc0abd82b3b030be3b3e58d7ca90b62dcb2e2efce59 not found: ID does not exist" May 21 20:52:43.714534 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:43.714447 2570 scope.go:117] "RemoveContainer" containerID="72b8e30f0cd6a45c56589fbe88aae8b32c3d89778d7bb7374c0439d6dd5daaac" May 21 20:52:43.723028 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:43.723009 2570 scope.go:117] "RemoveContainer" containerID="72b8e30f0cd6a45c56589fbe88aae8b32c3d89778d7bb7374c0439d6dd5daaac" May 21 20:52:43.723305 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:52:43.723288 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72b8e30f0cd6a45c56589fbe88aae8b32c3d89778d7bb7374c0439d6dd5daaac\": container with ID starting with 72b8e30f0cd6a45c56589fbe88aae8b32c3d89778d7bb7374c0439d6dd5daaac not found: ID does not exist" containerID="72b8e30f0cd6a45c56589fbe88aae8b32c3d89778d7bb7374c0439d6dd5daaac" May 21 20:52:43.723345 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:43.723312 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72b8e30f0cd6a45c56589fbe88aae8b32c3d89778d7bb7374c0439d6dd5daaac"} err="failed to get container status \"72b8e30f0cd6a45c56589fbe88aae8b32c3d89778d7bb7374c0439d6dd5daaac\": rpc error: code = NotFound desc = could not find container \"72b8e30f0cd6a45c56589fbe88aae8b32c3d89778d7bb7374c0439d6dd5daaac\": container with ID starting with 72b8e30f0cd6a45c56589fbe88aae8b32c3d89778d7bb7374c0439d6dd5daaac not found: ID does not exist" May 21 20:52:43.723345 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:43.723330 2570 scope.go:117] "RemoveContainer" containerID="e72b2adca03e413d4c48b8cac00d2e00c6378b99f99af6b9c81168a1ab5aa8f9" May 21 20:52:43.728302 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:43.728280 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-lgzk2"] May 21 20:52:43.730870 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:43.730836 2570 scope.go:117] "RemoveContainer" containerID="e72b2adca03e413d4c48b8cac00d2e00c6378b99f99af6b9c81168a1ab5aa8f9" May 21 20:52:43.731194 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:52:43.731158 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e72b2adca03e413d4c48b8cac00d2e00c6378b99f99af6b9c81168a1ab5aa8f9\": container with ID starting with e72b2adca03e413d4c48b8cac00d2e00c6378b99f99af6b9c81168a1ab5aa8f9 not found: ID does not exist" containerID="e72b2adca03e413d4c48b8cac00d2e00c6378b99f99af6b9c81168a1ab5aa8f9" May 21 20:52:43.731270 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:43.731194 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e72b2adca03e413d4c48b8cac00d2e00c6378b99f99af6b9c81168a1ab5aa8f9"} err="failed to get container status \"e72b2adca03e413d4c48b8cac00d2e00c6378b99f99af6b9c81168a1ab5aa8f9\": rpc error: code = NotFound desc = could not find container \"e72b2adca03e413d4c48b8cac00d2e00c6378b99f99af6b9c81168a1ab5aa8f9\": container with ID starting with e72b2adca03e413d4c48b8cac00d2e00c6378b99f99af6b9c81168a1ab5aa8f9 not found: ID does not exist" May 21 20:52:43.732286 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:43.732268 2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-lgzk2"] May 21 20:52:43.740300 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:43.740276 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-67dcd9ffc6-6x279"] May 21 20:52:43.742820 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:43.742802 2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-67dcd9ffc6-6x279"] May 21 20:52:43.750573 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:43.750546 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-l2qlh"] May 21 20:52:43.754203 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:43.754186 2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-l2qlh"] May 21 20:52:44.266487 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:44.266446 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="244f67ec-b292-4db6-82fe-14c90c916dd9" path="/var/lib/kubelet/pods/244f67ec-b292-4db6-82fe-14c90c916dd9/volumes" May 21 20:52:44.266779 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:44.266765 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d44e873-1123-4d5c-b2a2-6a1dba8230ab" path="/var/lib/kubelet/pods/6d44e873-1123-4d5c-b2a2-6a1dba8230ab/volumes" May 21 20:52:44.267030 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:52:44.267020 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea1923d8-0742-4e87-8348-432f56368cd5" path="/var/lib/kubelet/pods/ea1923d8-0742-4e87-8348-432f56368cd5/volumes" May 21 20:53:20.209317 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:53:20.209229 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7krlb_d8463ad6-6f3b-4984-ab32-781d1507d42d/ovn-acl-logging/0.log" May 21 20:53:20.212294 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:53:20.212275 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7krlb_d8463ad6-6f3b-4984-ab32-781d1507d42d/ovn-acl-logging/0.log" May 21 20:53:51.520277 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:53:51.520240 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-l8rp4"] May 21 20:53:51.520757 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:53:51.520525 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea1923d8-0742-4e87-8348-432f56368cd5" containerName="authorino" May 21 20:53:51.520757 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:53:51.520538 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea1923d8-0742-4e87-8348-432f56368cd5" containerName="authorino" May 21 20:53:51.520757 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:53:51.520556 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d44e873-1123-4d5c-b2a2-6a1dba8230ab" containerName="authorino" May 21 20:53:51.520757 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:53:51.520562 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d44e873-1123-4d5c-b2a2-6a1dba8230ab" containerName="authorino" May 21 20:53:51.520757 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:53:51.520568 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="244f67ec-b292-4db6-82fe-14c90c916dd9" containerName="authorino" May 21 20:53:51.520757 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:53:51.520573 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="244f67ec-b292-4db6-82fe-14c90c916dd9" containerName="authorino" May 21 20:53:51.520757 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:53:51.520624 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="ea1923d8-0742-4e87-8348-432f56368cd5" containerName="authorino" May 21 20:53:51.520757 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:53:51.520632 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="244f67ec-b292-4db6-82fe-14c90c916dd9" containerName="authorino" May 21 20:53:51.520757 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:53:51.520639 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="6d44e873-1123-4d5c-b2a2-6a1dba8230ab" containerName="authorino" May 21 20:53:51.523709 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:53:51.523690 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-l8rp4" May 21 20:53:51.525944 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:53:51.525913 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" May 21 20:53:51.526075 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:53:51.525993 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 21 20:53:51.526075 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:53:51.526008 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 21 20:53:51.526075 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:53:51.525995 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-7vwml\"" May 21 20:53:51.530336 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:53:51.530313 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-l8rp4"] May 21 20:53:51.618888 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:53:51.618853 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/650f9acb-1298-4798-b44d-d488de2c6e8c-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-l8rp4\" (UID: \"650f9acb-1298-4798-b44d-d488de2c6e8c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-l8rp4" May 21 20:53:51.619059 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:53:51.618893 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/650f9acb-1298-4798-b44d-d488de2c6e8c-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-l8rp4\" (UID: \"650f9acb-1298-4798-b44d-d488de2c6e8c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-l8rp4" May 21 20:53:51.619059 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:53:51.618951 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/650f9acb-1298-4798-b44d-d488de2c6e8c-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-l8rp4\" (UID: \"650f9acb-1298-4798-b44d-d488de2c6e8c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-l8rp4" May 21 20:53:51.619059 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:53:51.619010 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/650f9acb-1298-4798-b44d-d488de2c6e8c-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-l8rp4\" (UID: \"650f9acb-1298-4798-b44d-d488de2c6e8c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-l8rp4" May 21 20:53:51.619187 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:53:51.619080 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jr4s\" (UniqueName: \"kubernetes.io/projected/650f9acb-1298-4798-b44d-d488de2c6e8c-kube-api-access-7jr4s\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-l8rp4\" (UID: \"650f9acb-1298-4798-b44d-d488de2c6e8c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-l8rp4" May 21 20:53:51.619187 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:53:51.619109 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/650f9acb-1298-4798-b44d-d488de2c6e8c-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-l8rp4\" (UID: \"650f9acb-1298-4798-b44d-d488de2c6e8c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-l8rp4" May 21 20:53:51.719841 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:53:51.719798 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/650f9acb-1298-4798-b44d-d488de2c6e8c-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-l8rp4\" (UID: \"650f9acb-1298-4798-b44d-d488de2c6e8c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-l8rp4" May 21 20:53:51.719841 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:53:51.719843 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/650f9acb-1298-4798-b44d-d488de2c6e8c-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-l8rp4\" (UID: \"650f9acb-1298-4798-b44d-d488de2c6e8c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-l8rp4" May 21 20:53:51.720079 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:53:51.719859 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/650f9acb-1298-4798-b44d-d488de2c6e8c-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-l8rp4\" (UID: \"650f9acb-1298-4798-b44d-d488de2c6e8c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-l8rp4" May 21 20:53:51.720079 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:53:51.719897 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/650f9acb-1298-4798-b44d-d488de2c6e8c-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-l8rp4\" (UID: \"650f9acb-1298-4798-b44d-d488de2c6e8c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-l8rp4" May 21 20:53:51.720079 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:53:51.719939 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7jr4s\" (UniqueName: \"kubernetes.io/projected/650f9acb-1298-4798-b44d-d488de2c6e8c-kube-api-access-7jr4s\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-l8rp4\" (UID: \"650f9acb-1298-4798-b44d-d488de2c6e8c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-l8rp4" May 21 20:53:51.720079 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:53:51.719967 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/650f9acb-1298-4798-b44d-d488de2c6e8c-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-l8rp4\" (UID: \"650f9acb-1298-4798-b44d-d488de2c6e8c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-l8rp4" May 21 20:53:51.720338 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:53:51.720307 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/650f9acb-1298-4798-b44d-d488de2c6e8c-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-l8rp4\" (UID: \"650f9acb-1298-4798-b44d-d488de2c6e8c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-l8rp4" May 21 20:53:51.720457 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:53:51.720317 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/650f9acb-1298-4798-b44d-d488de2c6e8c-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-l8rp4\" (UID: \"650f9acb-1298-4798-b44d-d488de2c6e8c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-l8rp4" May 21 20:53:51.720457 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:53:51.720402 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/650f9acb-1298-4798-b44d-d488de2c6e8c-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-l8rp4\" (UID: \"650f9acb-1298-4798-b44d-d488de2c6e8c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-l8rp4" May 21 20:53:51.722175 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:53:51.722148 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/650f9acb-1298-4798-b44d-d488de2c6e8c-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-l8rp4\" (UID: \"650f9acb-1298-4798-b44d-d488de2c6e8c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-l8rp4" May 21 20:53:51.722561 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:53:51.722540 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/650f9acb-1298-4798-b44d-d488de2c6e8c-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-l8rp4\" (UID: \"650f9acb-1298-4798-b44d-d488de2c6e8c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-l8rp4" May 21 20:53:51.729154 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:53:51.729132 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jr4s\" (UniqueName: \"kubernetes.io/projected/650f9acb-1298-4798-b44d-d488de2c6e8c-kube-api-access-7jr4s\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-l8rp4\" (UID: \"650f9acb-1298-4798-b44d-d488de2c6e8c\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-l8rp4" May 21 20:53:51.834420 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:53:51.834324 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-l8rp4" May 21 20:53:51.965304 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:53:51.965262 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-l8rp4"] May 21 20:53:51.968010 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:53:51.967982 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod650f9acb_1298_4798_b44d_d488de2c6e8c.slice/crio-31852cf52d494acfe30d16846ed98766dbfa30b404b124d087a62ea339f64f18 WatchSource:0}: Error finding container 31852cf52d494acfe30d16846ed98766dbfa30b404b124d087a62ea339f64f18: Status 404 returned error can't find the container with id 31852cf52d494acfe30d16846ed98766dbfa30b404b124d087a62ea339f64f18 May 21 20:53:52.913751 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:53:52.913661 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-l8rp4" event={"ID":"650f9acb-1298-4798-b44d-d488de2c6e8c","Type":"ContainerStarted","Data":"31852cf52d494acfe30d16846ed98766dbfa30b404b124d087a62ea339f64f18"} May 21 20:53:57.933461 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:53:57.933422 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-l8rp4" event={"ID":"650f9acb-1298-4798-b44d-d488de2c6e8c","Type":"ContainerStarted","Data":"f55db9aaa4d1468fbe3f1a7588e70ae7d428891ee7d2393436359da7b7c7a941"} May 21 20:54:03.953644 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:03.953601 2570 generic.go:358] "Generic (PLEG): container finished" podID="650f9acb-1298-4798-b44d-d488de2c6e8c" containerID="f55db9aaa4d1468fbe3f1a7588e70ae7d428891ee7d2393436359da7b7c7a941" exitCode=0 May 21 20:54:03.954017 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:03.953676 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-l8rp4" event={"ID":"650f9acb-1298-4798-b44d-d488de2c6e8c","Type":"ContainerDied","Data":"f55db9aaa4d1468fbe3f1a7588e70ae7d428891ee7d2393436359da7b7c7a941"} May 21 20:54:05.962081 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:05.962048 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-l8rp4" event={"ID":"650f9acb-1298-4798-b44d-d488de2c6e8c","Type":"ContainerStarted","Data":"785b46e066fe137798c2a30eebb9550df299e6f0d3fefcb742f8a700520833a4"} May 21 20:54:05.962518 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:05.962283 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-l8rp4" May 21 20:54:05.978521 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:05.978438 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-l8rp4" podStartSLOduration=1.855507743 podStartE2EDuration="14.97842445s" podCreationTimestamp="2026-05-21 20:53:51 +0000 UTC" firstStartedPulling="2026-05-21 20:53:51.970178182 +0000 UTC m=+932.352358235" lastFinishedPulling="2026-05-21 20:54:05.093094892 +0000 UTC m=+945.475274942" observedRunningTime="2026-05-21 20:54:05.977297816 +0000 UTC m=+946.359477903" watchObservedRunningTime="2026-05-21 20:54:05.97842445 +0000 UTC m=+946.360604521" May 21 20:54:16.979389 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:16.979359 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-l8rp4" May 21 20:54:30.819542 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:30.819503 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-dtp7s"] May 21 20:54:30.849680 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:30.849640 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-dtp7s"] May 21 20:54:30.849845 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:30.849792 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dtp7s" May 21 20:54:30.851839 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:30.851821 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" May 21 20:54:30.966990 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:30.966945 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/212ee4f9-1a84-4b61-86c7-54e0df0f41a0-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dtp7s\" (UID: \"212ee4f9-1a84-4b61-86c7-54e0df0f41a0\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dtp7s" May 21 20:54:30.966990 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:30.966997 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/212ee4f9-1a84-4b61-86c7-54e0df0f41a0-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dtp7s\" (UID: \"212ee4f9-1a84-4b61-86c7-54e0df0f41a0\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dtp7s" May 21 20:54:30.967212 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:30.967042 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/212ee4f9-1a84-4b61-86c7-54e0df0f41a0-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dtp7s\" (UID: \"212ee4f9-1a84-4b61-86c7-54e0df0f41a0\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dtp7s" May 21 20:54:30.967212 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:30.967067 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/212ee4f9-1a84-4b61-86c7-54e0df0f41a0-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dtp7s\" (UID: \"212ee4f9-1a84-4b61-86c7-54e0df0f41a0\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dtp7s" May 21 20:54:30.967212 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:30.967137 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/212ee4f9-1a84-4b61-86c7-54e0df0f41a0-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dtp7s\" (UID: \"212ee4f9-1a84-4b61-86c7-54e0df0f41a0\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dtp7s" May 21 20:54:30.967212 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:30.967189 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhb6g\" (UniqueName: \"kubernetes.io/projected/212ee4f9-1a84-4b61-86c7-54e0df0f41a0-kube-api-access-lhb6g\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dtp7s\" (UID: \"212ee4f9-1a84-4b61-86c7-54e0df0f41a0\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dtp7s" May 21 20:54:31.067774 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:31.067719 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/212ee4f9-1a84-4b61-86c7-54e0df0f41a0-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dtp7s\" (UID: \"212ee4f9-1a84-4b61-86c7-54e0df0f41a0\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dtp7s" May 21 20:54:31.067984 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:31.067794 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lhb6g\" (UniqueName: \"kubernetes.io/projected/212ee4f9-1a84-4b61-86c7-54e0df0f41a0-kube-api-access-lhb6g\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dtp7s\" (UID: \"212ee4f9-1a84-4b61-86c7-54e0df0f41a0\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dtp7s" May 21 20:54:31.067984 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:31.067843 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/212ee4f9-1a84-4b61-86c7-54e0df0f41a0-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dtp7s\" (UID: \"212ee4f9-1a84-4b61-86c7-54e0df0f41a0\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dtp7s" May 21 20:54:31.067984 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:31.067881 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/212ee4f9-1a84-4b61-86c7-54e0df0f41a0-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dtp7s\" (UID: \"212ee4f9-1a84-4b61-86c7-54e0df0f41a0\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dtp7s" May 21 20:54:31.067984 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:31.067918 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/212ee4f9-1a84-4b61-86c7-54e0df0f41a0-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dtp7s\" (UID: \"212ee4f9-1a84-4b61-86c7-54e0df0f41a0\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dtp7s" May 21 20:54:31.067984 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:31.067950 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/212ee4f9-1a84-4b61-86c7-54e0df0f41a0-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dtp7s\" (UID: \"212ee4f9-1a84-4b61-86c7-54e0df0f41a0\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dtp7s" May 21 20:54:31.068283 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:31.068256 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/212ee4f9-1a84-4b61-86c7-54e0df0f41a0-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dtp7s\" (UID: \"212ee4f9-1a84-4b61-86c7-54e0df0f41a0\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dtp7s" May 21 20:54:31.068283 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:31.068270 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/212ee4f9-1a84-4b61-86c7-54e0df0f41a0-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dtp7s\" (UID: \"212ee4f9-1a84-4b61-86c7-54e0df0f41a0\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dtp7s" May 21 20:54:31.068389 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:31.068319 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/212ee4f9-1a84-4b61-86c7-54e0df0f41a0-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dtp7s\" (UID: \"212ee4f9-1a84-4b61-86c7-54e0df0f41a0\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dtp7s" May 21 20:54:31.070175 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:31.070116 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/212ee4f9-1a84-4b61-86c7-54e0df0f41a0-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dtp7s\" (UID: \"212ee4f9-1a84-4b61-86c7-54e0df0f41a0\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dtp7s" May 21 20:54:31.070548 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:31.070528 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/212ee4f9-1a84-4b61-86c7-54e0df0f41a0-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dtp7s\" (UID: \"212ee4f9-1a84-4b61-86c7-54e0df0f41a0\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dtp7s" May 21 20:54:31.078598 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:31.078571 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhb6g\" (UniqueName: \"kubernetes.io/projected/212ee4f9-1a84-4b61-86c7-54e0df0f41a0-kube-api-access-lhb6g\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-dtp7s\" (UID: \"212ee4f9-1a84-4b61-86c7-54e0df0f41a0\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dtp7s" May 21 20:54:31.159456 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:31.159408 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dtp7s" May 21 20:54:31.290422 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:31.290392 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-dtp7s"] May 21 20:54:31.293084 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:54:31.293051 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod212ee4f9_1a84_4b61_86c7_54e0df0f41a0.slice/crio-abe454ff9ec8eb14fde73b6a27622c5b486592150a6b624ee63c27d67f44cd51 WatchSource:0}: Error finding container abe454ff9ec8eb14fde73b6a27622c5b486592150a6b624ee63c27d67f44cd51: Status 404 returned error can't find the container with id abe454ff9ec8eb14fde73b6a27622c5b486592150a6b624ee63c27d67f44cd51 May 21 20:54:31.294715 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:31.294697 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 20:54:32.043573 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:32.043533 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dtp7s" event={"ID":"212ee4f9-1a84-4b61-86c7-54e0df0f41a0","Type":"ContainerStarted","Data":"39894b9995951ec9c1583ed968697c6bf1dc7888f3274226926f8b4eb5102e32"} May 21 20:54:32.043986 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:32.043581 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dtp7s" event={"ID":"212ee4f9-1a84-4b61-86c7-54e0df0f41a0","Type":"ContainerStarted","Data":"abe454ff9ec8eb14fde73b6a27622c5b486592150a6b624ee63c27d67f44cd51"} May 21 20:54:33.816827 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:33.816787 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqzwwr"] May 21 20:54:33.820914 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:33.820891 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqzwwr" May 21 20:54:33.823096 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:33.823064 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" May 21 20:54:33.831948 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:33.831921 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqzwwr"] May 21 20:54:33.892921 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:33.892884 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8263ace6-0f7c-4192-be54-301485e02d64-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqzwwr\" (UID: \"8263ace6-0f7c-4192-be54-301485e02d64\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqzwwr" May 21 20:54:33.893084 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:33.892940 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8263ace6-0f7c-4192-be54-301485e02d64-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqzwwr\" (UID: \"8263ace6-0f7c-4192-be54-301485e02d64\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqzwwr" May 21 20:54:33.893084 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:33.892986 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jx8mc\" (UniqueName: \"kubernetes.io/projected/8263ace6-0f7c-4192-be54-301485e02d64-kube-api-access-jx8mc\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqzwwr\" (UID: \"8263ace6-0f7c-4192-be54-301485e02d64\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqzwwr" May 21 20:54:33.893084 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:33.893026 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8263ace6-0f7c-4192-be54-301485e02d64-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqzwwr\" (UID: \"8263ace6-0f7c-4192-be54-301485e02d64\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqzwwr" May 21 20:54:33.893264 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:33.893179 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8263ace6-0f7c-4192-be54-301485e02d64-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqzwwr\" (UID: \"8263ace6-0f7c-4192-be54-301485e02d64\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqzwwr" May 21 20:54:33.893264 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:33.893213 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8263ace6-0f7c-4192-be54-301485e02d64-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqzwwr\" (UID: \"8263ace6-0f7c-4192-be54-301485e02d64\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqzwwr" May 21 20:54:33.994510 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:33.994448 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8263ace6-0f7c-4192-be54-301485e02d64-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqzwwr\" (UID: \"8263ace6-0f7c-4192-be54-301485e02d64\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqzwwr" May 21 20:54:33.994510 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:33.994513 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8263ace6-0f7c-4192-be54-301485e02d64-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqzwwr\" (UID: \"8263ace6-0f7c-4192-be54-301485e02d64\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqzwwr" May 21 20:54:33.994758 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:33.994535 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8263ace6-0f7c-4192-be54-301485e02d64-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqzwwr\" (UID: \"8263ace6-0f7c-4192-be54-301485e02d64\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqzwwr" May 21 20:54:33.994758 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:33.994554 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8263ace6-0f7c-4192-be54-301485e02d64-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqzwwr\" (UID: \"8263ace6-0f7c-4192-be54-301485e02d64\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqzwwr" May 21 20:54:33.994758 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:33.994582 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jx8mc\" (UniqueName: \"kubernetes.io/projected/8263ace6-0f7c-4192-be54-301485e02d64-kube-api-access-jx8mc\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqzwwr\" (UID: \"8263ace6-0f7c-4192-be54-301485e02d64\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqzwwr" May 21 20:54:33.994758 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:33.994605 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8263ace6-0f7c-4192-be54-301485e02d64-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqzwwr\" (UID: \"8263ace6-0f7c-4192-be54-301485e02d64\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqzwwr" May 21 20:54:33.994997 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:33.994973 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8263ace6-0f7c-4192-be54-301485e02d64-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqzwwr\" (UID: \"8263ace6-0f7c-4192-be54-301485e02d64\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqzwwr" May 21 20:54:33.995081 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:33.995053 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8263ace6-0f7c-4192-be54-301485e02d64-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqzwwr\" (UID: \"8263ace6-0f7c-4192-be54-301485e02d64\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqzwwr" May 21 20:54:33.995137 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:33.995092 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8263ace6-0f7c-4192-be54-301485e02d64-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqzwwr\" (UID: \"8263ace6-0f7c-4192-be54-301485e02d64\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqzwwr" May 21 20:54:33.996927 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:33.996903 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8263ace6-0f7c-4192-be54-301485e02d64-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqzwwr\" (UID: \"8263ace6-0f7c-4192-be54-301485e02d64\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqzwwr" May 21 20:54:33.997144 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:33.997128 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8263ace6-0f7c-4192-be54-301485e02d64-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqzwwr\" (UID: \"8263ace6-0f7c-4192-be54-301485e02d64\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqzwwr" May 21 20:54:34.002125 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:34.002101 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx8mc\" (UniqueName: \"kubernetes.io/projected/8263ace6-0f7c-4192-be54-301485e02d64-kube-api-access-jx8mc\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqzwwr\" (UID: \"8263ace6-0f7c-4192-be54-301485e02d64\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqzwwr" May 21 20:54:34.132906 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:34.132821 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqzwwr" May 21 20:54:34.276526 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:34.276499 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqzwwr"] May 21 20:54:34.279560 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:54:34.279524 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8263ace6_0f7c_4192_be54_301485e02d64.slice/crio-bf4c09c1cb224dfa6ec11bdc4622bde193c557b853f16e91f48c80c3adb3e491 WatchSource:0}: Error finding container bf4c09c1cb224dfa6ec11bdc4622bde193c557b853f16e91f48c80c3adb3e491: Status 404 returned error can't find the container with id bf4c09c1cb224dfa6ec11bdc4622bde193c557b853f16e91f48c80c3adb3e491 May 21 20:54:34.609998 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:34.609950 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xb928"] May 21 20:54:34.613236 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:34.613211 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xb928" May 21 20:54:34.614964 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:34.614941 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" May 21 20:54:34.621747 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:34.621720 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xb928"] May 21 20:54:34.700535 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:34.700500 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/017e13a5-3614-42f0-9676-5e69e3fd6304-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-xb928\" (UID: \"017e13a5-3614-42f0-9676-5e69e3fd6304\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xb928" May 21 20:54:34.700535 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:34.700540 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/017e13a5-3614-42f0-9676-5e69e3fd6304-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-xb928\" (UID: \"017e13a5-3614-42f0-9676-5e69e3fd6304\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xb928" May 21 20:54:34.700742 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:34.700589 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/017e13a5-3614-42f0-9676-5e69e3fd6304-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-xb928\" (UID: \"017e13a5-3614-42f0-9676-5e69e3fd6304\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xb928" May 21 20:54:34.700742 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:34.700627 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/017e13a5-3614-42f0-9676-5e69e3fd6304-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-xb928\" (UID: \"017e13a5-3614-42f0-9676-5e69e3fd6304\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xb928" May 21 20:54:34.700742 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:34.700681 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drl42\" (UniqueName: \"kubernetes.io/projected/017e13a5-3614-42f0-9676-5e69e3fd6304-kube-api-access-drl42\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-xb928\" (UID: \"017e13a5-3614-42f0-9676-5e69e3fd6304\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xb928" May 21 20:54:34.700742 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:34.700720 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/017e13a5-3614-42f0-9676-5e69e3fd6304-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-xb928\" (UID: \"017e13a5-3614-42f0-9676-5e69e3fd6304\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xb928" May 21 20:54:34.801280 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:34.801249 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/017e13a5-3614-42f0-9676-5e69e3fd6304-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-xb928\" (UID: \"017e13a5-3614-42f0-9676-5e69e3fd6304\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xb928" May 21 20:54:34.801441 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:34.801287 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/017e13a5-3614-42f0-9676-5e69e3fd6304-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-xb928\" (UID: \"017e13a5-3614-42f0-9676-5e69e3fd6304\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xb928" May 21 20:54:34.801500 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:34.801453 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/017e13a5-3614-42f0-9676-5e69e3fd6304-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-xb928\" (UID: \"017e13a5-3614-42f0-9676-5e69e3fd6304\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xb928" May 21 20:54:34.801554 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:34.801519 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/017e13a5-3614-42f0-9676-5e69e3fd6304-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-xb928\" (UID: \"017e13a5-3614-42f0-9676-5e69e3fd6304\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xb928" May 21 20:54:34.801594 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:34.801559 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-drl42\" (UniqueName: \"kubernetes.io/projected/017e13a5-3614-42f0-9676-5e69e3fd6304-kube-api-access-drl42\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-xb928\" (UID: \"017e13a5-3614-42f0-9676-5e69e3fd6304\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xb928" May 21 20:54:34.801649 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:34.801613 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/017e13a5-3614-42f0-9676-5e69e3fd6304-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-xb928\" (UID: \"017e13a5-3614-42f0-9676-5e69e3fd6304\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xb928" May 21 20:54:34.801701 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:34.801686 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/017e13a5-3614-42f0-9676-5e69e3fd6304-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-xb928\" (UID: \"017e13a5-3614-42f0-9676-5e69e3fd6304\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xb928" May 21 20:54:34.801787 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:34.801756 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/017e13a5-3614-42f0-9676-5e69e3fd6304-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-xb928\" (UID: \"017e13a5-3614-42f0-9676-5e69e3fd6304\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xb928" May 21 20:54:34.802051 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:34.802027 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/017e13a5-3614-42f0-9676-5e69e3fd6304-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-xb928\" (UID: \"017e13a5-3614-42f0-9676-5e69e3fd6304\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xb928" May 21 20:54:34.804334 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:34.804313 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/017e13a5-3614-42f0-9676-5e69e3fd6304-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-xb928\" (UID: \"017e13a5-3614-42f0-9676-5e69e3fd6304\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xb928" May 21 20:54:34.804635 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:34.804616 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/017e13a5-3614-42f0-9676-5e69e3fd6304-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-xb928\" (UID: \"017e13a5-3614-42f0-9676-5e69e3fd6304\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xb928" May 21 20:54:34.808650 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:34.808622 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drl42\" (UniqueName: \"kubernetes.io/projected/017e13a5-3614-42f0-9676-5e69e3fd6304-kube-api-access-drl42\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-xb928\" (UID: \"017e13a5-3614-42f0-9676-5e69e3fd6304\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xb928" May 21 20:54:34.924686 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:34.924559 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xb928" May 21 20:54:35.055275 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:35.055230 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqzwwr" event={"ID":"8263ace6-0f7c-4192-be54-301485e02d64","Type":"ContainerStarted","Data":"f5547598346f94b7a7bb0d04ff193406d7e2550ca0ffe3bf2b7cdd192887f160"} May 21 20:54:35.055275 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:35.055278 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqzwwr" event={"ID":"8263ace6-0f7c-4192-be54-301485e02d64","Type":"ContainerStarted","Data":"bf4c09c1cb224dfa6ec11bdc4622bde193c557b853f16e91f48c80c3adb3e491"} May 21 20:54:35.074913 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:35.074886 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xb928"] May 21 20:54:35.077551 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:54:35.077516 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod017e13a5_3614_42f0_9676_5e69e3fd6304.slice/crio-91b68448fa5a4679b1dc76fdf4dfdf0f433592aae902c3ce95ff004a7379c8d0 WatchSource:0}: Error finding container 91b68448fa5a4679b1dc76fdf4dfdf0f433592aae902c3ce95ff004a7379c8d0: Status 404 returned error can't find the container with id 91b68448fa5a4679b1dc76fdf4dfdf0f433592aae902c3ce95ff004a7379c8d0 May 21 20:54:35.315481 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:35.315422 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2kw5v"] May 21 20:54:35.319561 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:35.319534 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2kw5v" May 21 20:54:35.321525 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:35.321501 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" May 21 20:54:35.328426 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:35.328396 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2kw5v"] May 21 20:54:35.408540 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:35.408506 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/714e3cb5-bad8-40f8-ad7d-12865672f3de-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2kw5v\" (UID: \"714e3cb5-bad8-40f8-ad7d-12865672f3de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2kw5v" May 21 20:54:35.408728 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:35.408555 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/714e3cb5-bad8-40f8-ad7d-12865672f3de-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2kw5v\" (UID: \"714e3cb5-bad8-40f8-ad7d-12865672f3de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2kw5v" May 21 20:54:35.408728 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:35.408670 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/714e3cb5-bad8-40f8-ad7d-12865672f3de-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2kw5v\" (UID: \"714e3cb5-bad8-40f8-ad7d-12865672f3de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2kw5v" May 21 20:54:35.408844 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:35.408726 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/714e3cb5-bad8-40f8-ad7d-12865672f3de-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2kw5v\" (UID: \"714e3cb5-bad8-40f8-ad7d-12865672f3de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2kw5v" May 21 20:54:35.408844 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:35.408807 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/714e3cb5-bad8-40f8-ad7d-12865672f3de-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2kw5v\" (UID: \"714e3cb5-bad8-40f8-ad7d-12865672f3de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2kw5v" May 21 20:54:35.408943 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:35.408844 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrff2\" (UniqueName: \"kubernetes.io/projected/714e3cb5-bad8-40f8-ad7d-12865672f3de-kube-api-access-nrff2\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2kw5v\" (UID: \"714e3cb5-bad8-40f8-ad7d-12865672f3de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2kw5v" May 21 20:54:35.509388 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:35.509343 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/714e3cb5-bad8-40f8-ad7d-12865672f3de-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2kw5v\" (UID: \"714e3cb5-bad8-40f8-ad7d-12865672f3de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2kw5v" May 21 20:54:35.509605 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:35.509433 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/714e3cb5-bad8-40f8-ad7d-12865672f3de-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2kw5v\" (UID: \"714e3cb5-bad8-40f8-ad7d-12865672f3de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2kw5v" May 21 20:54:35.509605 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:35.509462 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nrff2\" (UniqueName: \"kubernetes.io/projected/714e3cb5-bad8-40f8-ad7d-12865672f3de-kube-api-access-nrff2\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2kw5v\" (UID: \"714e3cb5-bad8-40f8-ad7d-12865672f3de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2kw5v" May 21 20:54:35.510002 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:35.509973 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/714e3cb5-bad8-40f8-ad7d-12865672f3de-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2kw5v\" (UID: \"714e3cb5-bad8-40f8-ad7d-12865672f3de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2kw5v" May 21 20:54:35.510143 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:35.510021 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/714e3cb5-bad8-40f8-ad7d-12865672f3de-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2kw5v\" (UID: \"714e3cb5-bad8-40f8-ad7d-12865672f3de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2kw5v" May 21 20:54:35.510143 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:35.510078 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/714e3cb5-bad8-40f8-ad7d-12865672f3de-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2kw5v\" (UID: \"714e3cb5-bad8-40f8-ad7d-12865672f3de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2kw5v" May 21 20:54:35.510638 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:35.510609 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/714e3cb5-bad8-40f8-ad7d-12865672f3de-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2kw5v\" (UID: \"714e3cb5-bad8-40f8-ad7d-12865672f3de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2kw5v" May 21 20:54:35.510810 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:35.510787 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/714e3cb5-bad8-40f8-ad7d-12865672f3de-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2kw5v\" (UID: \"714e3cb5-bad8-40f8-ad7d-12865672f3de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2kw5v" May 21 20:54:35.510982 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:35.510962 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/714e3cb5-bad8-40f8-ad7d-12865672f3de-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2kw5v\" (UID: \"714e3cb5-bad8-40f8-ad7d-12865672f3de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2kw5v" May 21 20:54:35.512542 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:35.512460 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/714e3cb5-bad8-40f8-ad7d-12865672f3de-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2kw5v\" (UID: \"714e3cb5-bad8-40f8-ad7d-12865672f3de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2kw5v" May 21 20:54:35.512758 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:35.512738 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/714e3cb5-bad8-40f8-ad7d-12865672f3de-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2kw5v\" (UID: \"714e3cb5-bad8-40f8-ad7d-12865672f3de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2kw5v" May 21 20:54:35.516809 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:35.516781 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrff2\" (UniqueName: \"kubernetes.io/projected/714e3cb5-bad8-40f8-ad7d-12865672f3de-kube-api-access-nrff2\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2kw5v\" (UID: \"714e3cb5-bad8-40f8-ad7d-12865672f3de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2kw5v" May 21 20:54:35.634566 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:35.634060 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2kw5v" May 21 20:54:35.791926 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:35.791889 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2kw5v"] May 21 20:54:35.794033 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:54:35.793999 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod714e3cb5_bad8_40f8_ad7d_12865672f3de.slice/crio-86a664691d82b617d5fb729a8394f0d3b0ad35e98b6a958ebc7a082afa800acb WatchSource:0}: Error finding container 86a664691d82b617d5fb729a8394f0d3b0ad35e98b6a958ebc7a082afa800acb: Status 404 returned error can't find the container with id 86a664691d82b617d5fb729a8394f0d3b0ad35e98b6a958ebc7a082afa800acb May 21 20:54:36.062790 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:36.062741 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2kw5v" event={"ID":"714e3cb5-bad8-40f8-ad7d-12865672f3de","Type":"ContainerStarted","Data":"e33d3df4f7f6d3a6364d4d5efe85b3a8665d21ac85507ecec6c176c42b0823e7"} May 21 20:54:36.062790 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:36.062797 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2kw5v" event={"ID":"714e3cb5-bad8-40f8-ad7d-12865672f3de","Type":"ContainerStarted","Data":"86a664691d82b617d5fb729a8394f0d3b0ad35e98b6a958ebc7a082afa800acb"} May 21 20:54:36.064967 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:36.064445 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xb928" event={"ID":"017e13a5-3614-42f0-9676-5e69e3fd6304","Type":"ContainerStarted","Data":"306dc24ae4b7ff19f490765a854dfee89e3f571abc3148d081295b41df06220e"} May 21 20:54:36.064967 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:36.064513 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xb928" event={"ID":"017e13a5-3614-42f0-9676-5e69e3fd6304","Type":"ContainerStarted","Data":"91b68448fa5a4679b1dc76fdf4dfdf0f433592aae902c3ce95ff004a7379c8d0"} May 21 20:54:41.086972 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:41.086932 2570 generic.go:358] "Generic (PLEG): container finished" podID="212ee4f9-1a84-4b61-86c7-54e0df0f41a0" containerID="39894b9995951ec9c1583ed968697c6bf1dc7888f3274226926f8b4eb5102e32" exitCode=0 May 21 20:54:41.087399 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:41.087008 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dtp7s" event={"ID":"212ee4f9-1a84-4b61-86c7-54e0df0f41a0","Type":"ContainerDied","Data":"39894b9995951ec9c1583ed968697c6bf1dc7888f3274226926f8b4eb5102e32"} May 21 20:54:41.088489 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:41.088354 2570 generic.go:358] "Generic (PLEG): container finished" podID="8263ace6-0f7c-4192-be54-301485e02d64" containerID="f5547598346f94b7a7bb0d04ff193406d7e2550ca0ffe3bf2b7cdd192887f160" exitCode=0 May 21 20:54:41.088489 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:41.088436 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqzwwr" event={"ID":"8263ace6-0f7c-4192-be54-301485e02d64","Type":"ContainerDied","Data":"f5547598346f94b7a7bb0d04ff193406d7e2550ca0ffe3bf2b7cdd192887f160"} May 21 20:54:42.093643 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:42.093608 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dtp7s" event={"ID":"212ee4f9-1a84-4b61-86c7-54e0df0f41a0","Type":"ContainerStarted","Data":"bf094581694cb3a456b5a776dad1db8ff01f39071a5b6c97aef637c8ffa00a48"} May 21 20:54:42.094091 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:42.093803 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dtp7s" May 21 20:54:42.095176 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:42.095150 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqzwwr" event={"ID":"8263ace6-0f7c-4192-be54-301485e02d64","Type":"ContainerStarted","Data":"1e0000c9e1c0fb39943398902f2bd82813768da53d3d99879e549cfd79b5c389"} May 21 20:54:42.095370 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:42.095348 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqzwwr" May 21 20:54:42.096522 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:42.096497 2570 generic.go:358] "Generic (PLEG): container finished" podID="714e3cb5-bad8-40f8-ad7d-12865672f3de" containerID="e33d3df4f7f6d3a6364d4d5efe85b3a8665d21ac85507ecec6c176c42b0823e7" exitCode=0 May 21 20:54:42.096648 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:42.096561 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2kw5v" event={"ID":"714e3cb5-bad8-40f8-ad7d-12865672f3de","Type":"ContainerDied","Data":"e33d3df4f7f6d3a6364d4d5efe85b3a8665d21ac85507ecec6c176c42b0823e7"} May 21 20:54:42.097889 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:42.097871 2570 generic.go:358] "Generic (PLEG): container finished" podID="017e13a5-3614-42f0-9676-5e69e3fd6304" containerID="306dc24ae4b7ff19f490765a854dfee89e3f571abc3148d081295b41df06220e" exitCode=0 May 21 20:54:42.097955 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:42.097921 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xb928" event={"ID":"017e13a5-3614-42f0-9676-5e69e3fd6304","Type":"ContainerDied","Data":"306dc24ae4b7ff19f490765a854dfee89e3f571abc3148d081295b41df06220e"} May 21 20:54:42.114020 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:42.113962 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dtp7s" podStartSLOduration=11.817056611 podStartE2EDuration="12.113947788s" podCreationTimestamp="2026-05-21 20:54:30 +0000 UTC" firstStartedPulling="2026-05-21 20:54:41.087824357 +0000 UTC m=+981.470004421" lastFinishedPulling="2026-05-21 20:54:41.384715543 +0000 UTC m=+981.766895598" observedRunningTime="2026-05-21 20:54:42.112184591 +0000 UTC m=+982.494364662" watchObservedRunningTime="2026-05-21 20:54:42.113947788 +0000 UTC m=+982.496127916" May 21 20:54:42.131049 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:42.130996 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqzwwr" podStartSLOduration=8.881441799 podStartE2EDuration="9.130980815s" podCreationTimestamp="2026-05-21 20:54:33 +0000 UTC" firstStartedPulling="2026-05-21 20:54:41.089046817 +0000 UTC m=+981.471226866" lastFinishedPulling="2026-05-21 20:54:41.338585832 +0000 UTC m=+981.720765882" observedRunningTime="2026-05-21 20:54:42.130603691 +0000 UTC m=+982.512783764" watchObservedRunningTime="2026-05-21 20:54:42.130980815 +0000 UTC m=+982.513160883" May 21 20:54:43.107864 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:43.107817 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2kw5v" event={"ID":"714e3cb5-bad8-40f8-ad7d-12865672f3de","Type":"ContainerStarted","Data":"4bbc1b9354cd82f62926c7deeaacf7f947c8266e34b84cca6d8541f4b8232d75"} May 21 20:54:43.108281 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:43.108132 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2kw5v" May 21 20:54:43.109523 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:43.109496 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xb928" event={"ID":"017e13a5-3614-42f0-9676-5e69e3fd6304","Type":"ContainerStarted","Data":"cc9af7b08b71ffc685735e9d61ab2273a2fefb4ff8acc004180d01ae73f8e0e1"} May 21 20:54:43.109986 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:43.109967 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xb928" May 21 20:54:43.126116 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:43.126061 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2kw5v" podStartSLOduration=7.90243501 podStartE2EDuration="8.126046865s" podCreationTimestamp="2026-05-21 20:54:35 +0000 UTC" firstStartedPulling="2026-05-21 20:54:42.09714743 +0000 UTC m=+982.479327483" lastFinishedPulling="2026-05-21 20:54:42.320759286 +0000 UTC m=+982.702939338" observedRunningTime="2026-05-21 20:54:43.124848402 +0000 UTC m=+983.507028487" watchObservedRunningTime="2026-05-21 20:54:43.126046865 +0000 UTC m=+983.508226928" May 21 20:54:43.143140 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:43.143086 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xb928" podStartSLOduration=8.841520565 podStartE2EDuration="9.143071497s" podCreationTimestamp="2026-05-21 20:54:34 +0000 UTC" firstStartedPulling="2026-05-21 20:54:42.098439206 +0000 UTC m=+982.480619255" lastFinishedPulling="2026-05-21 20:54:42.399990131 +0000 UTC m=+982.782170187" observedRunningTime="2026-05-21 20:54:43.141978852 +0000 UTC m=+983.524158924" watchObservedRunningTime="2026-05-21 20:54:43.143071497 +0000 UTC m=+983.525251569" May 21 20:54:53.122042 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:53.122006 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqzwwr" May 21 20:54:53.122945 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:53.122926 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-dtp7s" May 21 20:54:54.128051 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:54.128023 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-xb928" May 21 20:54:54.129115 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:54:54.129094 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2kw5v" May 21 20:55:02.767926 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:55:02.767889 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-67945649d5-4xmfv"] May 21 20:55:02.770954 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:55:02.770935 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67945649d5-4xmfv" May 21 20:55:02.777037 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:55:02.777007 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-67945649d5-4xmfv"] May 21 20:55:02.866109 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:55:02.866071 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a36aaf86-0cb5-4192-a383-52c657caa55c-tls-cert\") pod \"authorino-67945649d5-4xmfv\" (UID: \"a36aaf86-0cb5-4192-a383-52c657caa55c\") " pod="kuadrant-system/authorino-67945649d5-4xmfv" May 21 20:55:02.866292 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:55:02.866177 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjg87\" (UniqueName: \"kubernetes.io/projected/a36aaf86-0cb5-4192-a383-52c657caa55c-kube-api-access-zjg87\") pod \"authorino-67945649d5-4xmfv\" (UID: \"a36aaf86-0cb5-4192-a383-52c657caa55c\") " pod="kuadrant-system/authorino-67945649d5-4xmfv" May 21 20:55:02.967442 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:55:02.967399 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zjg87\" (UniqueName: \"kubernetes.io/projected/a36aaf86-0cb5-4192-a383-52c657caa55c-kube-api-access-zjg87\") pod \"authorino-67945649d5-4xmfv\" (UID: \"a36aaf86-0cb5-4192-a383-52c657caa55c\") " pod="kuadrant-system/authorino-67945649d5-4xmfv" May 21 20:55:02.967598 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:55:02.967453 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a36aaf86-0cb5-4192-a383-52c657caa55c-tls-cert\") pod \"authorino-67945649d5-4xmfv\" (UID: \"a36aaf86-0cb5-4192-a383-52c657caa55c\") " pod="kuadrant-system/authorino-67945649d5-4xmfv" May 21 20:55:02.969997 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:55:02.969979 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a36aaf86-0cb5-4192-a383-52c657caa55c-tls-cert\") pod \"authorino-67945649d5-4xmfv\" (UID: \"a36aaf86-0cb5-4192-a383-52c657caa55c\") " pod="kuadrant-system/authorino-67945649d5-4xmfv" May 21 20:55:02.975766 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:55:02.975729 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjg87\" (UniqueName: \"kubernetes.io/projected/a36aaf86-0cb5-4192-a383-52c657caa55c-kube-api-access-zjg87\") pod \"authorino-67945649d5-4xmfv\" (UID: \"a36aaf86-0cb5-4192-a383-52c657caa55c\") " pod="kuadrant-system/authorino-67945649d5-4xmfv" May 21 20:55:03.081857 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:55:03.081769 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67945649d5-4xmfv" May 21 20:55:03.211904 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:55:03.211868 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-67945649d5-4xmfv"] May 21 20:55:03.214410 ip-10-0-131-158 kubenswrapper[2570]: W0521 20:55:03.214378 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda36aaf86_0cb5_4192_a383_52c657caa55c.slice/crio-95b425a76046dbec70881ef525efb46f330afee6c9e42fe326bde7d8e7a33241 WatchSource:0}: Error finding container 95b425a76046dbec70881ef525efb46f330afee6c9e42fe326bde7d8e7a33241: Status 404 returned error can't find the container with id 95b425a76046dbec70881ef525efb46f330afee6c9e42fe326bde7d8e7a33241 May 21 20:55:04.194838 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:55:04.194801 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67945649d5-4xmfv" event={"ID":"a36aaf86-0cb5-4192-a383-52c657caa55c","Type":"ContainerStarted","Data":"4172aba6b5a7741cded5549f75f5fe23cbd37a98127763e2be54bb5fa3acd653"} May 21 20:55:04.195239 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:55:04.194847 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67945649d5-4xmfv" event={"ID":"a36aaf86-0cb5-4192-a383-52c657caa55c","Type":"ContainerStarted","Data":"95b425a76046dbec70881ef525efb46f330afee6c9e42fe326bde7d8e7a33241"} May 21 20:55:04.210368 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:55:04.210308 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-67945649d5-4xmfv" podStartSLOduration=1.825851289 podStartE2EDuration="2.210292785s" podCreationTimestamp="2026-05-21 20:55:02 +0000 UTC" firstStartedPulling="2026-05-21 20:55:03.21575661 +0000 UTC m=+1003.597936660" lastFinishedPulling="2026-05-21 20:55:03.600198106 +0000 UTC m=+1003.982378156" observedRunningTime="2026-05-21 20:55:04.209170938 +0000 UTC m=+1004.591351010" watchObservedRunningTime="2026-05-21 20:55:04.210292785 +0000 UTC m=+1004.592472907" May 21 20:55:04.243221 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:55:04.243180 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-569b9d6d-2pkvt"] May 21 20:55:04.243453 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:55:04.243423 2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-569b9d6d-2pkvt" podUID="20446060-30f8-442a-add9-6b9e1e1ae24a" containerName="authorino" containerID="cri-o://8f733f478073050efec3e3376066736ef3172eb620c2db2c23ef63f8c4d7e796" gracePeriod=30 May 21 20:55:04.493219 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:55:04.488791 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-569b9d6d-2pkvt" May 21 20:55:04.583248 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:55:04.583192 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/20446060-30f8-442a-add9-6b9e1e1ae24a-tls-cert\") pod \"20446060-30f8-442a-add9-6b9e1e1ae24a\" (UID: \"20446060-30f8-442a-add9-6b9e1e1ae24a\") " May 21 20:55:04.583457 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:55:04.583292 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t6kth\" (UniqueName: \"kubernetes.io/projected/20446060-30f8-442a-add9-6b9e1e1ae24a-kube-api-access-t6kth\") pod \"20446060-30f8-442a-add9-6b9e1e1ae24a\" (UID: \"20446060-30f8-442a-add9-6b9e1e1ae24a\") " May 21 20:55:04.585610 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:55:04.585576 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20446060-30f8-442a-add9-6b9e1e1ae24a-kube-api-access-t6kth" (OuterVolumeSpecName: "kube-api-access-t6kth") pod "20446060-30f8-442a-add9-6b9e1e1ae24a" (UID: "20446060-30f8-442a-add9-6b9e1e1ae24a"). InnerVolumeSpecName "kube-api-access-t6kth". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 20:55:04.593933 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:55:04.593902 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20446060-30f8-442a-add9-6b9e1e1ae24a-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "20446060-30f8-442a-add9-6b9e1e1ae24a" (UID: "20446060-30f8-442a-add9-6b9e1e1ae24a"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 20:55:04.684612 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:55:04.684567 2570 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/20446060-30f8-442a-add9-6b9e1e1ae24a-tls-cert\") on node \"ip-10-0-131-158.ec2.internal\" DevicePath \"\"" May 21 20:55:04.684612 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:55:04.684602 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6kth\" (UniqueName: \"kubernetes.io/projected/20446060-30f8-442a-add9-6b9e1e1ae24a-kube-api-access-t6kth\") on node \"ip-10-0-131-158.ec2.internal\" DevicePath \"\"" May 21 20:55:05.199885 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:55:05.199847 2570 generic.go:358] "Generic (PLEG): container finished" podID="20446060-30f8-442a-add9-6b9e1e1ae24a" containerID="8f733f478073050efec3e3376066736ef3172eb620c2db2c23ef63f8c4d7e796" exitCode=0 May 21 20:55:05.200341 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:55:05.199905 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-569b9d6d-2pkvt" May 21 20:55:05.200341 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:55:05.199934 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-569b9d6d-2pkvt" event={"ID":"20446060-30f8-442a-add9-6b9e1e1ae24a","Type":"ContainerDied","Data":"8f733f478073050efec3e3376066736ef3172eb620c2db2c23ef63f8c4d7e796"} May 21 20:55:05.200341 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:55:05.199967 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-569b9d6d-2pkvt" event={"ID":"20446060-30f8-442a-add9-6b9e1e1ae24a","Type":"ContainerDied","Data":"d407696ce5b69e8aea176a4b2b0e455e079a7cc1ef8fa010a6a3c9aeedf7b9ee"} May 21 20:55:05.200341 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:55:05.199983 2570 scope.go:117] "RemoveContainer" containerID="8f733f478073050efec3e3376066736ef3172eb620c2db2c23ef63f8c4d7e796" May 21 20:55:05.208245 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:55:05.208228 2570 scope.go:117] "RemoveContainer" containerID="8f733f478073050efec3e3376066736ef3172eb620c2db2c23ef63f8c4d7e796" May 21 20:55:05.208510 ip-10-0-131-158 kubenswrapper[2570]: E0521 20:55:05.208494 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f733f478073050efec3e3376066736ef3172eb620c2db2c23ef63f8c4d7e796\": container with ID starting with 8f733f478073050efec3e3376066736ef3172eb620c2db2c23ef63f8c4d7e796 not found: ID does not exist" containerID="8f733f478073050efec3e3376066736ef3172eb620c2db2c23ef63f8c4d7e796" May 21 20:55:05.208588 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:55:05.208518 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f733f478073050efec3e3376066736ef3172eb620c2db2c23ef63f8c4d7e796"} err="failed to get container status \"8f733f478073050efec3e3376066736ef3172eb620c2db2c23ef63f8c4d7e796\": rpc error: code = NotFound desc = could not find container \"8f733f478073050efec3e3376066736ef3172eb620c2db2c23ef63f8c4d7e796\": container with ID starting with 8f733f478073050efec3e3376066736ef3172eb620c2db2c23ef63f8c4d7e796 not found: ID does not exist" May 21 20:55:05.219109 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:55:05.219086 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-569b9d6d-2pkvt"] May 21 20:55:05.222751 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:55:05.222731 2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-569b9d6d-2pkvt"] May 21 20:55:06.268396 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:55:06.268358 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20446060-30f8-442a-add9-6b9e1e1ae24a" path="/var/lib/kubelet/pods/20446060-30f8-442a-add9-6b9e1e1ae24a/volumes" May 21 20:58:20.232169 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:58:20.232136 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7krlb_d8463ad6-6f3b-4984-ab32-781d1507d42d/ovn-acl-logging/0.log" May 21 20:58:20.235752 ip-10-0-131-158 kubenswrapper[2570]: I0521 20:58:20.235729 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7krlb_d8463ad6-6f3b-4984-ab32-781d1507d42d/ovn-acl-logging/0.log" May 21 21:03:20.252825 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:03:20.252797 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7krlb_d8463ad6-6f3b-4984-ab32-781d1507d42d/ovn-acl-logging/0.log" May 21 21:03:20.256852 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:03:20.256828 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7krlb_d8463ad6-6f3b-4984-ab32-781d1507d42d/ovn-acl-logging/0.log" May 21 21:08:20.276191 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:08:20.276165 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7krlb_d8463ad6-6f3b-4984-ab32-781d1507d42d/ovn-acl-logging/0.log" May 21 21:08:20.279046 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:08:20.279028 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7krlb_d8463ad6-6f3b-4984-ab32-781d1507d42d/ovn-acl-logging/0.log" May 21 21:13:20.297999 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:13:20.297973 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7krlb_d8463ad6-6f3b-4984-ab32-781d1507d42d/ovn-acl-logging/0.log" May 21 21:13:20.300444 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:13:20.300423 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7krlb_d8463ad6-6f3b-4984-ab32-781d1507d42d/ovn-acl-logging/0.log" May 21 21:17:29.264203 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:29.264165 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-67945649d5-4xmfv_a36aaf86-0cb5-4192-a383-52c657caa55c/authorino/0.log" May 21 21:17:34.474409 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:34.474374 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76cc84b65c-mjz2c_611f1d12-d17d-40ea-b481-aeb14ca32acb/manager/0.log" May 21 21:17:35.811197 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:35.811156 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-67945649d5-4xmfv_a36aaf86-0cb5-4192-a383-52c657caa55c/authorino/0.log" May 21 21:17:36.131804 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:36.131726 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-4kkcr_a21b94ff-b121-45a3-88a1-5ccd3d87027d/kuadrant-console-plugin/0.log" May 21 21:17:37.255503 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:37.255437 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-c9f76b4c5-cn4nx_ddcebb69-59cd-4e3d-bba7-49f9b1abdad1/kube-auth-proxy/0.log" May 21 21:17:37.920061 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:37.920025 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-2kw5v_714e3cb5-bad8-40f8-ad7d-12865672f3de/storage-initializer/0.log" May 21 21:17:37.928374 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:37.928343 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-2kw5v_714e3cb5-bad8-40f8-ad7d-12865672f3de/main/0.log" May 21 21:17:38.143843 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:38.143810 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-l8rp4_650f9acb-1298-4798-b44d-d488de2c6e8c/storage-initializer/0.log" May 21 21:17:38.150531 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:38.150503 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-l8rp4_650f9acb-1298-4798-b44d-d488de2c6e8c/main/0.log" May 21 21:17:38.256592 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:38.256568 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqzwwr_8263ace6-0f7c-4192-be54-301485e02d64/storage-initializer/0.log" May 21 21:17:38.264116 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:38.264092 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqzwwr_8263ace6-0f7c-4192-be54-301485e02d64/main/0.log" May 21 21:17:38.366223 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:38.366194 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-xb928_017e13a5-3614-42f0-9676-5e69e3fd6304/storage-initializer/0.log" May 21 21:17:38.373769 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:38.373742 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-xb928_017e13a5-3614-42f0-9676-5e69e3fd6304/main/0.log" May 21 21:17:38.479415 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:38.479380 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-dtp7s_212ee4f9-1a84-4b61-86c7-54e0df0f41a0/storage-initializer/0.log" May 21 21:17:38.485940 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:38.485914 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-dtp7s_212ee4f9-1a84-4b61-86c7-54e0df0f41a0/main/0.log" May 21 21:17:45.240144 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:45.240113 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-ggpmx_a8a570de-2345-412f-ab88-790c20e290ac/global-pull-secret-syncer/0.log" May 21 21:17:45.329876 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:45.329809 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jldwc_87db88d5-9543-40d7-ae6f-2fecc9ac8a79/konnectivity-agent/0.log" May 21 21:17:45.440088 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:45.440047 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-158.ec2.internal_afa0e1cb1f51f2b57cc3bf0d39b525c9/haproxy/0.log" May 21 21:17:49.620914 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:49.620874 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-67945649d5-4xmfv_a36aaf86-0cb5-4192-a383-52c657caa55c/authorino/0.log" May 21 21:17:49.703842 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:49.703810 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-4kkcr_a21b94ff-b121-45a3-88a1-5ccd3d87027d/kuadrant-console-plugin/0.log" May 21 21:17:51.471777 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:51.471750 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-qmgjj_3b5b2738-69cc-420b-a3e6-a2f42e585417/kube-state-metrics/0.log" May 21 21:17:51.486367 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:51.486336 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-qmgjj_3b5b2738-69cc-420b-a3e6-a2f42e585417/kube-rbac-proxy-main/0.log" May 21 21:17:51.508768 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:51.508738 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-qmgjj_3b5b2738-69cc-420b-a3e6-a2f42e585417/kube-rbac-proxy-self/0.log" May 21 21:17:51.697597 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:51.697555 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b99ll_84e51d81-6646-4b28-b700-e510a7922240/node-exporter/0.log" May 21 21:17:51.714815 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:51.714785 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b99ll_84e51d81-6646-4b28-b700-e510a7922240/kube-rbac-proxy/0.log" May 21 21:17:51.732072 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:51.732009 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b99ll_84e51d81-6646-4b28-b700-e510a7922240/init-textfile/0.log" May 21 21:17:52.162022 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:52.161949 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d676847ff-tqvh7_474f72a0-cadd-454f-8375-774d1d4b4831/telemeter-client/0.log" May 21 21:17:52.182995 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:52.182968 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d676847ff-tqvh7_474f72a0-cadd-454f-8375-774d1d4b4831/reload/0.log" May 21 21:17:52.202508 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:52.202455 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d676847ff-tqvh7_474f72a0-cadd-454f-8375-774d1d4b4831/kube-rbac-proxy/0.log" May 21 21:17:54.046060 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:54.046023 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-866q5/perf-node-gather-daemonset-j4nw5"] May 21 21:17:54.046446 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:54.046339 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20446060-30f8-442a-add9-6b9e1e1ae24a" containerName="authorino" May 21 21:17:54.046446 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:54.046351 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="20446060-30f8-442a-add9-6b9e1e1ae24a" containerName="authorino" May 21 21:17:54.046446 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:54.046410 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="20446060-30f8-442a-add9-6b9e1e1ae24a" containerName="authorino" May 21 21:17:54.049529 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:54.049510 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-866q5/perf-node-gather-daemonset-j4nw5" May 21 21:17:54.051683 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:54.051661 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-866q5\"/\"kube-root-ca.crt\"" May 21 21:17:54.051783 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:54.051755 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-866q5\"/\"openshift-service-ca.crt\"" May 21 21:17:54.052265 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:54.052245 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-866q5\"/\"default-dockercfg-phbdl\"" May 21 21:17:54.059463 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:54.059435 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-866q5/perf-node-gather-daemonset-j4nw5"] May 21 21:17:54.213863 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:54.213832 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f65e5872-4d2b-4460-8bef-9323e7575c33-lib-modules\") pod \"perf-node-gather-daemonset-j4nw5\" (UID: \"f65e5872-4d2b-4460-8bef-9323e7575c33\") " pod="openshift-must-gather-866q5/perf-node-gather-daemonset-j4nw5" May 21 21:17:54.214056 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:54.213873 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f65e5872-4d2b-4460-8bef-9323e7575c33-proc\") pod \"perf-node-gather-daemonset-j4nw5\" (UID: \"f65e5872-4d2b-4460-8bef-9323e7575c33\") " pod="openshift-must-gather-866q5/perf-node-gather-daemonset-j4nw5" May 21 21:17:54.214056 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:54.213964 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f65e5872-4d2b-4460-8bef-9323e7575c33-sys\") pod \"perf-node-gather-daemonset-j4nw5\" (UID: \"f65e5872-4d2b-4460-8bef-9323e7575c33\") " pod="openshift-must-gather-866q5/perf-node-gather-daemonset-j4nw5" May 21 21:17:54.214056 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:54.214014 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqxc5\" (UniqueName: \"kubernetes.io/projected/f65e5872-4d2b-4460-8bef-9323e7575c33-kube-api-access-nqxc5\") pod \"perf-node-gather-daemonset-j4nw5\" (UID: \"f65e5872-4d2b-4460-8bef-9323e7575c33\") " pod="openshift-must-gather-866q5/perf-node-gather-daemonset-j4nw5" May 21 21:17:54.214176 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:54.214085 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f65e5872-4d2b-4460-8bef-9323e7575c33-podres\") pod \"perf-node-gather-daemonset-j4nw5\" (UID: \"f65e5872-4d2b-4460-8bef-9323e7575c33\") " pod="openshift-must-gather-866q5/perf-node-gather-daemonset-j4nw5" May 21 21:17:54.314574 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:54.314489 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f65e5872-4d2b-4460-8bef-9323e7575c33-sys\") pod \"perf-node-gather-daemonset-j4nw5\" (UID: \"f65e5872-4d2b-4460-8bef-9323e7575c33\") " pod="openshift-must-gather-866q5/perf-node-gather-daemonset-j4nw5" May 21 21:17:54.314574 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:54.314531 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nqxc5\" (UniqueName: \"kubernetes.io/projected/f65e5872-4d2b-4460-8bef-9323e7575c33-kube-api-access-nqxc5\") pod \"perf-node-gather-daemonset-j4nw5\" (UID: \"f65e5872-4d2b-4460-8bef-9323e7575c33\") " pod="openshift-must-gather-866q5/perf-node-gather-daemonset-j4nw5" May 21 21:17:54.314574 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:54.314565 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f65e5872-4d2b-4460-8bef-9323e7575c33-podres\") pod \"perf-node-gather-daemonset-j4nw5\" (UID: \"f65e5872-4d2b-4460-8bef-9323e7575c33\") " pod="openshift-must-gather-866q5/perf-node-gather-daemonset-j4nw5" May 21 21:17:54.314799 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:54.314592 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f65e5872-4d2b-4460-8bef-9323e7575c33-lib-modules\") pod \"perf-node-gather-daemonset-j4nw5\" (UID: \"f65e5872-4d2b-4460-8bef-9323e7575c33\") " pod="openshift-must-gather-866q5/perf-node-gather-daemonset-j4nw5" May 21 21:17:54.314799 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:54.314597 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f65e5872-4d2b-4460-8bef-9323e7575c33-sys\") pod \"perf-node-gather-daemonset-j4nw5\" (UID: \"f65e5872-4d2b-4460-8bef-9323e7575c33\") " pod="openshift-must-gather-866q5/perf-node-gather-daemonset-j4nw5" May 21 21:17:54.314799 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:54.314624 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f65e5872-4d2b-4460-8bef-9323e7575c33-proc\") pod \"perf-node-gather-daemonset-j4nw5\" (UID: \"f65e5872-4d2b-4460-8bef-9323e7575c33\") " pod="openshift-must-gather-866q5/perf-node-gather-daemonset-j4nw5" May 21 21:17:54.314799 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:54.314720 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f65e5872-4d2b-4460-8bef-9323e7575c33-proc\") pod \"perf-node-gather-daemonset-j4nw5\" (UID: \"f65e5872-4d2b-4460-8bef-9323e7575c33\") " pod="openshift-must-gather-866q5/perf-node-gather-daemonset-j4nw5" May 21 21:17:54.314799 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:54.314733 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f65e5872-4d2b-4460-8bef-9323e7575c33-podres\") pod \"perf-node-gather-daemonset-j4nw5\" (UID: \"f65e5872-4d2b-4460-8bef-9323e7575c33\") " pod="openshift-must-gather-866q5/perf-node-gather-daemonset-j4nw5" May 21 21:17:54.314799 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:54.314734 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f65e5872-4d2b-4460-8bef-9323e7575c33-lib-modules\") pod \"perf-node-gather-daemonset-j4nw5\" (UID: \"f65e5872-4d2b-4460-8bef-9323e7575c33\") " pod="openshift-must-gather-866q5/perf-node-gather-daemonset-j4nw5" May 21 21:17:54.322740 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:54.322711 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqxc5\" (UniqueName: \"kubernetes.io/projected/f65e5872-4d2b-4460-8bef-9323e7575c33-kube-api-access-nqxc5\") pod \"perf-node-gather-daemonset-j4nw5\" (UID: \"f65e5872-4d2b-4460-8bef-9323e7575c33\") " pod="openshift-must-gather-866q5/perf-node-gather-daemonset-j4nw5" May 21 21:17:54.360782 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:54.360743 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-866q5/perf-node-gather-daemonset-j4nw5" May 21 21:17:54.490122 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:54.490096 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-866q5/perf-node-gather-daemonset-j4nw5"] May 21 21:17:54.492731 ip-10-0-131-158 kubenswrapper[2570]: W0521 21:17:54.492697 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf65e5872_4d2b_4460_8bef_9323e7575c33.slice/crio-6cfeae402409effae1eb860e9cd8ad4e4904dbdf0a10c176834c318dda898656 WatchSource:0}: Error finding container 6cfeae402409effae1eb860e9cd8ad4e4904dbdf0a10c176834c318dda898656: Status 404 returned error can't find the container with id 6cfeae402409effae1eb860e9cd8ad4e4904dbdf0a10c176834c318dda898656 May 21 21:17:54.494372 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:54.494350 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 21:17:54.662430 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:54.662395 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-866q5/perf-node-gather-daemonset-j4nw5" event={"ID":"f65e5872-4d2b-4460-8bef-9323e7575c33","Type":"ContainerStarted","Data":"803aef7842f6793277f0a336f71e3d099865278ede1fc15452a578e6d2cb838e"} May 21 21:17:54.662430 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:54.662431 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-866q5/perf-node-gather-daemonset-j4nw5" event={"ID":"f65e5872-4d2b-4460-8bef-9323e7575c33","Type":"ContainerStarted","Data":"6cfeae402409effae1eb860e9cd8ad4e4904dbdf0a10c176834c318dda898656"} May 21 21:17:54.662658 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:54.662515 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-866q5/perf-node-gather-daemonset-j4nw5" May 21 21:17:54.677302 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:54.677256 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-866q5/perf-node-gather-daemonset-j4nw5" podStartSLOduration=0.677240622 podStartE2EDuration="677.240622ms" podCreationTimestamp="2026-05-21 21:17:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 21:17:54.675822207 +0000 UTC m=+2375.058002275" watchObservedRunningTime="2026-05-21 21:17:54.677240622 +0000 UTC m=+2375.059420693" May 21 21:17:55.949070 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:55.949047 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x7nft_19a963d1-f89b-4cee-8b37-3205095efa67/dns/0.log" May 21 21:17:55.969958 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:55.969922 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x7nft_19a963d1-f89b-4cee-8b37-3205095efa67/kube-rbac-proxy/0.log" May 21 21:17:56.099781 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:56.099754 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jfdql_e4184fd4-d71d-4bda-bda1-e40fa42e76d7/dns-node-resolver/0.log" May 21 21:17:56.625259 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:56.625220 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7547f88c84-bd29v_16e49620-1ddc-4037-800d-1af5a0184d63/registry/0.log" May 21 21:17:56.704217 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:56.704189 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vfm2z_bb9b42e0-e4e2-4738-b497-dbed3b79ec9f/node-ca/0.log" May 21 21:17:57.742352 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:57.742315 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-c9f76b4c5-cn4nx_ddcebb69-59cd-4e3d-bba7-49f9b1abdad1/kube-auth-proxy/0.log" May 21 21:17:58.395606 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:58.395571 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-j5jnw_d7d41f03-d42a-434d-b1a0-fb94372013b2/serve-healthcheck-canary/0.log" May 21 21:17:58.930527 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:58.930483 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cpl7g_228052a6-9af1-4317-b2f0-377729a9ed45/kube-rbac-proxy/0.log" May 21 21:17:58.950384 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:58.950345 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cpl7g_228052a6-9af1-4317-b2f0-377729a9ed45/exporter/0.log" May 21 21:17:58.970489 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:17:58.970438 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cpl7g_228052a6-9af1-4317-b2f0-377729a9ed45/extractor/0.log" May 21 21:18:00.676926 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:18:00.676901 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-866q5/perf-node-gather-daemonset-j4nw5" May 21 21:18:01.199267 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:18:01.199226 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76cc84b65c-mjz2c_611f1d12-d17d-40ea-b481-aeb14ca32acb/manager/0.log" May 21 21:18:02.316122 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:18:02.316081 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5465c6b7f8-nh8kx_f379809b-9d00-4ea0-ad55-2da51a5a4cb8/manager/0.log" May 21 21:18:08.155211 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:18:08.155180 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8zgxn_5404da1c-65ab-46a6-8824-6a1eb233b16a/kube-multus-additional-cni-plugins/0.log" May 21 21:18:08.176082 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:18:08.176053 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8zgxn_5404da1c-65ab-46a6-8824-6a1eb233b16a/egress-router-binary-copy/0.log" May 21 21:18:08.197192 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:18:08.197165 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8zgxn_5404da1c-65ab-46a6-8824-6a1eb233b16a/cni-plugins/0.log" May 21 21:18:08.217018 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:18:08.216979 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8zgxn_5404da1c-65ab-46a6-8824-6a1eb233b16a/bond-cni-plugin/0.log" May 21 21:18:08.237728 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:18:08.237698 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8zgxn_5404da1c-65ab-46a6-8824-6a1eb233b16a/routeoverride-cni/0.log" May 21 21:18:08.256402 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:18:08.256372 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8zgxn_5404da1c-65ab-46a6-8824-6a1eb233b16a/whereabouts-cni-bincopy/0.log" May 21 21:18:08.277068 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:18:08.277043 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8zgxn_5404da1c-65ab-46a6-8824-6a1eb233b16a/whereabouts-cni/0.log" May 21 21:18:08.709392 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:18:08.709352 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-zngpc_aa1ef7ae-4922-40df-833c-976271407550/kube-multus/0.log" May 21 21:18:08.731370 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:18:08.731341 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7lhdn_23d4cc46-4752-4afd-a726-67d9eced1af9/network-metrics-daemon/0.log" May 21 21:18:08.753682 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:18:08.753656 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7lhdn_23d4cc46-4752-4afd-a726-67d9eced1af9/kube-rbac-proxy/0.log" May 21 21:18:10.070675 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:18:10.070647 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7krlb_d8463ad6-6f3b-4984-ab32-781d1507d42d/ovn-controller/0.log" May 21 21:18:10.086509 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:18:10.086458 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7krlb_d8463ad6-6f3b-4984-ab32-781d1507d42d/ovn-acl-logging/0.log" May 21 21:18:10.107377 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:18:10.107351 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7krlb_d8463ad6-6f3b-4984-ab32-781d1507d42d/ovn-acl-logging/1.log" May 21 21:18:10.128659 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:18:10.128637 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7krlb_d8463ad6-6f3b-4984-ab32-781d1507d42d/kube-rbac-proxy-node/0.log" May 21 21:18:10.161542 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:18:10.161515 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7krlb_d8463ad6-6f3b-4984-ab32-781d1507d42d/kube-rbac-proxy-ovn-metrics/0.log" May 21 21:18:10.178867 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:18:10.178841 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7krlb_d8463ad6-6f3b-4984-ab32-781d1507d42d/northd/0.log" May 21 21:18:10.199631 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:18:10.199607 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7krlb_d8463ad6-6f3b-4984-ab32-781d1507d42d/nbdb/0.log" May 21 21:18:10.219055 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:18:10.219013 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7krlb_d8463ad6-6f3b-4984-ab32-781d1507d42d/sbdb/0.log" May 21 21:18:10.376093 ip-10-0-131-158 kubenswrapper[2570]: I0521 21:18:10.376000 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7krlb_d8463ad6-6f3b-4984-ab32-781d1507d42d/ovnkube-controller/0.log"