May 27 21:38:15.351641 ip-10-0-131-147 systemd[1]: Starting Kubernetes Kubelet... May 27 21:38:15.877015 ip-10-0-131-147 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 27 21:38:15.877015 ip-10-0-131-147 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 27 21:38:15.877015 ip-10-0-131-147 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 27 21:38:15.877015 ip-10-0-131-147 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 27 21:38:15.877015 ip-10-0-131-147 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 27 21:38:15.880001 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.879907 2576 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 27 21:38:15.884212 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884197 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 21:38:15.884212 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884212 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 21:38:15.884284 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884217 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 21:38:15.884284 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884236 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 21:38:15.884284 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884240 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 21:38:15.884284 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884243 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 21:38:15.884284 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884245 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 21:38:15.884284 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884248 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 21:38:15.884284 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884251 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 21:38:15.884284 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884254 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 21:38:15.884284 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884256 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 21:38:15.884284 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884259 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 21:38:15.884284 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884262 2576 feature_gate.go:328] unrecognized feature gate: Example May 27 21:38:15.884284 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884265 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 21:38:15.884284 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884267 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 21:38:15.884284 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884270 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 21:38:15.884284 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884272 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 21:38:15.884284 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884275 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 21:38:15.884284 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884278 2576 feature_gate.go:328] unrecognized feature gate: Example2 May 27 21:38:15.884284 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884280 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 21:38:15.884284 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884283 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 21:38:15.884284 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884286 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 21:38:15.884791 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884289 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 21:38:15.884791 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884292 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 21:38:15.884791 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884295 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 21:38:15.884791 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884298 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 21:38:15.884791 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884301 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 21:38:15.884791 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884309 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 21:38:15.884791 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884312 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 21:38:15.884791 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884315 2576 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 21:38:15.884791 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884318 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 21:38:15.884791 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884320 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 21:38:15.884791 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884323 2576 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 21:38:15.884791 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884325 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 21:38:15.884791 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884328 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 21:38:15.884791 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884331 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 21:38:15.884791 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884334 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 21:38:15.884791 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884336 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 21:38:15.884791 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884339 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 21:38:15.884791 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884341 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 21:38:15.884791 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884344 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 21:38:15.885275 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884347 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 21:38:15.885275 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884350 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 21:38:15.885275 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884354 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 21:38:15.885275 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884359 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 21:38:15.885275 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884361 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 21:38:15.885275 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884364 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 21:38:15.885275 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884367 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 21:38:15.885275 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884369 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 21:38:15.885275 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884371 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 21:38:15.885275 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884374 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 21:38:15.885275 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884376 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 21:38:15.885275 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884379 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 21:38:15.885275 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884381 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 21:38:15.885275 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884384 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 21:38:15.885275 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884387 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 21:38:15.885275 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884390 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 21:38:15.885275 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884393 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 21:38:15.885275 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884395 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 21:38:15.885275 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884398 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 21:38:15.885722 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884401 2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 21:38:15.885722 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884403 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 21:38:15.885722 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884406 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 21:38:15.885722 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884409 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 21:38:15.885722 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884411 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 21:38:15.885722 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884413 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 21:38:15.885722 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884416 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 21:38:15.885722 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884419 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 21:38:15.885722 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884421 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 21:38:15.885722 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884424 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 21:38:15.885722 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884428 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 21:38:15.885722 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884432 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 21:38:15.885722 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884435 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 21:38:15.885722 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884438 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 21:38:15.885722 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884441 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 21:38:15.885722 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884444 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 21:38:15.885722 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884447 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 21:38:15.885722 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884449 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 21:38:15.885722 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884452 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 21:38:15.886179 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884456 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 21:38:15.886179 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884459 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 21:38:15.886179 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884462 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 21:38:15.886179 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884465 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 21:38:15.886179 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884468 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 21:38:15.886179 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884470 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 21:38:15.886179 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884473 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 21:38:15.886179 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884853 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 21:38:15.886179 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884859 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 21:38:15.886179 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884862 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 21:38:15.886179 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884864 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 21:38:15.886179 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884868 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 21:38:15.886179 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884870 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 21:38:15.886179 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884873 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 21:38:15.886179 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884878 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 21:38:15.886179 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884881 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 21:38:15.886179 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884884 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 21:38:15.886179 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884887 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 21:38:15.886629 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884890 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 21:38:15.886629 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884893 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 21:38:15.886629 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884896 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 21:38:15.886629 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884898 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 21:38:15.886629 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884900 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 21:38:15.886629 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884903 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 21:38:15.886629 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884905 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 21:38:15.886629 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884908 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 21:38:15.886629 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884910 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 21:38:15.886629 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884913 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 21:38:15.886629 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884916 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 21:38:15.886629 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884918 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 21:38:15.886629 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884921 2576 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 21:38:15.886629 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884923 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 21:38:15.886629 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884926 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 21:38:15.886629 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884928 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 21:38:15.886629 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884931 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 21:38:15.886629 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884934 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 21:38:15.886629 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884936 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 21:38:15.886629 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884938 2576 feature_gate.go:328] unrecognized feature gate: Example May 27 21:38:15.887116 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884941 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 21:38:15.887116 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884943 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 21:38:15.887116 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884947 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 21:38:15.887116 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884950 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 21:38:15.887116 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884953 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 21:38:15.887116 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884955 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 21:38:15.887116 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884957 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 21:38:15.887116 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884960 2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 21:38:15.887116 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884963 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 21:38:15.887116 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884965 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 21:38:15.887116 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884968 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 21:38:15.887116 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884970 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 21:38:15.887116 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884974 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 21:38:15.887116 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884978 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 21:38:15.887116 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884980 2576 feature_gate.go:328] unrecognized feature gate: Example2 May 27 21:38:15.887116 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884983 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 21:38:15.887116 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884986 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 21:38:15.887116 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884988 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 21:38:15.887116 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884991 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 21:38:15.887593 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884993 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 21:38:15.887593 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884995 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 21:38:15.887593 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.884998 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 21:38:15.887593 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.885000 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 21:38:15.887593 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.885003 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 21:38:15.887593 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.885007 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 21:38:15.887593 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.885009 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 21:38:15.887593 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.885011 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 21:38:15.887593 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.885014 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 21:38:15.887593 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.885016 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 21:38:15.887593 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.885019 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 21:38:15.887593 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.885021 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 21:38:15.887593 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.885024 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 21:38:15.887593 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.885026 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 21:38:15.887593 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.885029 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 21:38:15.887593 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.885032 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 21:38:15.887593 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.885035 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 21:38:15.887593 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.885038 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 21:38:15.887593 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.885040 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 21:38:15.887593 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.885043 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 21:38:15.887593 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.885045 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 21:38:15.888118 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.885047 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 21:38:15.888118 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.885050 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 21:38:15.888118 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.885053 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 21:38:15.888118 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.885055 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 21:38:15.888118 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.885058 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 21:38:15.888118 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.885060 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 21:38:15.888118 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.885062 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 21:38:15.888118 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.885065 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 21:38:15.888118 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.885067 2576 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 21:38:15.888118 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.885071 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 21:38:15.888118 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.885074 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 21:38:15.888118 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.885076 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 21:38:15.888118 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.885079 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 21:38:15.888118 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.885081 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 21:38:15.888118 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.885084 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 21:38:15.888118 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886462 2576 flags.go:64] FLAG: --address="0.0.0.0" May 27 21:38:15.888118 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886475 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 27 21:38:15.888118 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886481 2576 flags.go:64] FLAG: --anonymous-auth="true" May 27 21:38:15.888118 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886485 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" May 27 21:38:15.888118 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886490 2576 flags.go:64] FLAG: --authentication-token-webhook="false" May 27 21:38:15.888118 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886493 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 27 21:38:15.888668 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886497 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 27 21:38:15.888668 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886502 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 27 21:38:15.888668 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886505 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 27 21:38:15.888668 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886508 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 27 21:38:15.888668 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886512 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 27 21:38:15.888668 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886515 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 27 21:38:15.888668 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886518 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 27 21:38:15.888668 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886521 2576 flags.go:64] FLAG: --cgroup-root="" May 27 21:38:15.888668 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886524 2576 flags.go:64] FLAG: --cgroups-per-qos="true" May 27 21:38:15.888668 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886527 2576 flags.go:64] FLAG: --client-ca-file="" May 27 21:38:15.888668 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886530 2576 flags.go:64] FLAG: --cloud-config="" May 27 21:38:15.888668 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886533 2576 flags.go:64] FLAG: --cloud-provider="external" May 27 21:38:15.888668 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886536 2576 flags.go:64] FLAG: --cluster-dns="[]" May 27 21:38:15.888668 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886542 2576 flags.go:64] FLAG: --cluster-domain="" May 27 21:38:15.888668 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886545 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 27 21:38:15.888668 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886548 2576 flags.go:64] FLAG: --config-dir="" May 27 21:38:15.888668 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886550 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 27 21:38:15.888668 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886554 2576 flags.go:64] FLAG: --container-log-max-files="5" May 27 21:38:15.888668 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886557 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" May 27 21:38:15.888668 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886561 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 27 21:38:15.888668 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886564 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 27 21:38:15.888668 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886567 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 27 21:38:15.888668 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886570 2576 flags.go:64] FLAG: --contention-profiling="false" May 27 21:38:15.888668 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886573 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" May 27 21:38:15.889246 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886576 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 27 21:38:15.889246 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886579 2576 flags.go:64] FLAG: --cpu-manager-policy="none" May 27 21:38:15.889246 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886582 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" May 27 21:38:15.889246 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886586 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 27 21:38:15.889246 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886590 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 27 21:38:15.889246 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886593 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" May 27 21:38:15.889246 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886596 2576 flags.go:64] FLAG: --enable-load-reader="false" May 27 21:38:15.889246 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886599 2576 flags.go:64] FLAG: --enable-server="true" May 27 21:38:15.889246 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886602 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 27 21:38:15.889246 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886606 2576 flags.go:64] FLAG: --event-burst="100" May 27 21:38:15.889246 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886609 2576 flags.go:64] FLAG: --event-qps="50" May 27 21:38:15.889246 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886613 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 27 21:38:15.889246 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886616 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 27 21:38:15.889246 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886620 2576 flags.go:64] FLAG: --eviction-hard="" May 27 21:38:15.889246 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886623 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 27 21:38:15.889246 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886626 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 27 21:38:15.889246 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886629 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 27 21:38:15.889246 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886633 2576 flags.go:64] FLAG: --eviction-soft="" May 27 21:38:15.889246 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886636 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" May 27 21:38:15.889246 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886639 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" May 27 21:38:15.889246 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886642 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 27 21:38:15.889246 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886645 2576 flags.go:64] FLAG: --experimental-mounter-path="" May 27 21:38:15.889246 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886648 2576 flags.go:64] FLAG: --fail-cgroupv1="false" May 27 21:38:15.889246 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886651 2576 flags.go:64] FLAG: --fail-swap-on="true" May 27 21:38:15.889246 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886654 2576 flags.go:64] FLAG: --feature-gates="" May 27 21:38:15.889845 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886657 2576 flags.go:64] FLAG: --file-check-frequency="20s" May 27 21:38:15.889845 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886660 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 27 21:38:15.889845 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886663 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 27 21:38:15.889845 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886667 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 27 21:38:15.889845 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886670 2576 flags.go:64] FLAG: --healthz-port="10248" May 27 21:38:15.889845 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886672 2576 flags.go:64] FLAG: --help="false" May 27 21:38:15.889845 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886675 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-131-147.ec2.internal" May 27 21:38:15.889845 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886678 2576 flags.go:64] FLAG: --housekeeping-interval="10s" May 27 21:38:15.889845 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886681 2576 flags.go:64] FLAG: --http-check-frequency="20s" May 27 21:38:15.889845 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886684 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 27 21:38:15.889845 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886688 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 27 21:38:15.889845 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886691 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" May 27 21:38:15.889845 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886698 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" May 27 21:38:15.889845 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886701 2576 flags.go:64] FLAG: --image-service-endpoint="" May 27 21:38:15.889845 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886704 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" May 27 21:38:15.889845 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886707 2576 flags.go:64] FLAG: --kube-api-burst="100" May 27 21:38:15.889845 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886710 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 27 21:38:15.889845 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886713 2576 flags.go:64] FLAG: --kube-api-qps="50" May 27 21:38:15.889845 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886716 2576 flags.go:64] FLAG: --kube-reserved="" May 27 21:38:15.889845 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886720 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" May 27 21:38:15.889845 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886723 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 27 21:38:15.889845 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886726 2576 flags.go:64] FLAG: --kubelet-cgroups="" May 27 21:38:15.889845 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886729 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 27 21:38:15.889845 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886732 2576 flags.go:64] FLAG: --lock-file="" May 27 21:38:15.890468 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886734 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" May 27 21:38:15.890468 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886737 2576 flags.go:64] FLAG: --log-flush-frequency="5s" May 27 21:38:15.890468 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886740 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 27 21:38:15.890468 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886745 2576 flags.go:64] FLAG: --log-json-split-stream="false" May 27 21:38:15.890468 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886748 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 27 21:38:15.890468 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886752 2576 flags.go:64] FLAG: --log-text-split-stream="false" May 27 21:38:15.890468 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886754 2576 flags.go:64] FLAG: --logging-format="text" May 27 21:38:15.890468 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886757 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 27 21:38:15.890468 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886761 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" May 27 21:38:15.890468 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886764 2576 flags.go:64] FLAG: --manifest-url="" May 27 21:38:15.890468 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886767 2576 flags.go:64] FLAG: --manifest-url-header="" May 27 21:38:15.890468 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886771 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 27 21:38:15.890468 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886774 2576 flags.go:64] FLAG: --max-open-files="1000000" May 27 21:38:15.890468 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886778 2576 flags.go:64] FLAG: --max-pods="110" May 27 21:38:15.890468 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886781 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" May 27 21:38:15.890468 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886784 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 27 21:38:15.890468 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886787 2576 flags.go:64] FLAG: --memory-manager-policy="None" May 27 21:38:15.890468 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886790 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 27 21:38:15.890468 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886797 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 27 21:38:15.890468 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886801 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" May 27 21:38:15.890468 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886804 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 27 21:38:15.890468 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886812 2576 flags.go:64] FLAG: --node-status-max-images="50" May 27 21:38:15.890468 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886815 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" May 27 21:38:15.890468 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886818 2576 flags.go:64] FLAG: --oom-score-adj="-999" May 27 21:38:15.890468 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886821 2576 flags.go:64] FLAG: --pod-cidr="" May 27 21:38:15.891059 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886824 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 27 21:38:15.891059 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886830 2576 flags.go:64] FLAG: --pod-manifest-path="" May 27 21:38:15.891059 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886833 2576 flags.go:64] FLAG: --pod-max-pids="-1" May 27 21:38:15.891059 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886836 2576 flags.go:64] FLAG: --pods-per-core="0" May 27 21:38:15.891059 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886839 2576 flags.go:64] FLAG: --port="10250" May 27 21:38:15.891059 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886842 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" May 27 21:38:15.891059 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886845 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04c0782fbfbac2488" May 27 21:38:15.891059 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886849 2576 flags.go:64] FLAG: --qos-reserved="" May 27 21:38:15.891059 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886851 2576 flags.go:64] FLAG: --read-only-port="10255" May 27 21:38:15.891059 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886854 2576 flags.go:64] FLAG: --register-node="true" May 27 21:38:15.891059 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886857 2576 flags.go:64] FLAG: --register-schedulable="true" May 27 21:38:15.891059 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886860 2576 flags.go:64] FLAG: --register-with-taints="" May 27 21:38:15.891059 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886863 2576 flags.go:64] FLAG: --registry-burst="10" May 27 21:38:15.891059 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886866 2576 flags.go:64] FLAG: --registry-qps="5" May 27 21:38:15.891059 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886869 2576 flags.go:64] FLAG: --reserved-cpus="" May 27 21:38:15.891059 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886872 2576 flags.go:64] FLAG: --reserved-memory="" May 27 21:38:15.891059 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886875 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 27 21:38:15.891059 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886878 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 27 21:38:15.891059 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886882 2576 flags.go:64] FLAG: --rotate-certificates="false" May 27 21:38:15.891059 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886885 2576 flags.go:64] FLAG: --rotate-server-certificates="false" May 27 21:38:15.891059 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886888 2576 flags.go:64] FLAG: --runonce="false" May 27 21:38:15.891059 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886891 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 27 21:38:15.891059 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886894 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 27 21:38:15.891059 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886897 2576 flags.go:64] FLAG: --seccomp-default="false" May 27 21:38:15.891059 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886900 2576 flags.go:64] FLAG: --serialize-image-pulls="true" May 27 21:38:15.891719 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886903 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 27 21:38:15.891719 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886907 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 27 21:38:15.891719 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886910 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 27 21:38:15.891719 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886913 2576 flags.go:64] FLAG: --storage-driver-password="root" May 27 21:38:15.891719 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886916 2576 flags.go:64] FLAG: --storage-driver-secure="false" May 27 21:38:15.891719 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886919 2576 flags.go:64] FLAG: --storage-driver-table="stats" May 27 21:38:15.891719 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886922 2576 flags.go:64] FLAG: --storage-driver-user="root" May 27 21:38:15.891719 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886925 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 27 21:38:15.891719 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886928 2576 flags.go:64] FLAG: --sync-frequency="1m0s" May 27 21:38:15.891719 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886931 2576 flags.go:64] FLAG: --system-cgroups="" May 27 21:38:15.891719 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886934 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 27 21:38:15.891719 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886939 2576 flags.go:64] FLAG: --system-reserved-cgroup="" May 27 21:38:15.891719 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886942 2576 flags.go:64] FLAG: --tls-cert-file="" May 27 21:38:15.891719 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886945 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" May 27 21:38:15.891719 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886949 2576 flags.go:64] FLAG: --tls-min-version="" May 27 21:38:15.891719 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886952 2576 flags.go:64] FLAG: --tls-private-key-file="" May 27 21:38:15.891719 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886954 2576 flags.go:64] FLAG: --topology-manager-policy="none" May 27 21:38:15.891719 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886957 2576 flags.go:64] FLAG: --topology-manager-policy-options="" May 27 21:38:15.891719 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886960 2576 flags.go:64] FLAG: --topology-manager-scope="container" May 27 21:38:15.891719 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886963 2576 flags.go:64] FLAG: --v="2" May 27 21:38:15.891719 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886967 2576 flags.go:64] FLAG: --version="false" May 27 21:38:15.891719 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886971 2576 flags.go:64] FLAG: --vmodule="" May 27 21:38:15.891719 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886974 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 27 21:38:15.891719 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.886978 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 27 21:38:15.891719 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887073 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 21:38:15.892330 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887077 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 21:38:15.892330 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887080 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 21:38:15.892330 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887083 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 21:38:15.892330 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887086 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 21:38:15.892330 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887088 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 21:38:15.892330 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887090 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 21:38:15.892330 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887093 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 21:38:15.892330 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887096 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 21:38:15.892330 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887100 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 21:38:15.892330 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887103 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 21:38:15.892330 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887106 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 21:38:15.892330 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887108 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 21:38:15.892330 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887118 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 21:38:15.892330 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887120 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 21:38:15.892330 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887123 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 21:38:15.892330 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887126 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 21:38:15.892330 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887131 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 21:38:15.892330 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887134 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 21:38:15.892330 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887137 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 21:38:15.892796 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887141 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 21:38:15.892796 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887144 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 21:38:15.892796 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887147 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 21:38:15.892796 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887150 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 21:38:15.892796 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887153 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 21:38:15.892796 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887155 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 21:38:15.892796 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887158 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 21:38:15.892796 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887160 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 21:38:15.892796 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887163 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 21:38:15.892796 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887166 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 21:38:15.892796 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887168 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 21:38:15.892796 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887171 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 21:38:15.892796 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887173 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 21:38:15.892796 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887177 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 21:38:15.892796 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887180 2576 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 21:38:15.892796 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887183 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 21:38:15.892796 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887185 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 21:38:15.892796 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887188 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 21:38:15.892796 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887190 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 21:38:15.892796 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887193 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 21:38:15.893484 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887195 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 21:38:15.893484 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887198 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 21:38:15.893484 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887201 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 21:38:15.893484 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887203 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 21:38:15.893484 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887206 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 21:38:15.893484 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887208 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 21:38:15.893484 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887215 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 21:38:15.893484 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887218 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 21:38:15.893484 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887234 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 21:38:15.893484 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887238 2576 feature_gate.go:328] unrecognized feature gate: Example2 May 27 21:38:15.893484 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887243 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 21:38:15.893484 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887246 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 21:38:15.893484 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887251 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 21:38:15.893484 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887254 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 21:38:15.893484 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887256 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 21:38:15.893484 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887259 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 21:38:15.893484 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887262 2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 21:38:15.893484 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887264 2576 feature_gate.go:328] unrecognized feature gate: Example May 27 21:38:15.893484 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887267 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 21:38:15.893484 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887269 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 21:38:15.893976 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887272 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 21:38:15.893976 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887274 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 21:38:15.893976 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887278 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 21:38:15.893976 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887281 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 21:38:15.893976 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887284 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 21:38:15.893976 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887288 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 21:38:15.893976 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887291 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 21:38:15.893976 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887293 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 21:38:15.893976 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887296 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 21:38:15.893976 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887298 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 21:38:15.893976 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887301 2576 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 21:38:15.893976 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887303 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 21:38:15.893976 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887306 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 21:38:15.893976 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887308 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 21:38:15.893976 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887311 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 21:38:15.893976 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887314 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 21:38:15.893976 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887317 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 21:38:15.893976 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887319 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 21:38:15.893976 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887322 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 21:38:15.894458 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887330 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 21:38:15.894458 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887333 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 21:38:15.894458 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887335 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 21:38:15.894458 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887338 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 21:38:15.894458 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887340 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 21:38:15.894458 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887343 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 21:38:15.894458 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.887345 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 21:38:15.894458 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.888155 2576 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 27 21:38:15.894674 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.894658 2576 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 27 21:38:15.894706 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.894675 2576 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 27 21:38:15.894733 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894726 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 21:38:15.894733 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894730 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 21:38:15.894733 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894733 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 21:38:15.894809 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894737 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 21:38:15.894809 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894741 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 21:38:15.894809 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894743 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 21:38:15.894809 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894746 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 21:38:15.894809 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894749 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 21:38:15.894809 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894752 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 21:38:15.894809 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894755 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 21:38:15.894809 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894757 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 21:38:15.894809 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894760 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 21:38:15.894809 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894763 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 21:38:15.894809 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894766 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 21:38:15.894809 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894769 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 21:38:15.894809 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894771 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 21:38:15.894809 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894774 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 21:38:15.894809 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894776 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 21:38:15.894809 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894779 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 21:38:15.894809 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894781 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 21:38:15.894809 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894784 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 21:38:15.894809 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894786 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 21:38:15.894809 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894790 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 21:38:15.895344 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894792 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 21:38:15.895344 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894795 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 21:38:15.895344 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894798 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 21:38:15.895344 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894800 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 21:38:15.895344 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894802 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 21:38:15.895344 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894805 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 21:38:15.895344 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894807 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 21:38:15.895344 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894810 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 21:38:15.895344 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894813 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 21:38:15.895344 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894816 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 21:38:15.895344 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894819 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 21:38:15.895344 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894823 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 21:38:15.895344 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894827 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 21:38:15.895344 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894830 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 21:38:15.895344 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894832 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 21:38:15.895344 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894835 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 21:38:15.895344 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894837 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 21:38:15.895344 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894840 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 21:38:15.895344 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894842 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 21:38:15.895817 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894845 2576 feature_gate.go:328] unrecognized feature gate: Example May 27 21:38:15.895817 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894847 2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 21:38:15.895817 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894850 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 21:38:15.895817 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894852 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 21:38:15.895817 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894855 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 21:38:15.895817 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894857 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 21:38:15.895817 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894859 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 21:38:15.895817 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894862 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 21:38:15.895817 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894864 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 21:38:15.895817 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894867 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 21:38:15.895817 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894870 2576 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 21:38:15.895817 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894872 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 21:38:15.895817 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894875 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 21:38:15.895817 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894878 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 21:38:15.895817 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894881 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 21:38:15.895817 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894886 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 21:38:15.895817 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894889 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 21:38:15.895817 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894892 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 21:38:15.895817 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894895 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 21:38:15.896322 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894898 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 21:38:15.896322 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894901 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 21:38:15.896322 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894903 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 21:38:15.896322 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894906 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 21:38:15.896322 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894909 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 21:38:15.896322 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894911 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 21:38:15.896322 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894913 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 21:38:15.896322 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894916 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 21:38:15.896322 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894918 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 21:38:15.896322 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894921 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 21:38:15.896322 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894923 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 21:38:15.896322 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894926 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 21:38:15.896322 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894929 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 21:38:15.896322 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894931 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 21:38:15.896322 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894934 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 21:38:15.896322 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894936 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 21:38:15.896322 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894939 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 21:38:15.896322 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894941 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 21:38:15.896322 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894943 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 21:38:15.896322 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894946 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 21:38:15.896800 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894948 2576 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 21:38:15.896800 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894951 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 21:38:15.896800 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894953 2576 feature_gate.go:328] unrecognized feature gate: Example2 May 27 21:38:15.896800 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894956 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 21:38:15.896800 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.894959 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 21:38:15.896800 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.894964 2576 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 27 21:38:15.896800 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895053 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 21:38:15.896800 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895058 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 21:38:15.896800 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895061 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 21:38:15.896800 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895064 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 21:38:15.896800 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895067 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 21:38:15.896800 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895069 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 21:38:15.896800 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895072 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 21:38:15.896800 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895075 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 21:38:15.896800 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895078 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 21:38:15.897171 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895081 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 21:38:15.897171 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895083 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 21:38:15.897171 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895086 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 21:38:15.897171 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895088 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 21:38:15.897171 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895091 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 21:38:15.897171 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895093 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 21:38:15.897171 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895096 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 21:38:15.897171 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895098 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 21:38:15.897171 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895101 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 21:38:15.897171 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895103 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 21:38:15.897171 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895106 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 21:38:15.897171 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895108 2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 21:38:15.897171 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895111 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 21:38:15.897171 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895113 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 21:38:15.897171 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895115 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 21:38:15.897171 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895118 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 21:38:15.897171 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895120 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 21:38:15.897171 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895123 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 21:38:15.897171 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895125 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 21:38:15.897171 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895127 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 21:38:15.897670 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895130 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 21:38:15.897670 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895132 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 21:38:15.897670 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895135 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 21:38:15.897670 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895137 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 21:38:15.897670 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895140 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 21:38:15.897670 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895143 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 21:38:15.897670 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895146 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 21:38:15.897670 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895150 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 21:38:15.897670 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895153 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 21:38:15.897670 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895156 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 21:38:15.897670 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895159 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 21:38:15.897670 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895162 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 21:38:15.897670 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895165 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 21:38:15.897670 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895168 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 21:38:15.897670 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895170 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 21:38:15.897670 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895173 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 21:38:15.897670 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895175 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 21:38:15.897670 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895178 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 21:38:15.897670 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895180 2576 feature_gate.go:328] unrecognized feature gate: Example May 27 21:38:15.898126 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895182 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 21:38:15.898126 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895185 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 21:38:15.898126 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895187 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 21:38:15.898126 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895190 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 21:38:15.898126 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895192 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 21:38:15.898126 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895195 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 21:38:15.898126 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895198 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 21:38:15.898126 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895200 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 21:38:15.898126 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895203 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 21:38:15.898126 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895206 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 21:38:15.898126 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895208 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 21:38:15.898126 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895210 2576 feature_gate.go:328] unrecognized feature gate: Example2 May 27 21:38:15.898126 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895213 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 21:38:15.898126 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895215 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 21:38:15.898126 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895218 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 21:38:15.898126 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895234 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 21:38:15.898126 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895238 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 21:38:15.898126 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895241 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 21:38:15.898126 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895245 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 21:38:15.898126 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895249 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 21:38:15.898651 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895252 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 21:38:15.898651 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895255 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 21:38:15.898651 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895257 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 21:38:15.898651 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895260 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 21:38:15.898651 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895262 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 21:38:15.898651 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895265 2576 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 21:38:15.898651 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895267 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 21:38:15.898651 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895270 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 21:38:15.898651 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895272 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 21:38:15.898651 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895275 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 21:38:15.898651 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895277 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 21:38:15.898651 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895280 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 21:38:15.898651 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895282 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 21:38:15.898651 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895285 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 21:38:15.898651 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895287 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 21:38:15.898651 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895290 2576 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 21:38:15.898651 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895292 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 21:38:15.898651 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:15.895295 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 21:38:15.899091 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.895300 2576 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 27 21:38:15.899091 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.896169 2576 server.go:962] "Client rotation is on, will bootstrap in background" May 27 21:38:15.899091 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.898426 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 27 21:38:15.899529 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.899516 2576 server.go:1019] "Starting client certificate rotation" May 27 21:38:15.899645 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.899627 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 27 21:38:15.899677 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.899666 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 27 21:38:15.928519 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.928501 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 27 21:38:15.931448 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.931426 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 27 21:38:15.950872 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.950854 2576 log.go:25] "Validated CRI v1 runtime API" May 27 21:38:15.956721 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.956705 2576 log.go:25] "Validated CRI v1 image API" May 27 21:38:15.958128 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.958110 2576 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 27 21:38:15.960616 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.960598 2576 fs.go:135] Filesystem UUIDs: map[5a517b50-a50a-47fa-9899-1e89c2b3d60d:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 9eacd70d-1258-42cd-8063-e4b323e51b28:/dev/nvme0n1p3] May 27 21:38:15.960681 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.960616 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 27 21:38:15.965512 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.965399 2576 manager.go:217] Machine: {Timestamp:2026-05-27 21:38:15.964892901 +0000 UTC m=+0.479642681 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102156 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28cf3f36726d577a84b89f1829f6e7 SystemUUID:ec28cf3f-3672-6d57-7a84-b89f1829f6e7 BootID:032e1619-905a-437c-ac82-b99f4aba7bc2 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2e:79:cd:8a:39 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2e:79:cd:8a:39 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5e:da:89:ea:86:48 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 27 21:38:15.966293 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.966278 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 27 21:38:15.966424 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.966409 2576 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 27 21:38:15.968516 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.968488 2576 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 27 21:38:15.968674 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.968520 2576 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-147.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 27 21:38:15.968764 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.968688 2576 topology_manager.go:138] "Creating topology manager with none policy" May 27 21:38:15.968764 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.968701 2576 container_manager_linux.go:306] "Creating device plugin manager" May 27 21:38:15.968764 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.968712 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 27 21:38:15.969605 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.969593 2576 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 27 21:38:15.971401 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.971384 2576 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 27 21:38:15.971470 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.971388 2576 state_mem.go:36] "Initialized new in-memory state store" May 27 21:38:15.971724 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.971711 2576 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 27 21:38:15.974394 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.974383 2576 kubelet.go:491] "Attempting to sync node with API server" May 27 21:38:15.974451 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.974401 2576 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 27 21:38:15.974451 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.974419 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 27 21:38:15.974451 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.974441 2576 kubelet.go:397] "Adding apiserver pod source" May 27 21:38:15.974570 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.974453 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 27 21:38:15.975839 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.975825 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 27 21:38:15.975912 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.975849 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 27 21:38:15.979467 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.979453 2576 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 27 21:38:15.981590 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.981576 2576 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 27 21:38:15.984537 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:15.984512 2576 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-147.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 27 21:38:15.984537 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.984532 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 27 21:38:15.984628 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.984547 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 27 21:38:15.984628 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.984553 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 27 21:38:15.984628 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.984559 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 27 21:38:15.984628 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.984567 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 27 21:38:15.984628 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.984573 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 27 21:38:15.984628 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.984579 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 27 21:38:15.984628 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.984585 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 27 21:38:15.984628 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.984591 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 27 21:38:15.984628 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.984597 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 27 21:38:15.984628 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:15.984512 2576 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 27 21:38:15.984628 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.984608 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 27 21:38:15.984628 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.984615 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 27 21:38:15.986508 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.986497 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 27 21:38:15.986542 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.986510 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 27 21:38:15.989583 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.989571 2576 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 27 21:38:15.989623 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.989609 2576 server.go:1295] "Started kubelet" May 27 21:38:15.989709 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.989666 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 27 21:38:15.989765 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.989716 2576 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 27 21:38:15.989803 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.989790 2576 server_v1.go:47] "podresources" method="list" useActivePods=true May 27 21:38:15.990304 ip-10-0-131-147 systemd[1]: Started Kubernetes Kubelet. May 27 21:38:15.992100 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.992073 2576 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 27 21:38:15.992959 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.992929 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-crl92" May 27 21:38:15.993135 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:15.993109 2576 server.go:317] "Adding debug handlers to kubelet server" May 27 21:38:16.000770 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.000755 2576 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-147.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 27 21:38:16.000864 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.000850 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-crl92" May 27 21:38:16.001366 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.001350 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 27 21:38:16.001438 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.001365 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 27 21:38:16.001640 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:16.001493 2576 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 27 21:38:16.001640 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.001519 2576 volume_manager.go:295] "The desired_state_of_world populator starts" May 27 21:38:16.001640 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.001530 2576 volume_manager.go:297] "Starting Kubelet Volume Manager" May 27 21:38:16.001814 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.001644 2576 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 27 21:38:16.001814 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.001709 2576 reconstruct.go:97] "Volume reconstruction finished" May 27 21:38:16.001814 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.001718 2576 reconciler.go:26] "Reconciler: start to sync state" May 27 21:38:16.002045 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.002029 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 27 21:38:16.002110 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.002048 2576 factory.go:55] Registering systemd factory May 27 21:38:16.002110 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.002057 2576 factory.go:223] Registration of the systemd container factory successfully May 27 21:38:16.002250 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:16.001175 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-147.ec2.internal.18b389e55fd1de5b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-147.ec2.internal,UID:ip-10-0-131-147.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-147.ec2.internal,},FirstTimestamp:2026-05-27 21:38:15.989583451 +0000 UTC m=+0.504333226,LastTimestamp:2026-05-27 21:38:15.989583451 +0000 UTC m=+0.504333226,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-147.ec2.internal,}" May 27 21:38:16.002317 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.002297 2576 factory.go:153] Registering CRI-O factory May 27 21:38:16.002317 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.002309 2576 factory.go:223] Registration of the crio container factory successfully May 27 21:38:16.002426 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.002321 2576 factory.go:103] Registering Raw factory May 27 21:38:16.002426 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.002335 2576 manager.go:1196] Started watching for new ooms in manager May 27 21:38:16.002644 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:16.002546 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-147.ec2.internal\" not found" May 27 21:38:16.003170 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.003153 2576 manager.go:319] Starting recovery of all containers May 27 21:38:16.011448 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.011288 2576 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 27 21:38:16.012044 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.011972 2576 manager.go:324] Recovery completed May 27 21:38:16.014391 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:16.014370 2576 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-131-147.ec2.internal\" not found" node="ip-10-0-131-147.ec2.internal" May 27 21:38:16.016802 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.016783 2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 21:38:16.019826 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.019810 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-147.ec2.internal" event="NodeHasSufficientMemory" May 27 21:38:16.019885 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.019837 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-147.ec2.internal" event="NodeHasNoDiskPressure" May 27 21:38:16.019885 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.019847 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-147.ec2.internal" event="NodeHasSufficientPID" May 27 21:38:16.020340 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.020316 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" May 27 21:38:16.020340 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.020332 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 27 21:38:16.020445 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.020351 2576 state_mem.go:36] "Initialized new in-memory state store" May 27 21:38:16.024137 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.024125 2576 policy_none.go:49] "None policy: Start" May 27 21:38:16.024192 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.024141 2576 memory_manager.go:186] "Starting memorymanager" policy="None" May 27 21:38:16.024192 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.024151 2576 state_mem.go:35] "Initializing new in-memory state store" May 27 21:38:16.065789 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.065775 2576 manager.go:341] "Starting Device Plugin manager" May 27 21:38:16.088985 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:16.065813 2576 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 27 21:38:16.088985 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.065833 2576 server.go:85] "Starting device plugin registration server" May 27 21:38:16.088985 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.066095 2576 eviction_manager.go:189] "Eviction manager: starting control loop" May 27 21:38:16.088985 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.066107 2576 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 27 21:38:16.088985 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.066199 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 27 21:38:16.088985 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.066293 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 27 21:38:16.088985 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.066302 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 27 21:38:16.088985 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:16.066743 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 27 21:38:16.088985 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:16.066769 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-147.ec2.internal\" not found" May 27 21:38:16.114073 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.114047 2576 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 27 21:38:16.115139 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.115125 2576 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 27 21:38:16.115243 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.115152 2576 status_manager.go:230] "Starting to sync pod status with apiserver" May 27 21:38:16.115243 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.115174 2576 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 27 21:38:16.115243 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.115182 2576 kubelet.go:2451] "Starting kubelet main sync loop" May 27 21:38:16.115380 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:16.115242 2576 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 27 21:38:16.119969 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.119948 2576 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 27 21:38:16.166963 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.166909 2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 21:38:16.168859 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.168845 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-147.ec2.internal" event="NodeHasSufficientMemory" May 27 21:38:16.168947 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.168877 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-147.ec2.internal" event="NodeHasNoDiskPressure" May 27 21:38:16.168947 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.168894 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-147.ec2.internal" event="NodeHasSufficientPID" May 27 21:38:16.168947 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.168924 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-147.ec2.internal" May 27 21:38:16.178111 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.178093 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-147.ec2.internal" May 27 21:38:16.178180 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:16.178116 2576 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-147.ec2.internal\": node \"ip-10-0-131-147.ec2.internal\" not found" May 27 21:38:16.194914 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:16.194889 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-147.ec2.internal\" not found" May 27 21:38:16.215658 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.215637 2576 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-147.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-147.ec2.internal"] May 27 21:38:16.215733 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.215706 2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 21:38:16.216978 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.216964 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-147.ec2.internal" event="NodeHasSufficientMemory" May 27 21:38:16.217056 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.216990 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-147.ec2.internal" event="NodeHasNoDiskPressure" May 27 21:38:16.217056 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.217004 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-147.ec2.internal" event="NodeHasSufficientPID" May 27 21:38:16.218665 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.218651 2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 21:38:16.218835 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.218821 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-147.ec2.internal" May 27 21:38:16.218915 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.218855 2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 21:38:16.219368 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.219355 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-147.ec2.internal" event="NodeHasSufficientMemory" May 27 21:38:16.219368 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.219363 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-147.ec2.internal" event="NodeHasSufficientMemory" May 27 21:38:16.219481 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.219381 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-147.ec2.internal" event="NodeHasNoDiskPressure" May 27 21:38:16.219481 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.219387 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-147.ec2.internal" event="NodeHasNoDiskPressure" May 27 21:38:16.219481 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.219394 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-147.ec2.internal" event="NodeHasSufficientPID" May 27 21:38:16.219481 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.219400 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-147.ec2.internal" event="NodeHasSufficientPID" May 27 21:38:16.220764 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.220750 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-147.ec2.internal" May 27 21:38:16.220834 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.220773 2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 21:38:16.221447 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.221429 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-147.ec2.internal" event="NodeHasSufficientMemory" May 27 21:38:16.221510 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.221454 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-147.ec2.internal" event="NodeHasNoDiskPressure" May 27 21:38:16.221510 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.221466 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-147.ec2.internal" event="NodeHasSufficientPID" May 27 21:38:16.244038 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:16.244014 2576 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-147.ec2.internal\" not found" node="ip-10-0-131-147.ec2.internal" May 27 21:38:16.248826 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:16.248807 2576 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-147.ec2.internal\" not found" node="ip-10-0-131-147.ec2.internal" May 27 21:38:16.295313 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:16.295282 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-147.ec2.internal\" not found" May 27 21:38:16.303602 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.303579 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c1afe2868c0fcdc073c3e2c06b48232e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-147.ec2.internal\" (UID: \"c1afe2868c0fcdc073c3e2c06b48232e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-147.ec2.internal" May 27 21:38:16.303672 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.303610 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b08bdc800ac3949123f1ded355038db0-config\") pod \"kube-apiserver-proxy-ip-10-0-131-147.ec2.internal\" (UID: \"b08bdc800ac3949123f1ded355038db0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-147.ec2.internal" May 27 21:38:16.303672 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.303628 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c1afe2868c0fcdc073c3e2c06b48232e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-147.ec2.internal\" (UID: \"c1afe2868c0fcdc073c3e2c06b48232e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-147.ec2.internal" May 27 21:38:16.395438 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:16.395410 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-147.ec2.internal\" not found" May 27 21:38:16.404118 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.404096 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b08bdc800ac3949123f1ded355038db0-config\") pod \"kube-apiserver-proxy-ip-10-0-131-147.ec2.internal\" (UID: \"b08bdc800ac3949123f1ded355038db0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-147.ec2.internal" May 27 21:38:16.404202 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.404129 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c1afe2868c0fcdc073c3e2c06b48232e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-147.ec2.internal\" (UID: \"c1afe2868c0fcdc073c3e2c06b48232e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-147.ec2.internal" May 27 21:38:16.404202 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.404155 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c1afe2868c0fcdc073c3e2c06b48232e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-147.ec2.internal\" (UID: \"c1afe2868c0fcdc073c3e2c06b48232e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-147.ec2.internal" May 27 21:38:16.404311 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.404210 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c1afe2868c0fcdc073c3e2c06b48232e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-147.ec2.internal\" (UID: \"c1afe2868c0fcdc073c3e2c06b48232e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-147.ec2.internal" May 27 21:38:16.404311 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.404216 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c1afe2868c0fcdc073c3e2c06b48232e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-147.ec2.internal\" (UID: \"c1afe2868c0fcdc073c3e2c06b48232e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-147.ec2.internal" May 27 21:38:16.404311 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.404216 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b08bdc800ac3949123f1ded355038db0-config\") pod \"kube-apiserver-proxy-ip-10-0-131-147.ec2.internal\" (UID: \"b08bdc800ac3949123f1ded355038db0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-147.ec2.internal" May 27 21:38:16.496560 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:16.496484 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-147.ec2.internal\" not found" May 27 21:38:16.546894 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.546864 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-147.ec2.internal" May 27 21:38:16.551620 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.551601 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-147.ec2.internal" May 27 21:38:16.597621 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:16.597589 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-147.ec2.internal\" not found" May 27 21:38:16.698040 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:16.698001 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-147.ec2.internal\" not found" May 27 21:38:16.798538 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:16.798456 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-147.ec2.internal\" not found" May 27 21:38:16.898965 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:16.898944 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-147.ec2.internal\" not found" May 27 21:38:16.898965 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.898952 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 27 21:38:16.899501 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.899086 2576 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 27 21:38:16.899501 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.899086 2576 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 27 21:38:16.961712 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.961686 2576 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 27 21:38:16.975282 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.975259 2576 apiserver.go:52] "Watching apiserver" May 27 21:38:16.986759 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.986738 2576 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 27 21:38:16.988159 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.987630 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqxwq","openshift-dns/node-resolver-l45ck","openshift-image-registry/node-ca-slshq","openshift-multus/multus-additional-cni-plugins-ppk2n","openshift-multus/multus-pf6kj","openshift-network-diagnostics/network-check-target-w2hrz","openshift-network-operator/iptables-alerter-c4lsx","openshift-cluster-node-tuning-operator/tuned-7mxp4","openshift-multus/network-metrics-daemon-9rhhm","openshift-ovn-kubernetes/ovnkube-node-szbhn","kube-system/konnectivity-agent-nd7v5"] May 27 21:38:16.990634 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.990613 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqxwq" May 27 21:38:16.991722 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.991706 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l45ck" May 27 21:38:16.991821 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.991806 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-slshq" May 27 21:38:16.993310 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.993294 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ppk2n" May 27 21:38:16.994486 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.994466 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pf6kj" May 27 21:38:16.995698 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.995682 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2hrz" May 27 21:38:16.995768 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:16.995747 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2hrz" podUID="d01f51b6-35bd-4b64-8ad3-bded3b471f4a" May 27 21:38:16.996895 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.996881 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c4lsx" May 27 21:38:16.998296 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.998278 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7mxp4" May 27 21:38:16.999476 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:16.999462 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9rhhm" May 27 21:38:16.999519 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:16.999506 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9rhhm" podUID="b674a492-3189-4694-a48b-fee4bb3f616f" May 27 21:38:17.000896 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.000879 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.001819 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.001805 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 27 21:38:17.001907 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.001804 2576 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-147.ec2.internal" May 27 21:38:17.002031 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.002014 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nd7v5" May 27 21:38:17.002667 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.002645 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-26 21:33:15 +0000 UTC" deadline="2028-03-03 00:52:19.753014664 +0000 UTC" May 27 21:38:17.002667 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.002666 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15483h14m2.750351589s" May 27 21:38:17.006396 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.006376 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/79a9dc4b-003d-47a5-9db1-c461022e3ee4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ppk2n\" (UID: \"79a9dc4b-003d-47a5-9db1-c461022e3ee4\") " pod="openshift-multus/multus-additional-cni-plugins-ppk2n" May 27 21:38:17.006450 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.006415 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/51ebb9a3-516d-49f1-913e-1fbf7c7952ef-iptables-alerter-script\") pod \"iptables-alerter-c4lsx\" (UID: \"51ebb9a3-516d-49f1-913e-1fbf7c7952ef\") " pod="openshift-network-operator/iptables-alerter-c4lsx" May 27 21:38:17.006450 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.006439 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/035c08c0-7405-4c02-970e-8876168c1041-hostroot\") pod \"multus-pf6kj\" (UID: \"035c08c0-7405-4c02-970e-8876168c1041\") " pod="openshift-multus/multus-pf6kj" May 27 21:38:17.006531 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.006465 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vx7rc\" (UniqueName: \"kubernetes.io/projected/035c08c0-7405-4c02-970e-8876168c1041-kube-api-access-vx7rc\") pod \"multus-pf6kj\" (UID: \"035c08c0-7405-4c02-970e-8876168c1041\") " pod="openshift-multus/multus-pf6kj" May 27 21:38:17.006531 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.006489 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/eff20c13-45ed-4db5-8948-597f7876aa7e-host-cni-netd\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.006531 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.006514 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eff20c13-45ed-4db5-8948-597f7876aa7e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.006657 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.006551 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f2ada616-2b6a-4c09-be0a-f1fe5acbe775-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bqxwq\" (UID: \"f2ada616-2b6a-4c09-be0a-f1fe5acbe775\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqxwq" May 27 21:38:17.006657 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.006575 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f2ada616-2b6a-4c09-be0a-f1fe5acbe775-socket-dir\") pod \"aws-ebs-csi-driver-node-bqxwq\" (UID: \"f2ada616-2b6a-4c09-be0a-f1fe5acbe775\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqxwq" May 27 21:38:17.006657 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.006615 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/79a9dc4b-003d-47a5-9db1-c461022e3ee4-cni-binary-copy\") pod \"multus-additional-cni-plugins-ppk2n\" (UID: \"79a9dc4b-003d-47a5-9db1-c461022e3ee4\") " pod="openshift-multus/multus-additional-cni-plugins-ppk2n" May 27 21:38:17.006657 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.006650 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bd5e8436-5b68-4fb7-9d97-d3d8d441f980-hosts-file\") pod \"node-resolver-l45ck\" (UID: \"bd5e8436-5b68-4fb7-9d97-d3d8d441f980\") " pod="openshift-dns/node-resolver-l45ck" May 27 21:38:17.006841 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.006671 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/035c08c0-7405-4c02-970e-8876168c1041-system-cni-dir\") pod \"multus-pf6kj\" (UID: \"035c08c0-7405-4c02-970e-8876168c1041\") " pod="openshift-multus/multus-pf6kj" May 27 21:38:17.006841 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.006712 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/035c08c0-7405-4c02-970e-8876168c1041-etc-kubernetes\") pod \"multus-pf6kj\" (UID: \"035c08c0-7405-4c02-970e-8876168c1041\") " pod="openshift-multus/multus-pf6kj" May 27 21:38:17.006841 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.006747 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eff20c13-45ed-4db5-8948-597f7876aa7e-host-run-ovn-kubernetes\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.006841 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.006780 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/97d8a31d-74d6-40a4-bbe8-734aa7e10fdd-agent-certs\") pod \"konnectivity-agent-nd7v5\" (UID: \"97d8a31d-74d6-40a4-bbe8-734aa7e10fdd\") " pod="kube-system/konnectivity-agent-nd7v5" May 27 21:38:17.006841 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.006805 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/035c08c0-7405-4c02-970e-8876168c1041-host-var-lib-kubelet\") pod \"multus-pf6kj\" (UID: \"035c08c0-7405-4c02-970e-8876168c1041\") " pod="openshift-multus/multus-pf6kj" May 27 21:38:17.006841 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.006831 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/debbbcbe-da6e-456c-b7fb-c346f7b6ed2d-tmp\") pod \"tuned-7mxp4\" (UID: \"debbbcbe-da6e-456c-b7fb-c346f7b6ed2d\") " pod="openshift-cluster-node-tuning-operator/tuned-7mxp4" May 27 21:38:17.007058 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.006854 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eff20c13-45ed-4db5-8948-597f7876aa7e-host-run-netns\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.007058 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.006876 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9efca526-fa4d-4195-a7ab-9139cb1c02ad-serviceca\") pod \"node-ca-slshq\" (UID: \"9efca526-fa4d-4195-a7ab-9139cb1c02ad\") " pod="openshift-image-registry/node-ca-slshq" May 27 21:38:17.007058 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.006912 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqjv4\" (UniqueName: \"kubernetes.io/projected/b674a492-3189-4694-a48b-fee4bb3f616f-kube-api-access-tqjv4\") pod \"network-metrics-daemon-9rhhm\" (UID: \"b674a492-3189-4694-a48b-fee4bb3f616f\") " pod="openshift-multus/network-metrics-daemon-9rhhm" May 27 21:38:17.007058 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.006932 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/debbbcbe-da6e-456c-b7fb-c346f7b6ed2d-etc-tuned\") pod \"tuned-7mxp4\" (UID: \"debbbcbe-da6e-456c-b7fb-c346f7b6ed2d\") " pod="openshift-cluster-node-tuning-operator/tuned-7mxp4" May 27 21:38:17.007058 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.006947 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eff20c13-45ed-4db5-8948-597f7876aa7e-run-openvswitch\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.007058 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.006961 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eff20c13-45ed-4db5-8948-597f7876aa7e-host-cni-bin\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.007058 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.006992 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f2ada616-2b6a-4c09-be0a-f1fe5acbe775-etc-selinux\") pod \"aws-ebs-csi-driver-node-bqxwq\" (UID: \"f2ada616-2b6a-4c09-be0a-f1fe5acbe775\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqxwq" May 27 21:38:17.007058 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.007026 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9efca526-fa4d-4195-a7ab-9139cb1c02ad-host\") pod \"node-ca-slshq\" (UID: \"9efca526-fa4d-4195-a7ab-9139cb1c02ad\") " pod="openshift-image-registry/node-ca-slshq" May 27 21:38:17.007058 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.007043 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpt5l\" (UniqueName: \"kubernetes.io/projected/9efca526-fa4d-4195-a7ab-9139cb1c02ad-kube-api-access-jpt5l\") pod \"node-ca-slshq\" (UID: \"9efca526-fa4d-4195-a7ab-9139cb1c02ad\") " pod="openshift-image-registry/node-ca-slshq" May 27 21:38:17.007058 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.007061 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/035c08c0-7405-4c02-970e-8876168c1041-host-run-multus-certs\") pod \"multus-pf6kj\" (UID: \"035c08c0-7405-4c02-970e-8876168c1041\") " pod="openshift-multus/multus-pf6kj" May 27 21:38:17.007468 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.007075 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/eff20c13-45ed-4db5-8948-597f7876aa7e-systemd-units\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.007468 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.007088 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eff20c13-45ed-4db5-8948-597f7876aa7e-host-slash\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.007468 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.007114 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eff20c13-45ed-4db5-8948-597f7876aa7e-etc-openvswitch\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.007468 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.007140 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/eff20c13-45ed-4db5-8948-597f7876aa7e-ovn-node-metrics-cert\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.007468 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.007156 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/eff20c13-45ed-4db5-8948-597f7876aa7e-host-kubelet\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.007468 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.007177 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/79a9dc4b-003d-47a5-9db1-c461022e3ee4-cnibin\") pod \"multus-additional-cni-plugins-ppk2n\" (UID: \"79a9dc4b-003d-47a5-9db1-c461022e3ee4\") " pod="openshift-multus/multus-additional-cni-plugins-ppk2n" May 27 21:38:17.007468 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.007193 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdncr\" (UniqueName: \"kubernetes.io/projected/51ebb9a3-516d-49f1-913e-1fbf7c7952ef-kube-api-access-sdncr\") pod \"iptables-alerter-c4lsx\" (UID: \"51ebb9a3-516d-49f1-913e-1fbf7c7952ef\") " pod="openshift-network-operator/iptables-alerter-c4lsx" May 27 21:38:17.007468 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.007209 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9nwz\" (UniqueName: \"kubernetes.io/projected/bd5e8436-5b68-4fb7-9d97-d3d8d441f980-kube-api-access-d9nwz\") pod \"node-resolver-l45ck\" (UID: \"bd5e8436-5b68-4fb7-9d97-d3d8d441f980\") " pod="openshift-dns/node-resolver-l45ck" May 27 21:38:17.007468 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.007237 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/035c08c0-7405-4c02-970e-8876168c1041-cnibin\") pod \"multus-pf6kj\" (UID: \"035c08c0-7405-4c02-970e-8876168c1041\") " pod="openshift-multus/multus-pf6kj" May 27 21:38:17.007468 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.007270 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/debbbcbe-da6e-456c-b7fb-c346f7b6ed2d-etc-sysctl-conf\") pod \"tuned-7mxp4\" (UID: \"debbbcbe-da6e-456c-b7fb-c346f7b6ed2d\") " pod="openshift-cluster-node-tuning-operator/tuned-7mxp4" May 27 21:38:17.007468 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.007299 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/035c08c0-7405-4c02-970e-8876168c1041-host-var-lib-cni-multus\") pod \"multus-pf6kj\" (UID: \"035c08c0-7405-4c02-970e-8876168c1041\") " pod="openshift-multus/multus-pf6kj" May 27 21:38:17.007468 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.007332 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/035c08c0-7405-4c02-970e-8876168c1041-multus-daemon-config\") pod \"multus-pf6kj\" (UID: \"035c08c0-7405-4c02-970e-8876168c1041\") " pod="openshift-multus/multus-pf6kj" May 27 21:38:17.007468 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.007358 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/debbbcbe-da6e-456c-b7fb-c346f7b6ed2d-etc-modprobe-d\") pod \"tuned-7mxp4\" (UID: \"debbbcbe-da6e-456c-b7fb-c346f7b6ed2d\") " pod="openshift-cluster-node-tuning-operator/tuned-7mxp4" May 27 21:38:17.007468 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.007382 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/debbbcbe-da6e-456c-b7fb-c346f7b6ed2d-etc-systemd\") pod \"tuned-7mxp4\" (UID: \"debbbcbe-da6e-456c-b7fb-c346f7b6ed2d\") " pod="openshift-cluster-node-tuning-operator/tuned-7mxp4" May 27 21:38:17.007468 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.007405 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/debbbcbe-da6e-456c-b7fb-c346f7b6ed2d-host\") pod \"tuned-7mxp4\" (UID: \"debbbcbe-da6e-456c-b7fb-c346f7b6ed2d\") " pod="openshift-cluster-node-tuning-operator/tuned-7mxp4" May 27 21:38:17.007468 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.007427 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/eff20c13-45ed-4db5-8948-597f7876aa7e-run-ovn\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.008067 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.007451 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/79a9dc4b-003d-47a5-9db1-c461022e3ee4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ppk2n\" (UID: \"79a9dc4b-003d-47a5-9db1-c461022e3ee4\") " pod="openshift-multus/multus-additional-cni-plugins-ppk2n" May 27 21:38:17.008067 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.007473 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/035c08c0-7405-4c02-970e-8876168c1041-multus-socket-dir-parent\") pod \"multus-pf6kj\" (UID: \"035c08c0-7405-4c02-970e-8876168c1041\") " pod="openshift-multus/multus-pf6kj" May 27 21:38:17.008067 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.007506 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/035c08c0-7405-4c02-970e-8876168c1041-host-run-netns\") pod \"multus-pf6kj\" (UID: \"035c08c0-7405-4c02-970e-8876168c1041\") " pod="openshift-multus/multus-pf6kj" May 27 21:38:17.008067 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.007525 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55cb6\" (UniqueName: \"kubernetes.io/projected/d01f51b6-35bd-4b64-8ad3-bded3b471f4a-kube-api-access-55cb6\") pod \"network-check-target-w2hrz\" (UID: \"d01f51b6-35bd-4b64-8ad3-bded3b471f4a\") " pod="openshift-network-diagnostics/network-check-target-w2hrz" May 27 21:38:17.008067 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.007540 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/debbbcbe-da6e-456c-b7fb-c346f7b6ed2d-sys\") pod \"tuned-7mxp4\" (UID: \"debbbcbe-da6e-456c-b7fb-c346f7b6ed2d\") " pod="openshift-cluster-node-tuning-operator/tuned-7mxp4" May 27 21:38:17.008067 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.007554 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/eff20c13-45ed-4db5-8948-597f7876aa7e-run-systemd\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.008067 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.007570 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/79a9dc4b-003d-47a5-9db1-c461022e3ee4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ppk2n\" (UID: \"79a9dc4b-003d-47a5-9db1-c461022e3ee4\") " pod="openshift-multus/multus-additional-cni-plugins-ppk2n" May 27 21:38:17.008067 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.007585 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/035c08c0-7405-4c02-970e-8876168c1041-multus-cni-dir\") pod \"multus-pf6kj\" (UID: \"035c08c0-7405-4c02-970e-8876168c1041\") " pod="openshift-multus/multus-pf6kj" May 27 21:38:17.008067 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.007615 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/debbbcbe-da6e-456c-b7fb-c346f7b6ed2d-etc-kubernetes\") pod \"tuned-7mxp4\" (UID: \"debbbcbe-da6e-456c-b7fb-c346f7b6ed2d\") " pod="openshift-cluster-node-tuning-operator/tuned-7mxp4" May 27 21:38:17.008067 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.007632 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f2ada616-2b6a-4c09-be0a-f1fe5acbe775-registration-dir\") pod \"aws-ebs-csi-driver-node-bqxwq\" (UID: \"f2ada616-2b6a-4c09-be0a-f1fe5acbe775\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqxwq" May 27 21:38:17.008067 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.007651 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/79a9dc4b-003d-47a5-9db1-c461022e3ee4-system-cni-dir\") pod \"multus-additional-cni-plugins-ppk2n\" (UID: \"79a9dc4b-003d-47a5-9db1-c461022e3ee4\") " pod="openshift-multus/multus-additional-cni-plugins-ppk2n" May 27 21:38:17.008067 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.007673 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/51ebb9a3-516d-49f1-913e-1fbf7c7952ef-host-slash\") pod \"iptables-alerter-c4lsx\" (UID: \"51ebb9a3-516d-49f1-913e-1fbf7c7952ef\") " pod="openshift-network-operator/iptables-alerter-c4lsx" May 27 21:38:17.008067 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.007688 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/debbbcbe-da6e-456c-b7fb-c346f7b6ed2d-lib-modules\") pod \"tuned-7mxp4\" (UID: \"debbbcbe-da6e-456c-b7fb-c346f7b6ed2d\") " pod="openshift-cluster-node-tuning-operator/tuned-7mxp4" May 27 21:38:17.008067 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.007707 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/eff20c13-45ed-4db5-8948-597f7876aa7e-ovnkube-script-lib\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.008067 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.007736 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/035c08c0-7405-4c02-970e-8876168c1041-host-run-k8s-cni-cncf-io\") pod \"multus-pf6kj\" (UID: \"035c08c0-7405-4c02-970e-8876168c1041\") " pod="openshift-multus/multus-pf6kj" May 27 21:38:17.008067 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.007770 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/debbbcbe-da6e-456c-b7fb-c346f7b6ed2d-var-lib-kubelet\") pod \"tuned-7mxp4\" (UID: \"debbbcbe-da6e-456c-b7fb-c346f7b6ed2d\") " pod="openshift-cluster-node-tuning-operator/tuned-7mxp4" May 27 21:38:17.008590 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.007799 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/eff20c13-45ed-4db5-8948-597f7876aa7e-node-log\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.008590 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.007823 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/eff20c13-45ed-4db5-8948-597f7876aa7e-log-socket\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.008590 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.007844 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/debbbcbe-da6e-456c-b7fb-c346f7b6ed2d-run\") pod \"tuned-7mxp4\" (UID: \"debbbcbe-da6e-456c-b7fb-c346f7b6ed2d\") " pod="openshift-cluster-node-tuning-operator/tuned-7mxp4" May 27 21:38:17.008590 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.007869 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wkkm\" (UniqueName: \"kubernetes.io/projected/debbbcbe-da6e-456c-b7fb-c346f7b6ed2d-kube-api-access-2wkkm\") pod \"tuned-7mxp4\" (UID: \"debbbcbe-da6e-456c-b7fb-c346f7b6ed2d\") " pod="openshift-cluster-node-tuning-operator/tuned-7mxp4" May 27 21:38:17.008590 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.007900 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzfb5\" (UniqueName: \"kubernetes.io/projected/79a9dc4b-003d-47a5-9db1-c461022e3ee4-kube-api-access-kzfb5\") pod \"multus-additional-cni-plugins-ppk2n\" (UID: \"79a9dc4b-003d-47a5-9db1-c461022e3ee4\") " pod="openshift-multus/multus-additional-cni-plugins-ppk2n" May 27 21:38:17.008590 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.007925 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/035c08c0-7405-4c02-970e-8876168c1041-cni-binary-copy\") pod \"multus-pf6kj\" (UID: \"035c08c0-7405-4c02-970e-8876168c1041\") " pod="openshift-multus/multus-pf6kj" May 27 21:38:17.008590 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.007950 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/035c08c0-7405-4c02-970e-8876168c1041-multus-conf-dir\") pod \"multus-pf6kj\" (UID: \"035c08c0-7405-4c02-970e-8876168c1041\") " pod="openshift-multus/multus-pf6kj" May 27 21:38:17.008590 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.007970 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/debbbcbe-da6e-456c-b7fb-c346f7b6ed2d-etc-sysconfig\") pod \"tuned-7mxp4\" (UID: \"debbbcbe-da6e-456c-b7fb-c346f7b6ed2d\") " pod="openshift-cluster-node-tuning-operator/tuned-7mxp4" May 27 21:38:17.008590 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.007993 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/eff20c13-45ed-4db5-8948-597f7876aa7e-ovnkube-config\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.008590 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.008021 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7f5kj\" (UniqueName: \"kubernetes.io/projected/eff20c13-45ed-4db5-8948-597f7876aa7e-kube-api-access-7f5kj\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.008590 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.008039 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd5e8436-5b68-4fb7-9d97-d3d8d441f980-tmp-dir\") pod \"node-resolver-l45ck\" (UID: \"bd5e8436-5b68-4fb7-9d97-d3d8d441f980\") " pod="openshift-dns/node-resolver-l45ck" May 27 21:38:17.008590 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.008052 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/035c08c0-7405-4c02-970e-8876168c1041-os-release\") pod \"multus-pf6kj\" (UID: \"035c08c0-7405-4c02-970e-8876168c1041\") " pod="openshift-multus/multus-pf6kj" May 27 21:38:17.008590 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.008064 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/035c08c0-7405-4c02-970e-8876168c1041-host-var-lib-cni-bin\") pod \"multus-pf6kj\" (UID: \"035c08c0-7405-4c02-970e-8876168c1041\") " pod="openshift-multus/multus-pf6kj" May 27 21:38:17.008590 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.008086 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eff20c13-45ed-4db5-8948-597f7876aa7e-var-lib-openvswitch\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.008590 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.008104 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/97d8a31d-74d6-40a4-bbe8-734aa7e10fdd-konnectivity-ca\") pod \"konnectivity-agent-nd7v5\" (UID: \"97d8a31d-74d6-40a4-bbe8-734aa7e10fdd\") " pod="kube-system/konnectivity-agent-nd7v5" May 27 21:38:17.008590 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.008119 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f2ada616-2b6a-4c09-be0a-f1fe5acbe775-device-dir\") pod \"aws-ebs-csi-driver-node-bqxwq\" (UID: \"f2ada616-2b6a-4c09-be0a-f1fe5acbe775\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqxwq" May 27 21:38:17.009015 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.008134 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/79a9dc4b-003d-47a5-9db1-c461022e3ee4-os-release\") pod \"multus-additional-cni-plugins-ppk2n\" (UID: \"79a9dc4b-003d-47a5-9db1-c461022e3ee4\") " pod="openshift-multus/multus-additional-cni-plugins-ppk2n" May 27 21:38:17.009015 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.008152 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b674a492-3189-4694-a48b-fee4bb3f616f-metrics-certs\") pod \"network-metrics-daemon-9rhhm\" (UID: \"b674a492-3189-4694-a48b-fee4bb3f616f\") " pod="openshift-multus/network-metrics-daemon-9rhhm" May 27 21:38:17.009015 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.008180 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/debbbcbe-da6e-456c-b7fb-c346f7b6ed2d-etc-sysctl-d\") pod \"tuned-7mxp4\" (UID: \"debbbcbe-da6e-456c-b7fb-c346f7b6ed2d\") " pod="openshift-cluster-node-tuning-operator/tuned-7mxp4" May 27 21:38:17.009015 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.008212 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/eff20c13-45ed-4db5-8948-597f7876aa7e-env-overrides\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.009015 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.008257 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f2ada616-2b6a-4c09-be0a-f1fe5acbe775-sys-fs\") pod \"aws-ebs-csi-driver-node-bqxwq\" (UID: \"f2ada616-2b6a-4c09-be0a-f1fe5acbe775\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqxwq" May 27 21:38:17.009015 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.008284 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lckr7\" (UniqueName: \"kubernetes.io/projected/f2ada616-2b6a-4c09-be0a-f1fe5acbe775-kube-api-access-lckr7\") pod \"aws-ebs-csi-driver-node-bqxwq\" (UID: \"f2ada616-2b6a-4c09-be0a-f1fe5acbe775\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqxwq" May 27 21:38:17.009015 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.008790 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dtlzm\"" May 27 21:38:17.009015 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.008998 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-596tc\"" May 27 21:38:17.009282 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.009102 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 27 21:38:17.010199 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.010184 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 27 21:38:17.010392 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.010377 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 27 21:38:17.010481 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.010468 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 27 21:38:17.010584 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.010571 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4lw6s\"" May 27 21:38:17.010647 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.010577 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 27 21:38:17.010785 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.010772 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 27 21:38:17.014867 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.014849 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 27 21:38:17.014959 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.014866 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 27 21:38:17.014959 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.014887 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 27 21:38:17.015083 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.014967 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 27 21:38:17.015136 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.015093 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 27 21:38:17.015136 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.015115 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 27 21:38:17.015249 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.015206 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 27 21:38:17.015249 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.015210 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 27 21:38:17.016188 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.016174 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 27 21:38:17.016272 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.016252 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 27 21:38:17.016468 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.016452 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 27 21:38:17.016612 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.016597 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-h2zm8\"" May 27 21:38:17.041352 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.041332 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 27 21:38:17.041453 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.041377 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-tbxm5\"" May 27 21:38:17.041959 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.041936 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 27 21:38:17.041959 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.041951 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 27 21:38:17.042080 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.042023 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 27 21:38:17.042126 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.042089 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nx5qm\"" May 27 21:38:17.042126 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.042089 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 27 21:38:17.042213 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.042160 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vngpc\"" May 27 21:38:17.042461 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.042442 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xmj65\"" May 27 21:38:17.042552 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.042470 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-z2f79\"" May 27 21:38:17.042552 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.042485 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 27 21:38:17.042552 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.042510 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 27 21:38:17.042690 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.042576 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 27 21:38:17.059374 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.059319 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 27 21:38:17.059374 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.059342 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 27 21:38:17.059578 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.059560 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-147.ec2.internal"] May 27 21:38:17.060292 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.060275 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 27 21:38:17.060358 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.060348 2576 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-147.ec2.internal" May 27 21:38:17.067802 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.067779 2576 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 27 21:38:17.067920 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.067866 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7lz9f" May 27 21:38:17.077469 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.077447 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7lz9f" May 27 21:38:17.097994 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.097974 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 27 21:38:17.098913 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.098897 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-147.ec2.internal"] May 27 21:38:17.102036 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.102021 2576 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 27 21:38:17.108759 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.108737 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-55cb6\" (UniqueName: \"kubernetes.io/projected/d01f51b6-35bd-4b64-8ad3-bded3b471f4a-kube-api-access-55cb6\") pod \"network-check-target-w2hrz\" (UID: \"d01f51b6-35bd-4b64-8ad3-bded3b471f4a\") " pod="openshift-network-diagnostics/network-check-target-w2hrz" May 27 21:38:17.108845 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.108774 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/debbbcbe-da6e-456c-b7fb-c346f7b6ed2d-sys\") pod \"tuned-7mxp4\" (UID: \"debbbcbe-da6e-456c-b7fb-c346f7b6ed2d\") " pod="openshift-cluster-node-tuning-operator/tuned-7mxp4" May 27 21:38:17.108845 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.108801 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/eff20c13-45ed-4db5-8948-597f7876aa7e-run-systemd\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.108845 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.108829 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/79a9dc4b-003d-47a5-9db1-c461022e3ee4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ppk2n\" (UID: \"79a9dc4b-003d-47a5-9db1-c461022e3ee4\") " pod="openshift-multus/multus-additional-cni-plugins-ppk2n" May 27 21:38:17.108985 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.108855 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/035c08c0-7405-4c02-970e-8876168c1041-multus-cni-dir\") pod \"multus-pf6kj\" (UID: \"035c08c0-7405-4c02-970e-8876168c1041\") " pod="openshift-multus/multus-pf6kj" May 27 21:38:17.108985 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.108873 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/debbbcbe-da6e-456c-b7fb-c346f7b6ed2d-sys\") pod \"tuned-7mxp4\" (UID: \"debbbcbe-da6e-456c-b7fb-c346f7b6ed2d\") " pod="openshift-cluster-node-tuning-operator/tuned-7mxp4" May 27 21:38:17.108985 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.108884 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/debbbcbe-da6e-456c-b7fb-c346f7b6ed2d-etc-kubernetes\") pod \"tuned-7mxp4\" (UID: \"debbbcbe-da6e-456c-b7fb-c346f7b6ed2d\") " pod="openshift-cluster-node-tuning-operator/tuned-7mxp4" May 27 21:38:17.108985 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.108930 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f2ada616-2b6a-4c09-be0a-f1fe5acbe775-registration-dir\") pod \"aws-ebs-csi-driver-node-bqxwq\" (UID: \"f2ada616-2b6a-4c09-be0a-f1fe5acbe775\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqxwq" May 27 21:38:17.108985 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.108940 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/debbbcbe-da6e-456c-b7fb-c346f7b6ed2d-etc-kubernetes\") pod \"tuned-7mxp4\" (UID: \"debbbcbe-da6e-456c-b7fb-c346f7b6ed2d\") " pod="openshift-cluster-node-tuning-operator/tuned-7mxp4" May 27 21:38:17.108985 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.108940 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/eff20c13-45ed-4db5-8948-597f7876aa7e-run-systemd\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.108985 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.108959 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/79a9dc4b-003d-47a5-9db1-c461022e3ee4-system-cni-dir\") pod \"multus-additional-cni-plugins-ppk2n\" (UID: \"79a9dc4b-003d-47a5-9db1-c461022e3ee4\") " pod="openshift-multus/multus-additional-cni-plugins-ppk2n" May 27 21:38:17.109330 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.109009 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/79a9dc4b-003d-47a5-9db1-c461022e3ee4-system-cni-dir\") pod \"multus-additional-cni-plugins-ppk2n\" (UID: \"79a9dc4b-003d-47a5-9db1-c461022e3ee4\") " pod="openshift-multus/multus-additional-cni-plugins-ppk2n" May 27 21:38:17.109330 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.109020 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f2ada616-2b6a-4c09-be0a-f1fe5acbe775-registration-dir\") pod \"aws-ebs-csi-driver-node-bqxwq\" (UID: \"f2ada616-2b6a-4c09-be0a-f1fe5acbe775\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqxwq" May 27 21:38:17.109330 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.109041 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/51ebb9a3-516d-49f1-913e-1fbf7c7952ef-host-slash\") pod \"iptables-alerter-c4lsx\" (UID: \"51ebb9a3-516d-49f1-913e-1fbf7c7952ef\") " pod="openshift-network-operator/iptables-alerter-c4lsx" May 27 21:38:17.109330 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.109070 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/debbbcbe-da6e-456c-b7fb-c346f7b6ed2d-lib-modules\") pod \"tuned-7mxp4\" (UID: \"debbbcbe-da6e-456c-b7fb-c346f7b6ed2d\") " pod="openshift-cluster-node-tuning-operator/tuned-7mxp4" May 27 21:38:17.109330 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.109095 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/035c08c0-7405-4c02-970e-8876168c1041-multus-cni-dir\") pod \"multus-pf6kj\" (UID: \"035c08c0-7405-4c02-970e-8876168c1041\") " pod="openshift-multus/multus-pf6kj" May 27 21:38:17.109330 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.109095 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/eff20c13-45ed-4db5-8948-597f7876aa7e-ovnkube-script-lib\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.109330 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.109154 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/51ebb9a3-516d-49f1-913e-1fbf7c7952ef-host-slash\") pod \"iptables-alerter-c4lsx\" (UID: \"51ebb9a3-516d-49f1-913e-1fbf7c7952ef\") " pod="openshift-network-operator/iptables-alerter-c4lsx" May 27 21:38:17.109330 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.109176 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/035c08c0-7405-4c02-970e-8876168c1041-host-run-k8s-cni-cncf-io\") pod \"multus-pf6kj\" (UID: \"035c08c0-7405-4c02-970e-8876168c1041\") " pod="openshift-multus/multus-pf6kj" May 27 21:38:17.109330 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.109216 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/debbbcbe-da6e-456c-b7fb-c346f7b6ed2d-var-lib-kubelet\") pod \"tuned-7mxp4\" (UID: \"debbbcbe-da6e-456c-b7fb-c346f7b6ed2d\") " pod="openshift-cluster-node-tuning-operator/tuned-7mxp4" May 27 21:38:17.109330 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.109240 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/035c08c0-7405-4c02-970e-8876168c1041-host-run-k8s-cni-cncf-io\") pod \"multus-pf6kj\" (UID: \"035c08c0-7405-4c02-970e-8876168c1041\") " pod="openshift-multus/multus-pf6kj" May 27 21:38:17.109330 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.109262 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/eff20c13-45ed-4db5-8948-597f7876aa7e-node-log\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.109330 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.109282 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/debbbcbe-da6e-456c-b7fb-c346f7b6ed2d-var-lib-kubelet\") pod \"tuned-7mxp4\" (UID: \"debbbcbe-da6e-456c-b7fb-c346f7b6ed2d\") " pod="openshift-cluster-node-tuning-operator/tuned-7mxp4" May 27 21:38:17.109330 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.109287 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/eff20c13-45ed-4db5-8948-597f7876aa7e-log-socket\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.109330 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.109318 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/eff20c13-45ed-4db5-8948-597f7876aa7e-node-log\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.109330 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.109326 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/debbbcbe-da6e-456c-b7fb-c346f7b6ed2d-run\") pod \"tuned-7mxp4\" (UID: \"debbbcbe-da6e-456c-b7fb-c346f7b6ed2d\") " pod="openshift-cluster-node-tuning-operator/tuned-7mxp4" May 27 21:38:17.109330 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.109333 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/eff20c13-45ed-4db5-8948-597f7876aa7e-log-socket\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.110025 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.109218 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/debbbcbe-da6e-456c-b7fb-c346f7b6ed2d-lib-modules\") pod \"tuned-7mxp4\" (UID: \"debbbcbe-da6e-456c-b7fb-c346f7b6ed2d\") " pod="openshift-cluster-node-tuning-operator/tuned-7mxp4" May 27 21:38:17.110025 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.109352 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2wkkm\" (UniqueName: \"kubernetes.io/projected/debbbcbe-da6e-456c-b7fb-c346f7b6ed2d-kube-api-access-2wkkm\") pod \"tuned-7mxp4\" (UID: \"debbbcbe-da6e-456c-b7fb-c346f7b6ed2d\") " pod="openshift-cluster-node-tuning-operator/tuned-7mxp4" May 27 21:38:17.110025 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.109365 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/debbbcbe-da6e-456c-b7fb-c346f7b6ed2d-run\") pod \"tuned-7mxp4\" (UID: \"debbbcbe-da6e-456c-b7fb-c346f7b6ed2d\") " pod="openshift-cluster-node-tuning-operator/tuned-7mxp4" May 27 21:38:17.110025 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.109379 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kzfb5\" (UniqueName: \"kubernetes.io/projected/79a9dc4b-003d-47a5-9db1-c461022e3ee4-kube-api-access-kzfb5\") pod \"multus-additional-cni-plugins-ppk2n\" (UID: \"79a9dc4b-003d-47a5-9db1-c461022e3ee4\") " pod="openshift-multus/multus-additional-cni-plugins-ppk2n" May 27 21:38:17.110025 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.109426 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/035c08c0-7405-4c02-970e-8876168c1041-cni-binary-copy\") pod \"multus-pf6kj\" (UID: \"035c08c0-7405-4c02-970e-8876168c1041\") " pod="openshift-multus/multus-pf6kj" May 27 21:38:17.110025 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.109442 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/035c08c0-7405-4c02-970e-8876168c1041-multus-conf-dir\") pod \"multus-pf6kj\" (UID: \"035c08c0-7405-4c02-970e-8876168c1041\") " pod="openshift-multus/multus-pf6kj" May 27 21:38:17.110025 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.109492 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/debbbcbe-da6e-456c-b7fb-c346f7b6ed2d-etc-sysconfig\") pod \"tuned-7mxp4\" (UID: \"debbbcbe-da6e-456c-b7fb-c346f7b6ed2d\") " pod="openshift-cluster-node-tuning-operator/tuned-7mxp4" May 27 21:38:17.110025 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.109510 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/eff20c13-45ed-4db5-8948-597f7876aa7e-ovnkube-config\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.110025 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.109512 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/79a9dc4b-003d-47a5-9db1-c461022e3ee4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ppk2n\" (UID: \"79a9dc4b-003d-47a5-9db1-c461022e3ee4\") " pod="openshift-multus/multus-additional-cni-plugins-ppk2n" May 27 21:38:17.110025 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.109524 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7f5kj\" (UniqueName: \"kubernetes.io/projected/eff20c13-45ed-4db5-8948-597f7876aa7e-kube-api-access-7f5kj\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.110025 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.109541 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd5e8436-5b68-4fb7-9d97-d3d8d441f980-tmp-dir\") pod \"node-resolver-l45ck\" (UID: \"bd5e8436-5b68-4fb7-9d97-d3d8d441f980\") " pod="openshift-dns/node-resolver-l45ck" May 27 21:38:17.110025 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.109578 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/debbbcbe-da6e-456c-b7fb-c346f7b6ed2d-etc-sysconfig\") pod \"tuned-7mxp4\" (UID: \"debbbcbe-da6e-456c-b7fb-c346f7b6ed2d\") " pod="openshift-cluster-node-tuning-operator/tuned-7mxp4" May 27 21:38:17.110025 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.109620 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/035c08c0-7405-4c02-970e-8876168c1041-os-release\") pod \"multus-pf6kj\" (UID: \"035c08c0-7405-4c02-970e-8876168c1041\") " pod="openshift-multus/multus-pf6kj" May 27 21:38:17.110025 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.109851 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/035c08c0-7405-4c02-970e-8876168c1041-os-release\") pod \"multus-pf6kj\" (UID: \"035c08c0-7405-4c02-970e-8876168c1041\") " pod="openshift-multus/multus-pf6kj" May 27 21:38:17.110025 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.109851 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd5e8436-5b68-4fb7-9d97-d3d8d441f980-tmp-dir\") pod \"node-resolver-l45ck\" (UID: \"bd5e8436-5b68-4fb7-9d97-d3d8d441f980\") " pod="openshift-dns/node-resolver-l45ck" May 27 21:38:17.110025 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.109911 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/035c08c0-7405-4c02-970e-8876168c1041-host-var-lib-cni-bin\") pod \"multus-pf6kj\" (UID: \"035c08c0-7405-4c02-970e-8876168c1041\") " pod="openshift-multus/multus-pf6kj" May 27 21:38:17.110025 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.109935 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eff20c13-45ed-4db5-8948-597f7876aa7e-var-lib-openvswitch\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.110025 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.109960 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/97d8a31d-74d6-40a4-bbe8-734aa7e10fdd-konnectivity-ca\") pod \"konnectivity-agent-nd7v5\" (UID: \"97d8a31d-74d6-40a4-bbe8-734aa7e10fdd\") " pod="kube-system/konnectivity-agent-nd7v5" May 27 21:38:17.110866 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.109963 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/035c08c0-7405-4c02-970e-8876168c1041-multus-conf-dir\") pod \"multus-pf6kj\" (UID: \"035c08c0-7405-4c02-970e-8876168c1041\") " pod="openshift-multus/multus-pf6kj" May 27 21:38:17.110866 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.109995 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f2ada616-2b6a-4c09-be0a-f1fe5acbe775-device-dir\") pod \"aws-ebs-csi-driver-node-bqxwq\" (UID: \"f2ada616-2b6a-4c09-be0a-f1fe5acbe775\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqxwq" May 27 21:38:17.110866 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.110007 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/035c08c0-7405-4c02-970e-8876168c1041-host-var-lib-cni-bin\") pod \"multus-pf6kj\" (UID: \"035c08c0-7405-4c02-970e-8876168c1041\") " pod="openshift-multus/multus-pf6kj" May 27 21:38:17.110866 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.110022 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/79a9dc4b-003d-47a5-9db1-c461022e3ee4-os-release\") pod \"multus-additional-cni-plugins-ppk2n\" (UID: \"79a9dc4b-003d-47a5-9db1-c461022e3ee4\") " pod="openshift-multus/multus-additional-cni-plugins-ppk2n" May 27 21:38:17.110866 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.110043 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eff20c13-45ed-4db5-8948-597f7876aa7e-var-lib-openvswitch\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.110866 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.110050 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b674a492-3189-4694-a48b-fee4bb3f616f-metrics-certs\") pod \"network-metrics-daemon-9rhhm\" (UID: \"b674a492-3189-4694-a48b-fee4bb3f616f\") " pod="openshift-multus/network-metrics-daemon-9rhhm" May 27 21:38:17.110866 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.110091 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f2ada616-2b6a-4c09-be0a-f1fe5acbe775-device-dir\") pod \"aws-ebs-csi-driver-node-bqxwq\" (UID: \"f2ada616-2b6a-4c09-be0a-f1fe5acbe775\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqxwq" May 27 21:38:17.110866 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.110114 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/debbbcbe-da6e-456c-b7fb-c346f7b6ed2d-etc-sysctl-d\") pod \"tuned-7mxp4\" (UID: \"debbbcbe-da6e-456c-b7fb-c346f7b6ed2d\") " pod="openshift-cluster-node-tuning-operator/tuned-7mxp4" May 27 21:38:17.110866 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.110139 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/eff20c13-45ed-4db5-8948-597f7876aa7e-env-overrides\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.110866 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.110165 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f2ada616-2b6a-4c09-be0a-f1fe5acbe775-sys-fs\") pod \"aws-ebs-csi-driver-node-bqxwq\" (UID: \"f2ada616-2b6a-4c09-be0a-f1fe5acbe775\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqxwq" May 27 21:38:17.110866 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:17.110183 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:38:17.110866 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.110190 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lckr7\" (UniqueName: \"kubernetes.io/projected/f2ada616-2b6a-4c09-be0a-f1fe5acbe775-kube-api-access-lckr7\") pod \"aws-ebs-csi-driver-node-bqxwq\" (UID: \"f2ada616-2b6a-4c09-be0a-f1fe5acbe775\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqxwq" May 27 21:38:17.110866 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.110216 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/79a9dc4b-003d-47a5-9db1-c461022e3ee4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ppk2n\" (UID: \"79a9dc4b-003d-47a5-9db1-c461022e3ee4\") " pod="openshift-multus/multus-additional-cni-plugins-ppk2n" May 27 21:38:17.110866 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:17.110268 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b674a492-3189-4694-a48b-fee4bb3f616f-metrics-certs podName:b674a492-3189-4694-a48b-fee4bb3f616f nodeName:}" failed. No retries permitted until 2026-05-27 21:38:17.610246638 +0000 UTC m=+2.124996400 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b674a492-3189-4694-a48b-fee4bb3f616f-metrics-certs") pod "network-metrics-daemon-9rhhm" (UID: "b674a492-3189-4694-a48b-fee4bb3f616f") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:38:17.110866 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.110289 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/51ebb9a3-516d-49f1-913e-1fbf7c7952ef-iptables-alerter-script\") pod \"iptables-alerter-c4lsx\" (UID: \"51ebb9a3-516d-49f1-913e-1fbf7c7952ef\") " pod="openshift-network-operator/iptables-alerter-c4lsx" May 27 21:38:17.110866 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.110316 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/035c08c0-7405-4c02-970e-8876168c1041-cni-binary-copy\") pod \"multus-pf6kj\" (UID: \"035c08c0-7405-4c02-970e-8876168c1041\") " pod="openshift-multus/multus-pf6kj" May 27 21:38:17.110866 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.110322 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/035c08c0-7405-4c02-970e-8876168c1041-hostroot\") pod \"multus-pf6kj\" (UID: \"035c08c0-7405-4c02-970e-8876168c1041\") " pod="openshift-multus/multus-pf6kj" May 27 21:38:17.111778 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.110350 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/79a9dc4b-003d-47a5-9db1-c461022e3ee4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ppk2n\" (UID: \"79a9dc4b-003d-47a5-9db1-c461022e3ee4\") " pod="openshift-multus/multus-additional-cni-plugins-ppk2n" May 27 21:38:17.111778 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.110355 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/035c08c0-7405-4c02-970e-8876168c1041-hostroot\") pod \"multus-pf6kj\" (UID: \"035c08c0-7405-4c02-970e-8876168c1041\") " pod="openshift-multus/multus-pf6kj" May 27 21:38:17.111778 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.110380 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vx7rc\" (UniqueName: \"kubernetes.io/projected/035c08c0-7405-4c02-970e-8876168c1041-kube-api-access-vx7rc\") pod \"multus-pf6kj\" (UID: \"035c08c0-7405-4c02-970e-8876168c1041\") " pod="openshift-multus/multus-pf6kj" May 27 21:38:17.111778 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.110414 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/eff20c13-45ed-4db5-8948-597f7876aa7e-host-cni-netd\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.111778 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.110442 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eff20c13-45ed-4db5-8948-597f7876aa7e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.111778 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.110452 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/debbbcbe-da6e-456c-b7fb-c346f7b6ed2d-etc-sysctl-d\") pod \"tuned-7mxp4\" (UID: \"debbbcbe-da6e-456c-b7fb-c346f7b6ed2d\") " pod="openshift-cluster-node-tuning-operator/tuned-7mxp4" May 27 21:38:17.111778 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.110470 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f2ada616-2b6a-4c09-be0a-f1fe5acbe775-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bqxwq\" (UID: \"f2ada616-2b6a-4c09-be0a-f1fe5acbe775\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqxwq" May 27 21:38:17.111778 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.110501 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f2ada616-2b6a-4c09-be0a-f1fe5acbe775-socket-dir\") pod \"aws-ebs-csi-driver-node-bqxwq\" (UID: \"f2ada616-2b6a-4c09-be0a-f1fe5acbe775\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqxwq" May 27 21:38:17.111778 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.110513 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/eff20c13-45ed-4db5-8948-597f7876aa7e-ovnkube-script-lib\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.111778 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.110528 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/79a9dc4b-003d-47a5-9db1-c461022e3ee4-cni-binary-copy\") pod \"multus-additional-cni-plugins-ppk2n\" (UID: \"79a9dc4b-003d-47a5-9db1-c461022e3ee4\") " pod="openshift-multus/multus-additional-cni-plugins-ppk2n" May 27 21:38:17.111778 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.110554 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bd5e8436-5b68-4fb7-9d97-d3d8d441f980-hosts-file\") pod \"node-resolver-l45ck\" (UID: \"bd5e8436-5b68-4fb7-9d97-d3d8d441f980\") " pod="openshift-dns/node-resolver-l45ck" May 27 21:38:17.111778 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.110588 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/035c08c0-7405-4c02-970e-8876168c1041-system-cni-dir\") pod \"multus-pf6kj\" (UID: \"035c08c0-7405-4c02-970e-8876168c1041\") " pod="openshift-multus/multus-pf6kj" May 27 21:38:17.111778 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.110611 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/035c08c0-7405-4c02-970e-8876168c1041-etc-kubernetes\") pod \"multus-pf6kj\" (UID: \"035c08c0-7405-4c02-970e-8876168c1041\") " pod="openshift-multus/multus-pf6kj" May 27 21:38:17.111778 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.110623 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/79a9dc4b-003d-47a5-9db1-c461022e3ee4-os-release\") pod \"multus-additional-cni-plugins-ppk2n\" (UID: \"79a9dc4b-003d-47a5-9db1-c461022e3ee4\") " pod="openshift-multus/multus-additional-cni-plugins-ppk2n" May 27 21:38:17.111778 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.110644 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/97d8a31d-74d6-40a4-bbe8-734aa7e10fdd-konnectivity-ca\") pod \"konnectivity-agent-nd7v5\" (UID: \"97d8a31d-74d6-40a4-bbe8-734aa7e10fdd\") " pod="kube-system/konnectivity-agent-nd7v5" May 27 21:38:17.111778 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.110561 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/eff20c13-45ed-4db5-8948-597f7876aa7e-host-cni-netd\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.111778 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.110682 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eff20c13-45ed-4db5-8948-597f7876aa7e-host-run-ovn-kubernetes\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.112423 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.110711 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bd5e8436-5b68-4fb7-9d97-d3d8d441f980-hosts-file\") pod \"node-resolver-l45ck\" (UID: \"bd5e8436-5b68-4fb7-9d97-d3d8d441f980\") " pod="openshift-dns/node-resolver-l45ck" May 27 21:38:17.112423 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.110643 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eff20c13-45ed-4db5-8948-597f7876aa7e-host-run-ovn-kubernetes\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.112423 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.110723 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/035c08c0-7405-4c02-970e-8876168c1041-system-cni-dir\") pod \"multus-pf6kj\" (UID: \"035c08c0-7405-4c02-970e-8876168c1041\") " pod="openshift-multus/multus-pf6kj" May 27 21:38:17.112423 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.110736 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/97d8a31d-74d6-40a4-bbe8-734aa7e10fdd-agent-certs\") pod \"konnectivity-agent-nd7v5\" (UID: \"97d8a31d-74d6-40a4-bbe8-734aa7e10fdd\") " pod="kube-system/konnectivity-agent-nd7v5" May 27 21:38:17.112423 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.110752 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/035c08c0-7405-4c02-970e-8876168c1041-host-var-lib-kubelet\") pod \"multus-pf6kj\" (UID: \"035c08c0-7405-4c02-970e-8876168c1041\") " pod="openshift-multus/multus-pf6kj" May 27 21:38:17.112423 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.110766 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/debbbcbe-da6e-456c-b7fb-c346f7b6ed2d-tmp\") pod \"tuned-7mxp4\" (UID: \"debbbcbe-da6e-456c-b7fb-c346f7b6ed2d\") " pod="openshift-cluster-node-tuning-operator/tuned-7mxp4" May 27 21:38:17.112423 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.110773 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/035c08c0-7405-4c02-970e-8876168c1041-etc-kubernetes\") pod \"multus-pf6kj\" (UID: \"035c08c0-7405-4c02-970e-8876168c1041\") " pod="openshift-multus/multus-pf6kj" May 27 21:38:17.112423 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.110782 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eff20c13-45ed-4db5-8948-597f7876aa7e-host-run-netns\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.112423 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.110799 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9efca526-fa4d-4195-a7ab-9139cb1c02ad-serviceca\") pod \"node-ca-slshq\" (UID: \"9efca526-fa4d-4195-a7ab-9139cb1c02ad\") " pod="openshift-image-registry/node-ca-slshq" May 27 21:38:17.112423 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.110815 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tqjv4\" (UniqueName: \"kubernetes.io/projected/b674a492-3189-4694-a48b-fee4bb3f616f-kube-api-access-tqjv4\") pod \"network-metrics-daemon-9rhhm\" (UID: \"b674a492-3189-4694-a48b-fee4bb3f616f\") " pod="openshift-multus/network-metrics-daemon-9rhhm" May 27 21:38:17.112423 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.110832 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/debbbcbe-da6e-456c-b7fb-c346f7b6ed2d-etc-tuned\") pod \"tuned-7mxp4\" (UID: \"debbbcbe-da6e-456c-b7fb-c346f7b6ed2d\") " pod="openshift-cluster-node-tuning-operator/tuned-7mxp4" May 27 21:38:17.112423 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.110817 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eff20c13-45ed-4db5-8948-597f7876aa7e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.112423 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.110863 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eff20c13-45ed-4db5-8948-597f7876aa7e-run-openvswitch\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.112423 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.110890 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eff20c13-45ed-4db5-8948-597f7876aa7e-host-cni-bin\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.112423 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.110913 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f2ada616-2b6a-4c09-be0a-f1fe5acbe775-etc-selinux\") pod \"aws-ebs-csi-driver-node-bqxwq\" (UID: \"f2ada616-2b6a-4c09-be0a-f1fe5acbe775\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqxwq" May 27 21:38:17.112423 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.110937 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9efca526-fa4d-4195-a7ab-9139cb1c02ad-host\") pod \"node-ca-slshq\" (UID: \"9efca526-fa4d-4195-a7ab-9139cb1c02ad\") " pod="openshift-image-registry/node-ca-slshq" May 27 21:38:17.112423 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.110964 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jpt5l\" (UniqueName: \"kubernetes.io/projected/9efca526-fa4d-4195-a7ab-9139cb1c02ad-kube-api-access-jpt5l\") pod \"node-ca-slshq\" (UID: \"9efca526-fa4d-4195-a7ab-9139cb1c02ad\") " pod="openshift-image-registry/node-ca-slshq" May 27 21:38:17.112423 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.110989 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/035c08c0-7405-4c02-970e-8876168c1041-host-run-multus-certs\") pod \"multus-pf6kj\" (UID: \"035c08c0-7405-4c02-970e-8876168c1041\") " pod="openshift-multus/multus-pf6kj" May 27 21:38:17.113184 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.111013 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/eff20c13-45ed-4db5-8948-597f7876aa7e-systemd-units\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.113184 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.111037 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eff20c13-45ed-4db5-8948-597f7876aa7e-host-slash\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.113184 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.111035 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 27 21:38:17.113184 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.111069 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eff20c13-45ed-4db5-8948-597f7876aa7e-etc-openvswitch\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.113184 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.111106 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/79a9dc4b-003d-47a5-9db1-c461022e3ee4-cni-binary-copy\") pod \"multus-additional-cni-plugins-ppk2n\" (UID: \"79a9dc4b-003d-47a5-9db1-c461022e3ee4\") " pod="openshift-multus/multus-additional-cni-plugins-ppk2n" May 27 21:38:17.113184 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.111119 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/eff20c13-45ed-4db5-8948-597f7876aa7e-ovn-node-metrics-cert\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.113184 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.111157 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/eff20c13-45ed-4db5-8948-597f7876aa7e-host-kubelet\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.113184 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.111165 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/51ebb9a3-516d-49f1-913e-1fbf7c7952ef-iptables-alerter-script\") pod \"iptables-alerter-c4lsx\" (UID: \"51ebb9a3-516d-49f1-913e-1fbf7c7952ef\") " pod="openshift-network-operator/iptables-alerter-c4lsx" May 27 21:38:17.113184 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.111182 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/79a9dc4b-003d-47a5-9db1-c461022e3ee4-cnibin\") pod \"multus-additional-cni-plugins-ppk2n\" (UID: \"79a9dc4b-003d-47a5-9db1-c461022e3ee4\") " pod="openshift-multus/multus-additional-cni-plugins-ppk2n" May 27 21:38:17.113184 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.111210 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sdncr\" (UniqueName: \"kubernetes.io/projected/51ebb9a3-516d-49f1-913e-1fbf7c7952ef-kube-api-access-sdncr\") pod \"iptables-alerter-c4lsx\" (UID: \"51ebb9a3-516d-49f1-913e-1fbf7c7952ef\") " pod="openshift-network-operator/iptables-alerter-c4lsx" May 27 21:38:17.113184 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.111212 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f2ada616-2b6a-4c09-be0a-f1fe5acbe775-socket-dir\") pod \"aws-ebs-csi-driver-node-bqxwq\" (UID: \"f2ada616-2b6a-4c09-be0a-f1fe5acbe775\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqxwq" May 27 21:38:17.113184 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.111267 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d9nwz\" (UniqueName: \"kubernetes.io/projected/bd5e8436-5b68-4fb7-9d97-d3d8d441f980-kube-api-access-d9nwz\") pod \"node-resolver-l45ck\" (UID: \"bd5e8436-5b68-4fb7-9d97-d3d8d441f980\") " pod="openshift-dns/node-resolver-l45ck" May 27 21:38:17.113184 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.111297 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/035c08c0-7405-4c02-970e-8876168c1041-cnibin\") pod \"multus-pf6kj\" (UID: \"035c08c0-7405-4c02-970e-8876168c1041\") " pod="openshift-multus/multus-pf6kj" May 27 21:38:17.113184 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.111330 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/debbbcbe-da6e-456c-b7fb-c346f7b6ed2d-etc-sysctl-conf\") pod \"tuned-7mxp4\" (UID: \"debbbcbe-da6e-456c-b7fb-c346f7b6ed2d\") " pod="openshift-cluster-node-tuning-operator/tuned-7mxp4" May 27 21:38:17.113184 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.111342 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f2ada616-2b6a-4c09-be0a-f1fe5acbe775-sys-fs\") pod \"aws-ebs-csi-driver-node-bqxwq\" (UID: \"f2ada616-2b6a-4c09-be0a-f1fe5acbe775\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqxwq" May 27 21:38:17.113184 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.111362 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/035c08c0-7405-4c02-970e-8876168c1041-host-var-lib-cni-multus\") pod \"multus-pf6kj\" (UID: \"035c08c0-7405-4c02-970e-8876168c1041\") " pod="openshift-multus/multus-pf6kj" May 27 21:38:17.113184 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.111388 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/035c08c0-7405-4c02-970e-8876168c1041-multus-daemon-config\") pod \"multus-pf6kj\" (UID: \"035c08c0-7405-4c02-970e-8876168c1041\") " pod="openshift-multus/multus-pf6kj" May 27 21:38:17.113184 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.111391 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eff20c13-45ed-4db5-8948-597f7876aa7e-host-run-netns\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.114007 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.111397 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/035c08c0-7405-4c02-970e-8876168c1041-host-run-multus-certs\") pod \"multus-pf6kj\" (UID: \"035c08c0-7405-4c02-970e-8876168c1041\") " pod="openshift-multus/multus-pf6kj" May 27 21:38:17.114007 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.111415 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/debbbcbe-da6e-456c-b7fb-c346f7b6ed2d-etc-modprobe-d\") pod \"tuned-7mxp4\" (UID: \"debbbcbe-da6e-456c-b7fb-c346f7b6ed2d\") " pod="openshift-cluster-node-tuning-operator/tuned-7mxp4" May 27 21:38:17.114007 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.111444 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/debbbcbe-da6e-456c-b7fb-c346f7b6ed2d-etc-systemd\") pod \"tuned-7mxp4\" (UID: \"debbbcbe-da6e-456c-b7fb-c346f7b6ed2d\") " pod="openshift-cluster-node-tuning-operator/tuned-7mxp4" May 27 21:38:17.114007 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.111440 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/035c08c0-7405-4c02-970e-8876168c1041-host-var-lib-kubelet\") pod \"multus-pf6kj\" (UID: \"035c08c0-7405-4c02-970e-8876168c1041\") " pod="openshift-multus/multus-pf6kj" May 27 21:38:17.114007 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.111470 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/debbbcbe-da6e-456c-b7fb-c346f7b6ed2d-host\") pod \"tuned-7mxp4\" (UID: \"debbbcbe-da6e-456c-b7fb-c346f7b6ed2d\") " pod="openshift-cluster-node-tuning-operator/tuned-7mxp4" May 27 21:38:17.114007 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.111486 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eff20c13-45ed-4db5-8948-597f7876aa7e-run-openvswitch\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.114007 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.111495 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/eff20c13-45ed-4db5-8948-597f7876aa7e-run-ovn\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.114007 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.111523 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/79a9dc4b-003d-47a5-9db1-c461022e3ee4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ppk2n\" (UID: \"79a9dc4b-003d-47a5-9db1-c461022e3ee4\") " pod="openshift-multus/multus-additional-cni-plugins-ppk2n" May 27 21:38:17.114007 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.111551 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/035c08c0-7405-4c02-970e-8876168c1041-multus-socket-dir-parent\") pod \"multus-pf6kj\" (UID: \"035c08c0-7405-4c02-970e-8876168c1041\") " pod="openshift-multus/multus-pf6kj" May 27 21:38:17.114007 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.111557 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eff20c13-45ed-4db5-8948-597f7876aa7e-host-cni-bin\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.114007 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.111579 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/035c08c0-7405-4c02-970e-8876168c1041-host-run-netns\") pod \"multus-pf6kj\" (UID: \"035c08c0-7405-4c02-970e-8876168c1041\") " pod="openshift-multus/multus-pf6kj" May 27 21:38:17.114007 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.111635 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f2ada616-2b6a-4c09-be0a-f1fe5acbe775-etc-selinux\") pod \"aws-ebs-csi-driver-node-bqxwq\" (UID: \"f2ada616-2b6a-4c09-be0a-f1fe5acbe775\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqxwq" May 27 21:38:17.114007 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.111669 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9efca526-fa4d-4195-a7ab-9139cb1c02ad-host\") pod \"node-ca-slshq\" (UID: \"9efca526-fa4d-4195-a7ab-9139cb1c02ad\") " pod="openshift-image-registry/node-ca-slshq" May 27 21:38:17.114007 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.111488 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/eff20c13-45ed-4db5-8948-597f7876aa7e-systemd-units\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.114007 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.111835 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/035c08c0-7405-4c02-970e-8876168c1041-cnibin\") pod \"multus-pf6kj\" (UID: \"035c08c0-7405-4c02-970e-8876168c1041\") " pod="openshift-multus/multus-pf6kj" May 27 21:38:17.114007 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.111935 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/eff20c13-45ed-4db5-8948-597f7876aa7e-host-kubelet\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.114007 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.111943 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/debbbcbe-da6e-456c-b7fb-c346f7b6ed2d-etc-sysctl-conf\") pod \"tuned-7mxp4\" (UID: \"debbbcbe-da6e-456c-b7fb-c346f7b6ed2d\") " pod="openshift-cluster-node-tuning-operator/tuned-7mxp4" May 27 21:38:17.114007 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.111990 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/035c08c0-7405-4c02-970e-8876168c1041-host-var-lib-cni-multus\") pod \"multus-pf6kj\" (UID: \"035c08c0-7405-4c02-970e-8876168c1041\") " pod="openshift-multus/multus-pf6kj" May 27 21:38:17.114790 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.112821 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/eff20c13-45ed-4db5-8948-597f7876aa7e-env-overrides\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.114790 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.113196 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/035c08c0-7405-4c02-970e-8876168c1041-multus-daemon-config\") pod \"multus-pf6kj\" (UID: \"035c08c0-7405-4c02-970e-8876168c1041\") " pod="openshift-multus/multus-pf6kj" May 27 21:38:17.114790 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.113325 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eff20c13-45ed-4db5-8948-597f7876aa7e-etc-openvswitch\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.114790 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.113403 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/79a9dc4b-003d-47a5-9db1-c461022e3ee4-cnibin\") pod \"multus-additional-cni-plugins-ppk2n\" (UID: \"79a9dc4b-003d-47a5-9db1-c461022e3ee4\") " pod="openshift-multus/multus-additional-cni-plugins-ppk2n" May 27 21:38:17.114790 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.113561 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/eff20c13-45ed-4db5-8948-597f7876aa7e-run-ovn\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.114790 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.113697 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/debbbcbe-da6e-456c-b7fb-c346f7b6ed2d-etc-modprobe-d\") pod \"tuned-7mxp4\" (UID: \"debbbcbe-da6e-456c-b7fb-c346f7b6ed2d\") " pod="openshift-cluster-node-tuning-operator/tuned-7mxp4" May 27 21:38:17.114790 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.113993 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/035c08c0-7405-4c02-970e-8876168c1041-multus-socket-dir-parent\") pod \"multus-pf6kj\" (UID: \"035c08c0-7405-4c02-970e-8876168c1041\") " pod="openshift-multus/multus-pf6kj" May 27 21:38:17.114790 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.114026 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/debbbcbe-da6e-456c-b7fb-c346f7b6ed2d-etc-systemd\") pod \"tuned-7mxp4\" (UID: \"debbbcbe-da6e-456c-b7fb-c346f7b6ed2d\") " pod="openshift-cluster-node-tuning-operator/tuned-7mxp4" May 27 21:38:17.114790 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.111525 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eff20c13-45ed-4db5-8948-597f7876aa7e-host-slash\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.114790 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.114477 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/79a9dc4b-003d-47a5-9db1-c461022e3ee4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ppk2n\" (UID: \"79a9dc4b-003d-47a5-9db1-c461022e3ee4\") " pod="openshift-multus/multus-additional-cni-plugins-ppk2n" May 27 21:38:17.114790 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.114555 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/debbbcbe-da6e-456c-b7fb-c346f7b6ed2d-host\") pod \"tuned-7mxp4\" (UID: \"debbbcbe-da6e-456c-b7fb-c346f7b6ed2d\") " pod="openshift-cluster-node-tuning-operator/tuned-7mxp4" May 27 21:38:17.114790 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.114611 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f2ada616-2b6a-4c09-be0a-f1fe5acbe775-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bqxwq\" (UID: \"f2ada616-2b6a-4c09-be0a-f1fe5acbe775\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqxwq" May 27 21:38:17.114790 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.114670 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/035c08c0-7405-4c02-970e-8876168c1041-host-run-netns\") pod \"multus-pf6kj\" (UID: \"035c08c0-7405-4c02-970e-8876168c1041\") " pod="openshift-multus/multus-pf6kj" May 27 21:38:17.115377 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.114871 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9efca526-fa4d-4195-a7ab-9139cb1c02ad-serviceca\") pod \"node-ca-slshq\" (UID: \"9efca526-fa4d-4195-a7ab-9139cb1c02ad\") " pod="openshift-image-registry/node-ca-slshq" May 27 21:38:17.115377 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.115129 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/debbbcbe-da6e-456c-b7fb-c346f7b6ed2d-tmp\") pod \"tuned-7mxp4\" (UID: \"debbbcbe-da6e-456c-b7fb-c346f7b6ed2d\") " pod="openshift-cluster-node-tuning-operator/tuned-7mxp4" May 27 21:38:17.116566 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.116505 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/debbbcbe-da6e-456c-b7fb-c346f7b6ed2d-etc-tuned\") pod \"tuned-7mxp4\" (UID: \"debbbcbe-da6e-456c-b7fb-c346f7b6ed2d\") " pod="openshift-cluster-node-tuning-operator/tuned-7mxp4" May 27 21:38:17.118166 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.117174 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/eff20c13-45ed-4db5-8948-597f7876aa7e-ovn-node-metrics-cert\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.118585 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.118546 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/eff20c13-45ed-4db5-8948-597f7876aa7e-ovnkube-config\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.120091 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.120067 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/97d8a31d-74d6-40a4-bbe8-734aa7e10fdd-agent-certs\") pod \"konnectivity-agent-nd7v5\" (UID: \"97d8a31d-74d6-40a4-bbe8-734aa7e10fdd\") " pod="kube-system/konnectivity-agent-nd7v5" May 27 21:38:17.146702 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.146681 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f5kj\" (UniqueName: \"kubernetes.io/projected/eff20c13-45ed-4db5-8948-597f7876aa7e-kube-api-access-7f5kj\") pod \"ovnkube-node-szbhn\" (UID: \"eff20c13-45ed-4db5-8948-597f7876aa7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.149936 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.149917 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:17.150118 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:17.150082 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 21:38:17.150118 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:17.150109 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 21:38:17.151961 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:17.150124 2576 projected.go:194] Error preparing data for projected volume kube-api-access-55cb6 for pod openshift-network-diagnostics/network-check-target-w2hrz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:38:17.151961 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:17.150187 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d01f51b6-35bd-4b64-8ad3-bded3b471f4a-kube-api-access-55cb6 podName:d01f51b6-35bd-4b64-8ad3-bded3b471f4a nodeName:}" failed. No retries permitted until 2026-05-27 21:38:17.650169013 +0000 UTC m=+2.164918795 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-55cb6" (UniqueName: "kubernetes.io/projected/d01f51b6-35bd-4b64-8ad3-bded3b471f4a-kube-api-access-55cb6") pod "network-check-target-w2hrz" (UID: "d01f51b6-35bd-4b64-8ad3-bded3b471f4a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:38:17.152641 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.152617 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9nwz\" (UniqueName: \"kubernetes.io/projected/bd5e8436-5b68-4fb7-9d97-d3d8d441f980-kube-api-access-d9nwz\") pod \"node-resolver-l45ck\" (UID: \"bd5e8436-5b68-4fb7-9d97-d3d8d441f980\") " pod="openshift-dns/node-resolver-l45ck" May 27 21:38:17.152740 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.152706 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vx7rc\" (UniqueName: \"kubernetes.io/projected/035c08c0-7405-4c02-970e-8876168c1041-kube-api-access-vx7rc\") pod \"multus-pf6kj\" (UID: \"035c08c0-7405-4c02-970e-8876168c1041\") " pod="openshift-multus/multus-pf6kj" May 27 21:38:17.152871 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.152850 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lckr7\" (UniqueName: \"kubernetes.io/projected/f2ada616-2b6a-4c09-be0a-f1fe5acbe775-kube-api-access-lckr7\") pod \"aws-ebs-csi-driver-node-bqxwq\" (UID: \"f2ada616-2b6a-4c09-be0a-f1fe5acbe775\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqxwq" May 27 21:38:17.153018 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.152994 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqjv4\" (UniqueName: \"kubernetes.io/projected/b674a492-3189-4694-a48b-fee4bb3f616f-kube-api-access-tqjv4\") pod \"network-metrics-daemon-9rhhm\" (UID: \"b674a492-3189-4694-a48b-fee4bb3f616f\") " pod="openshift-multus/network-metrics-daemon-9rhhm" May 27 21:38:17.153094 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.153063 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzfb5\" (UniqueName: \"kubernetes.io/projected/79a9dc4b-003d-47a5-9db1-c461022e3ee4-kube-api-access-kzfb5\") pod \"multus-additional-cni-plugins-ppk2n\" (UID: \"79a9dc4b-003d-47a5-9db1-c461022e3ee4\") " pod="openshift-multus/multus-additional-cni-plugins-ppk2n" May 27 21:38:17.154572 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.154553 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdncr\" (UniqueName: \"kubernetes.io/projected/51ebb9a3-516d-49f1-913e-1fbf7c7952ef-kube-api-access-sdncr\") pod \"iptables-alerter-c4lsx\" (UID: \"51ebb9a3-516d-49f1-913e-1fbf7c7952ef\") " pod="openshift-network-operator/iptables-alerter-c4lsx" May 27 21:38:17.154689 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.154657 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpt5l\" (UniqueName: \"kubernetes.io/projected/9efca526-fa4d-4195-a7ab-9139cb1c02ad-kube-api-access-jpt5l\") pod \"node-ca-slshq\" (UID: \"9efca526-fa4d-4195-a7ab-9139cb1c02ad\") " pod="openshift-image-registry/node-ca-slshq" May 27 21:38:17.157109 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.157085 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nd7v5" May 27 21:38:17.158173 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.158150 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wkkm\" (UniqueName: \"kubernetes.io/projected/debbbcbe-da6e-456c-b7fb-c346f7b6ed2d-kube-api-access-2wkkm\") pod \"tuned-7mxp4\" (UID: \"debbbcbe-da6e-456c-b7fb-c346f7b6ed2d\") " pod="openshift-cluster-node-tuning-operator/tuned-7mxp4" May 27 21:38:17.233527 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:17.233497 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1afe2868c0fcdc073c3e2c06b48232e.slice/crio-f4d04b2428b7dcd9af4176fc1c04ed60aa941931eb5bc1992e8f88d658a3a21d WatchSource:0}: Error finding container f4d04b2428b7dcd9af4176fc1c04ed60aa941931eb5bc1992e8f88d658a3a21d: Status 404 returned error can't find the container with id f4d04b2428b7dcd9af4176fc1c04ed60aa941931eb5bc1992e8f88d658a3a21d May 27 21:38:17.233726 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:17.233711 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb08bdc800ac3949123f1ded355038db0.slice/crio-c1dc2294a58b2570776d0b6822334cdae952ed5ef05f724529d164cb3f609001 WatchSource:0}: Error finding container c1dc2294a58b2570776d0b6822334cdae952ed5ef05f724529d164cb3f609001: Status 404 returned error can't find the container with id c1dc2294a58b2570776d0b6822334cdae952ed5ef05f724529d164cb3f609001 May 27 21:38:17.236323 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.236302 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 21:38:17.312289 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.310643 2576 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 27 21:38:17.317077 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.317057 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqxwq" May 27 21:38:17.323530 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:17.323505 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2ada616_2b6a_4c09_be0a_f1fe5acbe775.slice/crio-a35ab4762c02c42ff11f33f40d0bee0dbef17e32cf5f5b39643e77c18a7bfabd WatchSource:0}: Error finding container a35ab4762c02c42ff11f33f40d0bee0dbef17e32cf5f5b39643e77c18a7bfabd: Status 404 returned error can't find the container with id a35ab4762c02c42ff11f33f40d0bee0dbef17e32cf5f5b39643e77c18a7bfabd May 27 21:38:17.332476 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.332459 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l45ck" May 27 21:38:17.338543 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:17.338522 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd5e8436_5b68_4fb7_9d97_d3d8d441f980.slice/crio-bcde78972028c264978b843de66a0949ead33eb8e539dd609f5674fe0d548ec0 WatchSource:0}: Error finding container bcde78972028c264978b843de66a0949ead33eb8e539dd609f5674fe0d548ec0: Status 404 returned error can't find the container with id bcde78972028c264978b843de66a0949ead33eb8e539dd609f5674fe0d548ec0 May 27 21:38:17.354550 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.354532 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-slshq" May 27 21:38:17.360457 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:17.360435 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9efca526_fa4d_4195_a7ab_9139cb1c02ad.slice/crio-07c273f9b0d331ea56790be530b98497e3ca6d130e7167df47ba5c854cebd305 WatchSource:0}: Error finding container 07c273f9b0d331ea56790be530b98497e3ca6d130e7167df47ba5c854cebd305: Status 404 returned error can't find the container with id 07c273f9b0d331ea56790be530b98497e3ca6d130e7167df47ba5c854cebd305 May 27 21:38:17.373645 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.373627 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ppk2n" May 27 21:38:17.379873 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:17.379855 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79a9dc4b_003d_47a5_9db1_c461022e3ee4.slice/crio-e1ec1445a9a4df7488176d26b918a45e8171a03397f7a2d4fee99f067392502b WatchSource:0}: Error finding container e1ec1445a9a4df7488176d26b918a45e8171a03397f7a2d4fee99f067392502b: Status 404 returned error can't find the container with id e1ec1445a9a4df7488176d26b918a45e8171a03397f7a2d4fee99f067392502b May 27 21:38:17.385636 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.385618 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pf6kj" May 27 21:38:17.390876 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:17.390855 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod035c08c0_7405_4c02_970e_8876168c1041.slice/crio-cf0e3b90b390935ac8052d466ce8c6436089109f027e827b7bf66dc6d2063081 WatchSource:0}: Error finding container cf0e3b90b390935ac8052d466ce8c6436089109f027e827b7bf66dc6d2063081: Status 404 returned error can't find the container with id cf0e3b90b390935ac8052d466ce8c6436089109f027e827b7bf66dc6d2063081 May 27 21:38:17.407495 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.407474 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c4lsx" May 27 21:38:17.414142 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:17.414122 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51ebb9a3_516d_49f1_913e_1fbf7c7952ef.slice/crio-701ddd309a0b504130960a701161efa51061af6096b092bc60ed2d154868fe5d WatchSource:0}: Error finding container 701ddd309a0b504130960a701161efa51061af6096b092bc60ed2d154868fe5d: Status 404 returned error can't find the container with id 701ddd309a0b504130960a701161efa51061af6096b092bc60ed2d154868fe5d May 27 21:38:17.437037 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.437010 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7mxp4" May 27 21:38:17.442596 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:17.442570 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddebbbcbe_da6e_456c_b7fb_c346f7b6ed2d.slice/crio-9ce98a39729b46793ae71040a4f876459e04444ae285e4a9a39b9ae163ddc245 WatchSource:0}: Error finding container 9ce98a39729b46793ae71040a4f876459e04444ae285e4a9a39b9ae163ddc245: Status 404 returned error can't find the container with id 9ce98a39729b46793ae71040a4f876459e04444ae285e4a9a39b9ae163ddc245 May 27 21:38:17.488694 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:17.488667 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97d8a31d_74d6_40a4_bbe8_734aa7e10fdd.slice/crio-bc408f692c51bc2ec5dc588b815f18e3990a82dd68443145a0f18caa6bc38201 WatchSource:0}: Error finding container bc408f692c51bc2ec5dc588b815f18e3990a82dd68443145a0f18caa6bc38201: Status 404 returned error can't find the container with id bc408f692c51bc2ec5dc588b815f18e3990a82dd68443145a0f18caa6bc38201 May 27 21:38:17.614792 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.614718 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b674a492-3189-4694-a48b-fee4bb3f616f-metrics-certs\") pod \"network-metrics-daemon-9rhhm\" (UID: \"b674a492-3189-4694-a48b-fee4bb3f616f\") " pod="openshift-multus/network-metrics-daemon-9rhhm" May 27 21:38:17.614925 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:17.614838 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:38:17.614925 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:17.614895 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b674a492-3189-4694-a48b-fee4bb3f616f-metrics-certs podName:b674a492-3189-4694-a48b-fee4bb3f616f nodeName:}" failed. No retries permitted until 2026-05-27 21:38:18.614880761 +0000 UTC m=+3.129630523 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b674a492-3189-4694-a48b-fee4bb3f616f-metrics-certs") pod "network-metrics-daemon-9rhhm" (UID: "b674a492-3189-4694-a48b-fee4bb3f616f") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:38:17.650708 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:17.650663 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeff20c13_45ed_4db5_8948_597f7876aa7e.slice/crio-46240a9d92c71617a484072dd826e4acfc5195d710701688bbc97c4ff467dd87 WatchSource:0}: Error finding container 46240a9d92c71617a484072dd826e4acfc5195d710701688bbc97c4ff467dd87: Status 404 returned error can't find the container with id 46240a9d92c71617a484072dd826e4acfc5195d710701688bbc97c4ff467dd87 May 27 21:38:17.715772 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.715154 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-55cb6\" (UniqueName: \"kubernetes.io/projected/d01f51b6-35bd-4b64-8ad3-bded3b471f4a-kube-api-access-55cb6\") pod \"network-check-target-w2hrz\" (UID: \"d01f51b6-35bd-4b64-8ad3-bded3b471f4a\") " pod="openshift-network-diagnostics/network-check-target-w2hrz" May 27 21:38:17.715772 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:17.715352 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 21:38:17.715772 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:17.715370 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 21:38:17.715772 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:17.715381 2576 projected.go:194] Error preparing data for projected volume kube-api-access-55cb6 for pod openshift-network-diagnostics/network-check-target-w2hrz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:38:17.715772 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:17.715437 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d01f51b6-35bd-4b64-8ad3-bded3b471f4a-kube-api-access-55cb6 podName:d01f51b6-35bd-4b64-8ad3-bded3b471f4a nodeName:}" failed. No retries permitted until 2026-05-27 21:38:18.71541587 +0000 UTC m=+3.230165634 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-55cb6" (UniqueName: "kubernetes.io/projected/d01f51b6-35bd-4b64-8ad3-bded3b471f4a-kube-api-access-55cb6") pod "network-check-target-w2hrz" (UID: "d01f51b6-35bd-4b64-8ad3-bded3b471f4a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:38:17.980735 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:17.980703 2576 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 27 21:38:18.079124 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:18.078798 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-26 21:33:17 +0000 UTC" deadline="2028-01-27 22:06:13.766836088 +0000 UTC" May 27 21:38:18.079124 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:18.078838 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14640h27m55.688001517s" May 27 21:38:18.129261 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:18.129156 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" event={"ID":"eff20c13-45ed-4db5-8948-597f7876aa7e","Type":"ContainerStarted","Data":"46240a9d92c71617a484072dd826e4acfc5195d710701688bbc97c4ff467dd87"} May 27 21:38:18.135712 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:18.135680 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nd7v5" event={"ID":"97d8a31d-74d6-40a4-bbe8-734aa7e10fdd","Type":"ContainerStarted","Data":"bc408f692c51bc2ec5dc588b815f18e3990a82dd68443145a0f18caa6bc38201"} May 27 21:38:18.166817 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:18.166428 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqxwq" event={"ID":"f2ada616-2b6a-4c09-be0a-f1fe5acbe775","Type":"ContainerStarted","Data":"a35ab4762c02c42ff11f33f40d0bee0dbef17e32cf5f5b39643e77c18a7bfabd"} May 27 21:38:18.181986 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:18.181953 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-147.ec2.internal" event={"ID":"b08bdc800ac3949123f1ded355038db0","Type":"ContainerStarted","Data":"c1dc2294a58b2570776d0b6822334cdae952ed5ef05f724529d164cb3f609001"} May 27 21:38:18.192713 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:18.192678 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-147.ec2.internal" event={"ID":"c1afe2868c0fcdc073c3e2c06b48232e","Type":"ContainerStarted","Data":"f4d04b2428b7dcd9af4176fc1c04ed60aa941931eb5bc1992e8f88d658a3a21d"} May 27 21:38:18.204579 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:18.204507 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7mxp4" event={"ID":"debbbcbe-da6e-456c-b7fb-c346f7b6ed2d","Type":"ContainerStarted","Data":"9ce98a39729b46793ae71040a4f876459e04444ae285e4a9a39b9ae163ddc245"} May 27 21:38:18.208257 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:18.208203 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c4lsx" event={"ID":"51ebb9a3-516d-49f1-913e-1fbf7c7952ef","Type":"ContainerStarted","Data":"701ddd309a0b504130960a701161efa51061af6096b092bc60ed2d154868fe5d"} May 27 21:38:18.219333 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:18.219294 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pf6kj" event={"ID":"035c08c0-7405-4c02-970e-8876168c1041","Type":"ContainerStarted","Data":"cf0e3b90b390935ac8052d466ce8c6436089109f027e827b7bf66dc6d2063081"} May 27 21:38:18.226779 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:18.226752 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppk2n" event={"ID":"79a9dc4b-003d-47a5-9db1-c461022e3ee4","Type":"ContainerStarted","Data":"e1ec1445a9a4df7488176d26b918a45e8171a03397f7a2d4fee99f067392502b"} May 27 21:38:18.242967 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:18.242895 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-slshq" event={"ID":"9efca526-fa4d-4195-a7ab-9139cb1c02ad","Type":"ContainerStarted","Data":"07c273f9b0d331ea56790be530b98497e3ca6d130e7167df47ba5c854cebd305"} May 27 21:38:18.267849 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:18.267821 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l45ck" event={"ID":"bd5e8436-5b68-4fb7-9d97-d3d8d441f980","Type":"ContainerStarted","Data":"bcde78972028c264978b843de66a0949ead33eb8e539dd609f5674fe0d548ec0"} May 27 21:38:18.470999 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:18.470971 2576 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 27 21:38:18.624283 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:18.624185 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b674a492-3189-4694-a48b-fee4bb3f616f-metrics-certs\") pod \"network-metrics-daemon-9rhhm\" (UID: \"b674a492-3189-4694-a48b-fee4bb3f616f\") " pod="openshift-multus/network-metrics-daemon-9rhhm" May 27 21:38:18.624442 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:18.624375 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:38:18.624442 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:18.624440 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b674a492-3189-4694-a48b-fee4bb3f616f-metrics-certs podName:b674a492-3189-4694-a48b-fee4bb3f616f nodeName:}" failed. No retries permitted until 2026-05-27 21:38:20.62442031 +0000 UTC m=+5.139170077 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b674a492-3189-4694-a48b-fee4bb3f616f-metrics-certs") pod "network-metrics-daemon-9rhhm" (UID: "b674a492-3189-4694-a48b-fee4bb3f616f") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:38:18.724741 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:18.724708 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-55cb6\" (UniqueName: \"kubernetes.io/projected/d01f51b6-35bd-4b64-8ad3-bded3b471f4a-kube-api-access-55cb6\") pod \"network-check-target-w2hrz\" (UID: \"d01f51b6-35bd-4b64-8ad3-bded3b471f4a\") " pod="openshift-network-diagnostics/network-check-target-w2hrz" May 27 21:38:18.724918 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:18.724893 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 21:38:18.724918 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:18.724914 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 21:38:18.725022 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:18.724926 2576 projected.go:194] Error preparing data for projected volume kube-api-access-55cb6 for pod openshift-network-diagnostics/network-check-target-w2hrz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:38:18.725022 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:18.724982 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d01f51b6-35bd-4b64-8ad3-bded3b471f4a-kube-api-access-55cb6 podName:d01f51b6-35bd-4b64-8ad3-bded3b471f4a nodeName:}" failed. No retries permitted until 2026-05-27 21:38:20.72496451 +0000 UTC m=+5.239714285 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-55cb6" (UniqueName: "kubernetes.io/projected/d01f51b6-35bd-4b64-8ad3-bded3b471f4a-kube-api-access-55cb6") pod "network-check-target-w2hrz" (UID: "d01f51b6-35bd-4b64-8ad3-bded3b471f4a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:38:18.913256 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:18.913174 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-sbgqc"] May 27 21:38:18.917176 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:18.917144 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sbgqc" May 27 21:38:18.917325 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:18.917238 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sbgqc" podUID="c32abd03-a4ad-45f9-9847-21aff5756c70" May 27 21:38:19.027110 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:19.027069 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c32abd03-a4ad-45f9-9847-21aff5756c70-original-pull-secret\") pod \"global-pull-secret-syncer-sbgqc\" (UID: \"c32abd03-a4ad-45f9-9847-21aff5756c70\") " pod="kube-system/global-pull-secret-syncer-sbgqc" May 27 21:38:19.027589 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:19.027118 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c32abd03-a4ad-45f9-9847-21aff5756c70-kubelet-config\") pod \"global-pull-secret-syncer-sbgqc\" (UID: \"c32abd03-a4ad-45f9-9847-21aff5756c70\") " pod="kube-system/global-pull-secret-syncer-sbgqc" May 27 21:38:19.027589 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:19.027148 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c32abd03-a4ad-45f9-9847-21aff5756c70-dbus\") pod \"global-pull-secret-syncer-sbgqc\" (UID: \"c32abd03-a4ad-45f9-9847-21aff5756c70\") " pod="kube-system/global-pull-secret-syncer-sbgqc" May 27 21:38:19.079692 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:19.079618 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-26 21:33:17 +0000 UTC" deadline="2028-01-11 15:28:57.313603334 +0000 UTC" May 27 21:38:19.079692 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:19.079661 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14249h50m38.233945948s" May 27 21:38:19.116163 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:19.115489 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2hrz" May 27 21:38:19.116163 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:19.115608 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2hrz" podUID="d01f51b6-35bd-4b64-8ad3-bded3b471f4a" May 27 21:38:19.116163 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:19.115489 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9rhhm" May 27 21:38:19.116163 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:19.116118 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9rhhm" podUID="b674a492-3189-4694-a48b-fee4bb3f616f" May 27 21:38:19.128566 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:19.128158 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c32abd03-a4ad-45f9-9847-21aff5756c70-original-pull-secret\") pod \"global-pull-secret-syncer-sbgqc\" (UID: \"c32abd03-a4ad-45f9-9847-21aff5756c70\") " pod="kube-system/global-pull-secret-syncer-sbgqc" May 27 21:38:19.128566 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:19.128204 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c32abd03-a4ad-45f9-9847-21aff5756c70-kubelet-config\") pod \"global-pull-secret-syncer-sbgqc\" (UID: \"c32abd03-a4ad-45f9-9847-21aff5756c70\") " pod="kube-system/global-pull-secret-syncer-sbgqc" May 27 21:38:19.128566 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:19.128250 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c32abd03-a4ad-45f9-9847-21aff5756c70-dbus\") pod \"global-pull-secret-syncer-sbgqc\" (UID: \"c32abd03-a4ad-45f9-9847-21aff5756c70\") " pod="kube-system/global-pull-secret-syncer-sbgqc" May 27 21:38:19.128566 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:19.128463 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 27 21:38:19.128566 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:19.128523 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c32abd03-a4ad-45f9-9847-21aff5756c70-original-pull-secret podName:c32abd03-a4ad-45f9-9847-21aff5756c70 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:19.628504525 +0000 UTC m=+4.143254295 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c32abd03-a4ad-45f9-9847-21aff5756c70-original-pull-secret") pod "global-pull-secret-syncer-sbgqc" (UID: "c32abd03-a4ad-45f9-9847-21aff5756c70") : object "kube-system"/"original-pull-secret" not registered May 27 21:38:19.128566 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:19.128509 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c32abd03-a4ad-45f9-9847-21aff5756c70-kubelet-config\") pod \"global-pull-secret-syncer-sbgqc\" (UID: \"c32abd03-a4ad-45f9-9847-21aff5756c70\") " pod="kube-system/global-pull-secret-syncer-sbgqc" May 27 21:38:19.128566 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:19.128467 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c32abd03-a4ad-45f9-9847-21aff5756c70-dbus\") pod \"global-pull-secret-syncer-sbgqc\" (UID: \"c32abd03-a4ad-45f9-9847-21aff5756c70\") " pod="kube-system/global-pull-secret-syncer-sbgqc" May 27 21:38:19.631837 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:19.631798 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c32abd03-a4ad-45f9-9847-21aff5756c70-original-pull-secret\") pod \"global-pull-secret-syncer-sbgqc\" (UID: \"c32abd03-a4ad-45f9-9847-21aff5756c70\") " pod="kube-system/global-pull-secret-syncer-sbgqc" May 27 21:38:19.631985 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:19.631965 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 27 21:38:19.632528 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:19.632050 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c32abd03-a4ad-45f9-9847-21aff5756c70-original-pull-secret podName:c32abd03-a4ad-45f9-9847-21aff5756c70 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:20.632004177 +0000 UTC m=+5.146753944 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c32abd03-a4ad-45f9-9847-21aff5756c70-original-pull-secret") pod "global-pull-secret-syncer-sbgqc" (UID: "c32abd03-a4ad-45f9-9847-21aff5756c70") : object "kube-system"/"original-pull-secret" not registered May 27 21:38:20.641488 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:20.640868 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b674a492-3189-4694-a48b-fee4bb3f616f-metrics-certs\") pod \"network-metrics-daemon-9rhhm\" (UID: \"b674a492-3189-4694-a48b-fee4bb3f616f\") " pod="openshift-multus/network-metrics-daemon-9rhhm" May 27 21:38:20.641488 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:20.640925 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c32abd03-a4ad-45f9-9847-21aff5756c70-original-pull-secret\") pod \"global-pull-secret-syncer-sbgqc\" (UID: \"c32abd03-a4ad-45f9-9847-21aff5756c70\") " pod="kube-system/global-pull-secret-syncer-sbgqc" May 27 21:38:20.641488 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:20.641049 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 27 21:38:20.641488 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:20.641111 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c32abd03-a4ad-45f9-9847-21aff5756c70-original-pull-secret podName:c32abd03-a4ad-45f9-9847-21aff5756c70 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:22.641091974 +0000 UTC m=+7.155841737 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c32abd03-a4ad-45f9-9847-21aff5756c70-original-pull-secret") pod "global-pull-secret-syncer-sbgqc" (UID: "c32abd03-a4ad-45f9-9847-21aff5756c70") : object "kube-system"/"original-pull-secret" not registered May 27 21:38:20.642113 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:20.641520 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:38:20.642113 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:20.641610 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b674a492-3189-4694-a48b-fee4bb3f616f-metrics-certs podName:b674a492-3189-4694-a48b-fee4bb3f616f nodeName:}" failed. No retries permitted until 2026-05-27 21:38:24.641584488 +0000 UTC m=+9.156334252 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b674a492-3189-4694-a48b-fee4bb3f616f-metrics-certs") pod "network-metrics-daemon-9rhhm" (UID: "b674a492-3189-4694-a48b-fee4bb3f616f") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:38:20.742004 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:20.741971 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-55cb6\" (UniqueName: \"kubernetes.io/projected/d01f51b6-35bd-4b64-8ad3-bded3b471f4a-kube-api-access-55cb6\") pod \"network-check-target-w2hrz\" (UID: \"d01f51b6-35bd-4b64-8ad3-bded3b471f4a\") " pod="openshift-network-diagnostics/network-check-target-w2hrz" May 27 21:38:20.742186 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:20.742137 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 21:38:20.742186 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:20.742152 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 21:38:20.742186 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:20.742161 2576 projected.go:194] Error preparing data for projected volume kube-api-access-55cb6 for pod openshift-network-diagnostics/network-check-target-w2hrz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:38:20.742400 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:20.742237 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d01f51b6-35bd-4b64-8ad3-bded3b471f4a-kube-api-access-55cb6 podName:d01f51b6-35bd-4b64-8ad3-bded3b471f4a nodeName:}" failed. No retries permitted until 2026-05-27 21:38:24.742205827 +0000 UTC m=+9.256955589 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-55cb6" (UniqueName: "kubernetes.io/projected/d01f51b6-35bd-4b64-8ad3-bded3b471f4a-kube-api-access-55cb6") pod "network-check-target-w2hrz" (UID: "d01f51b6-35bd-4b64-8ad3-bded3b471f4a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:38:21.115586 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:21.115549 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sbgqc" May 27 21:38:21.115748 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:21.115686 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sbgqc" podUID="c32abd03-a4ad-45f9-9847-21aff5756c70" May 27 21:38:21.116113 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:21.115951 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9rhhm" May 27 21:38:21.116113 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:21.116068 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9rhhm" podUID="b674a492-3189-4694-a48b-fee4bb3f616f" May 27 21:38:21.116305 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:21.116125 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2hrz" May 27 21:38:21.116305 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:21.116216 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2hrz" podUID="d01f51b6-35bd-4b64-8ad3-bded3b471f4a" May 27 21:38:22.659140 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:22.659101 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c32abd03-a4ad-45f9-9847-21aff5756c70-original-pull-secret\") pod \"global-pull-secret-syncer-sbgqc\" (UID: \"c32abd03-a4ad-45f9-9847-21aff5756c70\") " pod="kube-system/global-pull-secret-syncer-sbgqc" May 27 21:38:22.659588 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:22.659252 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 27 21:38:22.659588 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:22.659327 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c32abd03-a4ad-45f9-9847-21aff5756c70-original-pull-secret podName:c32abd03-a4ad-45f9-9847-21aff5756c70 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:26.659307583 +0000 UTC m=+11.174057348 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c32abd03-a4ad-45f9-9847-21aff5756c70-original-pull-secret") pod "global-pull-secret-syncer-sbgqc" (UID: "c32abd03-a4ad-45f9-9847-21aff5756c70") : object "kube-system"/"original-pull-secret" not registered May 27 21:38:23.115530 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:23.115503 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9rhhm" May 27 21:38:23.115684 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:23.115649 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9rhhm" podUID="b674a492-3189-4694-a48b-fee4bb3f616f" May 27 21:38:23.115684 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:23.115497 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sbgqc" May 27 21:38:23.115790 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:23.115749 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sbgqc" podUID="c32abd03-a4ad-45f9-9847-21aff5756c70" May 27 21:38:23.115790 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:23.115497 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2hrz" May 27 21:38:23.115873 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:23.115816 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2hrz" podUID="d01f51b6-35bd-4b64-8ad3-bded3b471f4a" May 27 21:38:24.676098 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:24.675511 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b674a492-3189-4694-a48b-fee4bb3f616f-metrics-certs\") pod \"network-metrics-daemon-9rhhm\" (UID: \"b674a492-3189-4694-a48b-fee4bb3f616f\") " pod="openshift-multus/network-metrics-daemon-9rhhm" May 27 21:38:24.676098 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:24.675696 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:38:24.676098 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:24.675759 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b674a492-3189-4694-a48b-fee4bb3f616f-metrics-certs podName:b674a492-3189-4694-a48b-fee4bb3f616f nodeName:}" failed. No retries permitted until 2026-05-27 21:38:32.675739225 +0000 UTC m=+17.190488992 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b674a492-3189-4694-a48b-fee4bb3f616f-metrics-certs") pod "network-metrics-daemon-9rhhm" (UID: "b674a492-3189-4694-a48b-fee4bb3f616f") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:38:24.776076 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:24.776029 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-55cb6\" (UniqueName: \"kubernetes.io/projected/d01f51b6-35bd-4b64-8ad3-bded3b471f4a-kube-api-access-55cb6\") pod \"network-check-target-w2hrz\" (UID: \"d01f51b6-35bd-4b64-8ad3-bded3b471f4a\") " pod="openshift-network-diagnostics/network-check-target-w2hrz" May 27 21:38:24.776271 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:24.776213 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 21:38:24.776271 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:24.776257 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 21:38:24.776271 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:24.776271 2576 projected.go:194] Error preparing data for projected volume kube-api-access-55cb6 for pod openshift-network-diagnostics/network-check-target-w2hrz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:38:24.776450 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:24.776340 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d01f51b6-35bd-4b64-8ad3-bded3b471f4a-kube-api-access-55cb6 podName:d01f51b6-35bd-4b64-8ad3-bded3b471f4a nodeName:}" failed. No retries permitted until 2026-05-27 21:38:32.776320101 +0000 UTC m=+17.291069866 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-55cb6" (UniqueName: "kubernetes.io/projected/d01f51b6-35bd-4b64-8ad3-bded3b471f4a-kube-api-access-55cb6") pod "network-check-target-w2hrz" (UID: "d01f51b6-35bd-4b64-8ad3-bded3b471f4a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:38:25.116519 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:25.115933 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2hrz" May 27 21:38:25.116519 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:25.116060 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2hrz" podUID="d01f51b6-35bd-4b64-8ad3-bded3b471f4a" May 27 21:38:25.116519 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:25.116245 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sbgqc" May 27 21:38:25.116519 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:25.116359 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sbgqc" podUID="c32abd03-a4ad-45f9-9847-21aff5756c70" May 27 21:38:25.116519 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:25.116412 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9rhhm" May 27 21:38:25.116519 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:25.116486 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9rhhm" podUID="b674a492-3189-4694-a48b-fee4bb3f616f" May 27 21:38:26.691796 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:26.691755 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c32abd03-a4ad-45f9-9847-21aff5756c70-original-pull-secret\") pod \"global-pull-secret-syncer-sbgqc\" (UID: \"c32abd03-a4ad-45f9-9847-21aff5756c70\") " pod="kube-system/global-pull-secret-syncer-sbgqc" May 27 21:38:26.692335 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:26.691924 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 27 21:38:26.692335 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:26.691997 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c32abd03-a4ad-45f9-9847-21aff5756c70-original-pull-secret podName:c32abd03-a4ad-45f9-9847-21aff5756c70 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:34.691981415 +0000 UTC m=+19.206731178 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c32abd03-a4ad-45f9-9847-21aff5756c70-original-pull-secret") pod "global-pull-secret-syncer-sbgqc" (UID: "c32abd03-a4ad-45f9-9847-21aff5756c70") : object "kube-system"/"original-pull-secret" not registered May 27 21:38:27.115881 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:27.115813 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sbgqc" May 27 21:38:27.116021 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:27.115813 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2hrz" May 27 21:38:27.116021 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:27.115912 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sbgqc" podUID="c32abd03-a4ad-45f9-9847-21aff5756c70" May 27 21:38:27.116021 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:27.115998 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2hrz" podUID="d01f51b6-35bd-4b64-8ad3-bded3b471f4a" May 27 21:38:27.116021 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:27.115813 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9rhhm" May 27 21:38:27.116204 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:27.116113 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9rhhm" podUID="b674a492-3189-4694-a48b-fee4bb3f616f" May 27 21:38:29.116111 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:29.115901 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sbgqc" May 27 21:38:29.116512 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:29.115932 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2hrz" May 27 21:38:29.116512 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:29.116199 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sbgqc" podUID="c32abd03-a4ad-45f9-9847-21aff5756c70" May 27 21:38:29.116512 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:29.115969 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9rhhm" May 27 21:38:29.116512 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:29.116292 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2hrz" podUID="d01f51b6-35bd-4b64-8ad3-bded3b471f4a" May 27 21:38:29.116512 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:29.116339 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9rhhm" podUID="b674a492-3189-4694-a48b-fee4bb3f616f" May 27 21:38:31.115875 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:31.115836 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2hrz" May 27 21:38:31.115875 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:31.115876 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sbgqc" May 27 21:38:31.116391 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:31.115940 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9rhhm" May 27 21:38:31.116391 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:31.116040 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9rhhm" podUID="b674a492-3189-4694-a48b-fee4bb3f616f" May 27 21:38:31.116391 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:31.116171 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sbgqc" podUID="c32abd03-a4ad-45f9-9847-21aff5756c70" May 27 21:38:31.116391 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:31.116312 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2hrz" podUID="d01f51b6-35bd-4b64-8ad3-bded3b471f4a" May 27 21:38:32.740044 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:32.740008 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b674a492-3189-4694-a48b-fee4bb3f616f-metrics-certs\") pod \"network-metrics-daemon-9rhhm\" (UID: \"b674a492-3189-4694-a48b-fee4bb3f616f\") " pod="openshift-multus/network-metrics-daemon-9rhhm" May 27 21:38:32.740548 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:32.740135 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:38:32.740548 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:32.740205 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b674a492-3189-4694-a48b-fee4bb3f616f-metrics-certs podName:b674a492-3189-4694-a48b-fee4bb3f616f nodeName:}" failed. No retries permitted until 2026-05-27 21:38:48.740188199 +0000 UTC m=+33.254937970 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b674a492-3189-4694-a48b-fee4bb3f616f-metrics-certs") pod "network-metrics-daemon-9rhhm" (UID: "b674a492-3189-4694-a48b-fee4bb3f616f") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:38:32.841343 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:32.841309 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-55cb6\" (UniqueName: \"kubernetes.io/projected/d01f51b6-35bd-4b64-8ad3-bded3b471f4a-kube-api-access-55cb6\") pod \"network-check-target-w2hrz\" (UID: \"d01f51b6-35bd-4b64-8ad3-bded3b471f4a\") " pod="openshift-network-diagnostics/network-check-target-w2hrz" May 27 21:38:32.841518 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:32.841498 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 21:38:32.841565 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:32.841519 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 21:38:32.841565 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:32.841529 2576 projected.go:194] Error preparing data for projected volume kube-api-access-55cb6 for pod openshift-network-diagnostics/network-check-target-w2hrz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:38:32.841653 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:32.841582 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d01f51b6-35bd-4b64-8ad3-bded3b471f4a-kube-api-access-55cb6 podName:d01f51b6-35bd-4b64-8ad3-bded3b471f4a nodeName:}" failed. No retries permitted until 2026-05-27 21:38:48.841568191 +0000 UTC m=+33.356317954 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-55cb6" (UniqueName: "kubernetes.io/projected/d01f51b6-35bd-4b64-8ad3-bded3b471f4a-kube-api-access-55cb6") pod "network-check-target-w2hrz" (UID: "d01f51b6-35bd-4b64-8ad3-bded3b471f4a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:38:33.115806 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:33.115721 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sbgqc" May 27 21:38:33.115958 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:33.115721 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9rhhm" May 27 21:38:33.115958 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:33.115851 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sbgqc" podUID="c32abd03-a4ad-45f9-9847-21aff5756c70" May 27 21:38:33.115958 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:33.115721 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2hrz" May 27 21:38:33.116097 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:33.115953 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9rhhm" podUID="b674a492-3189-4694-a48b-fee4bb3f616f" May 27 21:38:33.116097 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:33.116060 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2hrz" podUID="d01f51b6-35bd-4b64-8ad3-bded3b471f4a" May 27 21:38:34.754323 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:34.754284 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c32abd03-a4ad-45f9-9847-21aff5756c70-original-pull-secret\") pod \"global-pull-secret-syncer-sbgqc\" (UID: \"c32abd03-a4ad-45f9-9847-21aff5756c70\") " pod="kube-system/global-pull-secret-syncer-sbgqc" May 27 21:38:34.754726 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:34.754432 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 27 21:38:34.754726 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:34.754507 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c32abd03-a4ad-45f9-9847-21aff5756c70-original-pull-secret podName:c32abd03-a4ad-45f9-9847-21aff5756c70 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:50.754488086 +0000 UTC m=+35.269237851 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c32abd03-a4ad-45f9-9847-21aff5756c70-original-pull-secret") pod "global-pull-secret-syncer-sbgqc" (UID: "c32abd03-a4ad-45f9-9847-21aff5756c70") : object "kube-system"/"original-pull-secret" not registered May 27 21:38:35.116010 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:35.115937 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sbgqc" May 27 21:38:35.116010 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:35.115972 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9rhhm" May 27 21:38:35.116010 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:35.115943 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2hrz" May 27 21:38:35.116257 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:35.116066 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sbgqc" podUID="c32abd03-a4ad-45f9-9847-21aff5756c70" May 27 21:38:35.116257 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:35.116155 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9rhhm" podUID="b674a492-3189-4694-a48b-fee4bb3f616f" May 27 21:38:35.116257 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:35.116239 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2hrz" podUID="d01f51b6-35bd-4b64-8ad3-bded3b471f4a" May 27 21:38:37.116319 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:37.116012 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2hrz" May 27 21:38:37.116955 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:37.116084 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9rhhm" May 27 21:38:37.116955 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:37.116393 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2hrz" podUID="d01f51b6-35bd-4b64-8ad3-bded3b471f4a" May 27 21:38:37.116955 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:37.116092 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sbgqc" May 27 21:38:37.116955 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:37.116528 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9rhhm" podUID="b674a492-3189-4694-a48b-fee4bb3f616f" May 27 21:38:37.116955 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:37.116627 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sbgqc" podUID="c32abd03-a4ad-45f9-9847-21aff5756c70" May 27 21:38:37.320206 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:37.320169 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqxwq" event={"ID":"f2ada616-2b6a-4c09-be0a-f1fe5acbe775","Type":"ContainerStarted","Data":"d2c6b36a37ee501e2bafdf143d72dfbd428380543c2f5e2035709248f779501b"} May 27 21:38:37.321558 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:37.321529 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-147.ec2.internal" event={"ID":"b08bdc800ac3949123f1ded355038db0","Type":"ContainerStarted","Data":"b9d7ef73012bc5aaf070398d19d9e198e63244132bcad4c9f8c37b6ef498f282"} May 27 21:38:37.322966 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:37.322935 2576 generic.go:358] "Generic (PLEG): container finished" podID="c1afe2868c0fcdc073c3e2c06b48232e" containerID="9d094ea4e72bffef172446234bace9c470aa7a688e6fa7a228370909233a91da" exitCode=0 May 27 21:38:37.323066 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:37.323001 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-147.ec2.internal" event={"ID":"c1afe2868c0fcdc073c3e2c06b48232e","Type":"ContainerDied","Data":"9d094ea4e72bffef172446234bace9c470aa7a688e6fa7a228370909233a91da"} May 27 21:38:37.324472 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:37.324444 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7mxp4" event={"ID":"debbbcbe-da6e-456c-b7fb-c346f7b6ed2d","Type":"ContainerStarted","Data":"e367401d8b546a58b486cdffe51ce55fc7038cb87eab20a7ba1affe5cfbf4e5a"} May 27 21:38:37.325915 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:37.325894 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pf6kj" event={"ID":"035c08c0-7405-4c02-970e-8876168c1041","Type":"ContainerStarted","Data":"c220feb2f2fed24e317c7133f37c4e8802f0cf28f1401e047fe5e367aa8bc912"} May 27 21:38:37.327391 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:37.327363 2576 generic.go:358] "Generic (PLEG): container finished" podID="79a9dc4b-003d-47a5-9db1-c461022e3ee4" containerID="db196bbe443dda50ea8fd2b7fd61105adac2b3991e9d11ee614c6810bd077a65" exitCode=0 May 27 21:38:37.327486 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:37.327445 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppk2n" event={"ID":"79a9dc4b-003d-47a5-9db1-c461022e3ee4","Type":"ContainerDied","Data":"db196bbe443dda50ea8fd2b7fd61105adac2b3991e9d11ee614c6810bd077a65"} May 27 21:38:37.329087 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:37.329053 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-slshq" event={"ID":"9efca526-fa4d-4195-a7ab-9139cb1c02ad","Type":"ContainerStarted","Data":"2e9441421a6f59462cae0be170d68b7a49fbe141951eae396cb1267e41b85a69"} May 27 21:38:37.330493 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:37.330467 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l45ck" event={"ID":"bd5e8436-5b68-4fb7-9d97-d3d8d441f980","Type":"ContainerStarted","Data":"ee8bdc3ec9a7d92020a13916c07ad74d97170bba02d98a18a002de8a740d571e"} May 27 21:38:37.333282 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:37.333261 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" event={"ID":"eff20c13-45ed-4db5-8948-597f7876aa7e","Type":"ContainerStarted","Data":"e7785c6a3633e0c67245b69c4f553d5a0bbabfa1b307bd69bc2a04420fe0df58"} May 27 21:38:37.333350 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:37.333291 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" event={"ID":"eff20c13-45ed-4db5-8948-597f7876aa7e","Type":"ContainerStarted","Data":"2757e376275cac6669d0e38e600e69cc123342999fd1b4018e1801418e7f0141"} May 27 21:38:37.333350 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:37.333304 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" event={"ID":"eff20c13-45ed-4db5-8948-597f7876aa7e","Type":"ContainerStarted","Data":"f278b0410edd74ce3de5cfbe01be8f3b0836da5220aa4198c70443c5770326d7"} May 27 21:38:37.333350 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:37.333318 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" event={"ID":"eff20c13-45ed-4db5-8948-597f7876aa7e","Type":"ContainerStarted","Data":"0a994deb91a631bb34d2f9ca9846a3a75544342f5f228fa10145a42be0e80850"} May 27 21:38:37.333350 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:37.333329 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" event={"ID":"eff20c13-45ed-4db5-8948-597f7876aa7e","Type":"ContainerStarted","Data":"6ff563ea519a6e5af9c0c3a6289bb7690e882c8ec9642e9850d9fa5b90938388"} May 27 21:38:37.333350 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:37.333341 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" event={"ID":"eff20c13-45ed-4db5-8948-597f7876aa7e","Type":"ContainerStarted","Data":"db384d64ef8314baa69c2dc0b4a4a714fd7338848fe82648651eec3cf416d489"} May 27 21:38:37.334595 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:37.334572 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nd7v5" event={"ID":"97d8a31d-74d6-40a4-bbe8-734aa7e10fdd","Type":"ContainerStarted","Data":"dc2e3fc6d4e20f529727914d7b09a718b7e746fb794c4ce96c764b3738e82594"} May 27 21:38:37.341678 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:37.341635 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-147.ec2.internal" podStartSLOduration=20.341621104 podStartE2EDuration="20.341621104s" podCreationTimestamp="2026-05-27 21:38:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 21:38:37.341035634 +0000 UTC m=+21.855785418" watchObservedRunningTime="2026-05-27 21:38:37.341621104 +0000 UTC m=+21.856370889" May 27 21:38:37.360032 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:37.359989 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-l45ck" podStartSLOduration=2.470942179 podStartE2EDuration="21.35997796s" podCreationTimestamp="2026-05-27 21:38:16 +0000 UTC" firstStartedPulling="2026-05-27 21:38:17.339852245 +0000 UTC m=+1.854602006" lastFinishedPulling="2026-05-27 21:38:36.22888802 +0000 UTC m=+20.743637787" observedRunningTime="2026-05-27 21:38:37.359519424 +0000 UTC m=+21.874269209" watchObservedRunningTime="2026-05-27 21:38:37.35997796 +0000 UTC m=+21.874727743" May 27 21:38:37.415793 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:37.415743 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-slshq" podStartSLOduration=2.555594294 podStartE2EDuration="21.415727992s" podCreationTimestamp="2026-05-27 21:38:16 +0000 UTC" firstStartedPulling="2026-05-27 21:38:17.361926901 +0000 UTC m=+1.876676663" lastFinishedPulling="2026-05-27 21:38:36.222060586 +0000 UTC m=+20.736810361" observedRunningTime="2026-05-27 21:38:37.384544043 +0000 UTC m=+21.899293838" watchObservedRunningTime="2026-05-27 21:38:37.415727992 +0000 UTC m=+21.930477777" May 27 21:38:37.438090 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:37.438055 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-pf6kj" podStartSLOduration=2.374285139 podStartE2EDuration="21.438040576s" podCreationTimestamp="2026-05-27 21:38:16 +0000 UTC" firstStartedPulling="2026-05-27 21:38:17.392494995 +0000 UTC m=+1.907244757" lastFinishedPulling="2026-05-27 21:38:36.456250419 +0000 UTC m=+20.971000194" observedRunningTime="2026-05-27 21:38:37.437907487 +0000 UTC m=+21.952657283" watchObservedRunningTime="2026-05-27 21:38:37.438040576 +0000 UTC m=+21.952790364" May 27 21:38:37.458261 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:37.458183 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7mxp4" podStartSLOduration=2.673339735 podStartE2EDuration="21.458172702s" podCreationTimestamp="2026-05-27 21:38:16 +0000 UTC" firstStartedPulling="2026-05-27 21:38:17.444053003 +0000 UTC m=+1.958802766" lastFinishedPulling="2026-05-27 21:38:36.228885957 +0000 UTC m=+20.743635733" observedRunningTime="2026-05-27 21:38:37.457986958 +0000 UTC m=+21.972736743" watchObservedRunningTime="2026-05-27 21:38:37.458172702 +0000 UTC m=+21.972922486" May 27 21:38:37.498381 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:37.498325 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nd7v5" podStartSLOduration=2.751306841 podStartE2EDuration="21.498307528s" podCreationTimestamp="2026-05-27 21:38:16 +0000 UTC" firstStartedPulling="2026-05-27 21:38:17.490137712 +0000 UTC m=+2.004887474" lastFinishedPulling="2026-05-27 21:38:36.237138385 +0000 UTC m=+20.751888161" observedRunningTime="2026-05-27 21:38:37.497524975 +0000 UTC m=+22.012274772" watchObservedRunningTime="2026-05-27 21:38:37.498307528 +0000 UTC m=+22.013057314" May 27 21:38:37.850629 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:37.850557 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 27 21:38:38.076461 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:38.076297 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-27T21:38:37.850578646Z","UUID":"1145bc49-eb95-4d25-9e48-496551189cc0","Handler":null,"Name":"","Endpoint":""} May 27 21:38:38.078009 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:38.077989 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 27 21:38:38.078009 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:38.078013 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 27 21:38:38.338876 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:38.338799 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-147.ec2.internal" event={"ID":"c1afe2868c0fcdc073c3e2c06b48232e","Type":"ContainerStarted","Data":"64120ea5ac7fecae4fbbf70da701c45c0e89fd7f7d01e2fa52666e42eef65744"} May 27 21:38:38.340453 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:38.340423 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c4lsx" event={"ID":"51ebb9a3-516d-49f1-913e-1fbf7c7952ef","Type":"ContainerStarted","Data":"2bd783389f3a29e27e40019e646a116c5e1aa20709ea1c19b761f8b297ec1421"} May 27 21:38:38.343028 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:38.343004 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqxwq" event={"ID":"f2ada616-2b6a-4c09-be0a-f1fe5acbe775","Type":"ContainerStarted","Data":"fcd3708556f801727027cf4d7301bd5bbb7dff5f0e92893a7bd6f259015a320d"} May 27 21:38:38.380111 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:38.380047 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-c4lsx" podStartSLOduration=3.546860655 podStartE2EDuration="22.380030224s" podCreationTimestamp="2026-05-27 21:38:16 +0000 UTC" firstStartedPulling="2026-05-27 21:38:17.41559845 +0000 UTC m=+1.930348213" lastFinishedPulling="2026-05-27 21:38:36.24876802 +0000 UTC m=+20.763517782" observedRunningTime="2026-05-27 21:38:38.379756072 +0000 UTC m=+22.894505857" watchObservedRunningTime="2026-05-27 21:38:38.380030224 +0000 UTC m=+22.894780013" May 27 21:38:38.380557 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:38.380521 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-147.ec2.internal" podStartSLOduration=21.380509487 podStartE2EDuration="21.380509487s" podCreationTimestamp="2026-05-27 21:38:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 21:38:38.360848742 +0000 UTC m=+22.875598528" watchObservedRunningTime="2026-05-27 21:38:38.380509487 +0000 UTC m=+22.895259289" May 27 21:38:39.116239 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:39.116144 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sbgqc" May 27 21:38:39.116399 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:39.116148 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9rhhm" May 27 21:38:39.116399 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:39.116279 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sbgqc" podUID="c32abd03-a4ad-45f9-9847-21aff5756c70" May 27 21:38:39.116399 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:39.116330 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9rhhm" podUID="b674a492-3189-4694-a48b-fee4bb3f616f" May 27 21:38:39.116399 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:39.116145 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2hrz" May 27 21:38:39.116578 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:39.116405 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2hrz" podUID="d01f51b6-35bd-4b64-8ad3-bded3b471f4a" May 27 21:38:39.346937 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:39.346896 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqxwq" event={"ID":"f2ada616-2b6a-4c09-be0a-f1fe5acbe775","Type":"ContainerStarted","Data":"86471d1c29af36b59d14304740f666f5facb29963bfb679a9ad513f35d0bb80b"} May 27 21:38:39.350115 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:39.350076 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" event={"ID":"eff20c13-45ed-4db5-8948-597f7876aa7e","Type":"ContainerStarted","Data":"7ee882892b9a1e09d5692b5a670717ef70e63b2e392b83435928241f9d493708"} May 27 21:38:39.371547 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:39.371446 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqxwq" podStartSLOduration=1.947341413 podStartE2EDuration="23.371433517s" podCreationTimestamp="2026-05-27 21:38:16 +0000 UTC" firstStartedPulling="2026-05-27 21:38:17.325067936 +0000 UTC m=+1.839817699" lastFinishedPulling="2026-05-27 21:38:38.749160036 +0000 UTC m=+23.263909803" observedRunningTime="2026-05-27 21:38:39.370976647 +0000 UTC m=+23.885726433" watchObservedRunningTime="2026-05-27 21:38:39.371433517 +0000 UTC m=+23.886183300" May 27 21:38:39.978264 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:39.978212 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nd7v5" May 27 21:38:39.978956 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:39.978917 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nd7v5" May 27 21:38:40.352860 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:40.352774 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nd7v5" May 27 21:38:40.353290 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:40.353160 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nd7v5" May 27 21:38:41.116112 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:41.116084 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2hrz" May 27 21:38:41.116303 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:41.116134 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9rhhm" May 27 21:38:41.116303 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:41.116216 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2hrz" podUID="d01f51b6-35bd-4b64-8ad3-bded3b471f4a" May 27 21:38:41.116303 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:41.116283 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9rhhm" podUID="b674a492-3189-4694-a48b-fee4bb3f616f" May 27 21:38:41.116441 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:41.116309 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sbgqc" May 27 21:38:41.116441 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:41.116394 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sbgqc" podUID="c32abd03-a4ad-45f9-9847-21aff5756c70" May 27 21:38:42.357076 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:42.356887 2576 generic.go:358] "Generic (PLEG): container finished" podID="79a9dc4b-003d-47a5-9db1-c461022e3ee4" containerID="bbe9a741880e40d25af77e33621daab0a1277a6fd8e67b4603c47258050942c2" exitCode=0 May 27 21:38:42.357979 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:42.356972 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppk2n" event={"ID":"79a9dc4b-003d-47a5-9db1-c461022e3ee4","Type":"ContainerDied","Data":"bbe9a741880e40d25af77e33621daab0a1277a6fd8e67b4603c47258050942c2"} May 27 21:38:42.360568 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:42.360363 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" event={"ID":"eff20c13-45ed-4db5-8948-597f7876aa7e","Type":"ContainerStarted","Data":"6bba44ea3346e5844658163936bb2ed26fa72ce7b5d836bcb492829393dad907"} May 27 21:38:42.360769 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:42.360748 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:42.360828 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:42.360786 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:42.375316 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:42.375294 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:42.411553 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:42.411515 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" podStartSLOduration=7.6739768 podStartE2EDuration="26.411504575s" podCreationTimestamp="2026-05-27 21:38:16 +0000 UTC" firstStartedPulling="2026-05-27 21:38:17.652834172 +0000 UTC m=+2.167583934" lastFinishedPulling="2026-05-27 21:38:36.390361938 +0000 UTC m=+20.905111709" observedRunningTime="2026-05-27 21:38:42.411197431 +0000 UTC m=+26.925947215" watchObservedRunningTime="2026-05-27 21:38:42.411504575 +0000 UTC m=+26.926254358" May 27 21:38:43.116000 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:43.115960 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9rhhm" May 27 21:38:43.116000 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:43.115981 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sbgqc" May 27 21:38:43.116000 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:43.116004 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2hrz" May 27 21:38:43.116300 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:43.116071 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9rhhm" podUID="b674a492-3189-4694-a48b-fee4bb3f616f" May 27 21:38:43.116300 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:43.116205 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sbgqc" podUID="c32abd03-a4ad-45f9-9847-21aff5756c70" May 27 21:38:43.116370 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:43.116312 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2hrz" podUID="d01f51b6-35bd-4b64-8ad3-bded3b471f4a" May 27 21:38:43.363714 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:43.363679 2576 generic.go:358] "Generic (PLEG): container finished" podID="79a9dc4b-003d-47a5-9db1-c461022e3ee4" containerID="72cbcaf28716981d69cb010841ea78687bdb783fab12138486f456e9c4449157" exitCode=0 May 27 21:38:43.364058 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:43.363761 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppk2n" event={"ID":"79a9dc4b-003d-47a5-9db1-c461022e3ee4","Type":"ContainerDied","Data":"72cbcaf28716981d69cb010841ea78687bdb783fab12138486f456e9c4449157"} May 27 21:38:43.364346 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:43.364321 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:43.378903 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:43.378882 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:38:43.442132 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:43.442104 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-w2hrz"] May 27 21:38:43.442265 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:43.442219 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2hrz" May 27 21:38:43.442349 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:43.442331 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2hrz" podUID="d01f51b6-35bd-4b64-8ad3-bded3b471f4a" May 27 21:38:43.448636 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:43.448612 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9rhhm"] May 27 21:38:43.448734 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:43.448702 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9rhhm" May 27 21:38:43.448789 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:43.448775 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9rhhm" podUID="b674a492-3189-4694-a48b-fee4bb3f616f" May 27 21:38:43.457849 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:43.457821 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sbgqc"] May 27 21:38:43.457928 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:43.457919 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sbgqc" May 27 21:38:43.458027 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:43.458008 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sbgqc" podUID="c32abd03-a4ad-45f9-9847-21aff5756c70" May 27 21:38:44.367068 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:44.366986 2576 generic.go:358] "Generic (PLEG): container finished" podID="79a9dc4b-003d-47a5-9db1-c461022e3ee4" containerID="2a9e52bd6bf3a6249eada5f57afd74950f64786a508d545dd3208c4a1d9a037d" exitCode=0 May 27 21:38:44.367477 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:44.367072 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppk2n" event={"ID":"79a9dc4b-003d-47a5-9db1-c461022e3ee4","Type":"ContainerDied","Data":"2a9e52bd6bf3a6249eada5f57afd74950f64786a508d545dd3208c4a1d9a037d"} May 27 21:38:45.116131 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:45.116098 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sbgqc" May 27 21:38:45.116329 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:45.116098 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9rhhm" May 27 21:38:45.116329 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:45.116266 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2hrz" May 27 21:38:45.116329 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:45.116272 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sbgqc" podUID="c32abd03-a4ad-45f9-9847-21aff5756c70" May 27 21:38:45.116481 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:45.116371 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2hrz" podUID="d01f51b6-35bd-4b64-8ad3-bded3b471f4a" May 27 21:38:45.116529 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:45.116471 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9rhhm" podUID="b674a492-3189-4694-a48b-fee4bb3f616f" May 27 21:38:47.115637 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:47.115558 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sbgqc" May 27 21:38:47.116032 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:47.115558 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9rhhm" May 27 21:38:47.116032 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:47.115665 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sbgqc" podUID="c32abd03-a4ad-45f9-9847-21aff5756c70" May 27 21:38:47.116032 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:47.115775 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9rhhm" podUID="b674a492-3189-4694-a48b-fee4bb3f616f" May 27 21:38:47.116032 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:47.115558 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2hrz" May 27 21:38:47.116032 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:47.115908 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2hrz" podUID="d01f51b6-35bd-4b64-8ad3-bded3b471f4a" May 27 21:38:48.763270 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:48.763037 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b674a492-3189-4694-a48b-fee4bb3f616f-metrics-certs\") pod \"network-metrics-daemon-9rhhm\" (UID: \"b674a492-3189-4694-a48b-fee4bb3f616f\") " pod="openshift-multus/network-metrics-daemon-9rhhm" May 27 21:38:48.763718 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:48.763147 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:38:48.763718 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:48.763399 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b674a492-3189-4694-a48b-fee4bb3f616f-metrics-certs podName:b674a492-3189-4694-a48b-fee4bb3f616f nodeName:}" failed. No retries permitted until 2026-05-27 21:39:20.763381128 +0000 UTC m=+65.278130909 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b674a492-3189-4694-a48b-fee4bb3f616f-metrics-certs") pod "network-metrics-daemon-9rhhm" (UID: "b674a492-3189-4694-a48b-fee4bb3f616f") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:38:48.864064 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:48.864031 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-55cb6\" (UniqueName: \"kubernetes.io/projected/d01f51b6-35bd-4b64-8ad3-bded3b471f4a-kube-api-access-55cb6\") pod \"network-check-target-w2hrz\" (UID: \"d01f51b6-35bd-4b64-8ad3-bded3b471f4a\") " pod="openshift-network-diagnostics/network-check-target-w2hrz" May 27 21:38:48.864244 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:48.864209 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 21:38:48.864323 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:48.864246 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 21:38:48.864323 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:48.864260 2576 projected.go:194] Error preparing data for projected volume kube-api-access-55cb6 for pod openshift-network-diagnostics/network-check-target-w2hrz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:38:48.864323 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:48.864320 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d01f51b6-35bd-4b64-8ad3-bded3b471f4a-kube-api-access-55cb6 podName:d01f51b6-35bd-4b64-8ad3-bded3b471f4a nodeName:}" failed. No retries permitted until 2026-05-27 21:39:20.864304893 +0000 UTC m=+65.379054656 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-55cb6" (UniqueName: "kubernetes.io/projected/d01f51b6-35bd-4b64-8ad3-bded3b471f4a-kube-api-access-55cb6") pod "network-check-target-w2hrz" (UID: "d01f51b6-35bd-4b64-8ad3-bded3b471f4a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:38:49.115775 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:49.115702 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9rhhm" May 27 21:38:49.116034 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:49.115703 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2hrz" May 27 21:38:49.116034 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:49.115838 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9rhhm" podUID="b674a492-3189-4694-a48b-fee4bb3f616f" May 27 21:38:49.116034 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:49.115702 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sbgqc" May 27 21:38:49.116034 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:49.115909 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2hrz" podUID="d01f51b6-35bd-4b64-8ad3-bded3b471f4a" May 27 21:38:49.116034 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:49.115989 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sbgqc" podUID="c32abd03-a4ad-45f9-9847-21aff5756c70" May 27 21:38:50.342670 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.342625 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-147.ec2.internal" event="NodeReady" May 27 21:38:50.343078 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.342781 2576 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 27 21:38:50.378554 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.378532 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7fbc4dbb7-rp6ng"] May 27 21:38:50.400143 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.400118 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kx8l8"] May 27 21:38:50.400368 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.400343 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fbc4dbb7-rp6ng" May 27 21:38:50.403855 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.403650 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 27 21:38:50.403855 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.403687 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 27 21:38:50.403855 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.403749 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8r2rz\"" May 27 21:38:50.404115 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.404087 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 27 21:38:50.409474 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.409447 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 27 21:38:50.422261 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.422194 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppk2n" event={"ID":"79a9dc4b-003d-47a5-9db1-c461022e3ee4","Type":"ContainerStarted","Data":"7555952dbc98e72618e158688859f7c055f07ff2ca5d35f4b42c59684b79e8d4"} May 27 21:38:50.422261 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.422249 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-cvngm"] May 27 21:38:50.422434 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.422376 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kx8l8" May 27 21:38:50.425137 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.425113 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7n5q2\"" May 27 21:38:50.425258 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.425138 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 27 21:38:50.425535 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.425504 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 27 21:38:50.443583 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.443514 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7fbc4dbb7-rp6ng"] May 27 21:38:50.443583 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.443542 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kx8l8"] May 27 21:38:50.443583 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.443550 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cvngm"] May 27 21:38:50.443778 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.443658 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cvngm" May 27 21:38:50.446573 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.446551 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 27 21:38:50.446712 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.446572 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 27 21:38:50.446712 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.446587 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 27 21:38:50.446712 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.446552 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wvcgf\"" May 27 21:38:50.476298 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.476272 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a881aae1-7e96-4349-beb5-70bb1ed2ec67-trusted-ca\") pod \"image-registry-7fbc4dbb7-rp6ng\" (UID: \"a881aae1-7e96-4349-beb5-70bb1ed2ec67\") " pod="openshift-image-registry/image-registry-7fbc4dbb7-rp6ng" May 27 21:38:50.476424 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.476350 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a881aae1-7e96-4349-beb5-70bb1ed2ec67-registry-tls\") pod \"image-registry-7fbc4dbb7-rp6ng\" (UID: \"a881aae1-7e96-4349-beb5-70bb1ed2ec67\") " pod="openshift-image-registry/image-registry-7fbc4dbb7-rp6ng" May 27 21:38:50.476424 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.476373 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a881aae1-7e96-4349-beb5-70bb1ed2ec67-ca-trust-extracted\") pod \"image-registry-7fbc4dbb7-rp6ng\" (UID: \"a881aae1-7e96-4349-beb5-70bb1ed2ec67\") " pod="openshift-image-registry/image-registry-7fbc4dbb7-rp6ng" May 27 21:38:50.476424 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.476415 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a881aae1-7e96-4349-beb5-70bb1ed2ec67-bound-sa-token\") pod \"image-registry-7fbc4dbb7-rp6ng\" (UID: \"a881aae1-7e96-4349-beb5-70bb1ed2ec67\") " pod="openshift-image-registry/image-registry-7fbc4dbb7-rp6ng" May 27 21:38:50.476581 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.476449 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a881aae1-7e96-4349-beb5-70bb1ed2ec67-registry-certificates\") pod \"image-registry-7fbc4dbb7-rp6ng\" (UID: \"a881aae1-7e96-4349-beb5-70bb1ed2ec67\") " pod="openshift-image-registry/image-registry-7fbc4dbb7-rp6ng" May 27 21:38:50.476581 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.476497 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a881aae1-7e96-4349-beb5-70bb1ed2ec67-installation-pull-secrets\") pod \"image-registry-7fbc4dbb7-rp6ng\" (UID: \"a881aae1-7e96-4349-beb5-70bb1ed2ec67\") " pod="openshift-image-registry/image-registry-7fbc4dbb7-rp6ng" May 27 21:38:50.476581 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.476564 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7w6l\" (UniqueName: \"kubernetes.io/projected/a881aae1-7e96-4349-beb5-70bb1ed2ec67-kube-api-access-h7w6l\") pod \"image-registry-7fbc4dbb7-rp6ng\" (UID: \"a881aae1-7e96-4349-beb5-70bb1ed2ec67\") " pod="openshift-image-registry/image-registry-7fbc4dbb7-rp6ng" May 27 21:38:50.476706 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.476602 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a881aae1-7e96-4349-beb5-70bb1ed2ec67-image-registry-private-configuration\") pod \"image-registry-7fbc4dbb7-rp6ng\" (UID: \"a881aae1-7e96-4349-beb5-70bb1ed2ec67\") " pod="openshift-image-registry/image-registry-7fbc4dbb7-rp6ng" May 27 21:38:50.577164 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.577135 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h7w6l\" (UniqueName: \"kubernetes.io/projected/a881aae1-7e96-4349-beb5-70bb1ed2ec67-kube-api-access-h7w6l\") pod \"image-registry-7fbc4dbb7-rp6ng\" (UID: \"a881aae1-7e96-4349-beb5-70bb1ed2ec67\") " pod="openshift-image-registry/image-registry-7fbc4dbb7-rp6ng" May 27 21:38:50.577315 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.577175 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a881aae1-7e96-4349-beb5-70bb1ed2ec67-image-registry-private-configuration\") pod \"image-registry-7fbc4dbb7-rp6ng\" (UID: \"a881aae1-7e96-4349-beb5-70bb1ed2ec67\") " pod="openshift-image-registry/image-registry-7fbc4dbb7-rp6ng" May 27 21:38:50.577315 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.577196 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aa3113b8-5396-4fab-b87f-a3d6bfee9121-config-volume\") pod \"dns-default-kx8l8\" (UID: \"aa3113b8-5396-4fab-b87f-a3d6bfee9121\") " pod="openshift-dns/dns-default-kx8l8" May 27 21:38:50.577315 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.577238 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa3113b8-5396-4fab-b87f-a3d6bfee9121-tmp-dir\") pod \"dns-default-kx8l8\" (UID: \"aa3113b8-5396-4fab-b87f-a3d6bfee9121\") " pod="openshift-dns/dns-default-kx8l8" May 27 21:38:50.577315 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.577264 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkz4x\" (UniqueName: \"kubernetes.io/projected/aa3113b8-5396-4fab-b87f-a3d6bfee9121-kube-api-access-fkz4x\") pod \"dns-default-kx8l8\" (UID: \"aa3113b8-5396-4fab-b87f-a3d6bfee9121\") " pod="openshift-dns/dns-default-kx8l8" May 27 21:38:50.577448 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.577322 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa3113b8-5396-4fab-b87f-a3d6bfee9121-metrics-tls\") pod \"dns-default-kx8l8\" (UID: \"aa3113b8-5396-4fab-b87f-a3d6bfee9121\") " pod="openshift-dns/dns-default-kx8l8" May 27 21:38:50.577448 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.577381 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a881aae1-7e96-4349-beb5-70bb1ed2ec67-trusted-ca\") pod \"image-registry-7fbc4dbb7-rp6ng\" (UID: \"a881aae1-7e96-4349-beb5-70bb1ed2ec67\") " pod="openshift-image-registry/image-registry-7fbc4dbb7-rp6ng" May 27 21:38:50.577448 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.577413 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34efe17a-77e3-4d91-81ea-2c8c98c73882-cert\") pod \"ingress-canary-cvngm\" (UID: \"34efe17a-77e3-4d91-81ea-2c8c98c73882\") " pod="openshift-ingress-canary/ingress-canary-cvngm" May 27 21:38:50.577560 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.577454 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a881aae1-7e96-4349-beb5-70bb1ed2ec67-registry-tls\") pod \"image-registry-7fbc4dbb7-rp6ng\" (UID: \"a881aae1-7e96-4349-beb5-70bb1ed2ec67\") " pod="openshift-image-registry/image-registry-7fbc4dbb7-rp6ng" May 27 21:38:50.577560 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.577470 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a881aae1-7e96-4349-beb5-70bb1ed2ec67-ca-trust-extracted\") pod \"image-registry-7fbc4dbb7-rp6ng\" (UID: \"a881aae1-7e96-4349-beb5-70bb1ed2ec67\") " pod="openshift-image-registry/image-registry-7fbc4dbb7-rp6ng" May 27 21:38:50.577560 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.577506 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a881aae1-7e96-4349-beb5-70bb1ed2ec67-bound-sa-token\") pod \"image-registry-7fbc4dbb7-rp6ng\" (UID: \"a881aae1-7e96-4349-beb5-70bb1ed2ec67\") " pod="openshift-image-registry/image-registry-7fbc4dbb7-rp6ng" May 27 21:38:50.577560 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.577527 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l4gv\" (UniqueName: \"kubernetes.io/projected/34efe17a-77e3-4d91-81ea-2c8c98c73882-kube-api-access-4l4gv\") pod \"ingress-canary-cvngm\" (UID: \"34efe17a-77e3-4d91-81ea-2c8c98c73882\") " pod="openshift-ingress-canary/ingress-canary-cvngm" May 27 21:38:50.577560 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:50.577531 2576 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 27 21:38:50.577560 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:50.577548 2576 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fbc4dbb7-rp6ng: secret "image-registry-tls" not found May 27 21:38:50.577560 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.577557 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a881aae1-7e96-4349-beb5-70bb1ed2ec67-registry-certificates\") pod \"image-registry-7fbc4dbb7-rp6ng\" (UID: \"a881aae1-7e96-4349-beb5-70bb1ed2ec67\") " pod="openshift-image-registry/image-registry-7fbc4dbb7-rp6ng" May 27 21:38:50.577867 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.577582 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a881aae1-7e96-4349-beb5-70bb1ed2ec67-installation-pull-secrets\") pod \"image-registry-7fbc4dbb7-rp6ng\" (UID: \"a881aae1-7e96-4349-beb5-70bb1ed2ec67\") " pod="openshift-image-registry/image-registry-7fbc4dbb7-rp6ng" May 27 21:38:50.577867 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:50.577606 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a881aae1-7e96-4349-beb5-70bb1ed2ec67-registry-tls podName:a881aae1-7e96-4349-beb5-70bb1ed2ec67 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:51.077584304 +0000 UTC m=+35.592334067 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a881aae1-7e96-4349-beb5-70bb1ed2ec67-registry-tls") pod "image-registry-7fbc4dbb7-rp6ng" (UID: "a881aae1-7e96-4349-beb5-70bb1ed2ec67") : secret "image-registry-tls" not found May 27 21:38:50.577867 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.577836 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a881aae1-7e96-4349-beb5-70bb1ed2ec67-ca-trust-extracted\") pod \"image-registry-7fbc4dbb7-rp6ng\" (UID: \"a881aae1-7e96-4349-beb5-70bb1ed2ec67\") " pod="openshift-image-registry/image-registry-7fbc4dbb7-rp6ng" May 27 21:38:50.578100 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.578064 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a881aae1-7e96-4349-beb5-70bb1ed2ec67-registry-certificates\") pod \"image-registry-7fbc4dbb7-rp6ng\" (UID: \"a881aae1-7e96-4349-beb5-70bb1ed2ec67\") " pod="openshift-image-registry/image-registry-7fbc4dbb7-rp6ng" May 27 21:38:50.578214 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.578185 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a881aae1-7e96-4349-beb5-70bb1ed2ec67-trusted-ca\") pod \"image-registry-7fbc4dbb7-rp6ng\" (UID: \"a881aae1-7e96-4349-beb5-70bb1ed2ec67\") " pod="openshift-image-registry/image-registry-7fbc4dbb7-rp6ng" May 27 21:38:50.581194 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.581169 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a881aae1-7e96-4349-beb5-70bb1ed2ec67-image-registry-private-configuration\") pod \"image-registry-7fbc4dbb7-rp6ng\" (UID: \"a881aae1-7e96-4349-beb5-70bb1ed2ec67\") " pod="openshift-image-registry/image-registry-7fbc4dbb7-rp6ng" May 27 21:38:50.581292 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.581217 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a881aae1-7e96-4349-beb5-70bb1ed2ec67-installation-pull-secrets\") pod \"image-registry-7fbc4dbb7-rp6ng\" (UID: \"a881aae1-7e96-4349-beb5-70bb1ed2ec67\") " pod="openshift-image-registry/image-registry-7fbc4dbb7-rp6ng" May 27 21:38:50.588533 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.588509 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a881aae1-7e96-4349-beb5-70bb1ed2ec67-bound-sa-token\") pod \"image-registry-7fbc4dbb7-rp6ng\" (UID: \"a881aae1-7e96-4349-beb5-70bb1ed2ec67\") " pod="openshift-image-registry/image-registry-7fbc4dbb7-rp6ng" May 27 21:38:50.588697 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.588681 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7w6l\" (UniqueName: \"kubernetes.io/projected/a881aae1-7e96-4349-beb5-70bb1ed2ec67-kube-api-access-h7w6l\") pod \"image-registry-7fbc4dbb7-rp6ng\" (UID: \"a881aae1-7e96-4349-beb5-70bb1ed2ec67\") " pod="openshift-image-registry/image-registry-7fbc4dbb7-rp6ng" May 27 21:38:50.678823 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.678790 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4l4gv\" (UniqueName: \"kubernetes.io/projected/34efe17a-77e3-4d91-81ea-2c8c98c73882-kube-api-access-4l4gv\") pod \"ingress-canary-cvngm\" (UID: \"34efe17a-77e3-4d91-81ea-2c8c98c73882\") " pod="openshift-ingress-canary/ingress-canary-cvngm" May 27 21:38:50.678944 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.678837 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aa3113b8-5396-4fab-b87f-a3d6bfee9121-config-volume\") pod \"dns-default-kx8l8\" (UID: \"aa3113b8-5396-4fab-b87f-a3d6bfee9121\") " pod="openshift-dns/dns-default-kx8l8" May 27 21:38:50.678944 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.678854 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa3113b8-5396-4fab-b87f-a3d6bfee9121-tmp-dir\") pod \"dns-default-kx8l8\" (UID: \"aa3113b8-5396-4fab-b87f-a3d6bfee9121\") " pod="openshift-dns/dns-default-kx8l8" May 27 21:38:50.678944 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.678872 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fkz4x\" (UniqueName: \"kubernetes.io/projected/aa3113b8-5396-4fab-b87f-a3d6bfee9121-kube-api-access-fkz4x\") pod \"dns-default-kx8l8\" (UID: \"aa3113b8-5396-4fab-b87f-a3d6bfee9121\") " pod="openshift-dns/dns-default-kx8l8" May 27 21:38:50.678944 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.678897 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa3113b8-5396-4fab-b87f-a3d6bfee9121-metrics-tls\") pod \"dns-default-kx8l8\" (UID: \"aa3113b8-5396-4fab-b87f-a3d6bfee9121\") " pod="openshift-dns/dns-default-kx8l8" May 27 21:38:50.678944 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.678932 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34efe17a-77e3-4d91-81ea-2c8c98c73882-cert\") pod \"ingress-canary-cvngm\" (UID: \"34efe17a-77e3-4d91-81ea-2c8c98c73882\") " pod="openshift-ingress-canary/ingress-canary-cvngm" May 27 21:38:50.679179 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:50.679025 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 21:38:50.679179 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:50.679070 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa3113b8-5396-4fab-b87f-a3d6bfee9121-metrics-tls podName:aa3113b8-5396-4fab-b87f-a3d6bfee9121 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:51.179056174 +0000 UTC m=+35.693805935 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aa3113b8-5396-4fab-b87f-a3d6bfee9121-metrics-tls") pod "dns-default-kx8l8" (UID: "aa3113b8-5396-4fab-b87f-a3d6bfee9121") : secret "dns-default-metrics-tls" not found May 27 21:38:50.679179 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:50.679093 2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 21:38:50.679179 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:50.679159 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34efe17a-77e3-4d91-81ea-2c8c98c73882-cert podName:34efe17a-77e3-4d91-81ea-2c8c98c73882 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:51.179142575 +0000 UTC m=+35.693892350 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/34efe17a-77e3-4d91-81ea-2c8c98c73882-cert") pod "ingress-canary-cvngm" (UID: "34efe17a-77e3-4d91-81ea-2c8c98c73882") : secret "canary-serving-cert" not found May 27 21:38:50.679382 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.679254 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa3113b8-5396-4fab-b87f-a3d6bfee9121-tmp-dir\") pod \"dns-default-kx8l8\" (UID: \"aa3113b8-5396-4fab-b87f-a3d6bfee9121\") " pod="openshift-dns/dns-default-kx8l8" May 27 21:38:50.679382 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.679318 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aa3113b8-5396-4fab-b87f-a3d6bfee9121-config-volume\") pod \"dns-default-kx8l8\" (UID: \"aa3113b8-5396-4fab-b87f-a3d6bfee9121\") " pod="openshift-dns/dns-default-kx8l8" May 27 21:38:50.688188 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.688169 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkz4x\" (UniqueName: \"kubernetes.io/projected/aa3113b8-5396-4fab-b87f-a3d6bfee9121-kube-api-access-fkz4x\") pod \"dns-default-kx8l8\" (UID: \"aa3113b8-5396-4fab-b87f-a3d6bfee9121\") " pod="openshift-dns/dns-default-kx8l8" May 27 21:38:50.688728 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.688705 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l4gv\" (UniqueName: \"kubernetes.io/projected/34efe17a-77e3-4d91-81ea-2c8c98c73882-kube-api-access-4l4gv\") pod \"ingress-canary-cvngm\" (UID: \"34efe17a-77e3-4d91-81ea-2c8c98c73882\") " pod="openshift-ingress-canary/ingress-canary-cvngm" May 27 21:38:50.780068 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:50.779994 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c32abd03-a4ad-45f9-9847-21aff5756c70-original-pull-secret\") pod \"global-pull-secret-syncer-sbgqc\" (UID: \"c32abd03-a4ad-45f9-9847-21aff5756c70\") " pod="kube-system/global-pull-secret-syncer-sbgqc" May 27 21:38:50.780175 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:50.780093 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 27 21:38:50.780175 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:50.780142 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c32abd03-a4ad-45f9-9847-21aff5756c70-original-pull-secret podName:c32abd03-a4ad-45f9-9847-21aff5756c70 nodeName:}" failed. No retries permitted until 2026-05-27 21:39:22.780130522 +0000 UTC m=+67.294880284 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c32abd03-a4ad-45f9-9847-21aff5756c70-original-pull-secret") pod "global-pull-secret-syncer-sbgqc" (UID: "c32abd03-a4ad-45f9-9847-21aff5756c70") : object "kube-system"/"original-pull-secret" not registered May 27 21:38:51.082548 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:51.082458 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a881aae1-7e96-4349-beb5-70bb1ed2ec67-registry-tls\") pod \"image-registry-7fbc4dbb7-rp6ng\" (UID: \"a881aae1-7e96-4349-beb5-70bb1ed2ec67\") " pod="openshift-image-registry/image-registry-7fbc4dbb7-rp6ng" May 27 21:38:51.082689 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:51.082591 2576 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 27 21:38:51.082689 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:51.082607 2576 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fbc4dbb7-rp6ng: secret "image-registry-tls" not found May 27 21:38:51.082689 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:51.082657 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a881aae1-7e96-4349-beb5-70bb1ed2ec67-registry-tls podName:a881aae1-7e96-4349-beb5-70bb1ed2ec67 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:52.082642769 +0000 UTC m=+36.597392532 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a881aae1-7e96-4349-beb5-70bb1ed2ec67-registry-tls") pod "image-registry-7fbc4dbb7-rp6ng" (UID: "a881aae1-7e96-4349-beb5-70bb1ed2ec67") : secret "image-registry-tls" not found May 27 21:38:51.116144 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:51.116112 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2hrz" May 27 21:38:51.116144 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:51.116147 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sbgqc" May 27 21:38:51.116355 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:51.116144 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9rhhm" May 27 21:38:51.120082 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:51.120058 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 27 21:38:51.120082 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:51.120077 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 27 21:38:51.120082 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:51.120083 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 27 21:38:51.120406 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:51.120107 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2tcr2\"" May 27 21:38:51.120406 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:51.120166 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 27 21:38:51.120521 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:51.120460 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rd4vz\"" May 27 21:38:51.183126 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:51.183093 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa3113b8-5396-4fab-b87f-a3d6bfee9121-metrics-tls\") pod \"dns-default-kx8l8\" (UID: \"aa3113b8-5396-4fab-b87f-a3d6bfee9121\") " pod="openshift-dns/dns-default-kx8l8" May 27 21:38:51.183322 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:51.183140 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34efe17a-77e3-4d91-81ea-2c8c98c73882-cert\") pod \"ingress-canary-cvngm\" (UID: \"34efe17a-77e3-4d91-81ea-2c8c98c73882\") " pod="openshift-ingress-canary/ingress-canary-cvngm" May 27 21:38:51.183322 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:51.183245 2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 21:38:51.183322 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:51.183261 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 21:38:51.183322 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:51.183307 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34efe17a-77e3-4d91-81ea-2c8c98c73882-cert podName:34efe17a-77e3-4d91-81ea-2c8c98c73882 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:52.183293831 +0000 UTC m=+36.698043593 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/34efe17a-77e3-4d91-81ea-2c8c98c73882-cert") pod "ingress-canary-cvngm" (UID: "34efe17a-77e3-4d91-81ea-2c8c98c73882") : secret "canary-serving-cert" not found May 27 21:38:51.183491 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:51.183370 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa3113b8-5396-4fab-b87f-a3d6bfee9121-metrics-tls podName:aa3113b8-5396-4fab-b87f-a3d6bfee9121 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:52.183351494 +0000 UTC m=+36.698101275 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aa3113b8-5396-4fab-b87f-a3d6bfee9121-metrics-tls") pod "dns-default-kx8l8" (UID: "aa3113b8-5396-4fab-b87f-a3d6bfee9121") : secret "dns-default-metrics-tls" not found May 27 21:38:51.385866 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:51.385782 2576 generic.go:358] "Generic (PLEG): container finished" podID="79a9dc4b-003d-47a5-9db1-c461022e3ee4" containerID="7555952dbc98e72618e158688859f7c055f07ff2ca5d35f4b42c59684b79e8d4" exitCode=0 May 27 21:38:51.385866 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:51.385827 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppk2n" event={"ID":"79a9dc4b-003d-47a5-9db1-c461022e3ee4","Type":"ContainerDied","Data":"7555952dbc98e72618e158688859f7c055f07ff2ca5d35f4b42c59684b79e8d4"} May 27 21:38:52.089164 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:52.089134 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a881aae1-7e96-4349-beb5-70bb1ed2ec67-registry-tls\") pod \"image-registry-7fbc4dbb7-rp6ng\" (UID: \"a881aae1-7e96-4349-beb5-70bb1ed2ec67\") " pod="openshift-image-registry/image-registry-7fbc4dbb7-rp6ng" May 27 21:38:52.089354 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:52.089326 2576 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 27 21:38:52.089354 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:52.089348 2576 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fbc4dbb7-rp6ng: secret "image-registry-tls" not found May 27 21:38:52.089464 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:52.089419 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a881aae1-7e96-4349-beb5-70bb1ed2ec67-registry-tls podName:a881aae1-7e96-4349-beb5-70bb1ed2ec67 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:54.089398236 +0000 UTC m=+38.604148004 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a881aae1-7e96-4349-beb5-70bb1ed2ec67-registry-tls") pod "image-registry-7fbc4dbb7-rp6ng" (UID: "a881aae1-7e96-4349-beb5-70bb1ed2ec67") : secret "image-registry-tls" not found May 27 21:38:52.190404 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:52.190368 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa3113b8-5396-4fab-b87f-a3d6bfee9121-metrics-tls\") pod \"dns-default-kx8l8\" (UID: \"aa3113b8-5396-4fab-b87f-a3d6bfee9121\") " pod="openshift-dns/dns-default-kx8l8" May 27 21:38:52.190557 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:52.190420 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34efe17a-77e3-4d91-81ea-2c8c98c73882-cert\") pod \"ingress-canary-cvngm\" (UID: \"34efe17a-77e3-4d91-81ea-2c8c98c73882\") " pod="openshift-ingress-canary/ingress-canary-cvngm" May 27 21:38:52.190557 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:52.190525 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 21:38:52.190557 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:52.190554 2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 21:38:52.190667 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:52.190591 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa3113b8-5396-4fab-b87f-a3d6bfee9121-metrics-tls podName:aa3113b8-5396-4fab-b87f-a3d6bfee9121 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:54.190575275 +0000 UTC m=+38.705325036 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aa3113b8-5396-4fab-b87f-a3d6bfee9121-metrics-tls") pod "dns-default-kx8l8" (UID: "aa3113b8-5396-4fab-b87f-a3d6bfee9121") : secret "dns-default-metrics-tls" not found May 27 21:38:52.190667 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:52.190606 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34efe17a-77e3-4d91-81ea-2c8c98c73882-cert podName:34efe17a-77e3-4d91-81ea-2c8c98c73882 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:54.190599888 +0000 UTC m=+38.705349649 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/34efe17a-77e3-4d91-81ea-2c8c98c73882-cert") pod "ingress-canary-cvngm" (UID: "34efe17a-77e3-4d91-81ea-2c8c98c73882") : secret "canary-serving-cert" not found May 27 21:38:52.390161 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:52.390083 2576 generic.go:358] "Generic (PLEG): container finished" podID="79a9dc4b-003d-47a5-9db1-c461022e3ee4" containerID="be95d91cb6e36af0b46327473e5ddb8ad28d8802a69d603887f56d1e66c729cd" exitCode=0 May 27 21:38:52.390610 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:52.390156 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppk2n" event={"ID":"79a9dc4b-003d-47a5-9db1-c461022e3ee4","Type":"ContainerDied","Data":"be95d91cb6e36af0b46327473e5ddb8ad28d8802a69d603887f56d1e66c729cd"} May 27 21:38:53.395089 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:53.394856 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppk2n" event={"ID":"79a9dc4b-003d-47a5-9db1-c461022e3ee4","Type":"ContainerStarted","Data":"57d445828f30a9267d5aea1b9f47093c25a5b6f2ffc25bca34f6bd792757e68d"} May 27 21:38:53.425777 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:53.425731 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ppk2n" podStartSLOduration=4.613179184 podStartE2EDuration="37.425717385s" podCreationTimestamp="2026-05-27 21:38:16 +0000 UTC" firstStartedPulling="2026-05-27 21:38:17.381202394 +0000 UTC m=+1.895952156" lastFinishedPulling="2026-05-27 21:38:50.193740591 +0000 UTC m=+34.708490357" observedRunningTime="2026-05-27 21:38:53.425254322 +0000 UTC m=+37.940004107" watchObservedRunningTime="2026-05-27 21:38:53.425717385 +0000 UTC m=+37.940467168" May 27 21:38:54.109269 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:54.109212 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a881aae1-7e96-4349-beb5-70bb1ed2ec67-registry-tls\") pod \"image-registry-7fbc4dbb7-rp6ng\" (UID: \"a881aae1-7e96-4349-beb5-70bb1ed2ec67\") " pod="openshift-image-registry/image-registry-7fbc4dbb7-rp6ng" May 27 21:38:54.109411 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:54.109322 2576 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 27 21:38:54.109411 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:54.109341 2576 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fbc4dbb7-rp6ng: secret "image-registry-tls" not found May 27 21:38:54.109411 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:54.109396 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a881aae1-7e96-4349-beb5-70bb1ed2ec67-registry-tls podName:a881aae1-7e96-4349-beb5-70bb1ed2ec67 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:58.109380334 +0000 UTC m=+42.624130101 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a881aae1-7e96-4349-beb5-70bb1ed2ec67-registry-tls") pod "image-registry-7fbc4dbb7-rp6ng" (UID: "a881aae1-7e96-4349-beb5-70bb1ed2ec67") : secret "image-registry-tls" not found May 27 21:38:54.209772 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:54.209741 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa3113b8-5396-4fab-b87f-a3d6bfee9121-metrics-tls\") pod \"dns-default-kx8l8\" (UID: \"aa3113b8-5396-4fab-b87f-a3d6bfee9121\") " pod="openshift-dns/dns-default-kx8l8" May 27 21:38:54.209936 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:54.209782 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34efe17a-77e3-4d91-81ea-2c8c98c73882-cert\") pod \"ingress-canary-cvngm\" (UID: \"34efe17a-77e3-4d91-81ea-2c8c98c73882\") " pod="openshift-ingress-canary/ingress-canary-cvngm" May 27 21:38:54.209936 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:54.209906 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 21:38:54.210057 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:54.209977 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa3113b8-5396-4fab-b87f-a3d6bfee9121-metrics-tls podName:aa3113b8-5396-4fab-b87f-a3d6bfee9121 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:58.209958219 +0000 UTC m=+42.724707985 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aa3113b8-5396-4fab-b87f-a3d6bfee9121-metrics-tls") pod "dns-default-kx8l8" (UID: "aa3113b8-5396-4fab-b87f-a3d6bfee9121") : secret "dns-default-metrics-tls" not found May 27 21:38:54.210057 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:54.209975 2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 21:38:54.210057 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:54.210034 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34efe17a-77e3-4d91-81ea-2c8c98c73882-cert podName:34efe17a-77e3-4d91-81ea-2c8c98c73882 nodeName:}" failed. No retries permitted until 2026-05-27 21:38:58.210018907 +0000 UTC m=+42.724768669 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/34efe17a-77e3-4d91-81ea-2c8c98c73882-cert") pod "ingress-canary-cvngm" (UID: "34efe17a-77e3-4d91-81ea-2c8c98c73882") : secret "canary-serving-cert" not found May 27 21:38:55.673869 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:55.673835 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-jf2hk"] May 27 21:38:55.706269 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:55.706219 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-jf2hk"] May 27 21:38:55.706403 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:55.706282 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-jf2hk" May 27 21:38:55.709076 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:55.709023 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" May 27 21:38:55.709176 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:55.709114 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" May 27 21:38:55.709263 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:55.709249 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" May 27 21:38:55.710325 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:55.710304 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" May 27 21:38:55.710545 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:55.710328 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-p8pgq\"" May 27 21:38:55.821338 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:55.821299 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkrb5\" (UniqueName: \"kubernetes.io/projected/753db63a-c8c4-4397-9725-de8821856f25-kube-api-access-lkrb5\") pod \"service-ca-67d667c7d-jf2hk\" (UID: \"753db63a-c8c4-4397-9725-de8821856f25\") " pod="openshift-service-ca/service-ca-67d667c7d-jf2hk" May 27 21:38:55.821510 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:55.821343 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/753db63a-c8c4-4397-9725-de8821856f25-signing-cabundle\") pod \"service-ca-67d667c7d-jf2hk\" (UID: \"753db63a-c8c4-4397-9725-de8821856f25\") " pod="openshift-service-ca/service-ca-67d667c7d-jf2hk" May 27 21:38:55.821510 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:55.821373 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/753db63a-c8c4-4397-9725-de8821856f25-signing-key\") pod \"service-ca-67d667c7d-jf2hk\" (UID: \"753db63a-c8c4-4397-9725-de8821856f25\") " pod="openshift-service-ca/service-ca-67d667c7d-jf2hk" May 27 21:38:55.922242 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:55.922203 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/753db63a-c8c4-4397-9725-de8821856f25-signing-key\") pod \"service-ca-67d667c7d-jf2hk\" (UID: \"753db63a-c8c4-4397-9725-de8821856f25\") " pod="openshift-service-ca/service-ca-67d667c7d-jf2hk" May 27 21:38:55.922386 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:55.922359 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lkrb5\" (UniqueName: \"kubernetes.io/projected/753db63a-c8c4-4397-9725-de8821856f25-kube-api-access-lkrb5\") pod \"service-ca-67d667c7d-jf2hk\" (UID: \"753db63a-c8c4-4397-9725-de8821856f25\") " pod="openshift-service-ca/service-ca-67d667c7d-jf2hk" May 27 21:38:55.922426 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:55.922404 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/753db63a-c8c4-4397-9725-de8821856f25-signing-cabundle\") pod \"service-ca-67d667c7d-jf2hk\" (UID: \"753db63a-c8c4-4397-9725-de8821856f25\") " pod="openshift-service-ca/service-ca-67d667c7d-jf2hk" May 27 21:38:55.923044 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:55.923027 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/753db63a-c8c4-4397-9725-de8821856f25-signing-cabundle\") pod \"service-ca-67d667c7d-jf2hk\" (UID: \"753db63a-c8c4-4397-9725-de8821856f25\") " pod="openshift-service-ca/service-ca-67d667c7d-jf2hk" May 27 21:38:55.925330 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:55.925289 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/753db63a-c8c4-4397-9725-de8821856f25-signing-key\") pod \"service-ca-67d667c7d-jf2hk\" (UID: \"753db63a-c8c4-4397-9725-de8821856f25\") " pod="openshift-service-ca/service-ca-67d667c7d-jf2hk" May 27 21:38:55.931982 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:55.931961 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkrb5\" (UniqueName: \"kubernetes.io/projected/753db63a-c8c4-4397-9725-de8821856f25-kube-api-access-lkrb5\") pod \"service-ca-67d667c7d-jf2hk\" (UID: \"753db63a-c8c4-4397-9725-de8821856f25\") " pod="openshift-service-ca/service-ca-67d667c7d-jf2hk" May 27 21:38:56.015450 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:56.015396 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-jf2hk" May 27 21:38:56.161351 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:56.161320 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-jf2hk"] May 27 21:38:56.165386 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:38:56.165359 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod753db63a_c8c4_4397_9725_de8821856f25.slice/crio-d2f04a1a49e1b28d21a9fc4c6fa9417dea484898697f2ae16d485c01671743ab WatchSource:0}: Error finding container d2f04a1a49e1b28d21a9fc4c6fa9417dea484898697f2ae16d485c01671743ab: Status 404 returned error can't find the container with id d2f04a1a49e1b28d21a9fc4c6fa9417dea484898697f2ae16d485c01671743ab May 27 21:38:56.401124 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:56.401090 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-jf2hk" event={"ID":"753db63a-c8c4-4397-9725-de8821856f25","Type":"ContainerStarted","Data":"d2f04a1a49e1b28d21a9fc4c6fa9417dea484898697f2ae16d485c01671743ab"} May 27 21:38:56.688429 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:56.688404 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l45ck_bd5e8436-5b68-4fb7-9d97-d3d8d441f980/dns-node-resolver/0.log" May 27 21:38:57.688653 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:57.688628 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-slshq_9efca526-fa4d-4195-a7ab-9139cb1c02ad/node-ca/0.log" May 27 21:38:58.139832 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:58.139760 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a881aae1-7e96-4349-beb5-70bb1ed2ec67-registry-tls\") pod \"image-registry-7fbc4dbb7-rp6ng\" (UID: \"a881aae1-7e96-4349-beb5-70bb1ed2ec67\") " pod="openshift-image-registry/image-registry-7fbc4dbb7-rp6ng" May 27 21:38:58.139953 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:58.139904 2576 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 27 21:38:58.139953 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:58.139921 2576 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fbc4dbb7-rp6ng: secret "image-registry-tls" not found May 27 21:38:58.140012 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:58.139973 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a881aae1-7e96-4349-beb5-70bb1ed2ec67-registry-tls podName:a881aae1-7e96-4349-beb5-70bb1ed2ec67 nodeName:}" failed. No retries permitted until 2026-05-27 21:39:06.13995728 +0000 UTC m=+50.654707043 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a881aae1-7e96-4349-beb5-70bb1ed2ec67-registry-tls") pod "image-registry-7fbc4dbb7-rp6ng" (UID: "a881aae1-7e96-4349-beb5-70bb1ed2ec67") : secret "image-registry-tls" not found May 27 21:38:58.240846 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:58.240811 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa3113b8-5396-4fab-b87f-a3d6bfee9121-metrics-tls\") pod \"dns-default-kx8l8\" (UID: \"aa3113b8-5396-4fab-b87f-a3d6bfee9121\") " pod="openshift-dns/dns-default-kx8l8" May 27 21:38:58.240991 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:58.240860 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34efe17a-77e3-4d91-81ea-2c8c98c73882-cert\") pod \"ingress-canary-cvngm\" (UID: \"34efe17a-77e3-4d91-81ea-2c8c98c73882\") " pod="openshift-ingress-canary/ingress-canary-cvngm" May 27 21:38:58.240991 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:58.240966 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 21:38:58.241051 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:58.241028 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa3113b8-5396-4fab-b87f-a3d6bfee9121-metrics-tls podName:aa3113b8-5396-4fab-b87f-a3d6bfee9121 nodeName:}" failed. No retries permitted until 2026-05-27 21:39:06.241009108 +0000 UTC m=+50.755758870 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aa3113b8-5396-4fab-b87f-a3d6bfee9121-metrics-tls") pod "dns-default-kx8l8" (UID: "aa3113b8-5396-4fab-b87f-a3d6bfee9121") : secret "dns-default-metrics-tls" not found May 27 21:38:58.241051 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:58.241044 2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 21:38:58.241120 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:38:58.241080 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34efe17a-77e3-4d91-81ea-2c8c98c73882-cert podName:34efe17a-77e3-4d91-81ea-2c8c98c73882 nodeName:}" failed. No retries permitted until 2026-05-27 21:39:06.241069642 +0000 UTC m=+50.755819403 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/34efe17a-77e3-4d91-81ea-2c8c98c73882-cert") pod "ingress-canary-cvngm" (UID: "34efe17a-77e3-4d91-81ea-2c8c98c73882") : secret "canary-serving-cert" not found May 27 21:38:59.407571 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:59.407534 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-jf2hk" event={"ID":"753db63a-c8c4-4397-9725-de8821856f25","Type":"ContainerStarted","Data":"21860b42d107f0cebdeb089d33e63166ecee67e655331f7b841aa55f07f5ce28"} May 27 21:38:59.425062 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:38:59.425012 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-jf2hk" podStartSLOduration=2.108989063 podStartE2EDuration="4.42499627s" podCreationTimestamp="2026-05-27 21:38:55 +0000 UTC" firstStartedPulling="2026-05-27 21:38:56.167160319 +0000 UTC m=+40.681910081" lastFinishedPulling="2026-05-27 21:38:58.483167526 +0000 UTC m=+42.997917288" observedRunningTime="2026-05-27 21:38:59.424501121 +0000 UTC m=+43.939250905" watchObservedRunningTime="2026-05-27 21:38:59.42499627 +0000 UTC m=+43.939746054" May 27 21:39:06.202508 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:06.202469 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a881aae1-7e96-4349-beb5-70bb1ed2ec67-registry-tls\") pod \"image-registry-7fbc4dbb7-rp6ng\" (UID: \"a881aae1-7e96-4349-beb5-70bb1ed2ec67\") " pod="openshift-image-registry/image-registry-7fbc4dbb7-rp6ng" May 27 21:39:06.204919 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:06.204896 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a881aae1-7e96-4349-beb5-70bb1ed2ec67-registry-tls\") pod \"image-registry-7fbc4dbb7-rp6ng\" (UID: \"a881aae1-7e96-4349-beb5-70bb1ed2ec67\") " pod="openshift-image-registry/image-registry-7fbc4dbb7-rp6ng" May 27 21:39:06.303561 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:06.303522 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa3113b8-5396-4fab-b87f-a3d6bfee9121-metrics-tls\") pod \"dns-default-kx8l8\" (UID: \"aa3113b8-5396-4fab-b87f-a3d6bfee9121\") " pod="openshift-dns/dns-default-kx8l8" May 27 21:39:06.303561 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:06.303569 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34efe17a-77e3-4d91-81ea-2c8c98c73882-cert\") pod \"ingress-canary-cvngm\" (UID: \"34efe17a-77e3-4d91-81ea-2c8c98c73882\") " pod="openshift-ingress-canary/ingress-canary-cvngm" May 27 21:39:06.305905 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:06.305872 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa3113b8-5396-4fab-b87f-a3d6bfee9121-metrics-tls\") pod \"dns-default-kx8l8\" (UID: \"aa3113b8-5396-4fab-b87f-a3d6bfee9121\") " pod="openshift-dns/dns-default-kx8l8" May 27 21:39:06.306008 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:06.305917 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34efe17a-77e3-4d91-81ea-2c8c98c73882-cert\") pod \"ingress-canary-cvngm\" (UID: \"34efe17a-77e3-4d91-81ea-2c8c98c73882\") " pod="openshift-ingress-canary/ingress-canary-cvngm" May 27 21:39:06.312797 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:06.312778 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fbc4dbb7-rp6ng" May 27 21:39:06.332513 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:06.332486 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kx8l8" May 27 21:39:06.356204 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:06.356174 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cvngm" May 27 21:39:06.495115 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:06.495057 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7fbc4dbb7-rp6ng"] May 27 21:39:06.496265 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:39:06.496219 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda881aae1_7e96_4349_beb5_70bb1ed2ec67.slice/crio-e9055fc3f581fafd8352ac12ecaff281b4bd974b3a35138f86c300d37bdc2324 WatchSource:0}: Error finding container e9055fc3f581fafd8352ac12ecaff281b4bd974b3a35138f86c300d37bdc2324: Status 404 returned error can't find the container with id e9055fc3f581fafd8352ac12ecaff281b4bd974b3a35138f86c300d37bdc2324 May 27 21:39:06.506743 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:06.506716 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kx8l8"] May 27 21:39:06.509625 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:39:06.509601 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa3113b8_5396_4fab_b87f_a3d6bfee9121.slice/crio-bd379c4cdbcb916cb13f0016ada946017a509cb2179c885cb43d2bfc2e71824c WatchSource:0}: Error finding container bd379c4cdbcb916cb13f0016ada946017a509cb2179c885cb43d2bfc2e71824c: Status 404 returned error can't find the container with id bd379c4cdbcb916cb13f0016ada946017a509cb2179c885cb43d2bfc2e71824c May 27 21:39:06.534236 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:06.534191 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cvngm"] May 27 21:39:06.537709 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:39:06.537686 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34efe17a_77e3_4d91_81ea_2c8c98c73882.slice/crio-2d5487c0ddc2203978dce3d7bc98c900239d969a3bb3983dcac05266be235d4b WatchSource:0}: Error finding container 2d5487c0ddc2203978dce3d7bc98c900239d969a3bb3983dcac05266be235d4b: Status 404 returned error can't find the container with id 2d5487c0ddc2203978dce3d7bc98c900239d969a3bb3983dcac05266be235d4b May 27 21:39:07.428482 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:07.428438 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kx8l8" event={"ID":"aa3113b8-5396-4fab-b87f-a3d6bfee9121","Type":"ContainerStarted","Data":"bd379c4cdbcb916cb13f0016ada946017a509cb2179c885cb43d2bfc2e71824c"} May 27 21:39:07.429749 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:07.429704 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cvngm" event={"ID":"34efe17a-77e3-4d91-81ea-2c8c98c73882","Type":"ContainerStarted","Data":"2d5487c0ddc2203978dce3d7bc98c900239d969a3bb3983dcac05266be235d4b"} May 27 21:39:07.431529 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:07.431502 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fbc4dbb7-rp6ng" event={"ID":"a881aae1-7e96-4349-beb5-70bb1ed2ec67","Type":"ContainerStarted","Data":"cedac6d54ca3036a75d7015626537cc0dbe19f26cb75b79ad58bf353b8af80ec"} May 27 21:39:07.431618 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:07.431536 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fbc4dbb7-rp6ng" event={"ID":"a881aae1-7e96-4349-beb5-70bb1ed2ec67","Type":"ContainerStarted","Data":"e9055fc3f581fafd8352ac12ecaff281b4bd974b3a35138f86c300d37bdc2324"} May 27 21:39:07.431715 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:07.431697 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7fbc4dbb7-rp6ng" May 27 21:39:07.460439 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:07.460398 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7fbc4dbb7-rp6ng" podStartSLOduration=54.460386392 podStartE2EDuration="54.460386392s" podCreationTimestamp="2026-05-27 21:38:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 21:39:07.459391791 +0000 UTC m=+51.974141575" watchObservedRunningTime="2026-05-27 21:39:07.460386392 +0000 UTC m=+51.975136176" May 27 21:39:09.436837 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:09.436799 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kx8l8" event={"ID":"aa3113b8-5396-4fab-b87f-a3d6bfee9121","Type":"ContainerStarted","Data":"0f521349d626d1f6a0cc344f221a2d7e94f063576fc899da5c5c18fda12e240f"} May 27 21:39:09.437278 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:09.436843 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kx8l8" event={"ID":"aa3113b8-5396-4fab-b87f-a3d6bfee9121","Type":"ContainerStarted","Data":"5f3a1175b35376f5d56ae9f0e11e1bd13ab7f1679195e55eca5fe406117cca81"} May 27 21:39:09.437278 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:09.436912 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kx8l8" May 27 21:39:09.438145 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:09.438115 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cvngm" event={"ID":"34efe17a-77e3-4d91-81ea-2c8c98c73882","Type":"ContainerStarted","Data":"e9783185f16444c2ce248841ff04b2c8cd85ff95ba6d258d7e6bb68e0ec6db5c"} May 27 21:39:09.456541 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:09.456502 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-kx8l8" podStartSLOduration=17.449203047 podStartE2EDuration="19.456492446s" podCreationTimestamp="2026-05-27 21:38:50 +0000 UTC" firstStartedPulling="2026-05-27 21:39:06.511506747 +0000 UTC m=+51.026256513" lastFinishedPulling="2026-05-27 21:39:08.518796138 +0000 UTC m=+53.033545912" observedRunningTime="2026-05-27 21:39:09.455667021 +0000 UTC m=+53.970416804" watchObservedRunningTime="2026-05-27 21:39:09.456492446 +0000 UTC m=+53.971242230" May 27 21:39:09.472987 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:09.472947 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-cvngm" podStartSLOduration=17.489398755 podStartE2EDuration="19.472935161s" podCreationTimestamp="2026-05-27 21:38:50 +0000 UTC" firstStartedPulling="2026-05-27 21:39:06.539824437 +0000 UTC m=+51.054574198" lastFinishedPulling="2026-05-27 21:39:08.523360828 +0000 UTC m=+53.038110604" observedRunningTime="2026-05-27 21:39:09.472471892 +0000 UTC m=+53.987221676" watchObservedRunningTime="2026-05-27 21:39:09.472935161 +0000 UTC m=+53.987684945" May 27 21:39:15.380011 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:15.379982 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-szbhn" May 27 21:39:16.118723 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.118694 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdcd8948f-j27bd"] May 27 21:39:16.121699 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.121678 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdcd8948f-j27bd" May 27 21:39:16.121813 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.121737 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4d7f78dc-ndmg4"] May 27 21:39:16.123610 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.123592 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4d7f78dc-ndmg4" May 27 21:39:16.125515 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.125494 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" May 27 21:39:16.125515 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.125508 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" May 27 21:39:16.125682 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.125555 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" May 27 21:39:16.125682 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.125612 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" May 27 21:39:16.126859 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.126840 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" May 27 21:39:16.127200 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.127183 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" May 27 21:39:16.127200 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.127192 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" May 27 21:39:16.127358 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.127328 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" May 27 21:39:16.130415 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.130396 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7fbc4dbb7-rp6ng"] May 27 21:39:16.135525 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.135369 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdcd8948f-j27bd"] May 27 21:39:16.151271 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.151250 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4d7f78dc-ndmg4"] May 27 21:39:16.177192 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.177165 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5c51a7d2-82fa-4e11-996a-52e8d68aa8db-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-d4d7f78dc-ndmg4\" (UID: \"5c51a7d2-82fa-4e11-996a-52e8d68aa8db\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4d7f78dc-ndmg4" May 27 21:39:16.177324 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.177240 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jjw5\" (UniqueName: \"kubernetes.io/projected/5c51a7d2-82fa-4e11-996a-52e8d68aa8db-kube-api-access-6jjw5\") pod \"cluster-proxy-proxy-agent-d4d7f78dc-ndmg4\" (UID: \"5c51a7d2-82fa-4e11-996a-52e8d68aa8db\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4d7f78dc-ndmg4" May 27 21:39:16.177324 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.177286 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-578nf\" (UniqueName: \"kubernetes.io/projected/40d30d69-62e2-4595-9017-6b28787486d2-kube-api-access-578nf\") pod \"klusterlet-addon-workmgr-7cdcd8948f-j27bd\" (UID: \"40d30d69-62e2-4595-9017-6b28787486d2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdcd8948f-j27bd" May 27 21:39:16.177324 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.177302 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5c51a7d2-82fa-4e11-996a-52e8d68aa8db-ca\") pod \"cluster-proxy-proxy-agent-d4d7f78dc-ndmg4\" (UID: \"5c51a7d2-82fa-4e11-996a-52e8d68aa8db\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4d7f78dc-ndmg4" May 27 21:39:16.177324 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.177317 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5c51a7d2-82fa-4e11-996a-52e8d68aa8db-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-d4d7f78dc-ndmg4\" (UID: \"5c51a7d2-82fa-4e11-996a-52e8d68aa8db\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4d7f78dc-ndmg4" May 27 21:39:16.177491 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.177333 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/5c51a7d2-82fa-4e11-996a-52e8d68aa8db-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-d4d7f78dc-ndmg4\" (UID: \"5c51a7d2-82fa-4e11-996a-52e8d68aa8db\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4d7f78dc-ndmg4" May 27 21:39:16.177491 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.177350 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/40d30d69-62e2-4595-9017-6b28787486d2-tmp\") pod \"klusterlet-addon-workmgr-7cdcd8948f-j27bd\" (UID: \"40d30d69-62e2-4595-9017-6b28787486d2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdcd8948f-j27bd" May 27 21:39:16.177491 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.177365 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/40d30d69-62e2-4595-9017-6b28787486d2-klusterlet-config\") pod \"klusterlet-addon-workmgr-7cdcd8948f-j27bd\" (UID: \"40d30d69-62e2-4595-9017-6b28787486d2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdcd8948f-j27bd" May 27 21:39:16.177491 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.177390 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5c51a7d2-82fa-4e11-996a-52e8d68aa8db-hub\") pod \"cluster-proxy-proxy-agent-d4d7f78dc-ndmg4\" (UID: \"5c51a7d2-82fa-4e11-996a-52e8d68aa8db\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4d7f78dc-ndmg4" May 27 21:39:16.269843 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.269817 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pdw2g"] May 27 21:39:16.271916 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.271891 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pdw2g" May 27 21:39:16.275008 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.274986 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 27 21:39:16.275195 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.275026 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 27 21:39:16.275336 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.275281 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mzgsc\"" May 27 21:39:16.275336 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.275309 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 27 21:39:16.275593 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.275570 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 27 21:39:16.277728 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.277707 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6jjw5\" (UniqueName: \"kubernetes.io/projected/5c51a7d2-82fa-4e11-996a-52e8d68aa8db-kube-api-access-6jjw5\") pod \"cluster-proxy-proxy-agent-d4d7f78dc-ndmg4\" (UID: \"5c51a7d2-82fa-4e11-996a-52e8d68aa8db\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4d7f78dc-ndmg4" May 27 21:39:16.277809 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.277753 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-578nf\" (UniqueName: \"kubernetes.io/projected/40d30d69-62e2-4595-9017-6b28787486d2-kube-api-access-578nf\") pod \"klusterlet-addon-workmgr-7cdcd8948f-j27bd\" (UID: \"40d30d69-62e2-4595-9017-6b28787486d2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdcd8948f-j27bd" May 27 21:39:16.277915 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.277899 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5c51a7d2-82fa-4e11-996a-52e8d68aa8db-ca\") pod \"cluster-proxy-proxy-agent-d4d7f78dc-ndmg4\" (UID: \"5c51a7d2-82fa-4e11-996a-52e8d68aa8db\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4d7f78dc-ndmg4" May 27 21:39:16.277954 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.277927 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5c51a7d2-82fa-4e11-996a-52e8d68aa8db-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-d4d7f78dc-ndmg4\" (UID: \"5c51a7d2-82fa-4e11-996a-52e8d68aa8db\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4d7f78dc-ndmg4" May 27 21:39:16.277954 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.277945 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/5c51a7d2-82fa-4e11-996a-52e8d68aa8db-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-d4d7f78dc-ndmg4\" (UID: \"5c51a7d2-82fa-4e11-996a-52e8d68aa8db\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4d7f78dc-ndmg4" May 27 21:39:16.278031 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.277971 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/40d30d69-62e2-4595-9017-6b28787486d2-tmp\") pod \"klusterlet-addon-workmgr-7cdcd8948f-j27bd\" (UID: \"40d30d69-62e2-4595-9017-6b28787486d2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdcd8948f-j27bd" May 27 21:39:16.278126 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.278102 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/40d30d69-62e2-4595-9017-6b28787486d2-klusterlet-config\") pod \"klusterlet-addon-workmgr-7cdcd8948f-j27bd\" (UID: \"40d30d69-62e2-4595-9017-6b28787486d2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdcd8948f-j27bd" May 27 21:39:16.278249 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.278161 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5c51a7d2-82fa-4e11-996a-52e8d68aa8db-hub\") pod \"cluster-proxy-proxy-agent-d4d7f78dc-ndmg4\" (UID: \"5c51a7d2-82fa-4e11-996a-52e8d68aa8db\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4d7f78dc-ndmg4" May 27 21:39:16.278249 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.278192 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5c51a7d2-82fa-4e11-996a-52e8d68aa8db-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-d4d7f78dc-ndmg4\" (UID: \"5c51a7d2-82fa-4e11-996a-52e8d68aa8db\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4d7f78dc-ndmg4" May 27 21:39:16.278380 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.278351 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/40d30d69-62e2-4595-9017-6b28787486d2-tmp\") pod \"klusterlet-addon-workmgr-7cdcd8948f-j27bd\" (UID: \"40d30d69-62e2-4595-9017-6b28787486d2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdcd8948f-j27bd" May 27 21:39:16.278827 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.278801 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/5c51a7d2-82fa-4e11-996a-52e8d68aa8db-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-d4d7f78dc-ndmg4\" (UID: \"5c51a7d2-82fa-4e11-996a-52e8d68aa8db\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4d7f78dc-ndmg4" May 27 21:39:16.280663 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.280634 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5c51a7d2-82fa-4e11-996a-52e8d68aa8db-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-d4d7f78dc-ndmg4\" (UID: \"5c51a7d2-82fa-4e11-996a-52e8d68aa8db\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4d7f78dc-ndmg4" May 27 21:39:16.280663 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.280638 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5c51a7d2-82fa-4e11-996a-52e8d68aa8db-ca\") pod \"cluster-proxy-proxy-agent-d4d7f78dc-ndmg4\" (UID: \"5c51a7d2-82fa-4e11-996a-52e8d68aa8db\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4d7f78dc-ndmg4" May 27 21:39:16.280778 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.280739 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/40d30d69-62e2-4595-9017-6b28787486d2-klusterlet-config\") pod \"klusterlet-addon-workmgr-7cdcd8948f-j27bd\" (UID: \"40d30d69-62e2-4595-9017-6b28787486d2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdcd8948f-j27bd" May 27 21:39:16.280897 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.280878 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5c51a7d2-82fa-4e11-996a-52e8d68aa8db-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-d4d7f78dc-ndmg4\" (UID: \"5c51a7d2-82fa-4e11-996a-52e8d68aa8db\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4d7f78dc-ndmg4" May 27 21:39:16.281694 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.281675 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5c51a7d2-82fa-4e11-996a-52e8d68aa8db-hub\") pod \"cluster-proxy-proxy-agent-d4d7f78dc-ndmg4\" (UID: \"5c51a7d2-82fa-4e11-996a-52e8d68aa8db\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4d7f78dc-ndmg4" May 27 21:39:16.284767 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.284747 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pdw2g"] May 27 21:39:16.290357 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.290313 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jjw5\" (UniqueName: \"kubernetes.io/projected/5c51a7d2-82fa-4e11-996a-52e8d68aa8db-kube-api-access-6jjw5\") pod \"cluster-proxy-proxy-agent-d4d7f78dc-ndmg4\" (UID: \"5c51a7d2-82fa-4e11-996a-52e8d68aa8db\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4d7f78dc-ndmg4" May 27 21:39:16.290787 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.290768 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-578nf\" (UniqueName: \"kubernetes.io/projected/40d30d69-62e2-4595-9017-6b28787486d2-kube-api-access-578nf\") pod \"klusterlet-addon-workmgr-7cdcd8948f-j27bd\" (UID: \"40d30d69-62e2-4595-9017-6b28787486d2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdcd8948f-j27bd" May 27 21:39:16.378713 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.378646 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/76bd7347-d8f1-48e4-b72a-10b7527a500d-crio-socket\") pod \"insights-runtime-extractor-pdw2g\" (UID: \"76bd7347-d8f1-48e4-b72a-10b7527a500d\") " pod="openshift-insights/insights-runtime-extractor-pdw2g" May 27 21:39:16.378713 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.378683 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/76bd7347-d8f1-48e4-b72a-10b7527a500d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pdw2g\" (UID: \"76bd7347-d8f1-48e4-b72a-10b7527a500d\") " pod="openshift-insights/insights-runtime-extractor-pdw2g" May 27 21:39:16.378864 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.378753 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/76bd7347-d8f1-48e4-b72a-10b7527a500d-data-volume\") pod \"insights-runtime-extractor-pdw2g\" (UID: \"76bd7347-d8f1-48e4-b72a-10b7527a500d\") " pod="openshift-insights/insights-runtime-extractor-pdw2g" May 27 21:39:16.378864 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.378830 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsddt\" (UniqueName: \"kubernetes.io/projected/76bd7347-d8f1-48e4-b72a-10b7527a500d-kube-api-access-gsddt\") pod \"insights-runtime-extractor-pdw2g\" (UID: \"76bd7347-d8f1-48e4-b72a-10b7527a500d\") " pod="openshift-insights/insights-runtime-extractor-pdw2g" May 27 21:39:16.378942 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.378870 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/76bd7347-d8f1-48e4-b72a-10b7527a500d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pdw2g\" (UID: \"76bd7347-d8f1-48e4-b72a-10b7527a500d\") " pod="openshift-insights/insights-runtime-extractor-pdw2g" May 27 21:39:16.432628 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.432606 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdcd8948f-j27bd" May 27 21:39:16.447016 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.446997 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4d7f78dc-ndmg4" May 27 21:39:16.479504 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.479468 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gsddt\" (UniqueName: \"kubernetes.io/projected/76bd7347-d8f1-48e4-b72a-10b7527a500d-kube-api-access-gsddt\") pod \"insights-runtime-extractor-pdw2g\" (UID: \"76bd7347-d8f1-48e4-b72a-10b7527a500d\") " pod="openshift-insights/insights-runtime-extractor-pdw2g" May 27 21:39:16.479604 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.479527 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/76bd7347-d8f1-48e4-b72a-10b7527a500d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pdw2g\" (UID: \"76bd7347-d8f1-48e4-b72a-10b7527a500d\") " pod="openshift-insights/insights-runtime-extractor-pdw2g" May 27 21:39:16.479604 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.479557 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/76bd7347-d8f1-48e4-b72a-10b7527a500d-crio-socket\") pod \"insights-runtime-extractor-pdw2g\" (UID: \"76bd7347-d8f1-48e4-b72a-10b7527a500d\") " pod="openshift-insights/insights-runtime-extractor-pdw2g" May 27 21:39:16.479604 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.479593 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/76bd7347-d8f1-48e4-b72a-10b7527a500d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pdw2g\" (UID: \"76bd7347-d8f1-48e4-b72a-10b7527a500d\") " pod="openshift-insights/insights-runtime-extractor-pdw2g" May 27 21:39:16.479750 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.479640 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/76bd7347-d8f1-48e4-b72a-10b7527a500d-data-volume\") pod \"insights-runtime-extractor-pdw2g\" (UID: \"76bd7347-d8f1-48e4-b72a-10b7527a500d\") " pod="openshift-insights/insights-runtime-extractor-pdw2g" May 27 21:39:16.480504 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.480016 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/76bd7347-d8f1-48e4-b72a-10b7527a500d-data-volume\") pod \"insights-runtime-extractor-pdw2g\" (UID: \"76bd7347-d8f1-48e4-b72a-10b7527a500d\") " pod="openshift-insights/insights-runtime-extractor-pdw2g" May 27 21:39:16.480504 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.480099 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/76bd7347-d8f1-48e4-b72a-10b7527a500d-crio-socket\") pod \"insights-runtime-extractor-pdw2g\" (UID: \"76bd7347-d8f1-48e4-b72a-10b7527a500d\") " pod="openshift-insights/insights-runtime-extractor-pdw2g" May 27 21:39:16.481255 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.481084 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/76bd7347-d8f1-48e4-b72a-10b7527a500d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pdw2g\" (UID: \"76bd7347-d8f1-48e4-b72a-10b7527a500d\") " pod="openshift-insights/insights-runtime-extractor-pdw2g" May 27 21:39:16.483090 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.483064 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/76bd7347-d8f1-48e4-b72a-10b7527a500d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pdw2g\" (UID: \"76bd7347-d8f1-48e4-b72a-10b7527a500d\") " pod="openshift-insights/insights-runtime-extractor-pdw2g" May 27 21:39:16.489766 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.489731 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsddt\" (UniqueName: \"kubernetes.io/projected/76bd7347-d8f1-48e4-b72a-10b7527a500d-kube-api-access-gsddt\") pod \"insights-runtime-extractor-pdw2g\" (UID: \"76bd7347-d8f1-48e4-b72a-10b7527a500d\") " pod="openshift-insights/insights-runtime-extractor-pdw2g" May 27 21:39:16.570936 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.570905 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdcd8948f-j27bd"] May 27 21:39:16.573819 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:39:16.573792 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40d30d69_62e2_4595_9017_6b28787486d2.slice/crio-771d217c5060a30e94ec4d496ea46269f47e3bdd6399ff118e7f30325591cf0c WatchSource:0}: Error finding container 771d217c5060a30e94ec4d496ea46269f47e3bdd6399ff118e7f30325591cf0c: Status 404 returned error can't find the container with id 771d217c5060a30e94ec4d496ea46269f47e3bdd6399ff118e7f30325591cf0c May 27 21:39:16.582939 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.582917 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4d7f78dc-ndmg4"] May 27 21:39:16.586767 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:39:16.586741 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c51a7d2_82fa_4e11_996a_52e8d68aa8db.slice/crio-9f620f712b1a7d9fc87971a4ddca34c35e80cdaf5fab9930d7fbeed4fb37b97c WatchSource:0}: Error finding container 9f620f712b1a7d9fc87971a4ddca34c35e80cdaf5fab9930d7fbeed4fb37b97c: Status 404 returned error can't find the container with id 9f620f712b1a7d9fc87971a4ddca34c35e80cdaf5fab9930d7fbeed4fb37b97c May 27 21:39:16.597964 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.597944 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pdw2g" May 27 21:39:16.721710 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:16.721677 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pdw2g"] May 27 21:39:16.724996 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:39:16.724970 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76bd7347_d8f1_48e4_b72a_10b7527a500d.slice/crio-7147b9c79fcc7d64d10fe0c0e9c1f07ff2e725699e6ddbb94665645af0ffb448 WatchSource:0}: Error finding container 7147b9c79fcc7d64d10fe0c0e9c1f07ff2e725699e6ddbb94665645af0ffb448: Status 404 returned error can't find the container with id 7147b9c79fcc7d64d10fe0c0e9c1f07ff2e725699e6ddbb94665645af0ffb448 May 27 21:39:17.458839 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:17.458772 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pdw2g" event={"ID":"76bd7347-d8f1-48e4-b72a-10b7527a500d","Type":"ContainerStarted","Data":"40322870e530b6dbb1c9f1487d6ee726900e1d63bd974234a3ac2514c0e53622"} May 27 21:39:17.458839 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:17.458815 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pdw2g" event={"ID":"76bd7347-d8f1-48e4-b72a-10b7527a500d","Type":"ContainerStarted","Data":"7147b9c79fcc7d64d10fe0c0e9c1f07ff2e725699e6ddbb94665645af0ffb448"} May 27 21:39:17.463120 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:17.463060 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4d7f78dc-ndmg4" event={"ID":"5c51a7d2-82fa-4e11-996a-52e8d68aa8db","Type":"ContainerStarted","Data":"9f620f712b1a7d9fc87971a4ddca34c35e80cdaf5fab9930d7fbeed4fb37b97c"} May 27 21:39:17.465074 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:17.465048 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdcd8948f-j27bd" event={"ID":"40d30d69-62e2-4595-9017-6b28787486d2","Type":"ContainerStarted","Data":"771d217c5060a30e94ec4d496ea46269f47e3bdd6399ff118e7f30325591cf0c"} May 27 21:39:18.472763 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:18.472723 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pdw2g" event={"ID":"76bd7347-d8f1-48e4-b72a-10b7527a500d","Type":"ContainerStarted","Data":"25983581b8b7bbd4a2cfe7eb7975c32dc129d9bbe5cfdeb82f43851dbca344c0"} May 27 21:39:19.443645 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:19.443616 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kx8l8" May 27 21:39:20.818607 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:20.818572 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b674a492-3189-4694-a48b-fee4bb3f616f-metrics-certs\") pod \"network-metrics-daemon-9rhhm\" (UID: \"b674a492-3189-4694-a48b-fee4bb3f616f\") " pod="openshift-multus/network-metrics-daemon-9rhhm" May 27 21:39:20.821933 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:20.821907 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 27 21:39:20.831290 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:20.831261 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b674a492-3189-4694-a48b-fee4bb3f616f-metrics-certs\") pod \"network-metrics-daemon-9rhhm\" (UID: \"b674a492-3189-4694-a48b-fee4bb3f616f\") " pod="openshift-multus/network-metrics-daemon-9rhhm" May 27 21:39:20.838001 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:20.837975 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rd4vz\"" May 27 21:39:20.845504 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:20.845482 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9rhhm" May 27 21:39:20.919927 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:20.919889 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-55cb6\" (UniqueName: \"kubernetes.io/projected/d01f51b6-35bd-4b64-8ad3-bded3b471f4a-kube-api-access-55cb6\") pod \"network-check-target-w2hrz\" (UID: \"d01f51b6-35bd-4b64-8ad3-bded3b471f4a\") " pod="openshift-network-diagnostics/network-check-target-w2hrz" May 27 21:39:20.923003 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:20.922968 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 27 21:39:20.933342 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:20.933301 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 27 21:39:20.943120 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:20.943096 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55cb6\" (UniqueName: \"kubernetes.io/projected/d01f51b6-35bd-4b64-8ad3-bded3b471f4a-kube-api-access-55cb6\") pod \"network-check-target-w2hrz\" (UID: \"d01f51b6-35bd-4b64-8ad3-bded3b471f4a\") " pod="openshift-network-diagnostics/network-check-target-w2hrz" May 27 21:39:21.138574 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:21.138501 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2tcr2\"" May 27 21:39:21.146245 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:21.146201 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2hrz" May 27 21:39:22.592056 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:22.591647 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9rhhm"] May 27 21:39:22.595978 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:39:22.595935 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb674a492_3189_4694_a48b_fee4bb3f616f.slice/crio-ba9faf40c09bfadbd895d4f8762334b74fb8e8d53483e60dc1a64434b7506101 WatchSource:0}: Error finding container ba9faf40c09bfadbd895d4f8762334b74fb8e8d53483e60dc1a64434b7506101: Status 404 returned error can't find the container with id ba9faf40c09bfadbd895d4f8762334b74fb8e8d53483e60dc1a64434b7506101 May 27 21:39:22.612464 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:22.612441 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-w2hrz"] May 27 21:39:22.616024 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:39:22.616000 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd01f51b6_35bd_4b64_8ad3_bded3b471f4a.slice/crio-fd8b498011ed25fd441a2dc5b758d6eed3bcac6734da47833eadbb6aa7f9e76c WatchSource:0}: Error finding container fd8b498011ed25fd441a2dc5b758d6eed3bcac6734da47833eadbb6aa7f9e76c: Status 404 returned error can't find the container with id fd8b498011ed25fd441a2dc5b758d6eed3bcac6734da47833eadbb6aa7f9e76c May 27 21:39:22.835821 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:22.835784 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c32abd03-a4ad-45f9-9847-21aff5756c70-original-pull-secret\") pod \"global-pull-secret-syncer-sbgqc\" (UID: \"c32abd03-a4ad-45f9-9847-21aff5756c70\") " pod="kube-system/global-pull-secret-syncer-sbgqc" May 27 21:39:22.838690 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:22.838669 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 27 21:39:22.848310 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:22.848288 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c32abd03-a4ad-45f9-9847-21aff5756c70-original-pull-secret\") pod \"global-pull-secret-syncer-sbgqc\" (UID: \"c32abd03-a4ad-45f9-9847-21aff5756c70\") " pod="kube-system/global-pull-secret-syncer-sbgqc" May 27 21:39:22.931295 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:22.931267 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sbgqc" May 27 21:39:23.065371 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:23.065315 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sbgqc"] May 27 21:39:23.068267 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:39:23.068221 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc32abd03_a4ad_45f9_9847_21aff5756c70.slice/crio-7e4c08115f9dedc952d997a0b7cefbd2cce9d39ba1757d58f2c9d6054649786c WatchSource:0}: Error finding container 7e4c08115f9dedc952d997a0b7cefbd2cce9d39ba1757d58f2c9d6054649786c: Status 404 returned error can't find the container with id 7e4c08115f9dedc952d997a0b7cefbd2cce9d39ba1757d58f2c9d6054649786c May 27 21:39:23.487380 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:23.487339 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4d7f78dc-ndmg4" event={"ID":"5c51a7d2-82fa-4e11-996a-52e8d68aa8db","Type":"ContainerStarted","Data":"98e4b2a8cfaaa8090263e337a3ee1be66c08bf0469c1afb0aadeb80fb6132b4b"} May 27 21:39:23.488839 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:23.488802 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdcd8948f-j27bd" event={"ID":"40d30d69-62e2-4595-9017-6b28787486d2","Type":"ContainerStarted","Data":"0c662fd8d309ba5821589638269c832e6813f99bbd5fe0b00e94f235c8663891"} May 27 21:39:23.489152 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:23.489129 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdcd8948f-j27bd" May 27 21:39:23.490905 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:23.490877 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-sbgqc" event={"ID":"c32abd03-a4ad-45f9-9847-21aff5756c70","Type":"ContainerStarted","Data":"7e4c08115f9dedc952d997a0b7cefbd2cce9d39ba1757d58f2c9d6054649786c"} May 27 21:39:23.491115 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:23.491097 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdcd8948f-j27bd" May 27 21:39:23.492167 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:23.492142 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9rhhm" event={"ID":"b674a492-3189-4694-a48b-fee4bb3f616f","Type":"ContainerStarted","Data":"ba9faf40c09bfadbd895d4f8762334b74fb8e8d53483e60dc1a64434b7506101"} May 27 21:39:23.494386 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:23.494362 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pdw2g" event={"ID":"76bd7347-d8f1-48e4-b72a-10b7527a500d","Type":"ContainerStarted","Data":"8fef8872bad62e09f7db780bdeb3bf7889066f4678077c010c85d63c99cded7e"} May 27 21:39:23.495595 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:23.495572 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-w2hrz" event={"ID":"d01f51b6-35bd-4b64-8ad3-bded3b471f4a","Type":"ContainerStarted","Data":"fd8b498011ed25fd441a2dc5b758d6eed3bcac6734da47833eadbb6aa7f9e76c"} May 27 21:39:23.508578 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:23.508536 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdcd8948f-j27bd" podStartSLOduration=1.6057474090000001 podStartE2EDuration="7.508521097s" podCreationTimestamp="2026-05-27 21:39:16 +0000 UTC" firstStartedPulling="2026-05-27 21:39:16.575524063 +0000 UTC m=+61.090273824" lastFinishedPulling="2026-05-27 21:39:22.47829774 +0000 UTC m=+66.993047512" observedRunningTime="2026-05-27 21:39:23.507877099 +0000 UTC m=+68.022626900" watchObservedRunningTime="2026-05-27 21:39:23.508521097 +0000 UTC m=+68.023270881" May 27 21:39:23.530118 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:23.530054 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pdw2g" podStartSLOduration=1.856340609 podStartE2EDuration="7.530034995s" podCreationTimestamp="2026-05-27 21:39:16 +0000 UTC" firstStartedPulling="2026-05-27 21:39:16.781856386 +0000 UTC m=+61.296606155" lastFinishedPulling="2026-05-27 21:39:22.455550761 +0000 UTC m=+66.970300541" observedRunningTime="2026-05-27 21:39:23.529139514 +0000 UTC m=+68.043889322" watchObservedRunningTime="2026-05-27 21:39:23.530034995 +0000 UTC m=+68.044784778" May 27 21:39:24.500323 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:24.500167 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9rhhm" event={"ID":"b674a492-3189-4694-a48b-fee4bb3f616f","Type":"ContainerStarted","Data":"97442c5dbacd3b9ed81a10d7aac7e08990deb1df98d008ca9e3d24d2f59aaad1"} May 27 21:39:24.500323 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:24.500214 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9rhhm" event={"ID":"b674a492-3189-4694-a48b-fee4bb3f616f","Type":"ContainerStarted","Data":"88b9cb04a51e33d5b2c3b433c37c5c0d355de927d5d1994a7875603d980c19e0"} May 27 21:39:24.530286 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:24.529962 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9rhhm" podStartSLOduration=67.457951615 podStartE2EDuration="1m8.529943643s" podCreationTimestamp="2026-05-27 21:38:16 +0000 UTC" firstStartedPulling="2026-05-27 21:39:22.598324107 +0000 UTC m=+67.113073869" lastFinishedPulling="2026-05-27 21:39:23.670316134 +0000 UTC m=+68.185065897" observedRunningTime="2026-05-27 21:39:24.529902248 +0000 UTC m=+69.044652032" watchObservedRunningTime="2026-05-27 21:39:24.529943643 +0000 UTC m=+69.044693427" May 27 21:39:26.138421 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:26.138087 2576 patch_prober.go:28] interesting pod/image-registry-7fbc4dbb7-rp6ng container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 27 21:39:26.138421 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:26.138177 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7fbc4dbb7-rp6ng" podUID="a881aae1-7e96-4349-beb5-70bb1ed2ec67" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 27 21:39:28.517525 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:28.517484 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-w2hrz" event={"ID":"d01f51b6-35bd-4b64-8ad3-bded3b471f4a","Type":"ContainerStarted","Data":"a64dfb4db912bec0e2938a658a1baef974c756255048a7fed99d075e6a0b3697"} May 27 21:39:28.517989 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:28.517553 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-w2hrz" May 27 21:39:28.519290 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:28.519261 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4d7f78dc-ndmg4" event={"ID":"5c51a7d2-82fa-4e11-996a-52e8d68aa8db","Type":"ContainerStarted","Data":"12f837728331d46f1e243521dfa863191f44b0833ccada2e8f52752e1b1c619e"} May 27 21:39:28.519418 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:28.519293 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4d7f78dc-ndmg4" event={"ID":"5c51a7d2-82fa-4e11-996a-52e8d68aa8db","Type":"ContainerStarted","Data":"3795e41b49aff1729a87edff5e4e440de69723f49c381fa79e511cf676aa3afa"} May 27 21:39:28.520478 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:28.520451 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-sbgqc" event={"ID":"c32abd03-a4ad-45f9-9847-21aff5756c70","Type":"ContainerStarted","Data":"a618354a51f902a7b648d8c42352fe537a800b41d4f4820f39eb4e5c9a6e02a3"} May 27 21:39:28.535550 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:28.535509 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-w2hrz" podStartSLOduration=67.104091209 podStartE2EDuration="1m12.535497726s" podCreationTimestamp="2026-05-27 21:38:16 +0000 UTC" firstStartedPulling="2026-05-27 21:39:22.617861641 +0000 UTC m=+67.132611415" lastFinishedPulling="2026-05-27 21:39:28.049268171 +0000 UTC m=+72.564017932" observedRunningTime="2026-05-27 21:39:28.53441138 +0000 UTC m=+73.049161164" watchObservedRunningTime="2026-05-27 21:39:28.535497726 +0000 UTC m=+73.050247510" May 27 21:39:28.551743 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:28.551706 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-sbgqc" podStartSLOduration=65.559142085 podStartE2EDuration="1m10.551695262s" podCreationTimestamp="2026-05-27 21:38:18 +0000 UTC" firstStartedPulling="2026-05-27 21:39:23.07042871 +0000 UTC m=+67.585178478" lastFinishedPulling="2026-05-27 21:39:28.062981874 +0000 UTC m=+72.577731655" observedRunningTime="2026-05-27 21:39:28.551316119 +0000 UTC m=+73.066065903" watchObservedRunningTime="2026-05-27 21:39:28.551695262 +0000 UTC m=+73.066445046" May 27 21:39:28.576696 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:28.576644 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4d7f78dc-ndmg4" podStartSLOduration=1.112335008 podStartE2EDuration="12.576629136s" podCreationTimestamp="2026-05-27 21:39:16 +0000 UTC" firstStartedPulling="2026-05-27 21:39:16.588543024 +0000 UTC m=+61.103292786" lastFinishedPulling="2026-05-27 21:39:28.052837138 +0000 UTC m=+72.567586914" observedRunningTime="2026-05-27 21:39:28.575054867 +0000 UTC m=+73.089804652" watchObservedRunningTime="2026-05-27 21:39:28.576629136 +0000 UTC m=+73.091378921" May 27 21:39:29.225889 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:29.225858 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-qvs6k"] May 27 21:39:29.228590 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:29.228570 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qvs6k" May 27 21:39:29.233140 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:29.233014 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 27 21:39:29.233140 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:29.233037 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 27 21:39:29.233140 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:29.233116 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 27 21:39:29.233371 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:29.233116 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 27 21:39:29.233416 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:29.233404 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 27 21:39:29.234193 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:29.234174 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 27 21:39:29.234288 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:29.234174 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hph2b\"" May 27 21:39:29.284178 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:29.284157 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b366099d-d3cb-4034-ab37-cc56a0f217c5-node-exporter-tls\") pod \"node-exporter-qvs6k\" (UID: \"b366099d-d3cb-4034-ab37-cc56a0f217c5\") " pod="openshift-monitoring/node-exporter-qvs6k" May 27 21:39:29.284318 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:29.284185 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vjtq\" (UniqueName: \"kubernetes.io/projected/b366099d-d3cb-4034-ab37-cc56a0f217c5-kube-api-access-7vjtq\") pod \"node-exporter-qvs6k\" (UID: \"b366099d-d3cb-4034-ab37-cc56a0f217c5\") " pod="openshift-monitoring/node-exporter-qvs6k" May 27 21:39:29.284318 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:29.284206 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b366099d-d3cb-4034-ab37-cc56a0f217c5-metrics-client-ca\") pod \"node-exporter-qvs6k\" (UID: \"b366099d-d3cb-4034-ab37-cc56a0f217c5\") " pod="openshift-monitoring/node-exporter-qvs6k" May 27 21:39:29.284318 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:29.284244 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b366099d-d3cb-4034-ab37-cc56a0f217c5-sys\") pod \"node-exporter-qvs6k\" (UID: \"b366099d-d3cb-4034-ab37-cc56a0f217c5\") " pod="openshift-monitoring/node-exporter-qvs6k" May 27 21:39:29.284318 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:29.284261 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b366099d-d3cb-4034-ab37-cc56a0f217c5-root\") pod \"node-exporter-qvs6k\" (UID: \"b366099d-d3cb-4034-ab37-cc56a0f217c5\") " pod="openshift-monitoring/node-exporter-qvs6k" May 27 21:39:29.284318 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:29.284285 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b366099d-d3cb-4034-ab37-cc56a0f217c5-node-exporter-textfile\") pod \"node-exporter-qvs6k\" (UID: \"b366099d-d3cb-4034-ab37-cc56a0f217c5\") " pod="openshift-monitoring/node-exporter-qvs6k" May 27 21:39:29.284573 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:29.284367 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b366099d-d3cb-4034-ab37-cc56a0f217c5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qvs6k\" (UID: \"b366099d-d3cb-4034-ab37-cc56a0f217c5\") " pod="openshift-monitoring/node-exporter-qvs6k" May 27 21:39:29.284573 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:29.284408 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b366099d-d3cb-4034-ab37-cc56a0f217c5-node-exporter-accelerators-collector-config\") pod \"node-exporter-qvs6k\" (UID: \"b366099d-d3cb-4034-ab37-cc56a0f217c5\") " pod="openshift-monitoring/node-exporter-qvs6k" May 27 21:39:29.284573 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:29.284483 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b366099d-d3cb-4034-ab37-cc56a0f217c5-node-exporter-wtmp\") pod \"node-exporter-qvs6k\" (UID: \"b366099d-d3cb-4034-ab37-cc56a0f217c5\") " pod="openshift-monitoring/node-exporter-qvs6k" May 27 21:39:29.385490 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:29.385459 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b366099d-d3cb-4034-ab37-cc56a0f217c5-node-exporter-wtmp\") pod \"node-exporter-qvs6k\" (UID: \"b366099d-d3cb-4034-ab37-cc56a0f217c5\") " pod="openshift-monitoring/node-exporter-qvs6k" May 27 21:39:29.385618 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:29.385499 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b366099d-d3cb-4034-ab37-cc56a0f217c5-node-exporter-tls\") pod \"node-exporter-qvs6k\" (UID: \"b366099d-d3cb-4034-ab37-cc56a0f217c5\") " pod="openshift-monitoring/node-exporter-qvs6k" May 27 21:39:29.385618 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:29.385519 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7vjtq\" (UniqueName: \"kubernetes.io/projected/b366099d-d3cb-4034-ab37-cc56a0f217c5-kube-api-access-7vjtq\") pod \"node-exporter-qvs6k\" (UID: \"b366099d-d3cb-4034-ab37-cc56a0f217c5\") " pod="openshift-monitoring/node-exporter-qvs6k" May 27 21:39:29.385618 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:29.385537 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b366099d-d3cb-4034-ab37-cc56a0f217c5-metrics-client-ca\") pod \"node-exporter-qvs6k\" (UID: \"b366099d-d3cb-4034-ab37-cc56a0f217c5\") " pod="openshift-monitoring/node-exporter-qvs6k" May 27 21:39:29.385618 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:29.385554 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b366099d-d3cb-4034-ab37-cc56a0f217c5-sys\") pod \"node-exporter-qvs6k\" (UID: \"b366099d-d3cb-4034-ab37-cc56a0f217c5\") " pod="openshift-monitoring/node-exporter-qvs6k" May 27 21:39:29.385618 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:29.385571 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b366099d-d3cb-4034-ab37-cc56a0f217c5-root\") pod \"node-exporter-qvs6k\" (UID: \"b366099d-d3cb-4034-ab37-cc56a0f217c5\") " pod="openshift-monitoring/node-exporter-qvs6k" May 27 21:39:29.385618 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:29.385588 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b366099d-d3cb-4034-ab37-cc56a0f217c5-node-exporter-textfile\") pod \"node-exporter-qvs6k\" (UID: \"b366099d-d3cb-4034-ab37-cc56a0f217c5\") " pod="openshift-monitoring/node-exporter-qvs6k" May 27 21:39:29.385895 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:29.385616 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b366099d-d3cb-4034-ab37-cc56a0f217c5-node-exporter-wtmp\") pod \"node-exporter-qvs6k\" (UID: \"b366099d-d3cb-4034-ab37-cc56a0f217c5\") " pod="openshift-monitoring/node-exporter-qvs6k" May 27 21:39:29.385895 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:29.385628 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b366099d-d3cb-4034-ab37-cc56a0f217c5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qvs6k\" (UID: \"b366099d-d3cb-4034-ab37-cc56a0f217c5\") " pod="openshift-monitoring/node-exporter-qvs6k" May 27 21:39:29.385895 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:29.385641 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b366099d-d3cb-4034-ab37-cc56a0f217c5-sys\") pod \"node-exporter-qvs6k\" (UID: \"b366099d-d3cb-4034-ab37-cc56a0f217c5\") " pod="openshift-monitoring/node-exporter-qvs6k" May 27 21:39:29.385895 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:29.385675 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b366099d-d3cb-4034-ab37-cc56a0f217c5-node-exporter-accelerators-collector-config\") pod \"node-exporter-qvs6k\" (UID: \"b366099d-d3cb-4034-ab37-cc56a0f217c5\") " pod="openshift-monitoring/node-exporter-qvs6k" May 27 21:39:29.385895 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:29.385717 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b366099d-d3cb-4034-ab37-cc56a0f217c5-root\") pod \"node-exporter-qvs6k\" (UID: \"b366099d-d3cb-4034-ab37-cc56a0f217c5\") " pod="openshift-monitoring/node-exporter-qvs6k" May 27 21:39:29.385895 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:39:29.385679 2576 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found May 27 21:39:29.385895 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:39:29.385810 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b366099d-d3cb-4034-ab37-cc56a0f217c5-node-exporter-tls podName:b366099d-d3cb-4034-ab37-cc56a0f217c5 nodeName:}" failed. No retries permitted until 2026-05-27 21:39:29.885790641 +0000 UTC m=+74.400540406 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/b366099d-d3cb-4034-ab37-cc56a0f217c5-node-exporter-tls") pod "node-exporter-qvs6k" (UID: "b366099d-d3cb-4034-ab37-cc56a0f217c5") : secret "node-exporter-tls" not found May 27 21:39:29.386251 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:29.386123 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b366099d-d3cb-4034-ab37-cc56a0f217c5-node-exporter-textfile\") pod \"node-exporter-qvs6k\" (UID: \"b366099d-d3cb-4034-ab37-cc56a0f217c5\") " pod="openshift-monitoring/node-exporter-qvs6k" May 27 21:39:29.386251 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:29.386243 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b366099d-d3cb-4034-ab37-cc56a0f217c5-metrics-client-ca\") pod \"node-exporter-qvs6k\" (UID: \"b366099d-d3cb-4034-ab37-cc56a0f217c5\") " pod="openshift-monitoring/node-exporter-qvs6k" May 27 21:39:29.386365 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:29.386335 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b366099d-d3cb-4034-ab37-cc56a0f217c5-node-exporter-accelerators-collector-config\") pod \"node-exporter-qvs6k\" (UID: \"b366099d-d3cb-4034-ab37-cc56a0f217c5\") " pod="openshift-monitoring/node-exporter-qvs6k" May 27 21:39:29.388304 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:29.388284 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b366099d-d3cb-4034-ab37-cc56a0f217c5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qvs6k\" (UID: \"b366099d-d3cb-4034-ab37-cc56a0f217c5\") " pod="openshift-monitoring/node-exporter-qvs6k" May 27 21:39:29.395537 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:29.395501 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vjtq\" (UniqueName: \"kubernetes.io/projected/b366099d-d3cb-4034-ab37-cc56a0f217c5-kube-api-access-7vjtq\") pod \"node-exporter-qvs6k\" (UID: \"b366099d-d3cb-4034-ab37-cc56a0f217c5\") " pod="openshift-monitoring/node-exporter-qvs6k" May 27 21:39:29.890654 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:29.890614 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b366099d-d3cb-4034-ab37-cc56a0f217c5-node-exporter-tls\") pod \"node-exporter-qvs6k\" (UID: \"b366099d-d3cb-4034-ab37-cc56a0f217c5\") " pod="openshift-monitoring/node-exporter-qvs6k" May 27 21:39:29.892974 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:29.892953 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b366099d-d3cb-4034-ab37-cc56a0f217c5-node-exporter-tls\") pod \"node-exporter-qvs6k\" (UID: \"b366099d-d3cb-4034-ab37-cc56a0f217c5\") " pod="openshift-monitoring/node-exporter-qvs6k" May 27 21:39:30.140211 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:30.140179 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qvs6k" May 27 21:39:30.149019 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:39:30.148992 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb366099d_d3cb_4034_ab37_cc56a0f217c5.slice/crio-b31294e4d7f5c532f7fce45427696941c805437d092886ce16145acd899ae121 WatchSource:0}: Error finding container b31294e4d7f5c532f7fce45427696941c805437d092886ce16145acd899ae121: Status 404 returned error can't find the container with id b31294e4d7f5c532f7fce45427696941c805437d092886ce16145acd899ae121 May 27 21:39:30.528121 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:30.528083 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qvs6k" event={"ID":"b366099d-d3cb-4034-ab37-cc56a0f217c5","Type":"ContainerStarted","Data":"b31294e4d7f5c532f7fce45427696941c805437d092886ce16145acd899ae121"} May 27 21:39:31.532186 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:31.532149 2576 generic.go:358] "Generic (PLEG): container finished" podID="b366099d-d3cb-4034-ab37-cc56a0f217c5" containerID="720a89756b293b83ea049b87b0e22184268694e474f71489282088c0ebf9515a" exitCode=0 May 27 21:39:31.532638 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:31.532252 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qvs6k" event={"ID":"b366099d-d3cb-4034-ab37-cc56a0f217c5","Type":"ContainerDied","Data":"720a89756b293b83ea049b87b0e22184268694e474f71489282088c0ebf9515a"} May 27 21:39:32.536483 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:32.536449 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qvs6k" event={"ID":"b366099d-d3cb-4034-ab37-cc56a0f217c5","Type":"ContainerStarted","Data":"957008ee1722b35372fd4df107ba7e99270210614d7c69e7c6cd4241628bbe25"} May 27 21:39:32.536483 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:32.536484 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qvs6k" event={"ID":"b366099d-d3cb-4034-ab37-cc56a0f217c5","Type":"ContainerStarted","Data":"ed712a21a79bc7d5a948779974f8e76c872a4a11396a26d7a9a3310886917667"} May 27 21:39:36.135711 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:36.135679 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7fbc4dbb7-rp6ng" May 27 21:39:36.161891 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:36.161840 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-qvs6k" podStartSLOduration=6.279176649 podStartE2EDuration="7.161825764s" podCreationTimestamp="2026-05-27 21:39:29 +0000 UTC" firstStartedPulling="2026-05-27 21:39:30.151083863 +0000 UTC m=+74.665833625" lastFinishedPulling="2026-05-27 21:39:31.033732979 +0000 UTC m=+75.548482740" observedRunningTime="2026-05-27 21:39:32.557875022 +0000 UTC m=+77.072624819" watchObservedRunningTime="2026-05-27 21:39:36.161825764 +0000 UTC m=+80.676575552" May 27 21:39:41.149332 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:41.149273 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7fbc4dbb7-rp6ng" podUID="a881aae1-7e96-4349-beb5-70bb1ed2ec67" containerName="registry" containerID="cri-o://cedac6d54ca3036a75d7015626537cc0dbe19f26cb75b79ad58bf353b8af80ec" gracePeriod=30 May 27 21:39:41.375316 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:41.375294 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fbc4dbb7-rp6ng" May 27 21:39:41.475093 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:41.475070 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a881aae1-7e96-4349-beb5-70bb1ed2ec67-registry-tls\") pod \"a881aae1-7e96-4349-beb5-70bb1ed2ec67\" (UID: \"a881aae1-7e96-4349-beb5-70bb1ed2ec67\") " May 27 21:39:41.475258 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:41.475111 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7w6l\" (UniqueName: \"kubernetes.io/projected/a881aae1-7e96-4349-beb5-70bb1ed2ec67-kube-api-access-h7w6l\") pod \"a881aae1-7e96-4349-beb5-70bb1ed2ec67\" (UID: \"a881aae1-7e96-4349-beb5-70bb1ed2ec67\") " May 27 21:39:41.475258 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:41.475131 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a881aae1-7e96-4349-beb5-70bb1ed2ec67-image-registry-private-configuration\") pod \"a881aae1-7e96-4349-beb5-70bb1ed2ec67\" (UID: \"a881aae1-7e96-4349-beb5-70bb1ed2ec67\") " May 27 21:39:41.475258 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:41.475155 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a881aae1-7e96-4349-beb5-70bb1ed2ec67-trusted-ca\") pod \"a881aae1-7e96-4349-beb5-70bb1ed2ec67\" (UID: \"a881aae1-7e96-4349-beb5-70bb1ed2ec67\") " May 27 21:39:41.475258 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:41.475183 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a881aae1-7e96-4349-beb5-70bb1ed2ec67-installation-pull-secrets\") pod \"a881aae1-7e96-4349-beb5-70bb1ed2ec67\" (UID: \"a881aae1-7e96-4349-beb5-70bb1ed2ec67\") " May 27 21:39:41.475258 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:41.475256 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a881aae1-7e96-4349-beb5-70bb1ed2ec67-ca-trust-extracted\") pod \"a881aae1-7e96-4349-beb5-70bb1ed2ec67\" (UID: \"a881aae1-7e96-4349-beb5-70bb1ed2ec67\") " May 27 21:39:41.475506 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:41.475286 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a881aae1-7e96-4349-beb5-70bb1ed2ec67-registry-certificates\") pod \"a881aae1-7e96-4349-beb5-70bb1ed2ec67\" (UID: \"a881aae1-7e96-4349-beb5-70bb1ed2ec67\") " May 27 21:39:41.475506 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:41.475342 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a881aae1-7e96-4349-beb5-70bb1ed2ec67-bound-sa-token\") pod \"a881aae1-7e96-4349-beb5-70bb1ed2ec67\" (UID: \"a881aae1-7e96-4349-beb5-70bb1ed2ec67\") " May 27 21:39:41.475764 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:41.475727 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a881aae1-7e96-4349-beb5-70bb1ed2ec67-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a881aae1-7e96-4349-beb5-70bb1ed2ec67" (UID: "a881aae1-7e96-4349-beb5-70bb1ed2ec67"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:39:41.476124 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:41.476095 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a881aae1-7e96-4349-beb5-70bb1ed2ec67-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "a881aae1-7e96-4349-beb5-70bb1ed2ec67" (UID: "a881aae1-7e96-4349-beb5-70bb1ed2ec67"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:39:41.477699 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:41.477673 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a881aae1-7e96-4349-beb5-70bb1ed2ec67-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a881aae1-7e96-4349-beb5-70bb1ed2ec67" (UID: "a881aae1-7e96-4349-beb5-70bb1ed2ec67"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:39:41.477836 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:41.477810 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a881aae1-7e96-4349-beb5-70bb1ed2ec67-kube-api-access-h7w6l" (OuterVolumeSpecName: "kube-api-access-h7w6l") pod "a881aae1-7e96-4349-beb5-70bb1ed2ec67" (UID: "a881aae1-7e96-4349-beb5-70bb1ed2ec67"). InnerVolumeSpecName "kube-api-access-h7w6l". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:39:41.477904 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:41.477857 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a881aae1-7e96-4349-beb5-70bb1ed2ec67-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "a881aae1-7e96-4349-beb5-70bb1ed2ec67" (UID: "a881aae1-7e96-4349-beb5-70bb1ed2ec67"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:39:41.477904 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:41.477884 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a881aae1-7e96-4349-beb5-70bb1ed2ec67-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a881aae1-7e96-4349-beb5-70bb1ed2ec67" (UID: "a881aae1-7e96-4349-beb5-70bb1ed2ec67"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:39:41.477984 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:41.477960 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a881aae1-7e96-4349-beb5-70bb1ed2ec67-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "a881aae1-7e96-4349-beb5-70bb1ed2ec67" (UID: "a881aae1-7e96-4349-beb5-70bb1ed2ec67"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:39:41.483830 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:41.483805 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a881aae1-7e96-4349-beb5-70bb1ed2ec67-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "a881aae1-7e96-4349-beb5-70bb1ed2ec67" (UID: "a881aae1-7e96-4349-beb5-70bb1ed2ec67"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:39:41.559354 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:41.559324 2576 generic.go:358] "Generic (PLEG): container finished" podID="a881aae1-7e96-4349-beb5-70bb1ed2ec67" containerID="cedac6d54ca3036a75d7015626537cc0dbe19f26cb75b79ad58bf353b8af80ec" exitCode=0 May 27 21:39:41.559494 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:41.559388 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fbc4dbb7-rp6ng" May 27 21:39:41.559494 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:41.559405 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fbc4dbb7-rp6ng" event={"ID":"a881aae1-7e96-4349-beb5-70bb1ed2ec67","Type":"ContainerDied","Data":"cedac6d54ca3036a75d7015626537cc0dbe19f26cb75b79ad58bf353b8af80ec"} May 27 21:39:41.559494 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:41.559444 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fbc4dbb7-rp6ng" event={"ID":"a881aae1-7e96-4349-beb5-70bb1ed2ec67","Type":"ContainerDied","Data":"e9055fc3f581fafd8352ac12ecaff281b4bd974b3a35138f86c300d37bdc2324"} May 27 21:39:41.559494 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:41.559459 2576 scope.go:117] "RemoveContainer" containerID="cedac6d54ca3036a75d7015626537cc0dbe19f26cb75b79ad58bf353b8af80ec" May 27 21:39:41.567291 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:41.567275 2576 scope.go:117] "RemoveContainer" containerID="cedac6d54ca3036a75d7015626537cc0dbe19f26cb75b79ad58bf353b8af80ec" May 27 21:39:41.567518 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:39:41.567498 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cedac6d54ca3036a75d7015626537cc0dbe19f26cb75b79ad58bf353b8af80ec\": container with ID starting with cedac6d54ca3036a75d7015626537cc0dbe19f26cb75b79ad58bf353b8af80ec not found: ID does not exist" containerID="cedac6d54ca3036a75d7015626537cc0dbe19f26cb75b79ad58bf353b8af80ec" May 27 21:39:41.567566 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:41.567524 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cedac6d54ca3036a75d7015626537cc0dbe19f26cb75b79ad58bf353b8af80ec"} err="failed to get container status \"cedac6d54ca3036a75d7015626537cc0dbe19f26cb75b79ad58bf353b8af80ec\": rpc error: code = NotFound desc = could not find container \"cedac6d54ca3036a75d7015626537cc0dbe19f26cb75b79ad58bf353b8af80ec\": container with ID starting with cedac6d54ca3036a75d7015626537cc0dbe19f26cb75b79ad58bf353b8af80ec not found: ID does not exist" May 27 21:39:41.575962 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:41.575940 2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a881aae1-7e96-4349-beb5-70bb1ed2ec67-bound-sa-token\") on node \"ip-10-0-131-147.ec2.internal\" DevicePath \"\"" May 27 21:39:41.575962 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:41.575959 2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a881aae1-7e96-4349-beb5-70bb1ed2ec67-registry-tls\") on node \"ip-10-0-131-147.ec2.internal\" DevicePath \"\"" May 27 21:39:41.576075 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:41.575969 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7w6l\" (UniqueName: \"kubernetes.io/projected/a881aae1-7e96-4349-beb5-70bb1ed2ec67-kube-api-access-h7w6l\") on node \"ip-10-0-131-147.ec2.internal\" DevicePath \"\"" May 27 21:39:41.576075 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:41.575979 2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a881aae1-7e96-4349-beb5-70bb1ed2ec67-image-registry-private-configuration\") on node \"ip-10-0-131-147.ec2.internal\" DevicePath \"\"" May 27 21:39:41.576075 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:41.575987 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a881aae1-7e96-4349-beb5-70bb1ed2ec67-trusted-ca\") on node \"ip-10-0-131-147.ec2.internal\" DevicePath \"\"" May 27 21:39:41.576075 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:41.575996 2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a881aae1-7e96-4349-beb5-70bb1ed2ec67-installation-pull-secrets\") on node \"ip-10-0-131-147.ec2.internal\" DevicePath \"\"" May 27 21:39:41.576075 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:41.576005 2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a881aae1-7e96-4349-beb5-70bb1ed2ec67-ca-trust-extracted\") on node \"ip-10-0-131-147.ec2.internal\" DevicePath \"\"" May 27 21:39:41.576075 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:41.576014 2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a881aae1-7e96-4349-beb5-70bb1ed2ec67-registry-certificates\") on node \"ip-10-0-131-147.ec2.internal\" DevicePath \"\"" May 27 21:39:41.581810 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:41.581789 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7fbc4dbb7-rp6ng"] May 27 21:39:41.586044 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:41.586025 2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7fbc4dbb7-rp6ng"] May 27 21:39:42.119026 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:42.118994 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a881aae1-7e96-4349-beb5-70bb1ed2ec67" path="/var/lib/kubelet/pods/a881aae1-7e96-4349-beb5-70bb1ed2ec67/volumes" May 27 21:39:59.528055 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:39:59.528023 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-w2hrz" May 27 21:43:16.016875 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:43:16.016847 2576 kubelet.go:1628] "Image garbage collection succeeded" May 27 21:43:46.298778 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:43:46.298742 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-84j9j"] May 27 21:43:46.300238 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:43:46.298984 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a881aae1-7e96-4349-beb5-70bb1ed2ec67" containerName="registry" May 27 21:43:46.300238 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:43:46.298994 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a881aae1-7e96-4349-beb5-70bb1ed2ec67" containerName="registry" May 27 21:43:46.300238 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:43:46.299038 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="a881aae1-7e96-4349-beb5-70bb1ed2ec67" containerName="registry" May 27 21:43:46.300647 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:43:46.300630 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-84j9j" May 27 21:43:46.303441 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:43:46.303418 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 27 21:43:46.303441 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:43:46.303442 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 27 21:43:46.304467 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:43:46.304448 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-5k2pt\"" May 27 21:43:46.309654 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:43:46.309633 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-84j9j"] May 27 21:43:46.415218 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:43:46.415184 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf4jl\" (UniqueName: \"kubernetes.io/projected/3dc66e0d-deb2-4978-a292-38d4f34269e2-kube-api-access-lf4jl\") pod \"cert-manager-webhook-587ccfb98-84j9j\" (UID: \"3dc66e0d-deb2-4978-a292-38d4f34269e2\") " pod="cert-manager/cert-manager-webhook-587ccfb98-84j9j" May 27 21:43:46.415218 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:43:46.415217 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3dc66e0d-deb2-4978-a292-38d4f34269e2-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-84j9j\" (UID: \"3dc66e0d-deb2-4978-a292-38d4f34269e2\") " pod="cert-manager/cert-manager-webhook-587ccfb98-84j9j" May 27 21:43:46.515771 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:43:46.515728 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lf4jl\" (UniqueName: \"kubernetes.io/projected/3dc66e0d-deb2-4978-a292-38d4f34269e2-kube-api-access-lf4jl\") pod \"cert-manager-webhook-587ccfb98-84j9j\" (UID: \"3dc66e0d-deb2-4978-a292-38d4f34269e2\") " pod="cert-manager/cert-manager-webhook-587ccfb98-84j9j" May 27 21:43:46.515771 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:43:46.515780 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3dc66e0d-deb2-4978-a292-38d4f34269e2-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-84j9j\" (UID: \"3dc66e0d-deb2-4978-a292-38d4f34269e2\") " pod="cert-manager/cert-manager-webhook-587ccfb98-84j9j" May 27 21:43:46.525132 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:43:46.525103 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3dc66e0d-deb2-4978-a292-38d4f34269e2-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-84j9j\" (UID: \"3dc66e0d-deb2-4978-a292-38d4f34269e2\") " pod="cert-manager/cert-manager-webhook-587ccfb98-84j9j" May 27 21:43:46.525380 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:43:46.525366 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf4jl\" (UniqueName: \"kubernetes.io/projected/3dc66e0d-deb2-4978-a292-38d4f34269e2-kube-api-access-lf4jl\") pod \"cert-manager-webhook-587ccfb98-84j9j\" (UID: \"3dc66e0d-deb2-4978-a292-38d4f34269e2\") " pod="cert-manager/cert-manager-webhook-587ccfb98-84j9j" May 27 21:43:46.609617 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:43:46.609535 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-84j9j" May 27 21:43:46.735366 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:43:46.735337 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-84j9j"] May 27 21:43:46.738138 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:43:46.738112 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3dc66e0d_deb2_4978_a292_38d4f34269e2.slice/crio-815034940ac1e5ae3045d7c707e826c2be4cd88eec300220290bf9e19c4e1d7d WatchSource:0}: Error finding container 815034940ac1e5ae3045d7c707e826c2be4cd88eec300220290bf9e19c4e1d7d: Status 404 returned error can't find the container with id 815034940ac1e5ae3045d7c707e826c2be4cd88eec300220290bf9e19c4e1d7d May 27 21:43:46.739888 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:43:46.739873 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 21:43:47.151496 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:43:47.151465 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-84j9j" event={"ID":"3dc66e0d-deb2-4978-a292-38d4f34269e2","Type":"ContainerStarted","Data":"815034940ac1e5ae3045d7c707e826c2be4cd88eec300220290bf9e19c4e1d7d"} May 27 21:43:50.160083 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:43:50.160043 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-84j9j" event={"ID":"3dc66e0d-deb2-4978-a292-38d4f34269e2","Type":"ContainerStarted","Data":"d08280c283595b2b2ab201dc2fac9a986d499bad5f40a461189ba56dcfd5111b"} May 27 21:43:50.160083 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:43:50.160090 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-84j9j" May 27 21:43:50.180041 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:43:50.180003 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-84j9j" podStartSLOduration=1.677313026 podStartE2EDuration="4.179972738s" podCreationTimestamp="2026-05-27 21:43:46 +0000 UTC" firstStartedPulling="2026-05-27 21:43:46.739994304 +0000 UTC m=+331.254744070" lastFinishedPulling="2026-05-27 21:43:49.242654018 +0000 UTC m=+333.757403782" observedRunningTime="2026-05-27 21:43:50.179778537 +0000 UTC m=+334.694528320" watchObservedRunningTime="2026-05-27 21:43:50.179972738 +0000 UTC m=+334.694722521" May 27 21:43:56.164780 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:43:56.164698 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-84j9j" May 27 21:44:16.684937 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:16.684907 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d4d9fcc6c-dc8g9"] May 27 21:44:16.686831 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:16.686815 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d4d9fcc6c-dc8g9" May 27 21:44:16.690173 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:16.690149 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 27 21:44:16.690442 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:16.690189 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 27 21:44:16.690563 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:16.690272 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 27 21:44:16.690619 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:16.690601 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-587pf\"" May 27 21:44:16.691384 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:16.691369 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 27 21:44:16.704437 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:16.704415 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d4d9fcc6c-dc8g9"] May 27 21:44:16.836079 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:16.836049 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/de2b5ad4-0617-4d55-87e9-57bae3df6fb2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d4d9fcc6c-dc8g9\" (UID: \"de2b5ad4-0617-4d55-87e9-57bae3df6fb2\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d9fcc6c-dc8g9" May 27 21:44:16.836242 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:16.836088 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/de2b5ad4-0617-4d55-87e9-57bae3df6fb2-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d4d9fcc6c-dc8g9\" (UID: \"de2b5ad4-0617-4d55-87e9-57bae3df6fb2\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d9fcc6c-dc8g9" May 27 21:44:16.836242 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:16.836147 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g6gt\" (UniqueName: \"kubernetes.io/projected/de2b5ad4-0617-4d55-87e9-57bae3df6fb2-kube-api-access-9g6gt\") pod \"opendatahub-operator-controller-manager-6d4d9fcc6c-dc8g9\" (UID: \"de2b5ad4-0617-4d55-87e9-57bae3df6fb2\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d9fcc6c-dc8g9" May 27 21:44:16.936555 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:16.936477 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/de2b5ad4-0617-4d55-87e9-57bae3df6fb2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d4d9fcc6c-dc8g9\" (UID: \"de2b5ad4-0617-4d55-87e9-57bae3df6fb2\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d9fcc6c-dc8g9" May 27 21:44:16.936555 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:16.936517 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/de2b5ad4-0617-4d55-87e9-57bae3df6fb2-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d4d9fcc6c-dc8g9\" (UID: \"de2b5ad4-0617-4d55-87e9-57bae3df6fb2\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d9fcc6c-dc8g9" May 27 21:44:16.936555 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:16.936553 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9g6gt\" (UniqueName: \"kubernetes.io/projected/de2b5ad4-0617-4d55-87e9-57bae3df6fb2-kube-api-access-9g6gt\") pod \"opendatahub-operator-controller-manager-6d4d9fcc6c-dc8g9\" (UID: \"de2b5ad4-0617-4d55-87e9-57bae3df6fb2\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d9fcc6c-dc8g9" May 27 21:44:16.938987 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:16.938956 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/de2b5ad4-0617-4d55-87e9-57bae3df6fb2-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d4d9fcc6c-dc8g9\" (UID: \"de2b5ad4-0617-4d55-87e9-57bae3df6fb2\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d9fcc6c-dc8g9" May 27 21:44:16.939093 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:16.939014 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/de2b5ad4-0617-4d55-87e9-57bae3df6fb2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d4d9fcc6c-dc8g9\" (UID: \"de2b5ad4-0617-4d55-87e9-57bae3df6fb2\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d9fcc6c-dc8g9" May 27 21:44:16.951411 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:16.951384 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g6gt\" (UniqueName: \"kubernetes.io/projected/de2b5ad4-0617-4d55-87e9-57bae3df6fb2-kube-api-access-9g6gt\") pod \"opendatahub-operator-controller-manager-6d4d9fcc6c-dc8g9\" (UID: \"de2b5ad4-0617-4d55-87e9-57bae3df6fb2\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4d9fcc6c-dc8g9" May 27 21:44:16.996312 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:16.996276 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d4d9fcc6c-dc8g9" May 27 21:44:17.126054 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:17.124252 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d4d9fcc6c-dc8g9"] May 27 21:44:17.130584 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:44:17.130550 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde2b5ad4_0617_4d55_87e9_57bae3df6fb2.slice/crio-923831fa90c1cacb91bc0ccaa9bf339ebfa7e80f2fd206493db2a2d675f259e8 WatchSource:0}: Error finding container 923831fa90c1cacb91bc0ccaa9bf339ebfa7e80f2fd206493db2a2d675f259e8: Status 404 returned error can't find the container with id 923831fa90c1cacb91bc0ccaa9bf339ebfa7e80f2fd206493db2a2d675f259e8 May 27 21:44:17.228834 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:17.228722 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d4d9fcc6c-dc8g9" event={"ID":"de2b5ad4-0617-4d55-87e9-57bae3df6fb2","Type":"ContainerStarted","Data":"923831fa90c1cacb91bc0ccaa9bf339ebfa7e80f2fd206493db2a2d675f259e8"} May 27 21:44:20.242660 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:20.242625 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d4d9fcc6c-dc8g9" event={"ID":"de2b5ad4-0617-4d55-87e9-57bae3df6fb2","Type":"ContainerStarted","Data":"1ba35802172b4b9dc8cbb2aa863624db5366a452b887ded95e12c2bced7a353b"} May 27 21:44:20.243112 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:20.242779 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6d4d9fcc6c-dc8g9" May 27 21:44:20.274922 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:20.274863 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6d4d9fcc6c-dc8g9" podStartSLOduration=1.84882679 podStartE2EDuration="4.274851728s" podCreationTimestamp="2026-05-27 21:44:16 +0000 UTC" firstStartedPulling="2026-05-27 21:44:17.132260572 +0000 UTC m=+361.647010334" lastFinishedPulling="2026-05-27 21:44:19.558285494 +0000 UTC m=+364.073035272" observedRunningTime="2026-05-27 21:44:20.273023714 +0000 UTC m=+364.787773497" watchObservedRunningTime="2026-05-27 21:44:20.274851728 +0000 UTC m=+364.789601512" May 27 21:44:31.247352 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:31.247323 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6d4d9fcc6c-dc8g9" May 27 21:44:34.357719 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:34.357685 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-798bcdfc67-d8zgz"] May 27 21:44:34.363820 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:34.363794 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-798bcdfc67-d8zgz" May 27 21:44:34.370537 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:34.370514 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 27 21:44:34.370838 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:34.370817 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 27 21:44:34.371806 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:34.371781 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 27 21:44:34.371905 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:34.371808 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-zd4bp\"" May 27 21:44:34.371905 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:34.371827 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 27 21:44:34.372145 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:34.372132 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 27 21:44:34.388622 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:34.388597 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-798bcdfc67-d8zgz"] May 27 21:44:34.462594 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:34.462568 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/915ff45e-f383-4d04-88c7-a71f08943163-cert\") pod \"lws-controller-manager-798bcdfc67-d8zgz\" (UID: \"915ff45e-f383-4d04-88c7-a71f08943163\") " pod="openshift-lws-operator/lws-controller-manager-798bcdfc67-d8zgz" May 27 21:44:34.462746 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:34.462614 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ww5rv\" (UniqueName: \"kubernetes.io/projected/915ff45e-f383-4d04-88c7-a71f08943163-kube-api-access-ww5rv\") pod \"lws-controller-manager-798bcdfc67-d8zgz\" (UID: \"915ff45e-f383-4d04-88c7-a71f08943163\") " pod="openshift-lws-operator/lws-controller-manager-798bcdfc67-d8zgz" May 27 21:44:34.462746 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:34.462649 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/915ff45e-f383-4d04-88c7-a71f08943163-manager-config\") pod \"lws-controller-manager-798bcdfc67-d8zgz\" (UID: \"915ff45e-f383-4d04-88c7-a71f08943163\") " pod="openshift-lws-operator/lws-controller-manager-798bcdfc67-d8zgz" May 27 21:44:34.462746 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:34.462685 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/915ff45e-f383-4d04-88c7-a71f08943163-metrics-cert\") pod \"lws-controller-manager-798bcdfc67-d8zgz\" (UID: \"915ff45e-f383-4d04-88c7-a71f08943163\") " pod="openshift-lws-operator/lws-controller-manager-798bcdfc67-d8zgz" May 27 21:44:34.564062 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:34.564024 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/915ff45e-f383-4d04-88c7-a71f08943163-manager-config\") pod \"lws-controller-manager-798bcdfc67-d8zgz\" (UID: \"915ff45e-f383-4d04-88c7-a71f08943163\") " pod="openshift-lws-operator/lws-controller-manager-798bcdfc67-d8zgz" May 27 21:44:34.564270 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:34.564072 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/915ff45e-f383-4d04-88c7-a71f08943163-metrics-cert\") pod \"lws-controller-manager-798bcdfc67-d8zgz\" (UID: \"915ff45e-f383-4d04-88c7-a71f08943163\") " pod="openshift-lws-operator/lws-controller-manager-798bcdfc67-d8zgz" May 27 21:44:34.564270 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:34.564104 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/915ff45e-f383-4d04-88c7-a71f08943163-cert\") pod \"lws-controller-manager-798bcdfc67-d8zgz\" (UID: \"915ff45e-f383-4d04-88c7-a71f08943163\") " pod="openshift-lws-operator/lws-controller-manager-798bcdfc67-d8zgz" May 27 21:44:34.564270 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:34.564152 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ww5rv\" (UniqueName: \"kubernetes.io/projected/915ff45e-f383-4d04-88c7-a71f08943163-kube-api-access-ww5rv\") pod \"lws-controller-manager-798bcdfc67-d8zgz\" (UID: \"915ff45e-f383-4d04-88c7-a71f08943163\") " pod="openshift-lws-operator/lws-controller-manager-798bcdfc67-d8zgz" May 27 21:44:34.564742 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:34.564712 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/915ff45e-f383-4d04-88c7-a71f08943163-manager-config\") pod \"lws-controller-manager-798bcdfc67-d8zgz\" (UID: \"915ff45e-f383-4d04-88c7-a71f08943163\") " pod="openshift-lws-operator/lws-controller-manager-798bcdfc67-d8zgz" May 27 21:44:34.566595 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:34.566568 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/915ff45e-f383-4d04-88c7-a71f08943163-metrics-cert\") pod \"lws-controller-manager-798bcdfc67-d8zgz\" (UID: \"915ff45e-f383-4d04-88c7-a71f08943163\") " pod="openshift-lws-operator/lws-controller-manager-798bcdfc67-d8zgz" May 27 21:44:34.566699 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:34.566655 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/915ff45e-f383-4d04-88c7-a71f08943163-cert\") pod \"lws-controller-manager-798bcdfc67-d8zgz\" (UID: \"915ff45e-f383-4d04-88c7-a71f08943163\") " pod="openshift-lws-operator/lws-controller-manager-798bcdfc67-d8zgz" May 27 21:44:34.619410 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:34.619341 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ww5rv\" (UniqueName: \"kubernetes.io/projected/915ff45e-f383-4d04-88c7-a71f08943163-kube-api-access-ww5rv\") pod \"lws-controller-manager-798bcdfc67-d8zgz\" (UID: \"915ff45e-f383-4d04-88c7-a71f08943163\") " pod="openshift-lws-operator/lws-controller-manager-798bcdfc67-d8zgz" May 27 21:44:34.673344 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:34.673307 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-798bcdfc67-d8zgz" May 27 21:44:34.902145 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:34.902064 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-798bcdfc67-d8zgz"] May 27 21:44:34.910306 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:44:34.910281 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod915ff45e_f383_4d04_88c7_a71f08943163.slice/crio-ad11a504b1960743f9d7b07ac1687236eb5802f1e86a448198768bd8b4cdc77b WatchSource:0}: Error finding container ad11a504b1960743f9d7b07ac1687236eb5802f1e86a448198768bd8b4cdc77b: Status 404 returned error can't find the container with id ad11a504b1960743f9d7b07ac1687236eb5802f1e86a448198768bd8b4cdc77b May 27 21:44:35.278817 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:35.278782 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-798bcdfc67-d8zgz" event={"ID":"915ff45e-f383-4d04-88c7-a71f08943163","Type":"ContainerStarted","Data":"ad11a504b1960743f9d7b07ac1687236eb5802f1e86a448198768bd8b4cdc77b"} May 27 21:44:35.284665 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:35.284640 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6ffdb65d85-chfmz"] May 27 21:44:35.288831 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:35.288812 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6ffdb65d85-chfmz" May 27 21:44:35.305508 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:35.305480 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 27 21:44:35.305643 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:35.305480 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 27 21:44:35.306803 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:35.306785 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-c9xxr\"" May 27 21:44:35.306893 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:35.306825 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 27 21:44:35.312897 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:35.312878 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 27 21:44:35.313634 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:35.313616 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6ffdb65d85-chfmz"] May 27 21:44:35.471386 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:35.471352 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41b9035e-a492-4413-aec3-9fa7d810be99-tmp\") pod \"kube-auth-proxy-6ffdb65d85-chfmz\" (UID: \"41b9035e-a492-4413-aec3-9fa7d810be99\") " pod="openshift-ingress/kube-auth-proxy-6ffdb65d85-chfmz" May 27 21:44:35.471744 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:35.471397 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41b9035e-a492-4413-aec3-9fa7d810be99-tls-certs\") pod \"kube-auth-proxy-6ffdb65d85-chfmz\" (UID: \"41b9035e-a492-4413-aec3-9fa7d810be99\") " pod="openshift-ingress/kube-auth-proxy-6ffdb65d85-chfmz" May 27 21:44:35.471744 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:35.471428 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r866r\" (UniqueName: \"kubernetes.io/projected/41b9035e-a492-4413-aec3-9fa7d810be99-kube-api-access-r866r\") pod \"kube-auth-proxy-6ffdb65d85-chfmz\" (UID: \"41b9035e-a492-4413-aec3-9fa7d810be99\") " pod="openshift-ingress/kube-auth-proxy-6ffdb65d85-chfmz" May 27 21:44:35.572785 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:35.572711 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41b9035e-a492-4413-aec3-9fa7d810be99-tls-certs\") pod \"kube-auth-proxy-6ffdb65d85-chfmz\" (UID: \"41b9035e-a492-4413-aec3-9fa7d810be99\") " pod="openshift-ingress/kube-auth-proxy-6ffdb65d85-chfmz" May 27 21:44:35.572785 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:35.572756 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r866r\" (UniqueName: \"kubernetes.io/projected/41b9035e-a492-4413-aec3-9fa7d810be99-kube-api-access-r866r\") pod \"kube-auth-proxy-6ffdb65d85-chfmz\" (UID: \"41b9035e-a492-4413-aec3-9fa7d810be99\") " pod="openshift-ingress/kube-auth-proxy-6ffdb65d85-chfmz" May 27 21:44:35.572942 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:35.572793 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41b9035e-a492-4413-aec3-9fa7d810be99-tmp\") pod \"kube-auth-proxy-6ffdb65d85-chfmz\" (UID: \"41b9035e-a492-4413-aec3-9fa7d810be99\") " pod="openshift-ingress/kube-auth-proxy-6ffdb65d85-chfmz" May 27 21:44:35.574988 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:35.574960 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41b9035e-a492-4413-aec3-9fa7d810be99-tmp\") pod \"kube-auth-proxy-6ffdb65d85-chfmz\" (UID: \"41b9035e-a492-4413-aec3-9fa7d810be99\") " pod="openshift-ingress/kube-auth-proxy-6ffdb65d85-chfmz" May 27 21:44:35.575204 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:35.575184 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41b9035e-a492-4413-aec3-9fa7d810be99-tls-certs\") pod \"kube-auth-proxy-6ffdb65d85-chfmz\" (UID: \"41b9035e-a492-4413-aec3-9fa7d810be99\") " pod="openshift-ingress/kube-auth-proxy-6ffdb65d85-chfmz" May 27 21:44:35.604570 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:35.604544 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r866r\" (UniqueName: \"kubernetes.io/projected/41b9035e-a492-4413-aec3-9fa7d810be99-kube-api-access-r866r\") pod \"kube-auth-proxy-6ffdb65d85-chfmz\" (UID: \"41b9035e-a492-4413-aec3-9fa7d810be99\") " pod="openshift-ingress/kube-auth-proxy-6ffdb65d85-chfmz" May 27 21:44:35.899097 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:35.899007 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6ffdb65d85-chfmz" May 27 21:44:36.059129 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:36.059087 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6ffdb65d85-chfmz"] May 27 21:44:36.062027 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:44:36.061995 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41b9035e_a492_4413_aec3_9fa7d810be99.slice/crio-85b29beadd40a47e59ccaaf3ea0b9b0008d4e0545c311db6fd9232e4f3d7fb33 WatchSource:0}: Error finding container 85b29beadd40a47e59ccaaf3ea0b9b0008d4e0545c311db6fd9232e4f3d7fb33: Status 404 returned error can't find the container with id 85b29beadd40a47e59ccaaf3ea0b9b0008d4e0545c311db6fd9232e4f3d7fb33 May 27 21:44:36.282414 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:36.282369 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6ffdb65d85-chfmz" event={"ID":"41b9035e-a492-4413-aec3-9fa7d810be99","Type":"ContainerStarted","Data":"85b29beadd40a47e59ccaaf3ea0b9b0008d4e0545c311db6fd9232e4f3d7fb33"} May 27 21:44:40.293335 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:40.293296 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-798bcdfc67-d8zgz" event={"ID":"915ff45e-f383-4d04-88c7-a71f08943163","Type":"ContainerStarted","Data":"b929de773e71b31fac073754f7ddd3215a0da99c0164d06ccdea331f2183449c"} May 27 21:44:40.293798 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:40.293416 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-798bcdfc67-d8zgz" May 27 21:44:40.294707 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:40.294684 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6ffdb65d85-chfmz" event={"ID":"41b9035e-a492-4413-aec3-9fa7d810be99","Type":"ContainerStarted","Data":"a7d20922ab48e65871dc5ba560e471b1cb1f670fc96d14548e651f956cc5254c"} May 27 21:44:40.313652 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:40.313603 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-798bcdfc67-d8zgz" podStartSLOduration=1.927697974 podStartE2EDuration="6.313591305s" podCreationTimestamp="2026-05-27 21:44:34 +0000 UTC" firstStartedPulling="2026-05-27 21:44:34.911802029 +0000 UTC m=+379.426551791" lastFinishedPulling="2026-05-27 21:44:39.297695357 +0000 UTC m=+383.812445122" observedRunningTime="2026-05-27 21:44:40.312266248 +0000 UTC m=+384.827016033" watchObservedRunningTime="2026-05-27 21:44:40.313591305 +0000 UTC m=+384.828341147" May 27 21:44:40.329995 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:40.329943 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6ffdb65d85-chfmz" podStartSLOduration=2.046665014 podStartE2EDuration="5.329928529s" podCreationTimestamp="2026-05-27 21:44:35 +0000 UTC" firstStartedPulling="2026-05-27 21:44:36.064433389 +0000 UTC m=+380.579183158" lastFinishedPulling="2026-05-27 21:44:39.347696911 +0000 UTC m=+383.862446673" observedRunningTime="2026-05-27 21:44:40.329551503 +0000 UTC m=+384.844301288" watchObservedRunningTime="2026-05-27 21:44:40.329928529 +0000 UTC m=+384.844678314" May 27 21:44:51.300337 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:44:51.300308 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-798bcdfc67-d8zgz" May 27 21:46:23.423162 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:46:23.423122 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-tg8px"] May 27 21:46:23.425115 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:46:23.425098 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-tg8px" May 27 21:46:23.428125 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:46:23.428101 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 27 21:46:23.428266 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:46:23.428161 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-btx95\"" May 27 21:46:23.428266 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:46:23.428162 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" May 27 21:46:23.429257 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:46:23.429239 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 27 21:46:23.429342 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:46:23.429261 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" May 27 21:46:23.436312 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:46:23.436293 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-tg8px"] May 27 21:46:23.551189 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:46:23.551155 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d45aed4-86c4-4f50-8e23-6bc6dcc9632e-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-tg8px\" (UID: \"7d45aed4-86c4-4f50-8e23-6bc6dcc9632e\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-tg8px" May 27 21:46:23.551189 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:46:23.551190 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtwmq\" (UniqueName: \"kubernetes.io/projected/7d45aed4-86c4-4f50-8e23-6bc6dcc9632e-kube-api-access-rtwmq\") pod \"kuadrant-console-plugin-6cb54b5c86-tg8px\" (UID: \"7d45aed4-86c4-4f50-8e23-6bc6dcc9632e\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-tg8px" May 27 21:46:23.551401 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:46:23.551287 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7d45aed4-86c4-4f50-8e23-6bc6dcc9632e-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-tg8px\" (UID: \"7d45aed4-86c4-4f50-8e23-6bc6dcc9632e\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-tg8px" May 27 21:46:23.652000 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:46:23.651969 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d45aed4-86c4-4f50-8e23-6bc6dcc9632e-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-tg8px\" (UID: \"7d45aed4-86c4-4f50-8e23-6bc6dcc9632e\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-tg8px" May 27 21:46:23.652000 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:46:23.652004 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rtwmq\" (UniqueName: \"kubernetes.io/projected/7d45aed4-86c4-4f50-8e23-6bc6dcc9632e-kube-api-access-rtwmq\") pod \"kuadrant-console-plugin-6cb54b5c86-tg8px\" (UID: \"7d45aed4-86c4-4f50-8e23-6bc6dcc9632e\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-tg8px" May 27 21:46:23.652182 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:46:23.652041 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7d45aed4-86c4-4f50-8e23-6bc6dcc9632e-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-tg8px\" (UID: \"7d45aed4-86c4-4f50-8e23-6bc6dcc9632e\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-tg8px" May 27 21:46:23.652182 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:46:23.652124 2576 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found May 27 21:46:23.652275 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:46:23.652208 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d45aed4-86c4-4f50-8e23-6bc6dcc9632e-plugin-serving-cert podName:7d45aed4-86c4-4f50-8e23-6bc6dcc9632e nodeName:}" failed. No retries permitted until 2026-05-27 21:46:24.152185803 +0000 UTC m=+488.666935566 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/7d45aed4-86c4-4f50-8e23-6bc6dcc9632e-plugin-serving-cert") pod "kuadrant-console-plugin-6cb54b5c86-tg8px" (UID: "7d45aed4-86c4-4f50-8e23-6bc6dcc9632e") : secret "plugin-serving-cert" not found May 27 21:46:23.652643 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:46:23.652626 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7d45aed4-86c4-4f50-8e23-6bc6dcc9632e-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-tg8px\" (UID: \"7d45aed4-86c4-4f50-8e23-6bc6dcc9632e\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-tg8px" May 27 21:46:23.664619 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:46:23.664594 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtwmq\" (UniqueName: \"kubernetes.io/projected/7d45aed4-86c4-4f50-8e23-6bc6dcc9632e-kube-api-access-rtwmq\") pod \"kuadrant-console-plugin-6cb54b5c86-tg8px\" (UID: \"7d45aed4-86c4-4f50-8e23-6bc6dcc9632e\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-tg8px" May 27 21:46:24.157439 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:46:24.157405 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d45aed4-86c4-4f50-8e23-6bc6dcc9632e-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-tg8px\" (UID: \"7d45aed4-86c4-4f50-8e23-6bc6dcc9632e\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-tg8px" May 27 21:46:24.159858 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:46:24.159833 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d45aed4-86c4-4f50-8e23-6bc6dcc9632e-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-tg8px\" (UID: \"7d45aed4-86c4-4f50-8e23-6bc6dcc9632e\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-tg8px" May 27 21:46:24.334324 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:46:24.334279 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-tg8px" May 27 21:46:24.479389 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:46:24.479357 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-tg8px"] May 27 21:46:24.482529 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:46:24.482501 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7d45aed4_86c4_4f50_8e23_6bc6dcc9632e.slice/crio-8769a9e1d07ea267403500dc29389b8926279aad36f2ee4f813cec5cd69167e7 WatchSource:0}: Error finding container 8769a9e1d07ea267403500dc29389b8926279aad36f2ee4f813cec5cd69167e7: Status 404 returned error can't find the container with id 8769a9e1d07ea267403500dc29389b8926279aad36f2ee4f813cec5cd69167e7 May 27 21:46:24.574852 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:46:24.574818 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-tg8px" event={"ID":"7d45aed4-86c4-4f50-8e23-6bc6dcc9632e","Type":"ContainerStarted","Data":"8769a9e1d07ea267403500dc29389b8926279aad36f2ee4f813cec5cd69167e7"} May 27 21:46:49.646273 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:46:49.646214 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-tg8px" event={"ID":"7d45aed4-86c4-4f50-8e23-6bc6dcc9632e","Type":"ContainerStarted","Data":"3a699fdf97466f2aa3157a9666db51687704718b766bb62691fcc593ac970367"} May 27 21:46:49.665154 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:46:49.665103 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-tg8px" podStartSLOduration=2.5826382839999997 podStartE2EDuration="26.665091899s" podCreationTimestamp="2026-05-27 21:46:23 +0000 UTC" firstStartedPulling="2026-05-27 21:46:24.483867739 +0000 UTC m=+488.998617501" lastFinishedPulling="2026-05-27 21:46:48.56632135 +0000 UTC m=+513.081071116" observedRunningTime="2026-05-27 21:46:49.66474428 +0000 UTC m=+514.179494065" watchObservedRunningTime="2026-05-27 21:46:49.665091899 +0000 UTC m=+514.179841683" May 27 21:47:22.414018 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:22.413986 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-b4pqj"] May 27 21:47:22.451264 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:22.451210 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-b4pqj"] May 27 21:47:22.451460 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:22.451387 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-b4pqj" May 27 21:47:22.454398 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:22.454374 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-6h2lx\"" May 27 21:47:22.596386 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:22.596353 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-knmxz"] May 27 21:47:22.599491 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:22.599476 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-knmxz" May 27 21:47:22.609330 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:22.609304 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-knmxz"] May 27 21:47:22.609445 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:22.609366 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrl4h\" (UniqueName: \"kubernetes.io/projected/332b365a-068c-484c-b568-3ddf20fca2f4-kube-api-access-vrl4h\") pod \"authorino-f99f4b5cd-b4pqj\" (UID: \"332b365a-068c-484c-b568-3ddf20fca2f4\") " pod="kuadrant-system/authorino-f99f4b5cd-b4pqj" May 27 21:47:22.710619 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:22.710582 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgsz8\" (UniqueName: \"kubernetes.io/projected/bf98bd8d-2d26-458b-a377-cdbcc94884f3-kube-api-access-xgsz8\") pod \"authorino-7498df8756-knmxz\" (UID: \"bf98bd8d-2d26-458b-a377-cdbcc94884f3\") " pod="kuadrant-system/authorino-7498df8756-knmxz" May 27 21:47:22.710785 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:22.710667 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vrl4h\" (UniqueName: \"kubernetes.io/projected/332b365a-068c-484c-b568-3ddf20fca2f4-kube-api-access-vrl4h\") pod \"authorino-f99f4b5cd-b4pqj\" (UID: \"332b365a-068c-484c-b568-3ddf20fca2f4\") " pod="kuadrant-system/authorino-f99f4b5cd-b4pqj" May 27 21:47:22.722597 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:22.722577 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrl4h\" (UniqueName: \"kubernetes.io/projected/332b365a-068c-484c-b568-3ddf20fca2f4-kube-api-access-vrl4h\") pod \"authorino-f99f4b5cd-b4pqj\" (UID: \"332b365a-068c-484c-b568-3ddf20fca2f4\") " pod="kuadrant-system/authorino-f99f4b5cd-b4pqj" May 27 21:47:22.759982 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:22.759940 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-b4pqj" May 27 21:47:22.811026 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:22.810998 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xgsz8\" (UniqueName: \"kubernetes.io/projected/bf98bd8d-2d26-458b-a377-cdbcc94884f3-kube-api-access-xgsz8\") pod \"authorino-7498df8756-knmxz\" (UID: \"bf98bd8d-2d26-458b-a377-cdbcc94884f3\") " pod="kuadrant-system/authorino-7498df8756-knmxz" May 27 21:47:22.821998 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:22.821971 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgsz8\" (UniqueName: \"kubernetes.io/projected/bf98bd8d-2d26-458b-a377-cdbcc94884f3-kube-api-access-xgsz8\") pod \"authorino-7498df8756-knmxz\" (UID: \"bf98bd8d-2d26-458b-a377-cdbcc94884f3\") " pod="kuadrant-system/authorino-7498df8756-knmxz" May 27 21:47:22.882324 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:22.882290 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-b4pqj"] May 27 21:47:22.886548 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:47:22.886515 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod332b365a_068c_484c_b568_3ddf20fca2f4.slice/crio-0b58380e496016c5509d2ecd603c1750042575212b9caa793def774fa1cb26fa WatchSource:0}: Error finding container 0b58380e496016c5509d2ecd603c1750042575212b9caa793def774fa1cb26fa: Status 404 returned error can't find the container with id 0b58380e496016c5509d2ecd603c1750042575212b9caa793def774fa1cb26fa May 27 21:47:22.907963 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:22.907936 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-knmxz" May 27 21:47:23.033539 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:23.033509 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-knmxz"] May 27 21:47:23.036081 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:47:23.036056 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf98bd8d_2d26_458b_a377_cdbcc94884f3.slice/crio-3e622380311925167cce3426199aa199b1e2b9c3afe4eb3811c6e6092b7ad409 WatchSource:0}: Error finding container 3e622380311925167cce3426199aa199b1e2b9c3afe4eb3811c6e6092b7ad409: Status 404 returned error can't find the container with id 3e622380311925167cce3426199aa199b1e2b9c3afe4eb3811c6e6092b7ad409 May 27 21:47:23.732966 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:23.732926 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-b4pqj" event={"ID":"332b365a-068c-484c-b568-3ddf20fca2f4","Type":"ContainerStarted","Data":"0b58380e496016c5509d2ecd603c1750042575212b9caa793def774fa1cb26fa"} May 27 21:47:23.735906 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:23.735874 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-knmxz" event={"ID":"bf98bd8d-2d26-458b-a377-cdbcc94884f3","Type":"ContainerStarted","Data":"3e622380311925167cce3426199aa199b1e2b9c3afe4eb3811c6e6092b7ad409"} May 27 21:47:26.746100 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:26.746064 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-knmxz" event={"ID":"bf98bd8d-2d26-458b-a377-cdbcc94884f3","Type":"ContainerStarted","Data":"3f524d5169e20152bebff604a1ea05deacdf2e80f53657e1f932699fa1d5ad8b"} May 27 21:47:26.747437 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:26.747407 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-b4pqj" event={"ID":"332b365a-068c-484c-b568-3ddf20fca2f4","Type":"ContainerStarted","Data":"84ae3406e19c95ff83991006059eb250519bc243d123e0e0d184f587dd9f6f7a"} May 27 21:47:26.765941 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:26.765901 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-knmxz" podStartSLOduration=1.549423926 podStartE2EDuration="4.765889962s" podCreationTimestamp="2026-05-27 21:47:22 +0000 UTC" firstStartedPulling="2026-05-27 21:47:23.037391505 +0000 UTC m=+547.552141268" lastFinishedPulling="2026-05-27 21:47:26.253857542 +0000 UTC m=+550.768607304" observedRunningTime="2026-05-27 21:47:26.76472124 +0000 UTC m=+551.279471026" watchObservedRunningTime="2026-05-27 21:47:26.765889962 +0000 UTC m=+551.280639745" May 27 21:47:26.782903 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:26.782858 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-b4pqj" podStartSLOduration=1.401341727 podStartE2EDuration="4.782845402s" podCreationTimestamp="2026-05-27 21:47:22 +0000 UTC" firstStartedPulling="2026-05-27 21:47:22.887889407 +0000 UTC m=+547.402639184" lastFinishedPulling="2026-05-27 21:47:26.269393083 +0000 UTC m=+550.784142859" observedRunningTime="2026-05-27 21:47:26.781513367 +0000 UTC m=+551.296263149" watchObservedRunningTime="2026-05-27 21:47:26.782845402 +0000 UTC m=+551.297595185" May 27 21:47:26.814860 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:26.814835 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-b4pqj"] May 27 21:47:28.753520 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:28.753477 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-b4pqj" podUID="332b365a-068c-484c-b568-3ddf20fca2f4" containerName="authorino" containerID="cri-o://84ae3406e19c95ff83991006059eb250519bc243d123e0e0d184f587dd9f6f7a" gracePeriod=30 May 27 21:47:28.985920 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:28.985889 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-b4pqj" May 27 21:47:29.161528 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:29.161439 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrl4h\" (UniqueName: \"kubernetes.io/projected/332b365a-068c-484c-b568-3ddf20fca2f4-kube-api-access-vrl4h\") pod \"332b365a-068c-484c-b568-3ddf20fca2f4\" (UID: \"332b365a-068c-484c-b568-3ddf20fca2f4\") " May 27 21:47:29.163625 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:29.163598 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/332b365a-068c-484c-b568-3ddf20fca2f4-kube-api-access-vrl4h" (OuterVolumeSpecName: "kube-api-access-vrl4h") pod "332b365a-068c-484c-b568-3ddf20fca2f4" (UID: "332b365a-068c-484c-b568-3ddf20fca2f4"). InnerVolumeSpecName "kube-api-access-vrl4h". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:47:29.262650 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:29.262625 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrl4h\" (UniqueName: \"kubernetes.io/projected/332b365a-068c-484c-b568-3ddf20fca2f4-kube-api-access-vrl4h\") on node \"ip-10-0-131-147.ec2.internal\" DevicePath \"\"" May 27 21:47:29.756872 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:29.756837 2576 generic.go:358] "Generic (PLEG): container finished" podID="332b365a-068c-484c-b568-3ddf20fca2f4" containerID="84ae3406e19c95ff83991006059eb250519bc243d123e0e0d184f587dd9f6f7a" exitCode=0 May 27 21:47:29.757296 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:29.756878 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-b4pqj" May 27 21:47:29.757296 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:29.756889 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-b4pqj" event={"ID":"332b365a-068c-484c-b568-3ddf20fca2f4","Type":"ContainerDied","Data":"84ae3406e19c95ff83991006059eb250519bc243d123e0e0d184f587dd9f6f7a"} May 27 21:47:29.757296 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:29.756919 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-b4pqj" event={"ID":"332b365a-068c-484c-b568-3ddf20fca2f4","Type":"ContainerDied","Data":"0b58380e496016c5509d2ecd603c1750042575212b9caa793def774fa1cb26fa"} May 27 21:47:29.757296 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:29.756935 2576 scope.go:117] "RemoveContainer" containerID="84ae3406e19c95ff83991006059eb250519bc243d123e0e0d184f587dd9f6f7a" May 27 21:47:29.764629 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:29.764612 2576 scope.go:117] "RemoveContainer" containerID="84ae3406e19c95ff83991006059eb250519bc243d123e0e0d184f587dd9f6f7a" May 27 21:47:29.764912 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:47:29.764888 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84ae3406e19c95ff83991006059eb250519bc243d123e0e0d184f587dd9f6f7a\": container with ID starting with 84ae3406e19c95ff83991006059eb250519bc243d123e0e0d184f587dd9f6f7a not found: ID does not exist" containerID="84ae3406e19c95ff83991006059eb250519bc243d123e0e0d184f587dd9f6f7a" May 27 21:47:29.764998 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:29.764917 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84ae3406e19c95ff83991006059eb250519bc243d123e0e0d184f587dd9f6f7a"} err="failed to get container status \"84ae3406e19c95ff83991006059eb250519bc243d123e0e0d184f587dd9f6f7a\": rpc error: code = NotFound desc = could not find container \"84ae3406e19c95ff83991006059eb250519bc243d123e0e0d184f587dd9f6f7a\": container with ID starting with 84ae3406e19c95ff83991006059eb250519bc243d123e0e0d184f587dd9f6f7a not found: ID does not exist" May 27 21:47:29.780164 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:29.780141 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-b4pqj"] May 27 21:47:29.787631 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:29.787612 2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-b4pqj"] May 27 21:47:30.119136 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:30.119058 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="332b365a-068c-484c-b568-3ddf20fca2f4" path="/var/lib/kubelet/pods/332b365a-068c-484c-b568-3ddf20fca2f4/volumes" May 27 21:47:54.206380 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:54.206340 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-995xq"] May 27 21:47:54.206825 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:54.206698 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="332b365a-068c-484c-b568-3ddf20fca2f4" containerName="authorino" May 27 21:47:54.206825 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:54.206715 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="332b365a-068c-484c-b568-3ddf20fca2f4" containerName="authorino" May 27 21:47:54.206825 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:54.206776 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="332b365a-068c-484c-b568-3ddf20fca2f4" containerName="authorino" May 27 21:47:54.209624 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:54.209603 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-995xq" May 27 21:47:54.214935 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:54.214913 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-995xq"] May 27 21:47:54.238314 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:54.238287 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ss8bz\" (UniqueName: \"kubernetes.io/projected/39a7ce75-9442-4d9f-9588-1cce39a68197-kube-api-access-ss8bz\") pod \"authorino-8b475cf9f-995xq\" (UID: \"39a7ce75-9442-4d9f-9588-1cce39a68197\") " pod="kuadrant-system/authorino-8b475cf9f-995xq" May 27 21:47:54.339639 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:54.339601 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ss8bz\" (UniqueName: \"kubernetes.io/projected/39a7ce75-9442-4d9f-9588-1cce39a68197-kube-api-access-ss8bz\") pod \"authorino-8b475cf9f-995xq\" (UID: \"39a7ce75-9442-4d9f-9588-1cce39a68197\") " pod="kuadrant-system/authorino-8b475cf9f-995xq" May 27 21:47:54.351015 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:54.350987 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ss8bz\" (UniqueName: \"kubernetes.io/projected/39a7ce75-9442-4d9f-9588-1cce39a68197-kube-api-access-ss8bz\") pod \"authorino-8b475cf9f-995xq\" (UID: \"39a7ce75-9442-4d9f-9588-1cce39a68197\") " pod="kuadrant-system/authorino-8b475cf9f-995xq" May 27 21:47:54.452102 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:54.452072 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-995xq"] May 27 21:47:54.452266 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:54.452254 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-995xq" May 27 21:47:54.481928 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:54.481897 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6469c84cb5-7g8l8"] May 27 21:47:54.484645 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:54.484629 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6469c84cb5-7g8l8" May 27 21:47:54.493495 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:54.493466 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6469c84cb5-7g8l8"] May 27 21:47:54.541803 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:54.541774 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqkwb\" (UniqueName: \"kubernetes.io/projected/bbe48b6b-c16f-48e5-b1e6-536498996051-kube-api-access-pqkwb\") pod \"authorino-6469c84cb5-7g8l8\" (UID: \"bbe48b6b-c16f-48e5-b1e6-536498996051\") " pod="kuadrant-system/authorino-6469c84cb5-7g8l8" May 27 21:47:54.577984 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:54.577960 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-995xq"] May 27 21:47:54.580544 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:47:54.580517 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod39a7ce75_9442_4d9f_9588_1cce39a68197.slice/crio-33df63666ec099a2d08e8b0874edea45fcd2eb7be57d7385610a84f4bd4a75c3 WatchSource:0}: Error finding container 33df63666ec099a2d08e8b0874edea45fcd2eb7be57d7385610a84f4bd4a75c3: Status 404 returned error can't find the container with id 33df63666ec099a2d08e8b0874edea45fcd2eb7be57d7385610a84f4bd4a75c3 May 27 21:47:54.642531 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:54.642500 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pqkwb\" (UniqueName: \"kubernetes.io/projected/bbe48b6b-c16f-48e5-b1e6-536498996051-kube-api-access-pqkwb\") pod \"authorino-6469c84cb5-7g8l8\" (UID: \"bbe48b6b-c16f-48e5-b1e6-536498996051\") " pod="kuadrant-system/authorino-6469c84cb5-7g8l8" May 27 21:47:54.654039 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:54.654015 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqkwb\" (UniqueName: \"kubernetes.io/projected/bbe48b6b-c16f-48e5-b1e6-536498996051-kube-api-access-pqkwb\") pod \"authorino-6469c84cb5-7g8l8\" (UID: \"bbe48b6b-c16f-48e5-b1e6-536498996051\") " pod="kuadrant-system/authorino-6469c84cb5-7g8l8" May 27 21:47:54.671136 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:54.671110 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6469c84cb5-7g8l8"] May 27 21:47:54.671334 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:54.671322 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6469c84cb5-7g8l8" May 27 21:47:54.701957 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:54.701931 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5cfb4dc9b9-bmstn"] May 27 21:47:54.705969 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:54.705951 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cfb4dc9b9-bmstn" May 27 21:47:54.708577 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:54.708559 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" May 27 21:47:54.712661 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:54.712597 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5cfb4dc9b9-bmstn"] May 27 21:47:54.743017 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:54.742992 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dec59248-7ffc-4906-8e28-dfca799550b1-tls-cert\") pod \"authorino-5cfb4dc9b9-bmstn\" (UID: \"dec59248-7ffc-4906-8e28-dfca799550b1\") " pod="kuadrant-system/authorino-5cfb4dc9b9-bmstn" May 27 21:47:54.743134 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:54.743057 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2qtg\" (UniqueName: \"kubernetes.io/projected/dec59248-7ffc-4906-8e28-dfca799550b1-kube-api-access-l2qtg\") pod \"authorino-5cfb4dc9b9-bmstn\" (UID: \"dec59248-7ffc-4906-8e28-dfca799550b1\") " pod="kuadrant-system/authorino-5cfb4dc9b9-bmstn" May 27 21:47:54.797267 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:54.797219 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6469c84cb5-7g8l8"] May 27 21:47:54.800382 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:47:54.800358 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbbe48b6b_c16f_48e5_b1e6_536498996051.slice/crio-d7fdc69881beeb3b3dffe20ba44e29781f19f5af94bb22d3a5ca5612b5e158b1 WatchSource:0}: Error finding container d7fdc69881beeb3b3dffe20ba44e29781f19f5af94bb22d3a5ca5612b5e158b1: Status 404 returned error can't find the container with id d7fdc69881beeb3b3dffe20ba44e29781f19f5af94bb22d3a5ca5612b5e158b1 May 27 21:47:54.824493 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:54.824467 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6469c84cb5-7g8l8" event={"ID":"bbe48b6b-c16f-48e5-b1e6-536498996051","Type":"ContainerStarted","Data":"d7fdc69881beeb3b3dffe20ba44e29781f19f5af94bb22d3a5ca5612b5e158b1"} May 27 21:47:54.825328 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:54.825310 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-995xq" event={"ID":"39a7ce75-9442-4d9f-9588-1cce39a68197","Type":"ContainerStarted","Data":"33df63666ec099a2d08e8b0874edea45fcd2eb7be57d7385610a84f4bd4a75c3"} May 27 21:47:54.843885 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:54.843863 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l2qtg\" (UniqueName: \"kubernetes.io/projected/dec59248-7ffc-4906-8e28-dfca799550b1-kube-api-access-l2qtg\") pod \"authorino-5cfb4dc9b9-bmstn\" (UID: \"dec59248-7ffc-4906-8e28-dfca799550b1\") " pod="kuadrant-system/authorino-5cfb4dc9b9-bmstn" May 27 21:47:54.843980 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:54.843902 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dec59248-7ffc-4906-8e28-dfca799550b1-tls-cert\") pod \"authorino-5cfb4dc9b9-bmstn\" (UID: \"dec59248-7ffc-4906-8e28-dfca799550b1\") " pod="kuadrant-system/authorino-5cfb4dc9b9-bmstn" May 27 21:47:54.846216 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:54.846196 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dec59248-7ffc-4906-8e28-dfca799550b1-tls-cert\") pod \"authorino-5cfb4dc9b9-bmstn\" (UID: \"dec59248-7ffc-4906-8e28-dfca799550b1\") " pod="kuadrant-system/authorino-5cfb4dc9b9-bmstn" May 27 21:47:54.853562 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:54.853541 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2qtg\" (UniqueName: \"kubernetes.io/projected/dec59248-7ffc-4906-8e28-dfca799550b1-kube-api-access-l2qtg\") pod \"authorino-5cfb4dc9b9-bmstn\" (UID: \"dec59248-7ffc-4906-8e28-dfca799550b1\") " pod="kuadrant-system/authorino-5cfb4dc9b9-bmstn" May 27 21:47:55.016132 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:55.016053 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cfb4dc9b9-bmstn" May 27 21:47:55.140627 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:55.140555 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5cfb4dc9b9-bmstn"] May 27 21:47:55.142907 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:47:55.142867 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddec59248_7ffc_4906_8e28_dfca799550b1.slice/crio-317d24f6640234a7bb8b709a6c028d1164d5c3577216b371df6114f9483b8637 WatchSource:0}: Error finding container 317d24f6640234a7bb8b709a6c028d1164d5c3577216b371df6114f9483b8637: Status 404 returned error can't find the container with id 317d24f6640234a7bb8b709a6c028d1164d5c3577216b371df6114f9483b8637 May 27 21:47:55.832468 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:55.832374 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-995xq" event={"ID":"39a7ce75-9442-4d9f-9588-1cce39a68197","Type":"ContainerStarted","Data":"7bd6f1a26b2136f5c870adee92cbabbbc9034cdcc172c49ddbe585a49c5480ab"} May 27 21:47:55.832468 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:55.832393 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-8b475cf9f-995xq" podUID="39a7ce75-9442-4d9f-9588-1cce39a68197" containerName="authorino" containerID="cri-o://7bd6f1a26b2136f5c870adee92cbabbbc9034cdcc172c49ddbe585a49c5480ab" gracePeriod=30 May 27 21:47:55.833624 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:55.833598 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6469c84cb5-7g8l8" event={"ID":"bbe48b6b-c16f-48e5-b1e6-536498996051","Type":"ContainerStarted","Data":"708824c1710f78ff03883287fc4f971bfb4dcaf59d51c19aa5303687eff646c9"} May 27 21:47:55.833768 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:55.833640 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-6469c84cb5-7g8l8" podUID="bbe48b6b-c16f-48e5-b1e6-536498996051" containerName="authorino" containerID="cri-o://708824c1710f78ff03883287fc4f971bfb4dcaf59d51c19aa5303687eff646c9" gracePeriod=30 May 27 21:47:55.834865 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:55.834842 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cfb4dc9b9-bmstn" event={"ID":"dec59248-7ffc-4906-8e28-dfca799550b1","Type":"ContainerStarted","Data":"8b3fcbaf0ce672200cae02713c786fb2cca3300ac445c29781fc199602715faa"} May 27 21:47:55.834989 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:55.834869 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cfb4dc9b9-bmstn" event={"ID":"dec59248-7ffc-4906-8e28-dfca799550b1","Type":"ContainerStarted","Data":"317d24f6640234a7bb8b709a6c028d1164d5c3577216b371df6114f9483b8637"} May 27 21:47:55.851800 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:55.851761 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-8b475cf9f-995xq" podStartSLOduration=1.5683492650000002 podStartE2EDuration="1.851749708s" podCreationTimestamp="2026-05-27 21:47:54 +0000 UTC" firstStartedPulling="2026-05-27 21:47:54.581760566 +0000 UTC m=+579.096510328" lastFinishedPulling="2026-05-27 21:47:54.865161008 +0000 UTC m=+579.379910771" observedRunningTime="2026-05-27 21:47:55.849540263 +0000 UTC m=+580.364290044" watchObservedRunningTime="2026-05-27 21:47:55.851749708 +0000 UTC m=+580.366499491" May 27 21:47:55.865821 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:55.865779 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-6469c84cb5-7g8l8" podStartSLOduration=1.498211926 podStartE2EDuration="1.865765058s" podCreationTimestamp="2026-05-27 21:47:54 +0000 UTC" firstStartedPulling="2026-05-27 21:47:54.801643105 +0000 UTC m=+579.316392867" lastFinishedPulling="2026-05-27 21:47:55.169196222 +0000 UTC m=+579.683945999" observedRunningTime="2026-05-27 21:47:55.864904261 +0000 UTC m=+580.379654045" watchObservedRunningTime="2026-05-27 21:47:55.865765058 +0000 UTC m=+580.380514841" May 27 21:47:55.884896 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:55.884855 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-5cfb4dc9b9-bmstn" podStartSLOduration=1.562862433 podStartE2EDuration="1.884840987s" podCreationTimestamp="2026-05-27 21:47:54 +0000 UTC" firstStartedPulling="2026-05-27 21:47:55.14416993 +0000 UTC m=+579.658919692" lastFinishedPulling="2026-05-27 21:47:55.466148478 +0000 UTC m=+579.980898246" observedRunningTime="2026-05-27 21:47:55.884265753 +0000 UTC m=+580.399015539" watchObservedRunningTime="2026-05-27 21:47:55.884840987 +0000 UTC m=+580.399590802" May 27 21:47:55.914870 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:55.914847 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-knmxz"] May 27 21:47:55.915052 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:55.915034 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-knmxz" podUID="bf98bd8d-2d26-458b-a377-cdbcc94884f3" containerName="authorino" containerID="cri-o://3f524d5169e20152bebff604a1ea05deacdf2e80f53657e1f932699fa1d5ad8b" gracePeriod=30 May 27 21:47:56.141570 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:56.141541 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6469c84cb5-7g8l8" May 27 21:47:56.183488 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:56.183464 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-995xq" May 27 21:47:56.190990 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:56.190971 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-knmxz" May 27 21:47:56.257294 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:56.257257 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pqkwb\" (UniqueName: \"kubernetes.io/projected/bbe48b6b-c16f-48e5-b1e6-536498996051-kube-api-access-pqkwb\") pod \"bbe48b6b-c16f-48e5-b1e6-536498996051\" (UID: \"bbe48b6b-c16f-48e5-b1e6-536498996051\") " May 27 21:47:56.257522 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:56.257302 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ss8bz\" (UniqueName: \"kubernetes.io/projected/39a7ce75-9442-4d9f-9588-1cce39a68197-kube-api-access-ss8bz\") pod \"39a7ce75-9442-4d9f-9588-1cce39a68197\" (UID: \"39a7ce75-9442-4d9f-9588-1cce39a68197\") " May 27 21:47:56.257522 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:56.257350 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xgsz8\" (UniqueName: \"kubernetes.io/projected/bf98bd8d-2d26-458b-a377-cdbcc94884f3-kube-api-access-xgsz8\") pod \"bf98bd8d-2d26-458b-a377-cdbcc94884f3\" (UID: \"bf98bd8d-2d26-458b-a377-cdbcc94884f3\") " May 27 21:47:56.259386 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:56.259342 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf98bd8d-2d26-458b-a377-cdbcc94884f3-kube-api-access-xgsz8" (OuterVolumeSpecName: "kube-api-access-xgsz8") pod "bf98bd8d-2d26-458b-a377-cdbcc94884f3" (UID: "bf98bd8d-2d26-458b-a377-cdbcc94884f3"). InnerVolumeSpecName "kube-api-access-xgsz8". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:47:56.259386 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:56.259348 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbe48b6b-c16f-48e5-b1e6-536498996051-kube-api-access-pqkwb" (OuterVolumeSpecName: "kube-api-access-pqkwb") pod "bbe48b6b-c16f-48e5-b1e6-536498996051" (UID: "bbe48b6b-c16f-48e5-b1e6-536498996051"). InnerVolumeSpecName "kube-api-access-pqkwb". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:47:56.259514 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:56.259399 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39a7ce75-9442-4d9f-9588-1cce39a68197-kube-api-access-ss8bz" (OuterVolumeSpecName: "kube-api-access-ss8bz") pod "39a7ce75-9442-4d9f-9588-1cce39a68197" (UID: "39a7ce75-9442-4d9f-9588-1cce39a68197"). InnerVolumeSpecName "kube-api-access-ss8bz". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:47:56.358758 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:56.358680 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xgsz8\" (UniqueName: \"kubernetes.io/projected/bf98bd8d-2d26-458b-a377-cdbcc94884f3-kube-api-access-xgsz8\") on node \"ip-10-0-131-147.ec2.internal\" DevicePath \"\"" May 27 21:47:56.358758 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:56.358710 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pqkwb\" (UniqueName: \"kubernetes.io/projected/bbe48b6b-c16f-48e5-b1e6-536498996051-kube-api-access-pqkwb\") on node \"ip-10-0-131-147.ec2.internal\" DevicePath \"\"" May 27 21:47:56.358758 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:56.358724 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ss8bz\" (UniqueName: \"kubernetes.io/projected/39a7ce75-9442-4d9f-9588-1cce39a68197-kube-api-access-ss8bz\") on node \"ip-10-0-131-147.ec2.internal\" DevicePath \"\"" May 27 21:47:56.839352 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:56.839313 2576 generic.go:358] "Generic (PLEG): container finished" podID="39a7ce75-9442-4d9f-9588-1cce39a68197" containerID="7bd6f1a26b2136f5c870adee92cbabbbc9034cdcc172c49ddbe585a49c5480ab" exitCode=0 May 27 21:47:56.839801 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:56.839367 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-995xq" May 27 21:47:56.839801 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:56.839408 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-995xq" event={"ID":"39a7ce75-9442-4d9f-9588-1cce39a68197","Type":"ContainerDied","Data":"7bd6f1a26b2136f5c870adee92cbabbbc9034cdcc172c49ddbe585a49c5480ab"} May 27 21:47:56.839801 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:56.839448 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-995xq" event={"ID":"39a7ce75-9442-4d9f-9588-1cce39a68197","Type":"ContainerDied","Data":"33df63666ec099a2d08e8b0874edea45fcd2eb7be57d7385610a84f4bd4a75c3"} May 27 21:47:56.839801 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:56.839467 2576 scope.go:117] "RemoveContainer" containerID="7bd6f1a26b2136f5c870adee92cbabbbc9034cdcc172c49ddbe585a49c5480ab" May 27 21:47:56.840713 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:56.840453 2576 generic.go:358] "Generic (PLEG): container finished" podID="bf98bd8d-2d26-458b-a377-cdbcc94884f3" containerID="3f524d5169e20152bebff604a1ea05deacdf2e80f53657e1f932699fa1d5ad8b" exitCode=0 May 27 21:47:56.840713 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:56.840499 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-knmxz" May 27 21:47:56.840713 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:56.840543 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-knmxz" event={"ID":"bf98bd8d-2d26-458b-a377-cdbcc94884f3","Type":"ContainerDied","Data":"3f524d5169e20152bebff604a1ea05deacdf2e80f53657e1f932699fa1d5ad8b"} May 27 21:47:56.840713 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:56.840575 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-knmxz" event={"ID":"bf98bd8d-2d26-458b-a377-cdbcc94884f3","Type":"ContainerDied","Data":"3e622380311925167cce3426199aa199b1e2b9c3afe4eb3811c6e6092b7ad409"} May 27 21:47:56.841655 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:56.841630 2576 generic.go:358] "Generic (PLEG): container finished" podID="bbe48b6b-c16f-48e5-b1e6-536498996051" containerID="708824c1710f78ff03883287fc4f971bfb4dcaf59d51c19aa5303687eff646c9" exitCode=0 May 27 21:47:56.841791 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:56.841655 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6469c84cb5-7g8l8" event={"ID":"bbe48b6b-c16f-48e5-b1e6-536498996051","Type":"ContainerDied","Data":"708824c1710f78ff03883287fc4f971bfb4dcaf59d51c19aa5303687eff646c9"} May 27 21:47:56.841791 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:56.841667 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6469c84cb5-7g8l8" May 27 21:47:56.841791 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:56.841683 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6469c84cb5-7g8l8" event={"ID":"bbe48b6b-c16f-48e5-b1e6-536498996051","Type":"ContainerDied","Data":"d7fdc69881beeb3b3dffe20ba44e29781f19f5af94bb22d3a5ca5612b5e158b1"} May 27 21:47:56.848003 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:56.847966 2576 scope.go:117] "RemoveContainer" containerID="7bd6f1a26b2136f5c870adee92cbabbbc9034cdcc172c49ddbe585a49c5480ab" May 27 21:47:56.848309 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:47:56.848290 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7bd6f1a26b2136f5c870adee92cbabbbc9034cdcc172c49ddbe585a49c5480ab\": container with ID starting with 7bd6f1a26b2136f5c870adee92cbabbbc9034cdcc172c49ddbe585a49c5480ab not found: ID does not exist" containerID="7bd6f1a26b2136f5c870adee92cbabbbc9034cdcc172c49ddbe585a49c5480ab" May 27 21:47:56.848404 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:56.848318 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bd6f1a26b2136f5c870adee92cbabbbc9034cdcc172c49ddbe585a49c5480ab"} err="failed to get container status \"7bd6f1a26b2136f5c870adee92cbabbbc9034cdcc172c49ddbe585a49c5480ab\": rpc error: code = NotFound desc = could not find container \"7bd6f1a26b2136f5c870adee92cbabbbc9034cdcc172c49ddbe585a49c5480ab\": container with ID starting with 7bd6f1a26b2136f5c870adee92cbabbbc9034cdcc172c49ddbe585a49c5480ab not found: ID does not exist" May 27 21:47:56.848404 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:56.848342 2576 scope.go:117] "RemoveContainer" containerID="3f524d5169e20152bebff604a1ea05deacdf2e80f53657e1f932699fa1d5ad8b" May 27 21:47:56.855854 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:56.855837 2576 scope.go:117] "RemoveContainer" containerID="3f524d5169e20152bebff604a1ea05deacdf2e80f53657e1f932699fa1d5ad8b" May 27 21:47:56.856061 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:47:56.856046 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f524d5169e20152bebff604a1ea05deacdf2e80f53657e1f932699fa1d5ad8b\": container with ID starting with 3f524d5169e20152bebff604a1ea05deacdf2e80f53657e1f932699fa1d5ad8b not found: ID does not exist" containerID="3f524d5169e20152bebff604a1ea05deacdf2e80f53657e1f932699fa1d5ad8b" May 27 21:47:56.856113 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:56.856066 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f524d5169e20152bebff604a1ea05deacdf2e80f53657e1f932699fa1d5ad8b"} err="failed to get container status \"3f524d5169e20152bebff604a1ea05deacdf2e80f53657e1f932699fa1d5ad8b\": rpc error: code = NotFound desc = could not find container \"3f524d5169e20152bebff604a1ea05deacdf2e80f53657e1f932699fa1d5ad8b\": container with ID starting with 3f524d5169e20152bebff604a1ea05deacdf2e80f53657e1f932699fa1d5ad8b not found: ID does not exist" May 27 21:47:56.856113 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:56.856081 2576 scope.go:117] "RemoveContainer" containerID="708824c1710f78ff03883287fc4f971bfb4dcaf59d51c19aa5303687eff646c9" May 27 21:47:56.862373 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:56.862353 2576 scope.go:117] "RemoveContainer" containerID="708824c1710f78ff03883287fc4f971bfb4dcaf59d51c19aa5303687eff646c9" May 27 21:47:56.862607 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:47:56.862589 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"708824c1710f78ff03883287fc4f971bfb4dcaf59d51c19aa5303687eff646c9\": container with ID starting with 708824c1710f78ff03883287fc4f971bfb4dcaf59d51c19aa5303687eff646c9 not found: ID does not exist" containerID="708824c1710f78ff03883287fc4f971bfb4dcaf59d51c19aa5303687eff646c9" May 27 21:47:56.862663 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:56.862620 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"708824c1710f78ff03883287fc4f971bfb4dcaf59d51c19aa5303687eff646c9"} err="failed to get container status \"708824c1710f78ff03883287fc4f971bfb4dcaf59d51c19aa5303687eff646c9\": rpc error: code = NotFound desc = could not find container \"708824c1710f78ff03883287fc4f971bfb4dcaf59d51c19aa5303687eff646c9\": container with ID starting with 708824c1710f78ff03883287fc4f971bfb4dcaf59d51c19aa5303687eff646c9 not found: ID does not exist" May 27 21:47:56.866855 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:56.866835 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-995xq"] May 27 21:47:56.872156 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:56.872137 2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-995xq"] May 27 21:47:56.885419 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:56.885389 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-knmxz"] May 27 21:47:56.893771 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:56.893751 2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-knmxz"] May 27 21:47:56.906466 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:56.906447 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6469c84cb5-7g8l8"] May 27 21:47:56.913317 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:56.913298 2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6469c84cb5-7g8l8"] May 27 21:47:58.119738 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:58.119708 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39a7ce75-9442-4d9f-9588-1cce39a68197" path="/var/lib/kubelet/pods/39a7ce75-9442-4d9f-9588-1cce39a68197/volumes" May 27 21:47:58.120120 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:58.120007 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbe48b6b-c16f-48e5-b1e6-536498996051" path="/var/lib/kubelet/pods/bbe48b6b-c16f-48e5-b1e6-536498996051/volumes" May 27 21:47:58.120290 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:47:58.120278 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf98bd8d-2d26-458b-a377-cdbcc94884f3" path="/var/lib/kubelet/pods/bf98bd8d-2d26-458b-a377-cdbcc94884f3/volumes" May 27 21:49:02.055823 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:02.055788 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-66d54"] May 27 21:49:02.056213 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:02.056116 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf98bd8d-2d26-458b-a377-cdbcc94884f3" containerName="authorino" May 27 21:49:02.056213 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:02.056129 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf98bd8d-2d26-458b-a377-cdbcc94884f3" containerName="authorino" May 27 21:49:02.056213 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:02.056141 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39a7ce75-9442-4d9f-9588-1cce39a68197" containerName="authorino" May 27 21:49:02.056213 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:02.056147 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="39a7ce75-9442-4d9f-9588-1cce39a68197" containerName="authorino" May 27 21:49:02.056213 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:02.056154 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbe48b6b-c16f-48e5-b1e6-536498996051" containerName="authorino" May 27 21:49:02.056213 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:02.056160 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbe48b6b-c16f-48e5-b1e6-536498996051" containerName="authorino" May 27 21:49:02.056213 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:02.056199 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="bf98bd8d-2d26-458b-a377-cdbcc94884f3" containerName="authorino" May 27 21:49:02.056213 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:02.056206 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="39a7ce75-9442-4d9f-9588-1cce39a68197" containerName="authorino" May 27 21:49:02.056213 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:02.056212 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="bbe48b6b-c16f-48e5-b1e6-536498996051" containerName="authorino" May 27 21:49:02.059138 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:02.059120 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-66d54" May 27 21:49:02.063059 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:02.063025 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 27 21:49:02.063192 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:02.063094 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" May 27 21:49:02.063192 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:02.063146 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-rzlbq\"" May 27 21:49:02.063192 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:02.063177 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 27 21:49:02.069479 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:02.069458 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-66d54"] May 27 21:49:02.139093 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:02.139061 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49e8fb71-180b-45a6-827f-ae36b97ebea5-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-66d54\" (UID: \"49e8fb71-180b-45a6-827f-ae36b97ebea5\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-66d54" May 27 21:49:02.139291 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:02.139111 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49e8fb71-180b-45a6-827f-ae36b97ebea5-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-66d54\" (UID: \"49e8fb71-180b-45a6-827f-ae36b97ebea5\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-66d54" May 27 21:49:02.139291 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:02.139134 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49e8fb71-180b-45a6-827f-ae36b97ebea5-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-66d54\" (UID: \"49e8fb71-180b-45a6-827f-ae36b97ebea5\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-66d54" May 27 21:49:02.139291 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:02.139196 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49e8fb71-180b-45a6-827f-ae36b97ebea5-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-66d54\" (UID: \"49e8fb71-180b-45a6-827f-ae36b97ebea5\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-66d54" May 27 21:49:02.139291 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:02.139258 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/49e8fb71-180b-45a6-827f-ae36b97ebea5-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-66d54\" (UID: \"49e8fb71-180b-45a6-827f-ae36b97ebea5\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-66d54" May 27 21:49:02.139291 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:02.139285 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlsrn\" (UniqueName: \"kubernetes.io/projected/49e8fb71-180b-45a6-827f-ae36b97ebea5-kube-api-access-rlsrn\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-66d54\" (UID: \"49e8fb71-180b-45a6-827f-ae36b97ebea5\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-66d54" May 27 21:49:02.240453 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:02.240417 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49e8fb71-180b-45a6-827f-ae36b97ebea5-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-66d54\" (UID: \"49e8fb71-180b-45a6-827f-ae36b97ebea5\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-66d54" May 27 21:49:02.240631 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:02.240491 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49e8fb71-180b-45a6-827f-ae36b97ebea5-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-66d54\" (UID: \"49e8fb71-180b-45a6-827f-ae36b97ebea5\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-66d54" May 27 21:49:02.240631 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:02.240527 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49e8fb71-180b-45a6-827f-ae36b97ebea5-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-66d54\" (UID: \"49e8fb71-180b-45a6-827f-ae36b97ebea5\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-66d54" May 27 21:49:02.240631 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:02.240572 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49e8fb71-180b-45a6-827f-ae36b97ebea5-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-66d54\" (UID: \"49e8fb71-180b-45a6-827f-ae36b97ebea5\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-66d54" May 27 21:49:02.240631 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:02.240596 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/49e8fb71-180b-45a6-827f-ae36b97ebea5-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-66d54\" (UID: \"49e8fb71-180b-45a6-827f-ae36b97ebea5\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-66d54" May 27 21:49:02.240631 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:02.240621 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rlsrn\" (UniqueName: \"kubernetes.io/projected/49e8fb71-180b-45a6-827f-ae36b97ebea5-kube-api-access-rlsrn\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-66d54\" (UID: \"49e8fb71-180b-45a6-827f-ae36b97ebea5\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-66d54" May 27 21:49:02.240895 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:02.240873 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49e8fb71-180b-45a6-827f-ae36b97ebea5-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-66d54\" (UID: \"49e8fb71-180b-45a6-827f-ae36b97ebea5\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-66d54" May 27 21:49:02.240955 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:02.240928 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49e8fb71-180b-45a6-827f-ae36b97ebea5-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-66d54\" (UID: \"49e8fb71-180b-45a6-827f-ae36b97ebea5\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-66d54" May 27 21:49:02.241015 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:02.241000 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/49e8fb71-180b-45a6-827f-ae36b97ebea5-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-66d54\" (UID: \"49e8fb71-180b-45a6-827f-ae36b97ebea5\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-66d54" May 27 21:49:02.242882 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:02.242864 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49e8fb71-180b-45a6-827f-ae36b97ebea5-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-66d54\" (UID: \"49e8fb71-180b-45a6-827f-ae36b97ebea5\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-66d54" May 27 21:49:02.243040 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:02.243026 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49e8fb71-180b-45a6-827f-ae36b97ebea5-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-66d54\" (UID: \"49e8fb71-180b-45a6-827f-ae36b97ebea5\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-66d54" May 27 21:49:02.250235 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:02.250201 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlsrn\" (UniqueName: \"kubernetes.io/projected/49e8fb71-180b-45a6-827f-ae36b97ebea5-kube-api-access-rlsrn\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-66d54\" (UID: \"49e8fb71-180b-45a6-827f-ae36b97ebea5\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-66d54" May 27 21:49:02.369184 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:02.369096 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-66d54" May 27 21:49:02.497722 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:02.497695 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-66d54"] May 27 21:49:02.500352 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:49:02.500326 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49e8fb71_180b_45a6_827f_ae36b97ebea5.slice/crio-a0d7e197fa4f6493c658a35837c6f89be1369d5ea334ebc9b995eef09f413508 WatchSource:0}: Error finding container a0d7e197fa4f6493c658a35837c6f89be1369d5ea334ebc9b995eef09f413508: Status 404 returned error can't find the container with id a0d7e197fa4f6493c658a35837c6f89be1369d5ea334ebc9b995eef09f413508 May 27 21:49:02.502098 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:02.502083 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 21:49:03.028979 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:03.028945 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-66d54" event={"ID":"49e8fb71-180b-45a6-827f-ae36b97ebea5","Type":"ContainerStarted","Data":"a0d7e197fa4f6493c658a35837c6f89be1369d5ea334ebc9b995eef09f413508"} May 27 21:49:09.050812 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:09.050772 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-66d54" event={"ID":"49e8fb71-180b-45a6-827f-ae36b97ebea5","Type":"ContainerStarted","Data":"85e4d4e98cf576f3f23809775f870c146c1e6f47dae0f223d20b8d737d0e349e"} May 27 21:49:13.235826 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:13.235791 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vlstq"] May 27 21:49:13.380771 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:13.380742 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vlstq"] May 27 21:49:13.380910 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:13.380892 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vlstq" May 27 21:49:13.384539 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:13.384520 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" May 27 21:49:13.432501 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:13.432473 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ece705d7-03a7-4158-8606-6f601147c3b0-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-vlstq\" (UID: \"ece705d7-03a7-4158-8606-6f601147c3b0\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vlstq" May 27 21:49:13.432677 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:13.432534 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ece705d7-03a7-4158-8606-6f601147c3b0-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-vlstq\" (UID: \"ece705d7-03a7-4158-8606-6f601147c3b0\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vlstq" May 27 21:49:13.432677 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:13.432571 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ece705d7-03a7-4158-8606-6f601147c3b0-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-vlstq\" (UID: \"ece705d7-03a7-4158-8606-6f601147c3b0\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vlstq" May 27 21:49:13.432677 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:13.432600 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ece705d7-03a7-4158-8606-6f601147c3b0-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-vlstq\" (UID: \"ece705d7-03a7-4158-8606-6f601147c3b0\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vlstq" May 27 21:49:13.432780 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:13.432679 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msm8g\" (UniqueName: \"kubernetes.io/projected/ece705d7-03a7-4158-8606-6f601147c3b0-kube-api-access-msm8g\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-vlstq\" (UID: \"ece705d7-03a7-4158-8606-6f601147c3b0\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vlstq" May 27 21:49:13.432780 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:13.432721 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ece705d7-03a7-4158-8606-6f601147c3b0-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-vlstq\" (UID: \"ece705d7-03a7-4158-8606-6f601147c3b0\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vlstq" May 27 21:49:13.534071 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:13.533999 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ece705d7-03a7-4158-8606-6f601147c3b0-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-vlstq\" (UID: \"ece705d7-03a7-4158-8606-6f601147c3b0\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vlstq" May 27 21:49:13.534071 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:13.534043 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ece705d7-03a7-4158-8606-6f601147c3b0-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-vlstq\" (UID: \"ece705d7-03a7-4158-8606-6f601147c3b0\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vlstq" May 27 21:49:13.534071 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:13.534067 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ece705d7-03a7-4158-8606-6f601147c3b0-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-vlstq\" (UID: \"ece705d7-03a7-4158-8606-6f601147c3b0\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vlstq" May 27 21:49:13.534370 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:13.534092 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-msm8g\" (UniqueName: \"kubernetes.io/projected/ece705d7-03a7-4158-8606-6f601147c3b0-kube-api-access-msm8g\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-vlstq\" (UID: \"ece705d7-03a7-4158-8606-6f601147c3b0\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vlstq" May 27 21:49:13.534370 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:13.534124 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ece705d7-03a7-4158-8606-6f601147c3b0-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-vlstq\" (UID: \"ece705d7-03a7-4158-8606-6f601147c3b0\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vlstq" May 27 21:49:13.534370 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:13.534153 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ece705d7-03a7-4158-8606-6f601147c3b0-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-vlstq\" (UID: \"ece705d7-03a7-4158-8606-6f601147c3b0\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vlstq" May 27 21:49:13.534524 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:13.534451 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ece705d7-03a7-4158-8606-6f601147c3b0-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-vlstq\" (UID: \"ece705d7-03a7-4158-8606-6f601147c3b0\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vlstq" May 27 21:49:13.534589 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:13.534538 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ece705d7-03a7-4158-8606-6f601147c3b0-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-vlstq\" (UID: \"ece705d7-03a7-4158-8606-6f601147c3b0\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vlstq" May 27 21:49:13.534638 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:13.534591 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ece705d7-03a7-4158-8606-6f601147c3b0-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-vlstq\" (UID: \"ece705d7-03a7-4158-8606-6f601147c3b0\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vlstq" May 27 21:49:13.536533 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:13.536513 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ece705d7-03a7-4158-8606-6f601147c3b0-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-vlstq\" (UID: \"ece705d7-03a7-4158-8606-6f601147c3b0\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vlstq" May 27 21:49:13.536628 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:13.536614 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ece705d7-03a7-4158-8606-6f601147c3b0-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-vlstq\" (UID: \"ece705d7-03a7-4158-8606-6f601147c3b0\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vlstq" May 27 21:49:13.544648 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:13.544620 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-msm8g\" (UniqueName: \"kubernetes.io/projected/ece705d7-03a7-4158-8606-6f601147c3b0-kube-api-access-msm8g\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-vlstq\" (UID: \"ece705d7-03a7-4158-8606-6f601147c3b0\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vlstq" May 27 21:49:13.691207 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:13.691175 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vlstq" May 27 21:49:13.824295 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:13.824273 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vlstq"] May 27 21:49:13.854040 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:49:13.854013 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podece705d7_03a7_4158_8606_6f601147c3b0.slice/crio-90c5938a0f60b05f67d167b80b2cb810736ca409fb3afacc2a4db624189e548c WatchSource:0}: Error finding container 90c5938a0f60b05f67d167b80b2cb810736ca409fb3afacc2a4db624189e548c: Status 404 returned error can't find the container with id 90c5938a0f60b05f67d167b80b2cb810736ca409fb3afacc2a4db624189e548c May 27 21:49:14.064866 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:14.064783 2576 generic.go:358] "Generic (PLEG): container finished" podID="49e8fb71-180b-45a6-827f-ae36b97ebea5" containerID="85e4d4e98cf576f3f23809775f870c146c1e6f47dae0f223d20b8d737d0e349e" exitCode=0 May 27 21:49:14.064866 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:14.064845 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-66d54" event={"ID":"49e8fb71-180b-45a6-827f-ae36b97ebea5","Type":"ContainerDied","Data":"85e4d4e98cf576f3f23809775f870c146c1e6f47dae0f223d20b8d737d0e349e"} May 27 21:49:14.066339 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:14.066306 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vlstq" event={"ID":"ece705d7-03a7-4158-8606-6f601147c3b0","Type":"ContainerStarted","Data":"656a573457a22053635459718be7927d1b85003ed0867813bdbd44bdc0388f08"} May 27 21:49:14.066441 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:14.066346 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vlstq" event={"ID":"ece705d7-03a7-4158-8606-6f601147c3b0","Type":"ContainerStarted","Data":"90c5938a0f60b05f67d167b80b2cb810736ca409fb3afacc2a4db624189e548c"} May 27 21:49:16.073462 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:16.073420 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-66d54" event={"ID":"49e8fb71-180b-45a6-827f-ae36b97ebea5","Type":"ContainerStarted","Data":"7c077995859bc0163363bf6284f9b317255412d52139071c91a86afdecd7b6f9"} May 27 21:49:16.073834 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:16.073639 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-66d54" May 27 21:49:16.096016 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:16.095952 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-66d54" podStartSLOduration=1.423964974 podStartE2EDuration="14.095932475s" podCreationTimestamp="2026-05-27 21:49:02 +0000 UTC" firstStartedPulling="2026-05-27 21:49:02.502214152 +0000 UTC m=+647.016963930" lastFinishedPulling="2026-05-27 21:49:15.174181664 +0000 UTC m=+659.688931431" observedRunningTime="2026-05-27 21:49:16.095256974 +0000 UTC m=+660.610006758" watchObservedRunningTime="2026-05-27 21:49:16.095932475 +0000 UTC m=+660.610682259" May 27 21:49:20.084873 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:20.084836 2576 generic.go:358] "Generic (PLEG): container finished" podID="ece705d7-03a7-4158-8606-6f601147c3b0" containerID="656a573457a22053635459718be7927d1b85003ed0867813bdbd44bdc0388f08" exitCode=0 May 27 21:49:20.085258 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:20.084914 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vlstq" event={"ID":"ece705d7-03a7-4158-8606-6f601147c3b0","Type":"ContainerDied","Data":"656a573457a22053635459718be7927d1b85003ed0867813bdbd44bdc0388f08"} May 27 21:49:21.088939 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:21.088904 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vlstq" event={"ID":"ece705d7-03a7-4158-8606-6f601147c3b0","Type":"ContainerStarted","Data":"aa54c0359db80b95ece6bee3fd2fa859b19e983e714c42d197405578470d6909"} May 27 21:49:21.089434 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:21.089136 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vlstq" May 27 21:49:21.113087 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:21.113044 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vlstq" podStartSLOduration=7.9124014339999995 podStartE2EDuration="8.113031367s" podCreationTimestamp="2026-05-27 21:49:13 +0000 UTC" firstStartedPulling="2026-05-27 21:49:20.085553841 +0000 UTC m=+664.600303602" lastFinishedPulling="2026-05-27 21:49:20.286183764 +0000 UTC m=+664.800933535" observedRunningTime="2026-05-27 21:49:21.110965731 +0000 UTC m=+665.625715515" watchObservedRunningTime="2026-05-27 21:49:21.113031367 +0000 UTC m=+665.627781151" May 27 21:49:27.088960 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:27.088929 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-66d54" May 27 21:49:32.106731 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:32.106698 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-vlstq" May 27 21:49:57.034087 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:57.034007 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c6sbj"] May 27 21:49:57.054605 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:57.054574 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c6sbj"] May 27 21:49:57.054744 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:57.054697 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c6sbj" May 27 21:49:57.057518 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:57.057497 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" May 27 21:49:57.186813 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:57.186780 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d6f176c-f179-40dd-84b2-5c94e30bc3cc-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-c6sbj\" (UID: \"2d6f176c-f179-40dd-84b2-5c94e30bc3cc\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c6sbj" May 27 21:49:57.186813 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:57.186814 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2d6f176c-f179-40dd-84b2-5c94e30bc3cc-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-c6sbj\" (UID: \"2d6f176c-f179-40dd-84b2-5c94e30bc3cc\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c6sbj" May 27 21:49:57.187030 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:57.186841 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d6f176c-f179-40dd-84b2-5c94e30bc3cc-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-c6sbj\" (UID: \"2d6f176c-f179-40dd-84b2-5c94e30bc3cc\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c6sbj" May 27 21:49:57.187030 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:57.186895 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d6f176c-f179-40dd-84b2-5c94e30bc3cc-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-c6sbj\" (UID: \"2d6f176c-f179-40dd-84b2-5c94e30bc3cc\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c6sbj" May 27 21:49:57.187030 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:57.186912 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hzqm\" (UniqueName: \"kubernetes.io/projected/2d6f176c-f179-40dd-84b2-5c94e30bc3cc-kube-api-access-7hzqm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-c6sbj\" (UID: \"2d6f176c-f179-40dd-84b2-5c94e30bc3cc\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c6sbj" May 27 21:49:57.187030 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:57.186977 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d6f176c-f179-40dd-84b2-5c94e30bc3cc-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-c6sbj\" (UID: \"2d6f176c-f179-40dd-84b2-5c94e30bc3cc\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c6sbj" May 27 21:49:57.287609 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:57.287513 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d6f176c-f179-40dd-84b2-5c94e30bc3cc-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-c6sbj\" (UID: \"2d6f176c-f179-40dd-84b2-5c94e30bc3cc\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c6sbj" May 27 21:49:57.287609 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:57.287578 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d6f176c-f179-40dd-84b2-5c94e30bc3cc-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-c6sbj\" (UID: \"2d6f176c-f179-40dd-84b2-5c94e30bc3cc\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c6sbj" May 27 21:49:57.287609 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:57.287598 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7hzqm\" (UniqueName: \"kubernetes.io/projected/2d6f176c-f179-40dd-84b2-5c94e30bc3cc-kube-api-access-7hzqm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-c6sbj\" (UID: \"2d6f176c-f179-40dd-84b2-5c94e30bc3cc\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c6sbj" May 27 21:49:57.287873 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:57.287631 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d6f176c-f179-40dd-84b2-5c94e30bc3cc-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-c6sbj\" (UID: \"2d6f176c-f179-40dd-84b2-5c94e30bc3cc\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c6sbj" May 27 21:49:57.287873 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:57.287670 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d6f176c-f179-40dd-84b2-5c94e30bc3cc-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-c6sbj\" (UID: \"2d6f176c-f179-40dd-84b2-5c94e30bc3cc\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c6sbj" May 27 21:49:57.287873 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:57.287687 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2d6f176c-f179-40dd-84b2-5c94e30bc3cc-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-c6sbj\" (UID: \"2d6f176c-f179-40dd-84b2-5c94e30bc3cc\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c6sbj" May 27 21:49:57.288141 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:57.288112 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d6f176c-f179-40dd-84b2-5c94e30bc3cc-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-c6sbj\" (UID: \"2d6f176c-f179-40dd-84b2-5c94e30bc3cc\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c6sbj" May 27 21:49:57.288141 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:57.288130 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2d6f176c-f179-40dd-84b2-5c94e30bc3cc-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-c6sbj\" (UID: \"2d6f176c-f179-40dd-84b2-5c94e30bc3cc\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c6sbj" May 27 21:49:57.288321 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:57.288267 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d6f176c-f179-40dd-84b2-5c94e30bc3cc-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-c6sbj\" (UID: \"2d6f176c-f179-40dd-84b2-5c94e30bc3cc\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c6sbj" May 27 21:49:57.289885 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:57.289863 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d6f176c-f179-40dd-84b2-5c94e30bc3cc-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-c6sbj\" (UID: \"2d6f176c-f179-40dd-84b2-5c94e30bc3cc\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c6sbj" May 27 21:49:57.290041 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:57.290025 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d6f176c-f179-40dd-84b2-5c94e30bc3cc-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-c6sbj\" (UID: \"2d6f176c-f179-40dd-84b2-5c94e30bc3cc\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c6sbj" May 27 21:49:57.296563 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:57.296544 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hzqm\" (UniqueName: \"kubernetes.io/projected/2d6f176c-f179-40dd-84b2-5c94e30bc3cc-kube-api-access-7hzqm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-c6sbj\" (UID: \"2d6f176c-f179-40dd-84b2-5c94e30bc3cc\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c6sbj" May 27 21:49:57.365141 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:57.365121 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c6sbj" May 27 21:49:57.493300 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:57.493276 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c6sbj"] May 27 21:49:57.495612 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:49:57.495579 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d6f176c_f179_40dd_84b2_5c94e30bc3cc.slice/crio-01f39a99aee7e6ce1a298cd8e32939768a38ad329eb279e2eaf94cd07e1dedbc WatchSource:0}: Error finding container 01f39a99aee7e6ce1a298cd8e32939768a38ad329eb279e2eaf94cd07e1dedbc: Status 404 returned error can't find the container with id 01f39a99aee7e6ce1a298cd8e32939768a38ad329eb279e2eaf94cd07e1dedbc May 27 21:49:58.187976 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:58.187937 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c6sbj" event={"ID":"2d6f176c-f179-40dd-84b2-5c94e30bc3cc","Type":"ContainerStarted","Data":"d39d8868b38b04cfaf798c7a3cb66ad172968c392a76faaf7640f0e859911790"} May 27 21:49:58.187976 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:49:58.187977 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c6sbj" event={"ID":"2d6f176c-f179-40dd-84b2-5c94e30bc3cc","Type":"ContainerStarted","Data":"01f39a99aee7e6ce1a298cd8e32939768a38ad329eb279e2eaf94cd07e1dedbc"} May 27 21:50:03.207359 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:50:03.207326 2576 generic.go:358] "Generic (PLEG): container finished" podID="2d6f176c-f179-40dd-84b2-5c94e30bc3cc" containerID="d39d8868b38b04cfaf798c7a3cb66ad172968c392a76faaf7640f0e859911790" exitCode=0 May 27 21:50:03.207727 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:50:03.207383 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c6sbj" event={"ID":"2d6f176c-f179-40dd-84b2-5c94e30bc3cc","Type":"ContainerDied","Data":"d39d8868b38b04cfaf798c7a3cb66ad172968c392a76faaf7640f0e859911790"} May 27 21:50:04.211618 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:50:04.211584 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c6sbj" event={"ID":"2d6f176c-f179-40dd-84b2-5c94e30bc3cc","Type":"ContainerStarted","Data":"d80e1ab16bc15451329595971fe5574aa93ceccd6423dc05d63d515d114eb421"} May 27 21:50:04.212015 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:50:04.211798 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c6sbj" May 27 21:50:04.240144 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:50:04.240085 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c6sbj" podStartSLOduration=7.005893266 podStartE2EDuration="7.240068008s" podCreationTimestamp="2026-05-27 21:49:57 +0000 UTC" firstStartedPulling="2026-05-27 21:50:03.207932383 +0000 UTC m=+707.722682146" lastFinishedPulling="2026-05-27 21:50:03.442107125 +0000 UTC m=+707.956856888" observedRunningTime="2026-05-27 21:50:04.237805891 +0000 UTC m=+708.752555675" watchObservedRunningTime="2026-05-27 21:50:04.240068008 +0000 UTC m=+708.754817794" May 27 21:50:15.227500 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:50:15.227471 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-c6sbj" May 27 21:50:44.564288 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:50:44.564251 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5fc658c964-4cvz2"] May 27 21:50:44.567332 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:50:44.567315 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5fc658c964-4cvz2" May 27 21:50:44.579849 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:50:44.579828 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5fc658c964-4cvz2"] May 27 21:50:44.682493 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:50:44.682462 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/161d108d-1f25-43a5-9e7a-c06b6a4f6809-tls-cert\") pod \"authorino-5fc658c964-4cvz2\" (UID: \"161d108d-1f25-43a5-9e7a-c06b6a4f6809\") " pod="kuadrant-system/authorino-5fc658c964-4cvz2" May 27 21:50:44.682493 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:50:44.682495 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzzd6\" (UniqueName: \"kubernetes.io/projected/161d108d-1f25-43a5-9e7a-c06b6a4f6809-kube-api-access-zzzd6\") pod \"authorino-5fc658c964-4cvz2\" (UID: \"161d108d-1f25-43a5-9e7a-c06b6a4f6809\") " pod="kuadrant-system/authorino-5fc658c964-4cvz2" May 27 21:50:44.783296 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:50:44.783263 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/161d108d-1f25-43a5-9e7a-c06b6a4f6809-tls-cert\") pod \"authorino-5fc658c964-4cvz2\" (UID: \"161d108d-1f25-43a5-9e7a-c06b6a4f6809\") " pod="kuadrant-system/authorino-5fc658c964-4cvz2" May 27 21:50:44.783296 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:50:44.783300 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zzzd6\" (UniqueName: \"kubernetes.io/projected/161d108d-1f25-43a5-9e7a-c06b6a4f6809-kube-api-access-zzzd6\") pod \"authorino-5fc658c964-4cvz2\" (UID: \"161d108d-1f25-43a5-9e7a-c06b6a4f6809\") " pod="kuadrant-system/authorino-5fc658c964-4cvz2" May 27 21:50:44.785643 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:50:44.785619 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/161d108d-1f25-43a5-9e7a-c06b6a4f6809-tls-cert\") pod \"authorino-5fc658c964-4cvz2\" (UID: \"161d108d-1f25-43a5-9e7a-c06b6a4f6809\") " pod="kuadrant-system/authorino-5fc658c964-4cvz2" May 27 21:50:44.793178 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:50:44.793158 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzzd6\" (UniqueName: \"kubernetes.io/projected/161d108d-1f25-43a5-9e7a-c06b6a4f6809-kube-api-access-zzzd6\") pod \"authorino-5fc658c964-4cvz2\" (UID: \"161d108d-1f25-43a5-9e7a-c06b6a4f6809\") " pod="kuadrant-system/authorino-5fc658c964-4cvz2" May 27 21:50:44.876183 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:50:44.876112 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5fc658c964-4cvz2" May 27 21:50:45.008652 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:50:45.008617 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5fc658c964-4cvz2"] May 27 21:50:45.011034 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:50:45.011009 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod161d108d_1f25_43a5_9e7a_c06b6a4f6809.slice/crio-f3dc062e55f3f2c01d57fc4d0b33deff46eaf92fd03f103818c107fb3b20a643 WatchSource:0}: Error finding container f3dc062e55f3f2c01d57fc4d0b33deff46eaf92fd03f103818c107fb3b20a643: Status 404 returned error can't find the container with id f3dc062e55f3f2c01d57fc4d0b33deff46eaf92fd03f103818c107fb3b20a643 May 27 21:50:45.333698 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:50:45.333666 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5fc658c964-4cvz2" event={"ID":"161d108d-1f25-43a5-9e7a-c06b6a4f6809","Type":"ContainerStarted","Data":"f3dc062e55f3f2c01d57fc4d0b33deff46eaf92fd03f103818c107fb3b20a643"} May 27 21:50:46.340542 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:50:46.340499 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5fc658c964-4cvz2" event={"ID":"161d108d-1f25-43a5-9e7a-c06b6a4f6809","Type":"ContainerStarted","Data":"d35aa5ae563e19b9e2a85756209f101d24e2e01ade6aab1ff1e2cc0fd87d192e"} May 27 21:50:46.394505 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:50:46.394448 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-5fc658c964-4cvz2" podStartSLOduration=2.029710753 podStartE2EDuration="2.394432149s" podCreationTimestamp="2026-05-27 21:50:44 +0000 UTC" firstStartedPulling="2026-05-27 21:50:45.012293668 +0000 UTC m=+749.527043430" lastFinishedPulling="2026-05-27 21:50:45.377015063 +0000 UTC m=+749.891764826" observedRunningTime="2026-05-27 21:50:46.394089747 +0000 UTC m=+750.908839530" watchObservedRunningTime="2026-05-27 21:50:46.394432149 +0000 UTC m=+750.909181948" May 27 21:50:46.449730 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:50:46.449697 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5cfb4dc9b9-bmstn"] May 27 21:50:46.449956 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:50:46.449923 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-5cfb4dc9b9-bmstn" podUID="dec59248-7ffc-4906-8e28-dfca799550b1" containerName="authorino" containerID="cri-o://8b3fcbaf0ce672200cae02713c786fb2cca3300ac445c29781fc199602715faa" gracePeriod=30 May 27 21:50:46.700782 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:50:46.700761 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cfb4dc9b9-bmstn" May 27 21:50:46.802260 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:50:46.802208 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dec59248-7ffc-4906-8e28-dfca799550b1-tls-cert\") pod \"dec59248-7ffc-4906-8e28-dfca799550b1\" (UID: \"dec59248-7ffc-4906-8e28-dfca799550b1\") " May 27 21:50:46.802413 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:50:46.802311 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l2qtg\" (UniqueName: \"kubernetes.io/projected/dec59248-7ffc-4906-8e28-dfca799550b1-kube-api-access-l2qtg\") pod \"dec59248-7ffc-4906-8e28-dfca799550b1\" (UID: \"dec59248-7ffc-4906-8e28-dfca799550b1\") " May 27 21:50:46.804260 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:50:46.804212 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dec59248-7ffc-4906-8e28-dfca799550b1-kube-api-access-l2qtg" (OuterVolumeSpecName: "kube-api-access-l2qtg") pod "dec59248-7ffc-4906-8e28-dfca799550b1" (UID: "dec59248-7ffc-4906-8e28-dfca799550b1"). InnerVolumeSpecName "kube-api-access-l2qtg". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:50:46.811248 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:50:46.811199 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dec59248-7ffc-4906-8e28-dfca799550b1-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "dec59248-7ffc-4906-8e28-dfca799550b1" (UID: "dec59248-7ffc-4906-8e28-dfca799550b1"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:50:46.902926 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:50:46.902861 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l2qtg\" (UniqueName: \"kubernetes.io/projected/dec59248-7ffc-4906-8e28-dfca799550b1-kube-api-access-l2qtg\") on node \"ip-10-0-131-147.ec2.internal\" DevicePath \"\"" May 27 21:50:46.902926 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:50:46.902887 2576 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dec59248-7ffc-4906-8e28-dfca799550b1-tls-cert\") on node \"ip-10-0-131-147.ec2.internal\" DevicePath \"\"" May 27 21:50:47.344462 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:50:47.344422 2576 generic.go:358] "Generic (PLEG): container finished" podID="dec59248-7ffc-4906-8e28-dfca799550b1" containerID="8b3fcbaf0ce672200cae02713c786fb2cca3300ac445c29781fc199602715faa" exitCode=0 May 27 21:50:47.344916 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:50:47.344476 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cfb4dc9b9-bmstn" May 27 21:50:47.344916 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:50:47.344509 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cfb4dc9b9-bmstn" event={"ID":"dec59248-7ffc-4906-8e28-dfca799550b1","Type":"ContainerDied","Data":"8b3fcbaf0ce672200cae02713c786fb2cca3300ac445c29781fc199602715faa"} May 27 21:50:47.344916 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:50:47.344547 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cfb4dc9b9-bmstn" event={"ID":"dec59248-7ffc-4906-8e28-dfca799550b1","Type":"ContainerDied","Data":"317d24f6640234a7bb8b709a6c028d1164d5c3577216b371df6114f9483b8637"} May 27 21:50:47.344916 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:50:47.344570 2576 scope.go:117] "RemoveContainer" containerID="8b3fcbaf0ce672200cae02713c786fb2cca3300ac445c29781fc199602715faa" May 27 21:50:47.352653 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:50:47.352633 2576 scope.go:117] "RemoveContainer" containerID="8b3fcbaf0ce672200cae02713c786fb2cca3300ac445c29781fc199602715faa" May 27 21:50:47.352883 ip-10-0-131-147 kubenswrapper[2576]: E0527 21:50:47.352862 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b3fcbaf0ce672200cae02713c786fb2cca3300ac445c29781fc199602715faa\": container with ID starting with 8b3fcbaf0ce672200cae02713c786fb2cca3300ac445c29781fc199602715faa not found: ID does not exist" containerID="8b3fcbaf0ce672200cae02713c786fb2cca3300ac445c29781fc199602715faa" May 27 21:50:47.352946 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:50:47.352894 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b3fcbaf0ce672200cae02713c786fb2cca3300ac445c29781fc199602715faa"} err="failed to get container status \"8b3fcbaf0ce672200cae02713c786fb2cca3300ac445c29781fc199602715faa\": rpc error: code = NotFound desc = could not find container \"8b3fcbaf0ce672200cae02713c786fb2cca3300ac445c29781fc199602715faa\": container with ID starting with 8b3fcbaf0ce672200cae02713c786fb2cca3300ac445c29781fc199602715faa not found: ID does not exist" May 27 21:50:47.367775 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:50:47.367752 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5cfb4dc9b9-bmstn"] May 27 21:50:47.375941 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:50:47.375922 2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5cfb4dc9b9-bmstn"] May 27 21:50:48.119580 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:50:48.119550 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dec59248-7ffc-4906-8e28-dfca799550b1" path="/var/lib/kubelet/pods/dec59248-7ffc-4906-8e28-dfca799550b1/volumes" May 27 21:51:41.484405 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:51:41.484333 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5fc658c964-4cvz2_161d108d-1f25-43a5-9e7a-c06b6a4f6809/authorino/0.log" May 27 21:51:46.707148 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:51:46.707119 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d4d9fcc6c-dc8g9_de2b5ad4-0617-4d55-87e9-57bae3df6fb2/manager/0.log" May 27 21:51:48.289786 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:51:48.289742 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5fc658c964-4cvz2_161d108d-1f25-43a5-9e7a-c06b6a4f6809/authorino/0.log" May 27 21:51:48.631782 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:51:48.631707 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-tg8px_7d45aed4-86c4-4f50-8e23-6bc6dcc9632e/kuadrant-console-plugin/0.log" May 27 21:51:49.802377 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:51:49.802319 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6ffdb65d85-chfmz_41b9035e-a492-4413-aec3-9fa7d810be99/kube-auth-proxy/0.log" May 27 21:51:50.629978 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:51:50.629947 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-vlstq_ece705d7-03a7-4158-8606-6f601147c3b0/storage-initializer/0.log" May 27 21:51:50.638723 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:51:50.638690 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-vlstq_ece705d7-03a7-4158-8606-6f601147c3b0/main/0.log" May 27 21:51:50.754134 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:51:50.754108 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-66d54_49e8fb71-180b-45a6-827f-ae36b97ebea5/storage-initializer/0.log" May 27 21:51:50.762792 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:51:50.762770 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-66d54_49e8fb71-180b-45a6-827f-ae36b97ebea5/main/0.log" May 27 21:51:50.999028 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:51:50.999002 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-c6sbj_2d6f176c-f179-40dd-84b2-5c94e30bc3cc/storage-initializer/0.log" May 27 21:51:51.008042 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:51:51.008021 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-c6sbj_2d6f176c-f179-40dd-84b2-5c94e30bc3cc/main/0.log" May 27 21:51:58.147802 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:51:58.147775 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-sbgqc_c32abd03-a4ad-45f9-9847-21aff5756c70/global-pull-secret-syncer/0.log" May 27 21:51:58.262661 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:51:58.262630 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nd7v5_97d8a31d-74d6-40a4-bbe8-734aa7e10fdd/konnectivity-agent/0.log" May 27 21:51:58.317219 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:51:58.317187 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-147.ec2.internal_b08bdc800ac3949123f1ded355038db0/haproxy/0.log" May 27 21:52:02.265343 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:52:02.265310 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5fc658c964-4cvz2_161d108d-1f25-43a5-9e7a-c06b6a4f6809/authorino/0.log" May 27 21:52:02.356442 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:52:02.356415 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-tg8px_7d45aed4-86c4-4f50-8e23-6bc6dcc9632e/kuadrant-console-plugin/0.log" May 27 21:52:04.601651 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:52:04.601622 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qvs6k_b366099d-d3cb-4034-ab37-cc56a0f217c5/node-exporter/0.log" May 27 21:52:04.632194 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:52:04.632170 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qvs6k_b366099d-d3cb-4034-ab37-cc56a0f217c5/kube-rbac-proxy/0.log" May 27 21:52:04.664815 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:52:04.664789 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qvs6k_b366099d-d3cb-4034-ab37-cc56a0f217c5/init-textfile/0.log" May 27 21:52:06.636482 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:52:06.636443 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4k6x8/perf-node-gather-daemonset-n7xj6"] May 27 21:52:06.636934 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:52:06.636835 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dec59248-7ffc-4906-8e28-dfca799550b1" containerName="authorino" May 27 21:52:06.636934 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:52:06.636853 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="dec59248-7ffc-4906-8e28-dfca799550b1" containerName="authorino" May 27 21:52:06.637041 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:52:06.636950 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="dec59248-7ffc-4906-8e28-dfca799550b1" containerName="authorino" May 27 21:52:06.638801 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:52:06.638780 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4k6x8/perf-node-gather-daemonset-n7xj6" May 27 21:52:06.641563 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:52:06.641537 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4k6x8\"/\"default-dockercfg-d2xxg\"" May 27 21:52:06.642126 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:52:06.642112 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4k6x8\"/\"openshift-service-ca.crt\"" May 27 21:52:06.643068 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:52:06.643038 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4k6x8\"/\"kube-root-ca.crt\"" May 27 21:52:06.649336 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:52:06.649316 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4k6x8/perf-node-gather-daemonset-n7xj6"] May 27 21:52:06.718286 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:52:06.718217 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7ea9282d-8797-41b6-8dc2-46fda22595e5-proc\") pod \"perf-node-gather-daemonset-n7xj6\" (UID: \"7ea9282d-8797-41b6-8dc2-46fda22595e5\") " pod="openshift-must-gather-4k6x8/perf-node-gather-daemonset-n7xj6" May 27 21:52:06.718286 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:52:06.718292 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7ea9282d-8797-41b6-8dc2-46fda22595e5-lib-modules\") pod \"perf-node-gather-daemonset-n7xj6\" (UID: \"7ea9282d-8797-41b6-8dc2-46fda22595e5\") " pod="openshift-must-gather-4k6x8/perf-node-gather-daemonset-n7xj6" May 27 21:52:06.718549 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:52:06.718386 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7ea9282d-8797-41b6-8dc2-46fda22595e5-podres\") pod \"perf-node-gather-daemonset-n7xj6\" (UID: \"7ea9282d-8797-41b6-8dc2-46fda22595e5\") " pod="openshift-must-gather-4k6x8/perf-node-gather-daemonset-n7xj6" May 27 21:52:06.718549 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:52:06.718440 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh9mz\" (UniqueName: \"kubernetes.io/projected/7ea9282d-8797-41b6-8dc2-46fda22595e5-kube-api-access-zh9mz\") pod \"perf-node-gather-daemonset-n7xj6\" (UID: \"7ea9282d-8797-41b6-8dc2-46fda22595e5\") " pod="openshift-must-gather-4k6x8/perf-node-gather-daemonset-n7xj6" May 27 21:52:06.718549 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:52:06.718481 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ea9282d-8797-41b6-8dc2-46fda22595e5-sys\") pod \"perf-node-gather-daemonset-n7xj6\" (UID: \"7ea9282d-8797-41b6-8dc2-46fda22595e5\") " pod="openshift-must-gather-4k6x8/perf-node-gather-daemonset-n7xj6" May 27 21:52:06.819533 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:52:06.819493 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zh9mz\" (UniqueName: \"kubernetes.io/projected/7ea9282d-8797-41b6-8dc2-46fda22595e5-kube-api-access-zh9mz\") pod \"perf-node-gather-daemonset-n7xj6\" (UID: \"7ea9282d-8797-41b6-8dc2-46fda22595e5\") " pod="openshift-must-gather-4k6x8/perf-node-gather-daemonset-n7xj6" May 27 21:52:06.819701 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:52:06.819549 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ea9282d-8797-41b6-8dc2-46fda22595e5-sys\") pod \"perf-node-gather-daemonset-n7xj6\" (UID: \"7ea9282d-8797-41b6-8dc2-46fda22595e5\") " pod="openshift-must-gather-4k6x8/perf-node-gather-daemonset-n7xj6" May 27 21:52:06.819701 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:52:06.819612 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7ea9282d-8797-41b6-8dc2-46fda22595e5-proc\") pod \"perf-node-gather-daemonset-n7xj6\" (UID: \"7ea9282d-8797-41b6-8dc2-46fda22595e5\") " pod="openshift-must-gather-4k6x8/perf-node-gather-daemonset-n7xj6" May 27 21:52:06.819701 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:52:06.819645 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7ea9282d-8797-41b6-8dc2-46fda22595e5-lib-modules\") pod \"perf-node-gather-daemonset-n7xj6\" (UID: \"7ea9282d-8797-41b6-8dc2-46fda22595e5\") " pod="openshift-must-gather-4k6x8/perf-node-gather-daemonset-n7xj6" May 27 21:52:06.819701 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:52:06.819692 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7ea9282d-8797-41b6-8dc2-46fda22595e5-podres\") pod \"perf-node-gather-daemonset-n7xj6\" (UID: \"7ea9282d-8797-41b6-8dc2-46fda22595e5\") " pod="openshift-must-gather-4k6x8/perf-node-gather-daemonset-n7xj6" May 27 21:52:06.819884 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:52:06.819704 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7ea9282d-8797-41b6-8dc2-46fda22595e5-proc\") pod \"perf-node-gather-daemonset-n7xj6\" (UID: \"7ea9282d-8797-41b6-8dc2-46fda22595e5\") " pod="openshift-must-gather-4k6x8/perf-node-gather-daemonset-n7xj6" May 27 21:52:06.819884 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:52:06.819705 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ea9282d-8797-41b6-8dc2-46fda22595e5-sys\") pod \"perf-node-gather-daemonset-n7xj6\" (UID: \"7ea9282d-8797-41b6-8dc2-46fda22595e5\") " pod="openshift-must-gather-4k6x8/perf-node-gather-daemonset-n7xj6" May 27 21:52:06.819884 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:52:06.819810 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7ea9282d-8797-41b6-8dc2-46fda22595e5-podres\") pod \"perf-node-gather-daemonset-n7xj6\" (UID: \"7ea9282d-8797-41b6-8dc2-46fda22595e5\") " pod="openshift-must-gather-4k6x8/perf-node-gather-daemonset-n7xj6" May 27 21:52:06.819884 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:52:06.819814 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7ea9282d-8797-41b6-8dc2-46fda22595e5-lib-modules\") pod \"perf-node-gather-daemonset-n7xj6\" (UID: \"7ea9282d-8797-41b6-8dc2-46fda22595e5\") " pod="openshift-must-gather-4k6x8/perf-node-gather-daemonset-n7xj6" May 27 21:52:06.830837 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:52:06.830807 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh9mz\" (UniqueName: \"kubernetes.io/projected/7ea9282d-8797-41b6-8dc2-46fda22595e5-kube-api-access-zh9mz\") pod \"perf-node-gather-daemonset-n7xj6\" (UID: \"7ea9282d-8797-41b6-8dc2-46fda22595e5\") " pod="openshift-must-gather-4k6x8/perf-node-gather-daemonset-n7xj6" May 27 21:52:06.948291 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:52:06.948263 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4k6x8/perf-node-gather-daemonset-n7xj6" May 27 21:52:07.077276 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:52:07.077251 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4k6x8/perf-node-gather-daemonset-n7xj6"] May 27 21:52:07.079590 ip-10-0-131-147 kubenswrapper[2576]: W0527 21:52:07.079560 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7ea9282d_8797_41b6_8dc2_46fda22595e5.slice/crio-3e3e53e7c20045af2e09b97c08cb3884fd4163301497da0ccb75fcdda64c1f38 WatchSource:0}: Error finding container 3e3e53e7c20045af2e09b97c08cb3884fd4163301497da0ccb75fcdda64c1f38: Status 404 returned error can't find the container with id 3e3e53e7c20045af2e09b97c08cb3884fd4163301497da0ccb75fcdda64c1f38 May 27 21:52:07.589058 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:52:07.589025 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4k6x8/perf-node-gather-daemonset-n7xj6" event={"ID":"7ea9282d-8797-41b6-8dc2-46fda22595e5","Type":"ContainerStarted","Data":"754b09aca87d2bdfcd61cf3ecac28760a321bf33c559f6c7cf40462995e5eb33"} May 27 21:52:07.589058 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:52:07.589062 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4k6x8/perf-node-gather-daemonset-n7xj6" event={"ID":"7ea9282d-8797-41b6-8dc2-46fda22595e5","Type":"ContainerStarted","Data":"3e3e53e7c20045af2e09b97c08cb3884fd4163301497da0ccb75fcdda64c1f38"} May 27 21:52:07.589298 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:52:07.589095 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4k6x8/perf-node-gather-daemonset-n7xj6" May 27 21:52:07.606714 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:52:07.606662 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-4k6x8/perf-node-gather-daemonset-n7xj6" podStartSLOduration=1.606646498 podStartE2EDuration="1.606646498s" podCreationTimestamp="2026-05-27 21:52:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 21:52:07.60612267 +0000 UTC m=+832.120872477" watchObservedRunningTime="2026-05-27 21:52:07.606646498 +0000 UTC m=+832.121396339" May 27 21:52:09.517288 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:52:09.517257 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kx8l8_aa3113b8-5396-4fab-b87f-a3d6bfee9121/dns/0.log" May 27 21:52:09.551199 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:52:09.551171 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kx8l8_aa3113b8-5396-4fab-b87f-a3d6bfee9121/kube-rbac-proxy/0.log" May 27 21:52:09.649533 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:52:09.649508 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l45ck_bd5e8436-5b68-4fb7-9d97-d3d8d441f980/dns-node-resolver/0.log" May 27 21:52:10.250109 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:52:10.250077 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-slshq_9efca526-fa4d-4195-a7ab-9139cb1c02ad/node-ca/0.log" May 27 21:52:11.413306 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:52:11.413279 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6ffdb65d85-chfmz_41b9035e-a492-4413-aec3-9fa7d810be99/kube-auth-proxy/0.log" May 27 21:52:12.130394 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:52:12.130359 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cvngm_34efe17a-77e3-4d91-81ea-2c8c98c73882/serve-healthcheck-canary/0.log" May 27 21:52:12.773597 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:52:12.773565 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pdw2g_76bd7347-d8f1-48e4-b72a-10b7527a500d/kube-rbac-proxy/0.log" May 27 21:52:12.820305 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:52:12.820283 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pdw2g_76bd7347-d8f1-48e4-b72a-10b7527a500d/exporter/0.log" May 27 21:52:12.867763 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:52:12.867740 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pdw2g_76bd7347-d8f1-48e4-b72a-10b7527a500d/extractor/0.log" May 27 21:52:13.601468 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:52:13.601443 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4k6x8/perf-node-gather-daemonset-n7xj6" May 27 21:52:15.140886 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:52:15.140857 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d4d9fcc6c-dc8g9_de2b5ad4-0617-4d55-87e9-57bae3df6fb2/manager/0.log" May 27 21:52:16.603073 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:52:16.603005 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-798bcdfc67-d8zgz_915ff45e-f383-4d04-88c7-a71f08943163/manager/0.log" May 27 21:52:23.473250 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:52:23.473201 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ppk2n_79a9dc4b-003d-47a5-9db1-c461022e3ee4/kube-multus-additional-cni-plugins/0.log" May 27 21:52:23.502567 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:52:23.502532 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ppk2n_79a9dc4b-003d-47a5-9db1-c461022e3ee4/egress-router-binary-copy/0.log" May 27 21:52:23.532751 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:52:23.532732 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ppk2n_79a9dc4b-003d-47a5-9db1-c461022e3ee4/cni-plugins/0.log" May 27 21:52:23.560578 ip-10-0-131-147 kubenswrapper[2576]: I0527 21:52:23.560550 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ppk2n_79a9dc4b-003d-47a5-9db1-c461022e3ee4/bond-cni-plugin/0.log"