May 26 16:08:29.360821 ip-10-0-142-102 systemd[1]: Starting Kubernetes Kubelet... May 26 16:08:29.749496 ip-10-0-142-102 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 26 16:08:29.749496 ip-10-0-142-102 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 26 16:08:29.749496 ip-10-0-142-102 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 26 16:08:29.749496 ip-10-0-142-102 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 26 16:08:29.749496 ip-10-0-142-102 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 26 16:08:29.751170 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.751081 2560 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 26 16:08:29.758407 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758381 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 26 16:08:29.758407 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758402 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 26 16:08:29.758407 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758406 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 26 16:08:29.758407 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758410 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 26 16:08:29.758407 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758413 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 26 16:08:29.758621 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758417 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 26 16:08:29.758621 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758420 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 26 16:08:29.758621 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758423 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 26 16:08:29.758621 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758441 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 26 16:08:29.758621 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758444 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 26 16:08:29.758621 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758447 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 26 16:08:29.758621 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758450 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages May 26 16:08:29.758621 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758453 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 26 16:08:29.758621 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758456 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 26 16:08:29.758621 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758458 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 26 16:08:29.758621 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758461 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 26 16:08:29.758621 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758463 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 26 16:08:29.758621 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758466 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 26 16:08:29.758621 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758469 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 26 16:08:29.758621 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758471 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 26 16:08:29.758621 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758474 2560 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 26 16:08:29.758621 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758477 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 26 16:08:29.758621 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758479 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 26 16:08:29.758621 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758482 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 26 16:08:29.758621 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758485 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 26 16:08:29.759093 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758487 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 26 16:08:29.759093 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758490 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 26 16:08:29.759093 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758493 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 26 16:08:29.759093 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758497 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 26 16:08:29.759093 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758501 2560 feature_gate.go:328] unrecognized feature gate: DualReplica May 26 16:08:29.759093 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758504 2560 feature_gate.go:328] unrecognized feature gate: Example May 26 16:08:29.759093 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758506 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 26 16:08:29.759093 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758509 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 26 16:08:29.759093 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758512 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 26 16:08:29.759093 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758514 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 26 16:08:29.759093 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758517 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 26 16:08:29.759093 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758519 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 26 16:08:29.759093 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758522 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 26 16:08:29.759093 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758525 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 26 16:08:29.759093 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758528 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 26 16:08:29.759093 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758531 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 26 16:08:29.759093 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758534 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 26 16:08:29.759093 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758536 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 26 16:08:29.759093 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758539 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 26 16:08:29.759093 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758542 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 26 16:08:29.759596 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758544 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 26 16:08:29.759596 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758547 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 26 16:08:29.759596 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758549 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 26 16:08:29.759596 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758552 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 26 16:08:29.759596 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758555 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores May 26 16:08:29.759596 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758558 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 26 16:08:29.759596 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758561 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 26 16:08:29.759596 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758565 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 26 16:08:29.759596 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758570 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 26 16:08:29.759596 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758573 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability May 26 16:08:29.759596 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758576 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 26 16:08:29.759596 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758579 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 26 16:08:29.759596 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758581 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 26 16:08:29.759596 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758585 2560 feature_gate.go:328] unrecognized feature gate: NewOLM May 26 16:08:29.759596 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758588 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 26 16:08:29.759596 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758591 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 26 16:08:29.759596 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758594 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 26 16:08:29.759596 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758597 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 26 16:08:29.759596 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758600 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 26 16:08:29.760059 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758603 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 26 16:08:29.760059 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758606 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 26 16:08:29.760059 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758608 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 26 16:08:29.760059 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758611 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 26 16:08:29.760059 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758615 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 26 16:08:29.760059 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758618 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 26 16:08:29.760059 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758621 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 26 16:08:29.760059 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758623 2560 feature_gate.go:328] unrecognized feature gate: Example2 May 26 16:08:29.760059 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758626 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 26 16:08:29.760059 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758629 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 26 16:08:29.760059 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758631 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 26 16:08:29.760059 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758634 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 26 16:08:29.760059 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758637 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 26 16:08:29.760059 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758639 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 26 16:08:29.760059 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758647 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 26 16:08:29.760059 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758649 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 26 16:08:29.760059 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758652 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 26 16:08:29.760059 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758654 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 26 16:08:29.760059 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758657 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 26 16:08:29.760059 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758660 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 26 16:08:29.760556 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758662 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 26 16:08:29.760556 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.758665 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 26 16:08:29.760556 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759075 2560 feature_gate.go:328] unrecognized feature gate: Example2 May 26 16:08:29.760556 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759080 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 26 16:08:29.760556 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759083 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 26 16:08:29.760556 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759087 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 26 16:08:29.760556 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759090 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 26 16:08:29.760556 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759093 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 26 16:08:29.760556 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759096 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 26 16:08:29.760556 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759099 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 26 16:08:29.760556 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759101 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 26 16:08:29.760556 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759105 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 26 16:08:29.760556 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759109 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 26 16:08:29.760556 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759111 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 26 16:08:29.760556 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759114 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 26 16:08:29.760556 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759117 2560 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 26 16:08:29.760556 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759119 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 26 16:08:29.760556 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759122 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 26 16:08:29.760556 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759125 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 26 16:08:29.761017 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759128 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 26 16:08:29.761017 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759130 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 26 16:08:29.761017 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759133 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 26 16:08:29.761017 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759135 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 26 16:08:29.761017 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759138 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 26 16:08:29.761017 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759141 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 26 16:08:29.761017 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759143 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 26 16:08:29.761017 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759146 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 26 16:08:29.761017 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759149 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 26 16:08:29.761017 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759152 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores May 26 16:08:29.761017 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759154 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 26 16:08:29.761017 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759156 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 26 16:08:29.761017 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759159 2560 feature_gate.go:328] unrecognized feature gate: DualReplica May 26 16:08:29.761017 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759162 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 26 16:08:29.761017 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759165 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 26 16:08:29.761017 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759167 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 26 16:08:29.761017 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759170 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages May 26 16:08:29.761017 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759172 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 26 16:08:29.761017 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759175 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 26 16:08:29.761017 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759177 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 26 16:08:29.761531 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759180 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 26 16:08:29.761531 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759182 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 26 16:08:29.761531 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759185 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 26 16:08:29.761531 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759187 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 26 16:08:29.761531 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759190 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 26 16:08:29.761531 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759192 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 26 16:08:29.761531 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759194 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 26 16:08:29.761531 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759197 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 26 16:08:29.761531 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759199 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 26 16:08:29.761531 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759202 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 26 16:08:29.761531 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759205 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 26 16:08:29.761531 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759210 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 26 16:08:29.761531 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759213 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 26 16:08:29.761531 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759216 2560 feature_gate.go:328] unrecognized feature gate: Example May 26 16:08:29.761531 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759219 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 26 16:08:29.761531 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759223 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 26 16:08:29.761531 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759226 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 26 16:08:29.761531 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759228 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 26 16:08:29.761531 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759231 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 26 16:08:29.762022 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759234 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 26 16:08:29.762022 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759237 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 26 16:08:29.762022 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759239 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 26 16:08:29.762022 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759242 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 26 16:08:29.762022 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759244 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 26 16:08:29.762022 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759247 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 26 16:08:29.762022 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759249 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 26 16:08:29.762022 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759252 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 26 16:08:29.762022 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759254 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 26 16:08:29.762022 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759257 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 26 16:08:29.762022 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759260 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 26 16:08:29.762022 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759262 2560 feature_gate.go:328] unrecognized feature gate: NewOLM May 26 16:08:29.762022 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759264 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 26 16:08:29.762022 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759267 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 26 16:08:29.762022 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759269 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 26 16:08:29.762022 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759273 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 26 16:08:29.762022 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759275 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 26 16:08:29.762022 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759278 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 26 16:08:29.762022 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759280 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 26 16:08:29.762022 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759283 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 26 16:08:29.762516 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759285 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability May 26 16:08:29.762516 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759288 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 26 16:08:29.762516 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759290 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 26 16:08:29.762516 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759293 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 26 16:08:29.762516 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759295 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 26 16:08:29.762516 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759298 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 26 16:08:29.762516 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759300 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 26 16:08:29.762516 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759303 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 26 16:08:29.762516 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759305 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 26 16:08:29.762516 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.759308 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 26 16:08:29.762516 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759372 2560 flags.go:64] FLAG: --address="0.0.0.0" May 26 16:08:29.762516 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759380 2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 26 16:08:29.762516 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759395 2560 flags.go:64] FLAG: --anonymous-auth="true" May 26 16:08:29.762516 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759399 2560 flags.go:64] FLAG: --application-metrics-count-limit="100" May 26 16:08:29.762516 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759404 2560 flags.go:64] FLAG: --authentication-token-webhook="false" May 26 16:08:29.762516 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759408 2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 26 16:08:29.762516 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759417 2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 26 16:08:29.762516 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759422 2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 26 16:08:29.762516 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759441 2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 26 16:08:29.762516 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759446 2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 26 16:08:29.762516 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759451 2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 26 16:08:29.763056 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759456 2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 26 16:08:29.763056 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759460 2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 26 16:08:29.763056 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759463 2560 flags.go:64] FLAG: --cgroup-root="" May 26 16:08:29.763056 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759466 2560 flags.go:64] FLAG: --cgroups-per-qos="true" May 26 16:08:29.763056 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759469 2560 flags.go:64] FLAG: --client-ca-file="" May 26 16:08:29.763056 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759472 2560 flags.go:64] FLAG: --cloud-config="" May 26 16:08:29.763056 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759475 2560 flags.go:64] FLAG: --cloud-provider="external" May 26 16:08:29.763056 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759478 2560 flags.go:64] FLAG: --cluster-dns="[]" May 26 16:08:29.763056 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759482 2560 flags.go:64] FLAG: --cluster-domain="" May 26 16:08:29.763056 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759485 2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 26 16:08:29.763056 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759488 2560 flags.go:64] FLAG: --config-dir="" May 26 16:08:29.763056 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759491 2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 26 16:08:29.763056 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759495 2560 flags.go:64] FLAG: --container-log-max-files="5" May 26 16:08:29.763056 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759499 2560 flags.go:64] FLAG: --container-log-max-size="10Mi" May 26 16:08:29.763056 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759502 2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 26 16:08:29.763056 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759506 2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 26 16:08:29.763056 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759509 2560 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 26 16:08:29.763056 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759512 2560 flags.go:64] FLAG: --contention-profiling="false" May 26 16:08:29.763056 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759515 2560 flags.go:64] FLAG: --cpu-cfs-quota="true" May 26 16:08:29.763056 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759519 2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 26 16:08:29.763056 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759522 2560 flags.go:64] FLAG: --cpu-manager-policy="none" May 26 16:08:29.763056 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759525 2560 flags.go:64] FLAG: --cpu-manager-policy-options="" May 26 16:08:29.763056 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759529 2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 26 16:08:29.763056 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759532 2560 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 26 16:08:29.763056 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759535 2560 flags.go:64] FLAG: --enable-debugging-handlers="true" May 26 16:08:29.763674 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759537 2560 flags.go:64] FLAG: --enable-load-reader="false" May 26 16:08:29.763674 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759541 2560 flags.go:64] FLAG: --enable-server="true" May 26 16:08:29.763674 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759546 2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 26 16:08:29.763674 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759552 2560 flags.go:64] FLAG: --event-burst="100" May 26 16:08:29.763674 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759556 2560 flags.go:64] FLAG: --event-qps="50" May 26 16:08:29.763674 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759559 2560 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 26 16:08:29.763674 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759562 2560 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 26 16:08:29.763674 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759565 2560 flags.go:64] FLAG: --eviction-hard="" May 26 16:08:29.763674 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759568 2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 26 16:08:29.763674 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759571 2560 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 26 16:08:29.763674 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759574 2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 26 16:08:29.763674 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759578 2560 flags.go:64] FLAG: --eviction-soft="" May 26 16:08:29.763674 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759581 2560 flags.go:64] FLAG: --eviction-soft-grace-period="" May 26 16:08:29.763674 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759584 2560 flags.go:64] FLAG: --exit-on-lock-contention="false" May 26 16:08:29.763674 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759586 2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 26 16:08:29.763674 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759589 2560 flags.go:64] FLAG: --experimental-mounter-path="" May 26 16:08:29.763674 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759592 2560 flags.go:64] FLAG: --fail-cgroupv1="false" May 26 16:08:29.763674 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759595 2560 flags.go:64] FLAG: --fail-swap-on="true" May 26 16:08:29.763674 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759598 2560 flags.go:64] FLAG: --feature-gates="" May 26 16:08:29.763674 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759603 2560 flags.go:64] FLAG: --file-check-frequency="20s" May 26 16:08:29.763674 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759606 2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 26 16:08:29.763674 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759609 2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 26 16:08:29.763674 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759612 2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 26 16:08:29.763674 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759616 2560 flags.go:64] FLAG: --healthz-port="10248" May 26 16:08:29.763674 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759619 2560 flags.go:64] FLAG: --help="false" May 26 16:08:29.764313 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759622 2560 flags.go:64] FLAG: --hostname-override="ip-10-0-142-102.ec2.internal" May 26 16:08:29.764313 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759625 2560 flags.go:64] FLAG: --housekeeping-interval="10s" May 26 16:08:29.764313 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759628 2560 flags.go:64] FLAG: --http-check-frequency="20s" May 26 16:08:29.764313 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759631 2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 26 16:08:29.764313 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759634 2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 26 16:08:29.764313 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759638 2560 flags.go:64] FLAG: --image-gc-high-threshold="85" May 26 16:08:29.764313 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759641 2560 flags.go:64] FLAG: --image-gc-low-threshold="80" May 26 16:08:29.764313 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759644 2560 flags.go:64] FLAG: --image-service-endpoint="" May 26 16:08:29.764313 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759646 2560 flags.go:64] FLAG: --kernel-memcg-notification="false" May 26 16:08:29.764313 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759652 2560 flags.go:64] FLAG: --kube-api-burst="100" May 26 16:08:29.764313 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759655 2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 26 16:08:29.764313 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759658 2560 flags.go:64] FLAG: --kube-api-qps="50" May 26 16:08:29.764313 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759661 2560 flags.go:64] FLAG: --kube-reserved="" May 26 16:08:29.764313 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759664 2560 flags.go:64] FLAG: --kube-reserved-cgroup="" May 26 16:08:29.764313 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759667 2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 26 16:08:29.764313 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759670 2560 flags.go:64] FLAG: --kubelet-cgroups="" May 26 16:08:29.764313 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759673 2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 26 16:08:29.764313 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759676 2560 flags.go:64] FLAG: --lock-file="" May 26 16:08:29.764313 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759679 2560 flags.go:64] FLAG: --log-cadvisor-usage="false" May 26 16:08:29.764313 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759683 2560 flags.go:64] FLAG: --log-flush-frequency="5s" May 26 16:08:29.764313 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759686 2560 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 26 16:08:29.764313 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759691 2560 flags.go:64] FLAG: --log-json-split-stream="false" May 26 16:08:29.764313 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759694 2560 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 26 16:08:29.764893 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759697 2560 flags.go:64] FLAG: --log-text-split-stream="false" May 26 16:08:29.764893 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759700 2560 flags.go:64] FLAG: --logging-format="text" May 26 16:08:29.764893 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759703 2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 26 16:08:29.764893 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759707 2560 flags.go:64] FLAG: --make-iptables-util-chains="true" May 26 16:08:29.764893 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759709 2560 flags.go:64] FLAG: --manifest-url="" May 26 16:08:29.764893 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759713 2560 flags.go:64] FLAG: --manifest-url-header="" May 26 16:08:29.764893 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759718 2560 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 26 16:08:29.764893 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759721 2560 flags.go:64] FLAG: --max-open-files="1000000" May 26 16:08:29.764893 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759725 2560 flags.go:64] FLAG: --max-pods="110" May 26 16:08:29.764893 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759728 2560 flags.go:64] FLAG: --maximum-dead-containers="-1" May 26 16:08:29.764893 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759731 2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 26 16:08:29.764893 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759734 2560 flags.go:64] FLAG: --memory-manager-policy="None" May 26 16:08:29.764893 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759737 2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 26 16:08:29.764893 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759740 2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 26 16:08:29.764893 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759743 2560 flags.go:64] FLAG: --node-ip="0.0.0.0" May 26 16:08:29.764893 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759746 2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 26 16:08:29.764893 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759754 2560 flags.go:64] FLAG: --node-status-max-images="50" May 26 16:08:29.764893 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759758 2560 flags.go:64] FLAG: --node-status-update-frequency="10s" May 26 16:08:29.764893 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759762 2560 flags.go:64] FLAG: --oom-score-adj="-999" May 26 16:08:29.764893 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759766 2560 flags.go:64] FLAG: --pod-cidr="" May 26 16:08:29.764893 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759769 2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 26 16:08:29.764893 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759774 2560 flags.go:64] FLAG: --pod-manifest-path="" May 26 16:08:29.764893 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759777 2560 flags.go:64] FLAG: --pod-max-pids="-1" May 26 16:08:29.764893 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759781 2560 flags.go:64] FLAG: --pods-per-core="0" May 26 16:08:29.765514 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759784 2560 flags.go:64] FLAG: --port="10250" May 26 16:08:29.765514 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759787 2560 flags.go:64] FLAG: --protect-kernel-defaults="false" May 26 16:08:29.765514 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759790 2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-081308d61c0154382" May 26 16:08:29.765514 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759794 2560 flags.go:64] FLAG: --qos-reserved="" May 26 16:08:29.765514 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759796 2560 flags.go:64] FLAG: --read-only-port="10255" May 26 16:08:29.765514 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759799 2560 flags.go:64] FLAG: --register-node="true" May 26 16:08:29.765514 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759802 2560 flags.go:64] FLAG: --register-schedulable="true" May 26 16:08:29.765514 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759805 2560 flags.go:64] FLAG: --register-with-taints="" May 26 16:08:29.765514 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759809 2560 flags.go:64] FLAG: --registry-burst="10" May 26 16:08:29.765514 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759812 2560 flags.go:64] FLAG: --registry-qps="5" May 26 16:08:29.765514 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759815 2560 flags.go:64] FLAG: --reserved-cpus="" May 26 16:08:29.765514 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759818 2560 flags.go:64] FLAG: --reserved-memory="" May 26 16:08:29.765514 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759821 2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 26 16:08:29.765514 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759825 2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 26 16:08:29.765514 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759828 2560 flags.go:64] FLAG: --rotate-certificates="false" May 26 16:08:29.765514 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759831 2560 flags.go:64] FLAG: --rotate-server-certificates="false" May 26 16:08:29.765514 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759834 2560 flags.go:64] FLAG: --runonce="false" May 26 16:08:29.765514 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759837 2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 26 16:08:29.765514 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759840 2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 26 16:08:29.765514 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759843 2560 flags.go:64] FLAG: --seccomp-default="false" May 26 16:08:29.765514 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759846 2560 flags.go:64] FLAG: --serialize-image-pulls="true" May 26 16:08:29.765514 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759849 2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 26 16:08:29.765514 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759852 2560 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 26 16:08:29.765514 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759856 2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 26 16:08:29.765514 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759859 2560 flags.go:64] FLAG: --storage-driver-password="root" May 26 16:08:29.765514 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759862 2560 flags.go:64] FLAG: --storage-driver-secure="false" May 26 16:08:29.766302 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759865 2560 flags.go:64] FLAG: --storage-driver-table="stats" May 26 16:08:29.766302 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759869 2560 flags.go:64] FLAG: --storage-driver-user="root" May 26 16:08:29.766302 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759873 2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 26 16:08:29.766302 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759876 2560 flags.go:64] FLAG: --sync-frequency="1m0s" May 26 16:08:29.766302 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759879 2560 flags.go:64] FLAG: --system-cgroups="" May 26 16:08:29.766302 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759882 2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 26 16:08:29.766302 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759887 2560 flags.go:64] FLAG: --system-reserved-cgroup="" May 26 16:08:29.766302 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759890 2560 flags.go:64] FLAG: --tls-cert-file="" May 26 16:08:29.766302 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759893 2560 flags.go:64] FLAG: --tls-cipher-suites="[]" May 26 16:08:29.766302 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759897 2560 flags.go:64] FLAG: --tls-min-version="" May 26 16:08:29.766302 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759900 2560 flags.go:64] FLAG: --tls-private-key-file="" May 26 16:08:29.766302 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759902 2560 flags.go:64] FLAG: --topology-manager-policy="none" May 26 16:08:29.766302 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759905 2560 flags.go:64] FLAG: --topology-manager-policy-options="" May 26 16:08:29.766302 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759908 2560 flags.go:64] FLAG: --topology-manager-scope="container" May 26 16:08:29.766302 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759911 2560 flags.go:64] FLAG: --v="2" May 26 16:08:29.766302 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759916 2560 flags.go:64] FLAG: --version="false" May 26 16:08:29.766302 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759920 2560 flags.go:64] FLAG: --vmodule="" May 26 16:08:29.766302 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759924 2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 26 16:08:29.766302 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.759928 2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 26 16:08:29.766302 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760022 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 26 16:08:29.766302 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760025 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 26 16:08:29.766302 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760028 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 26 16:08:29.766302 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760031 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 26 16:08:29.766302 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760035 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 26 16:08:29.766901 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760038 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 26 16:08:29.766901 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760041 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 26 16:08:29.766901 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760043 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 26 16:08:29.766901 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760047 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 26 16:08:29.766901 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760050 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 26 16:08:29.766901 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760053 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 26 16:08:29.766901 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760056 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 26 16:08:29.766901 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760058 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 26 16:08:29.766901 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760062 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 26 16:08:29.766901 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760067 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 26 16:08:29.766901 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760071 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 26 16:08:29.766901 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760074 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 26 16:08:29.766901 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760077 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 26 16:08:29.766901 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760079 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 26 16:08:29.766901 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760083 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 26 16:08:29.766901 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760086 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 26 16:08:29.766901 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760088 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 26 16:08:29.766901 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760091 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 26 16:08:29.766901 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760093 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 26 16:08:29.767385 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760096 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 26 16:08:29.767385 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760099 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 26 16:08:29.767385 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760101 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 26 16:08:29.767385 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760104 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 26 16:08:29.767385 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760106 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 26 16:08:29.767385 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760109 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 26 16:08:29.767385 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760111 2560 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 26 16:08:29.767385 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760114 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 26 16:08:29.767385 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760117 2560 feature_gate.go:328] unrecognized feature gate: Example2 May 26 16:08:29.767385 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760119 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 26 16:08:29.767385 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760122 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 26 16:08:29.767385 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760125 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 26 16:08:29.767385 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760127 2560 feature_gate.go:328] unrecognized feature gate: DualReplica May 26 16:08:29.767385 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760130 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 26 16:08:29.767385 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760132 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 26 16:08:29.767385 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760135 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 26 16:08:29.767385 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760137 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 26 16:08:29.767385 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760140 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 26 16:08:29.767385 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760143 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 26 16:08:29.767385 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760145 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 26 16:08:29.767901 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760149 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 26 16:08:29.767901 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760153 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 26 16:08:29.767901 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760157 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 26 16:08:29.767901 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760160 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 26 16:08:29.767901 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760163 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 26 16:08:29.767901 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760165 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 26 16:08:29.767901 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760169 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 26 16:08:29.767901 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760172 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 26 16:08:29.767901 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760174 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 26 16:08:29.767901 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760177 2560 feature_gate.go:328] unrecognized feature gate: Example May 26 16:08:29.767901 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760179 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 26 16:08:29.767901 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760182 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 26 16:08:29.767901 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760185 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 26 16:08:29.767901 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760187 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 26 16:08:29.767901 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760190 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 26 16:08:29.767901 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760192 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 26 16:08:29.767901 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760195 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 26 16:08:29.767901 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760197 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 26 16:08:29.767901 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760200 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 26 16:08:29.768361 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760202 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 26 16:08:29.768361 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760205 2560 feature_gate.go:328] unrecognized feature gate: NewOLM May 26 16:08:29.768361 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760207 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 26 16:08:29.768361 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760210 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 26 16:08:29.768361 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760213 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 26 16:08:29.768361 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760215 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 26 16:08:29.768361 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760218 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 26 16:08:29.768361 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760221 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 26 16:08:29.768361 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760223 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores May 26 16:08:29.768361 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760226 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 26 16:08:29.768361 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760228 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 26 16:08:29.768361 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760231 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability May 26 16:08:29.768361 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760233 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 26 16:08:29.768361 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760236 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 26 16:08:29.768361 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760238 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 26 16:08:29.768361 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760243 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 26 16:08:29.768361 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760245 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 26 16:08:29.768361 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760248 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 26 16:08:29.768361 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760250 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages May 26 16:08:29.768361 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760254 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 26 16:08:29.768892 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760257 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 26 16:08:29.768892 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760259 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 26 16:08:29.768892 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.760262 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 26 16:08:29.768892 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.760908 2560 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 26 16:08:29.768892 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.767578 2560 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 26 16:08:29.768892 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.767599 2560 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 26 16:08:29.768892 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767656 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 26 16:08:29.768892 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767661 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 26 16:08:29.768892 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767664 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 26 16:08:29.768892 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767668 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 26 16:08:29.768892 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767671 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 26 16:08:29.768892 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767674 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 26 16:08:29.768892 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767677 2560 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 26 16:08:29.768892 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767680 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 26 16:08:29.768892 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767683 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 26 16:08:29.768892 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767686 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 26 16:08:29.769340 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767689 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 26 16:08:29.769340 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767692 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 26 16:08:29.769340 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767695 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 26 16:08:29.769340 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767697 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 26 16:08:29.769340 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767700 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 26 16:08:29.769340 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767703 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability May 26 16:08:29.769340 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767705 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 26 16:08:29.769340 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767708 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 26 16:08:29.769340 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767711 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 26 16:08:29.769340 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767713 2560 feature_gate.go:328] unrecognized feature gate: DualReplica May 26 16:08:29.769340 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767716 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 26 16:08:29.769340 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767720 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 26 16:08:29.769340 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767725 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 26 16:08:29.769340 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767728 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 26 16:08:29.769340 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767731 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 26 16:08:29.769340 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767733 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 26 16:08:29.769340 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767736 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 26 16:08:29.769340 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767738 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 26 16:08:29.769340 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767741 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 26 16:08:29.769340 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767743 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores May 26 16:08:29.769859 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767746 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 26 16:08:29.769859 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767751 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 26 16:08:29.769859 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767753 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 26 16:08:29.769859 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767756 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 26 16:08:29.769859 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767759 2560 feature_gate.go:328] unrecognized feature gate: NewOLM May 26 16:08:29.769859 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767761 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 26 16:08:29.769859 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767764 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 26 16:08:29.769859 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767766 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 26 16:08:29.769859 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767769 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 26 16:08:29.769859 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767772 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 26 16:08:29.769859 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767774 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 26 16:08:29.769859 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767777 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 26 16:08:29.769859 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767780 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 26 16:08:29.769859 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767782 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 26 16:08:29.769859 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767786 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 26 16:08:29.769859 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767790 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 26 16:08:29.769859 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767793 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 26 16:08:29.769859 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767795 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 26 16:08:29.769859 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767798 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 26 16:08:29.769859 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767801 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 26 16:08:29.770362 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767803 2560 feature_gate.go:328] unrecognized feature gate: Example2 May 26 16:08:29.770362 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767806 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 26 16:08:29.770362 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767809 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 26 16:08:29.770362 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767811 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 26 16:08:29.770362 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767814 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 26 16:08:29.770362 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767816 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 26 16:08:29.770362 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767819 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 26 16:08:29.770362 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767821 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 26 16:08:29.770362 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767823 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 26 16:08:29.770362 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767826 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 26 16:08:29.770362 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767829 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 26 16:08:29.770362 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767831 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 26 16:08:29.770362 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767834 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 26 16:08:29.770362 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767837 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 26 16:08:29.770362 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767844 2560 feature_gate.go:328] unrecognized feature gate: Example May 26 16:08:29.770362 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767846 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 26 16:08:29.770362 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767849 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 26 16:08:29.770362 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767852 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 26 16:08:29.770362 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767854 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 26 16:08:29.770859 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767857 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 26 16:08:29.770859 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767859 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 26 16:08:29.770859 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767862 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 26 16:08:29.770859 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767864 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 26 16:08:29.770859 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767866 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 26 16:08:29.770859 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767869 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 26 16:08:29.770859 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767872 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 26 16:08:29.770859 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767874 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages May 26 16:08:29.770859 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767876 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 26 16:08:29.770859 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767879 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 26 16:08:29.770859 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767881 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 26 16:08:29.770859 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767884 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 26 16:08:29.770859 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767886 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 26 16:08:29.770859 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767889 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 26 16:08:29.770859 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767891 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 26 16:08:29.770859 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767894 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 26 16:08:29.770859 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.767896 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 26 16:08:29.771276 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.767901 2560 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 26 16:08:29.771276 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768008 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 26 16:08:29.771276 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768013 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 26 16:08:29.771276 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768016 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 26 16:08:29.771276 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768019 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 26 16:08:29.771276 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768022 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 26 16:08:29.771276 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768025 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 26 16:08:29.771276 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768028 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 26 16:08:29.771276 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768031 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 26 16:08:29.771276 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768033 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 26 16:08:29.771276 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768036 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 26 16:08:29.771276 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768040 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 26 16:08:29.771276 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768042 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 26 16:08:29.771276 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768045 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 26 16:08:29.771276 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768048 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 26 16:08:29.771662 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768052 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 26 16:08:29.771662 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768056 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 26 16:08:29.771662 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768059 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 26 16:08:29.771662 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768062 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 26 16:08:29.771662 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768065 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 26 16:08:29.771662 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768068 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 26 16:08:29.771662 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768070 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 26 16:08:29.771662 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768072 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 26 16:08:29.771662 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768075 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 26 16:08:29.771662 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768078 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 26 16:08:29.771662 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768080 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 26 16:08:29.771662 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768083 2560 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 26 16:08:29.771662 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768085 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 26 16:08:29.771662 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768087 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 26 16:08:29.771662 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768090 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 26 16:08:29.771662 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768093 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability May 26 16:08:29.771662 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768095 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 26 16:08:29.771662 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768097 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 26 16:08:29.771662 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768100 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores May 26 16:08:29.772139 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768102 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 26 16:08:29.772139 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768105 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 26 16:08:29.772139 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768107 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 26 16:08:29.772139 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768110 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 26 16:08:29.772139 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768112 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 26 16:08:29.772139 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768115 2560 feature_gate.go:328] unrecognized feature gate: NewOLM May 26 16:08:29.772139 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768117 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages May 26 16:08:29.772139 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768120 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 26 16:08:29.772139 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768123 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 26 16:08:29.772139 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768126 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 26 16:08:29.772139 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768130 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 26 16:08:29.772139 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768134 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 26 16:08:29.772139 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768137 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 26 16:08:29.772139 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768140 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 26 16:08:29.772139 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768143 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 26 16:08:29.772139 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768145 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 26 16:08:29.772139 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768148 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 26 16:08:29.772139 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768151 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 26 16:08:29.772139 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768154 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 26 16:08:29.772705 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768156 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 26 16:08:29.772705 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768159 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 26 16:08:29.772705 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768162 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 26 16:08:29.772705 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768164 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 26 16:08:29.772705 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768167 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 26 16:08:29.772705 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768170 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 26 16:08:29.772705 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768172 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 26 16:08:29.772705 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768175 2560 feature_gate.go:328] unrecognized feature gate: Example2 May 26 16:08:29.772705 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768178 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 26 16:08:29.772705 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768181 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 26 16:08:29.772705 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768184 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 26 16:08:29.772705 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768186 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 26 16:08:29.772705 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768189 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 26 16:08:29.772705 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768191 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 26 16:08:29.772705 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768194 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 26 16:08:29.772705 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768196 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 26 16:08:29.772705 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768199 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 26 16:08:29.772705 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768201 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 26 16:08:29.772705 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768204 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 26 16:08:29.773157 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768206 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 26 16:08:29.773157 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768209 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 26 16:08:29.773157 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768212 2560 feature_gate.go:328] unrecognized feature gate: Example May 26 16:08:29.773157 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768215 2560 feature_gate.go:328] unrecognized feature gate: DualReplica May 26 16:08:29.773157 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768217 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 26 16:08:29.773157 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768220 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 26 16:08:29.773157 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768223 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 26 16:08:29.773157 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768225 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 26 16:08:29.773157 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768228 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 26 16:08:29.773157 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768230 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 26 16:08:29.773157 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768233 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 26 16:08:29.773157 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768235 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 26 16:08:29.773157 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768238 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 26 16:08:29.773157 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768240 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 26 16:08:29.773157 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:29.768243 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 26 16:08:29.773157 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.768247 2560 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 26 16:08:29.773592 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.768922 2560 server.go:962] "Client rotation is on, will bootstrap in background" May 26 16:08:29.773592 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.773552 2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 26 16:08:29.774489 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.774477 2560 server.go:1019] "Starting client certificate rotation" May 26 16:08:29.774623 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.774605 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 26 16:08:29.774683 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.774654 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 26 16:08:29.794678 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.794654 2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 26 16:08:29.796474 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.796447 2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 26 16:08:29.809568 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.809544 2560 log.go:25] "Validated CRI v1 runtime API" May 26 16:08:29.815890 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.815873 2560 log.go:25] "Validated CRI v1 image API" May 26 16:08:29.817296 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.817280 2560 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 26 16:08:29.819840 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.819807 2560 fs.go:135] Filesystem UUIDs: map[420c08a4-d938-4121-9e09-6545ab7f478b:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f41869c4-fef1-4092-87b7-a3afd3fde216:/dev/nvme0n1p3] May 26 16:08:29.819917 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.819838 2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 26 16:08:29.824497 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.824366 2560 manager.go:217] Machine: {Timestamp:2026-05-26 16:08:29.823845699 +0000 UTC m=+0.354339298 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101633 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec285755a0e5d2a6a5ea3c129585f675 SystemUUID:ec285755-a0e5-d2a6-a5ea-3c129585f675 BootID:1f469c0c-5be2-4f02-b506-a88c7d73d4a0 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f8:b4:b6:69:b7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f8:b4:b6:69:b7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:16:94:33:65:45:3a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 26 16:08:29.825226 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.825215 2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 26 16:08:29.825312 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.825300 2560 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 26 16:08:29.826057 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.826043 2560 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 26 16:08:29.829086 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.829055 2560 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 26 16:08:29.829238 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.829089 2560 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-102.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 26 16:08:29.829288 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.829248 2560 topology_manager.go:138] "Creating topology manager with none policy" May 26 16:08:29.829288 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.829256 2560 container_manager_linux.go:306] "Creating device plugin manager" May 26 16:08:29.829288 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.829264 2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 26 16:08:29.830198 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.830188 2560 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 26 16:08:29.833098 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.833087 2560 state_mem.go:36] "Initialized new in-memory state store" May 26 16:08:29.833368 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.833359 2560 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 26 16:08:29.836321 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.836310 2560 kubelet.go:491] "Attempting to sync node with API server" May 26 16:08:29.836358 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.836325 2560 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 26 16:08:29.836358 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.836338 2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 26 16:08:29.836358 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.836346 2560 kubelet.go:397] "Adding apiserver pod source" May 26 16:08:29.836358 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.836355 2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 26 16:08:29.837661 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.837649 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 26 16:08:29.837711 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.837668 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 26 16:08:29.840938 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.840920 2560 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 26 16:08:29.843224 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.843211 2560 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 26 16:08:29.844140 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.844127 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 26 16:08:29.844140 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.844143 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 26 16:08:29.844239 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.844149 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 26 16:08:29.844239 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.844155 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 26 16:08:29.844239 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.844163 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 26 16:08:29.844239 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.844169 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 26 16:08:29.844239 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.844175 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 26 16:08:29.844239 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.844180 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 26 16:08:29.844239 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.844187 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 26 16:08:29.844239 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.844193 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 26 16:08:29.844239 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.844202 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 26 16:08:29.844685 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.844676 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 26 16:08:29.845488 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.845479 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 26 16:08:29.845519 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.845489 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 26 16:08:29.847419 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.847403 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hr6xn" May 26 16:08:29.848870 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.848858 2560 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 26 16:08:29.848905 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.848899 2560 server.go:1295] "Started kubelet" May 26 16:08:29.848982 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.848946 2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 26 16:08:29.849050 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.848992 2560 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 26 16:08:29.850648 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.850621 2560 server_v1.go:47] "podresources" method="list" useActivePods=true May 26 16:08:29.850723 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.850712 2560 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-102.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 26 16:08:29.850862 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:29.850838 2560 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 26 16:08:29.850973 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:29.850956 2560 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-102.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 26 16:08:29.851311 ip-10-0-142-102 systemd[1]: Started Kubernetes Kubelet. May 26 16:08:29.852446 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.852355 2560 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 26 16:08:29.853772 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.853741 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hr6xn" May 26 16:08:29.855089 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.855072 2560 server.go:317] "Adding debug handlers to kubelet server" May 26 16:08:29.859116 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:29.858023 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-102.ec2.internal.18b32951fc9f640e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-102.ec2.internal,UID:ip-10-0-142-102.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-102.ec2.internal,},FirstTimestamp:2026-05-26 16:08:29.84887195 +0000 UTC m=+0.379365549,LastTimestamp:2026-05-26 16:08:29.84887195 +0000 UTC m=+0.379365549,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-102.ec2.internal,}" May 26 16:08:29.863121 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:29.863083 2560 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 26 16:08:29.864108 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.864092 2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 26 16:08:29.864173 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.864114 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 26 16:08:29.864269 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.864221 2560 volume_manager.go:295] "The desired_state_of_world populator starts" May 26 16:08:29.864269 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.864236 2560 volume_manager.go:297] "Starting Kubelet Volume Manager" May 26 16:08:29.864375 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.864359 2560 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 26 16:08:29.864456 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.864423 2560 reconstruct.go:97] "Volume reconstruction finished" May 26 16:08:29.864456 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.864453 2560 reconciler.go:26] "Reconciler: start to sync state" May 26 16:08:29.865116 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.865089 2560 factory.go:55] Registering systemd factory May 26 16:08:29.865203 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.865142 2560 factory.go:223] Registration of the systemd container factory successfully May 26 16:08:29.865339 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:29.865305 2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-102.ec2.internal\" not found" May 26 16:08:29.865339 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.865324 2560 factory.go:153] Registering CRI-O factory May 26 16:08:29.865510 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.865350 2560 factory.go:223] Registration of the crio container factory successfully May 26 16:08:29.865510 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.865419 2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 26 16:08:29.865510 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.865461 2560 factory.go:103] Registering Raw factory May 26 16:08:29.865510 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.865477 2560 manager.go:1196] Started watching for new ooms in manager May 26 16:08:29.865927 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.865914 2560 manager.go:319] Starting recovery of all containers May 26 16:08:29.875596 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.875393 2560 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 26 16:08:29.875705 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.875655 2560 manager.go:324] Recovery completed May 26 16:08:29.877598 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:29.877580 2560 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-142-102.ec2.internal\" not found" node="ip-10-0-142-102.ec2.internal" May 26 16:08:29.880292 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.880280 2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 16:08:29.882296 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.882280 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-102.ec2.internal" event="NodeHasSufficientMemory" May 26 16:08:29.882385 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.882308 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-102.ec2.internal" event="NodeHasNoDiskPressure" May 26 16:08:29.882385 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.882319 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-102.ec2.internal" event="NodeHasSufficientPID" May 26 16:08:29.882866 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.882853 2560 cpu_manager.go:222] "Starting CPU manager" policy="none" May 26 16:08:29.882932 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.882866 2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 26 16:08:29.882932 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.882886 2560 state_mem.go:36] "Initialized new in-memory state store" May 26 16:08:29.887100 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.887064 2560 policy_none.go:49] "None policy: Start" May 26 16:08:29.887221 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.887203 2560 memory_manager.go:186] "Starting memorymanager" policy="None" May 26 16:08:29.887307 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.887231 2560 state_mem.go:35] "Initializing new in-memory state store" May 26 16:08:29.929077 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.929064 2560 manager.go:341] "Starting Device Plugin manager" May 26 16:08:29.950156 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:29.929094 2560 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 26 16:08:29.950156 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.929104 2560 server.go:85] "Starting device plugin registration server" May 26 16:08:29.950156 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.929353 2560 eviction_manager.go:189] "Eviction manager: starting control loop" May 26 16:08:29.950156 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.929366 2560 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 26 16:08:29.950156 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.929525 2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 26 16:08:29.950156 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.929610 2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 26 16:08:29.950156 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:29.929619 2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 26 16:08:29.950156 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:29.930148 2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 26 16:08:29.950156 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:29.930185 2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-102.ec2.internal\" not found" May 26 16:08:30.001405 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:30.001328 2560 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 26 16:08:30.002596 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:30.002577 2560 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 26 16:08:30.002660 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:30.002613 2560 status_manager.go:230] "Starting to sync pod status with apiserver" May 26 16:08:30.002660 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:30.002640 2560 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 26 16:08:30.002660 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:30.002650 2560 kubelet.go:2451] "Starting kubelet main sync loop" May 26 16:08:30.002799 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:30.002698 2560 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 26 16:08:30.005682 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:30.005662 2560 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 26 16:08:30.029774 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:30.029740 2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 16:08:30.030998 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:30.030982 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-102.ec2.internal" event="NodeHasSufficientMemory" May 26 16:08:30.031093 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:30.031011 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-102.ec2.internal" event="NodeHasNoDiskPressure" May 26 16:08:30.031093 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:30.031022 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-102.ec2.internal" event="NodeHasSufficientPID" May 26 16:08:30.031093 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:30.031056 2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-102.ec2.internal" May 26 16:08:30.039688 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:30.039667 2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-102.ec2.internal" May 26 16:08:30.039775 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:30.039690 2560 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-102.ec2.internal\": node \"ip-10-0-142-102.ec2.internal\" not found" May 26 16:08:30.056964 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:30.056936 2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-102.ec2.internal\" not found" May 26 16:08:30.102881 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:30.102820 2560 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-102.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-102.ec2.internal"] May 26 16:08:30.102977 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:30.102932 2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 16:08:30.104696 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:30.104678 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-102.ec2.internal" event="NodeHasSufficientMemory" May 26 16:08:30.104770 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:30.104707 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-102.ec2.internal" event="NodeHasNoDiskPressure" May 26 16:08:30.104770 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:30.104717 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-102.ec2.internal" event="NodeHasSufficientPID" May 26 16:08:30.106011 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:30.105999 2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 16:08:30.106167 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:30.106153 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-102.ec2.internal" May 26 16:08:30.106212 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:30.106183 2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 16:08:30.106755 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:30.106735 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-102.ec2.internal" event="NodeHasSufficientMemory" May 26 16:08:30.106755 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:30.106747 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-102.ec2.internal" event="NodeHasSufficientMemory" May 26 16:08:30.106889 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:30.106768 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-102.ec2.internal" event="NodeHasNoDiskPressure" May 26 16:08:30.106889 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:30.106768 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-102.ec2.internal" event="NodeHasNoDiskPressure" May 26 16:08:30.106889 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:30.106781 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-102.ec2.internal" event="NodeHasSufficientPID" May 26 16:08:30.106889 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:30.106791 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-102.ec2.internal" event="NodeHasSufficientPID" May 26 16:08:30.107720 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:30.107706 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-102.ec2.internal" May 26 16:08:30.107782 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:30.107729 2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 16:08:30.108364 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:30.108344 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-102.ec2.internal" event="NodeHasSufficientMemory" May 26 16:08:30.108364 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:30.108368 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-102.ec2.internal" event="NodeHasNoDiskPressure" May 26 16:08:30.108507 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:30.108378 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-102.ec2.internal" event="NodeHasSufficientPID" May 26 16:08:30.136183 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:30.136157 2560 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-102.ec2.internal\" not found" node="ip-10-0-142-102.ec2.internal" May 26 16:08:30.140702 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:30.140684 2560 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-102.ec2.internal\" not found" node="ip-10-0-142-102.ec2.internal" May 26 16:08:30.157472 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:30.157451 2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-102.ec2.internal\" not found" May 26 16:08:30.166288 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:30.166263 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3fee12dcae6578402519bc5aede8750c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-102.ec2.internal\" (UID: \"3fee12dcae6578402519bc5aede8750c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-102.ec2.internal" May 26 16:08:30.166378 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:30.166290 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3fee12dcae6578402519bc5aede8750c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-102.ec2.internal\" (UID: \"3fee12dcae6578402519bc5aede8750c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-102.ec2.internal" May 26 16:08:30.166378 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:30.166310 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2e1cb75f0e94e5eb2d26b2c46dee4fa3-config\") pod \"kube-apiserver-proxy-ip-10-0-142-102.ec2.internal\" (UID: \"2e1cb75f0e94e5eb2d26b2c46dee4fa3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-102.ec2.internal" May 26 16:08:30.258240 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:30.258169 2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-102.ec2.internal\" not found" May 26 16:08:30.266524 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:30.266498 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3fee12dcae6578402519bc5aede8750c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-102.ec2.internal\" (UID: \"3fee12dcae6578402519bc5aede8750c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-102.ec2.internal" May 26 16:08:30.266665 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:30.266550 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3fee12dcae6578402519bc5aede8750c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-102.ec2.internal\" (UID: \"3fee12dcae6578402519bc5aede8750c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-102.ec2.internal" May 26 16:08:30.266665 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:30.266577 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2e1cb75f0e94e5eb2d26b2c46dee4fa3-config\") pod \"kube-apiserver-proxy-ip-10-0-142-102.ec2.internal\" (UID: \"2e1cb75f0e94e5eb2d26b2c46dee4fa3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-102.ec2.internal" May 26 16:08:30.266665 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:30.266504 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3fee12dcae6578402519bc5aede8750c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-102.ec2.internal\" (UID: \"3fee12dcae6578402519bc5aede8750c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-102.ec2.internal" May 26 16:08:30.266665 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:30.266641 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3fee12dcae6578402519bc5aede8750c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-102.ec2.internal\" (UID: \"3fee12dcae6578402519bc5aede8750c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-102.ec2.internal" May 26 16:08:30.266665 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:30.266646 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2e1cb75f0e94e5eb2d26b2c46dee4fa3-config\") pod \"kube-apiserver-proxy-ip-10-0-142-102.ec2.internal\" (UID: \"2e1cb75f0e94e5eb2d26b2c46dee4fa3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-102.ec2.internal" May 26 16:08:30.358904 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:30.358851 2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-102.ec2.internal\" not found" May 26 16:08:30.439321 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:30.439294 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-102.ec2.internal" May 26 16:08:30.444046 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:30.444029 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-102.ec2.internal" May 26 16:08:30.459074 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:30.459053 2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-102.ec2.internal\" not found" May 26 16:08:30.559637 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:30.559552 2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-102.ec2.internal\" not found" May 26 16:08:30.660074 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:30.660040 2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-102.ec2.internal\" not found" May 26 16:08:30.760635 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:30.760611 2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-102.ec2.internal\" not found" May 26 16:08:30.774071 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:30.774047 2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 26 16:08:30.774256 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:30.774238 2560 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 26 16:08:30.774256 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:30.774243 2560 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 26 16:08:30.857237 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:30.857146 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-25 16:03:29 +0000 UTC" deadline="2028-01-04 06:51:42.785977588 +0000 UTC" May 26 16:08:30.857237 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:30.857190 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14102h43m11.928790314s" May 26 16:08:30.861407 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:30.861385 2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-102.ec2.internal\" not found" May 26 16:08:30.864687 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:30.864672 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 26 16:08:30.874514 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:30.874488 2560 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 26 16:08:30.893785 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:30.893766 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7sk8f" May 26 16:08:30.905499 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:30.905472 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7sk8f" May 26 16:08:30.961983 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:30.961949 2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-102.ec2.internal\" not found" May 26 16:08:31.025903 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:31.025864 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fee12dcae6578402519bc5aede8750c.slice/crio-f69fec5d81b3e5e9dbff2d60241e11cbb78e3dbd5f7761b621c2ea75b2ec6390 WatchSource:0}: Error finding container f69fec5d81b3e5e9dbff2d60241e11cbb78e3dbd5f7761b621c2ea75b2ec6390: Status 404 returned error can't find the container with id f69fec5d81b3e5e9dbff2d60241e11cbb78e3dbd5f7761b621c2ea75b2ec6390 May 26 16:08:31.026146 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:31.026126 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e1cb75f0e94e5eb2d26b2c46dee4fa3.slice/crio-b5de0a40a84068124be2c21daa050cd44ad879e235dbc4f42e8a1a52793be30b WatchSource:0}: Error finding container b5de0a40a84068124be2c21daa050cd44ad879e235dbc4f42e8a1a52793be30b: Status 404 returned error can't find the container with id b5de0a40a84068124be2c21daa050cd44ad879e235dbc4f42e8a1a52793be30b May 26 16:08:31.030035 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.030020 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 26 16:08:31.062476 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:31.062445 2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-102.ec2.internal\" not found" May 26 16:08:31.163018 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:31.162953 2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-102.ec2.internal\" not found" May 26 16:08:31.263492 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:31.263445 2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-102.ec2.internal\" not found" May 26 16:08:31.357929 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.357907 2560 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 26 16:08:31.364286 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.364267 2560 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-102.ec2.internal" May 26 16:08:31.376323 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.376303 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 26 16:08:31.378283 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.378265 2560 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-102.ec2.internal" May 26 16:08:31.382900 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.382885 2560 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 26 16:08:31.386644 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.386629 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 26 16:08:31.823581 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.823548 2560 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 26 16:08:31.837739 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.837712 2560 apiserver.go:52] "Watching apiserver" May 26 16:08:31.845701 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.845675 2560 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 26 16:08:31.848245 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.848218 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-6kkzr","kube-system/kube-apiserver-proxy-ip-10-0-142-102.ec2.internal","openshift-dns/node-resolver-nqcwn","openshift-image-registry/node-ca-5rp4s","openshift-multus/multus-additional-cni-plugins-2r6kq","openshift-multus/multus-bqsfl","openshift-network-operator/iptables-alerter-45qvm","openshift-ovn-kubernetes/ovnkube-node-7xvh4","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cn7v","openshift-cluster-node-tuning-operator/tuned-vqcfh","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-102.ec2.internal","openshift-multus/network-metrics-daemon-ws4lv","openshift-network-diagnostics/network-check-target-ms765"] May 26 16:08:31.852821 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.852800 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-45qvm" May 26 16:08:31.855046 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.855018 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nqcwn" May 26 16:08:31.855151 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.855113 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5rp4s" May 26 16:08:31.855824 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.855800 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 26 16:08:31.855957 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.855888 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 26 16:08:31.856018 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.855994 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-2fnhx\"" May 26 16:08:31.856149 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.856106 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 26 16:08:31.857855 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.857760 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 26 16:08:31.858258 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.858241 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 26 16:08:31.858471 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.858455 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 26 16:08:31.858868 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.858843 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6xskk\"" May 26 16:08:31.858961 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.858875 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 26 16:08:31.858961 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.858880 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 26 16:08:31.858961 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.858881 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wcjqj\"" May 26 16:08:31.859281 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.859260 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2r6kq" May 26 16:08:31.859649 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.859574 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bqsfl" May 26 16:08:31.861623 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.861566 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 26 16:08:31.861812 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.861778 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 26 16:08:31.861925 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.861838 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 26 16:08:31.861925 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.861868 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6kkzr" May 26 16:08:31.862094 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.862074 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 26 16:08:31.862285 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.862164 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rqqcs\"" May 26 16:08:31.862285 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.862184 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 26 16:08:31.862285 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.862225 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-fmcfd\"" May 26 16:08:31.862285 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.862255 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 26 16:08:31.863880 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.863858 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.868556 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.867728 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jqcs6\"" May 26 16:08:31.868556 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.867767 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-pdgnc\"" May 26 16:08:31.868556 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.867952 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 26 16:08:31.868556 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.868222 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 26 16:08:31.868556 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.868364 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 26 16:08:31.868556 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.868393 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 26 16:08:31.868556 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.868458 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 26 16:08:31.868906 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.868763 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 26 16:08:31.868906 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.868867 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 26 16:08:31.869082 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.869062 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 26 16:08:31.870828 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.870810 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cn7v" May 26 16:08:31.873851 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.873289 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 26 16:08:31.873851 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.873587 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-crj2s\"" May 26 16:08:31.873851 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.873689 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 26 16:08:31.874007 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.873902 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vqcfh" May 26 16:08:31.874007 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.873986 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e88baa86-d2fb-4052-9453-0fb254a02aa1-host-run-netns\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.874105 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.874020 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e88baa86-d2fb-4052-9453-0fb254a02aa1-host-run-ovn-kubernetes\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.874105 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.874027 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ws4lv" May 26 16:08:31.874218 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:31.874100 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ws4lv" podUID="eec5f0e1-7fd2-4597-a1a0-3b5b10517934" May 26 16:08:31.874218 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.874047 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e88baa86-d2fb-4052-9453-0fb254a02aa1-env-overrides\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.874218 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.874167 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7848e219-3fad-4749-80de-651dc7faace5-multus-daemon-config\") pod \"multus-bqsfl\" (UID: \"7848e219-3fad-4749-80de-651dc7faace5\") " pod="openshift-multus/multus-bqsfl" May 26 16:08:31.874218 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.874197 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eae253a8-1f39-46f2-abe6-b677fff8aa74-os-release\") pod \"multus-additional-cni-plugins-2r6kq\" (UID: \"eae253a8-1f39-46f2-abe6-b677fff8aa74\") " pod="openshift-multus/multus-additional-cni-plugins-2r6kq" May 26 16:08:31.874440 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.874222 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e88baa86-d2fb-4052-9453-0fb254a02aa1-ovnkube-script-lib\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.874440 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.874247 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7848e219-3fad-4749-80de-651dc7faace5-cni-binary-copy\") pod \"multus-bqsfl\" (UID: \"7848e219-3fad-4749-80de-651dc7faace5\") " pod="openshift-multus/multus-bqsfl" May 26 16:08:31.874440 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.874272 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7848e219-3fad-4749-80de-651dc7faace5-multus-conf-dir\") pod \"multus-bqsfl\" (UID: \"7848e219-3fad-4749-80de-651dc7faace5\") " pod="openshift-multus/multus-bqsfl" May 26 16:08:31.874440 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.874295 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e88baa86-d2fb-4052-9453-0fb254a02aa1-host-kubelet\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.874440 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.874319 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7848e219-3fad-4749-80de-651dc7faace5-host-run-k8s-cni-cncf-io\") pod \"multus-bqsfl\" (UID: \"7848e219-3fad-4749-80de-651dc7faace5\") " pod="openshift-multus/multus-bqsfl" May 26 16:08:31.874440 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.874344 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/45ada7c3-c4cd-423d-b8b9-a3ed76d9e56e-agent-certs\") pod \"konnectivity-agent-6kkzr\" (UID: \"45ada7c3-c4cd-423d-b8b9-a3ed76d9e56e\") " pod="kube-system/konnectivity-agent-6kkzr" May 26 16:08:31.874440 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.874391 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/45ada7c3-c4cd-423d-b8b9-a3ed76d9e56e-konnectivity-ca\") pod \"konnectivity-agent-6kkzr\" (UID: \"45ada7c3-c4cd-423d-b8b9-a3ed76d9e56e\") " pod="kube-system/konnectivity-agent-6kkzr" May 26 16:08:31.874787 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.874465 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eae253a8-1f39-46f2-abe6-b677fff8aa74-cni-binary-copy\") pod \"multus-additional-cni-plugins-2r6kq\" (UID: \"eae253a8-1f39-46f2-abe6-b677fff8aa74\") " pod="openshift-multus/multus-additional-cni-plugins-2r6kq" May 26 16:08:31.874787 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.874506 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e88baa86-d2fb-4052-9453-0fb254a02aa1-run-openvswitch\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.874787 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.874533 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d3a8f3a-02fd-4849-a169-2b72451d600a-tmp-dir\") pod \"node-resolver-nqcwn\" (UID: \"2d3a8f3a-02fd-4849-a169-2b72451d600a\") " pod="openshift-dns/node-resolver-nqcwn" May 26 16:08:31.874787 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.874557 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7848e219-3fad-4749-80de-651dc7faace5-multus-cni-dir\") pod \"multus-bqsfl\" (UID: \"7848e219-3fad-4749-80de-651dc7faace5\") " pod="openshift-multus/multus-bqsfl" May 26 16:08:31.874787 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.874581 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7848e219-3fad-4749-80de-651dc7faace5-host-var-lib-cni-bin\") pod \"multus-bqsfl\" (UID: \"7848e219-3fad-4749-80de-651dc7faace5\") " pod="openshift-multus/multus-bqsfl" May 26 16:08:31.874787 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.874604 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ce8f2e7d-5806-41f9-aed0-49e4edec1092-serviceca\") pod \"node-ca-5rp4s\" (UID: \"ce8f2e7d-5806-41f9-aed0-49e4edec1092\") " pod="openshift-image-registry/node-ca-5rp4s" May 26 16:08:31.874787 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.874626 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e88baa86-d2fb-4052-9453-0fb254a02aa1-host-cni-netd\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.874787 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.874658 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8fb3d31f-2753-4592-a4da-a8cbf5a69a38-device-dir\") pod \"aws-ebs-csi-driver-node-4cn7v\" (UID: \"8fb3d31f-2753-4592-a4da-a8cbf5a69a38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cn7v" May 26 16:08:31.874787 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.874683 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9plpm\" (UniqueName: \"kubernetes.io/projected/8fb3d31f-2753-4592-a4da-a8cbf5a69a38-kube-api-access-9plpm\") pod \"aws-ebs-csi-driver-node-4cn7v\" (UID: \"8fb3d31f-2753-4592-a4da-a8cbf5a69a38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cn7v" May 26 16:08:31.874787 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.874707 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2d3a8f3a-02fd-4849-a169-2b72451d600a-hosts-file\") pod \"node-resolver-nqcwn\" (UID: \"2d3a8f3a-02fd-4849-a169-2b72451d600a\") " pod="openshift-dns/node-resolver-nqcwn" May 26 16:08:31.874787 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.874733 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/eae253a8-1f39-46f2-abe6-b677fff8aa74-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2r6kq\" (UID: \"eae253a8-1f39-46f2-abe6-b677fff8aa74\") " pod="openshift-multus/multus-additional-cni-plugins-2r6kq" May 26 16:08:31.874787 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.874759 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e88baa86-d2fb-4052-9453-0fb254a02aa1-run-ovn\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.874787 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.874787 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7848e219-3fad-4749-80de-651dc7faace5-host-run-multus-certs\") pod \"multus-bqsfl\" (UID: \"7848e219-3fad-4749-80de-651dc7faace5\") " pod="openshift-multus/multus-bqsfl" May 26 16:08:31.875409 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.874810 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e88baa86-d2fb-4052-9453-0fb254a02aa1-host-cni-bin\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.875409 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.874919 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5s5v\" (UniqueName: \"kubernetes.io/projected/e88baa86-d2fb-4052-9453-0fb254a02aa1-kube-api-access-c5s5v\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.875409 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.874955 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8fb3d31f-2753-4592-a4da-a8cbf5a69a38-socket-dir\") pod \"aws-ebs-csi-driver-node-4cn7v\" (UID: \"8fb3d31f-2753-4592-a4da-a8cbf5a69a38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cn7v" May 26 16:08:31.875409 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.874982 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pm554\" (UniqueName: \"kubernetes.io/projected/2d3a8f3a-02fd-4849-a169-2b72451d600a-kube-api-access-pm554\") pod \"node-resolver-nqcwn\" (UID: \"2d3a8f3a-02fd-4849-a169-2b72451d600a\") " pod="openshift-dns/node-resolver-nqcwn" May 26 16:08:31.875409 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.875008 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vw86q\" (UniqueName: \"kubernetes.io/projected/eae253a8-1f39-46f2-abe6-b677fff8aa74-kube-api-access-vw86q\") pod \"multus-additional-cni-plugins-2r6kq\" (UID: \"eae253a8-1f39-46f2-abe6-b677fff8aa74\") " pod="openshift-multus/multus-additional-cni-plugins-2r6kq" May 26 16:08:31.875409 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.875033 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e88baa86-d2fb-4052-9453-0fb254a02aa1-log-socket\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.875409 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.875058 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7848e219-3fad-4749-80de-651dc7faace5-system-cni-dir\") pod \"multus-bqsfl\" (UID: \"7848e219-3fad-4749-80de-651dc7faace5\") " pod="openshift-multus/multus-bqsfl" May 26 16:08:31.875409 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.875138 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7848e219-3fad-4749-80de-651dc7faace5-os-release\") pod \"multus-bqsfl\" (UID: \"7848e219-3fad-4749-80de-651dc7faace5\") " pod="openshift-multus/multus-bqsfl" May 26 16:08:31.875409 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.875217 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7848e219-3fad-4749-80de-651dc7faace5-host-var-lib-kubelet\") pod \"multus-bqsfl\" (UID: \"7848e219-3fad-4749-80de-651dc7faace5\") " pod="openshift-multus/multus-bqsfl" May 26 16:08:31.875409 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.875242 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm967\" (UniqueName: \"kubernetes.io/projected/7848e219-3fad-4749-80de-651dc7faace5-kube-api-access-hm967\") pod \"multus-bqsfl\" (UID: \"7848e219-3fad-4749-80de-651dc7faace5\") " pod="openshift-multus/multus-bqsfl" May 26 16:08:31.875409 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.875265 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b8045062-09e4-495a-ba60-aefc78dd16b7-iptables-alerter-script\") pod \"iptables-alerter-45qvm\" (UID: \"b8045062-09e4-495a-ba60-aefc78dd16b7\") " pod="openshift-network-operator/iptables-alerter-45qvm" May 26 16:08:31.875409 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.875287 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eae253a8-1f39-46f2-abe6-b677fff8aa74-cnibin\") pod \"multus-additional-cni-plugins-2r6kq\" (UID: \"eae253a8-1f39-46f2-abe6-b677fff8aa74\") " pod="openshift-multus/multus-additional-cni-plugins-2r6kq" May 26 16:08:31.875409 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.875311 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e88baa86-d2fb-4052-9453-0fb254a02aa1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.875409 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.875333 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7848e219-3fad-4749-80de-651dc7faace5-cnibin\") pod \"multus-bqsfl\" (UID: \"7848e219-3fad-4749-80de-651dc7faace5\") " pod="openshift-multus/multus-bqsfl" May 26 16:08:31.875409 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.875354 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7848e219-3fad-4749-80de-651dc7faace5-multus-socket-dir-parent\") pod \"multus-bqsfl\" (UID: \"7848e219-3fad-4749-80de-651dc7faace5\") " pod="openshift-multus/multus-bqsfl" May 26 16:08:31.876092 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.875417 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e88baa86-d2fb-4052-9453-0fb254a02aa1-node-log\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.876092 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.875466 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ce8f2e7d-5806-41f9-aed0-49e4edec1092-host\") pod \"node-ca-5rp4s\" (UID: \"ce8f2e7d-5806-41f9-aed0-49e4edec1092\") " pod="openshift-image-registry/node-ca-5rp4s" May 26 16:08:31.876092 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.875489 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/eae253a8-1f39-46f2-abe6-b677fff8aa74-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2r6kq\" (UID: \"eae253a8-1f39-46f2-abe6-b677fff8aa74\") " pod="openshift-multus/multus-additional-cni-plugins-2r6kq" May 26 16:08:31.876092 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.875514 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e88baa86-d2fb-4052-9453-0fb254a02aa1-systemd-units\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.876092 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.875561 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e88baa86-d2fb-4052-9453-0fb254a02aa1-run-systemd\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.876092 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.875586 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8fb3d31f-2753-4592-a4da-a8cbf5a69a38-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4cn7v\" (UID: \"8fb3d31f-2753-4592-a4da-a8cbf5a69a38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cn7v" May 26 16:08:31.876092 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.875603 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7848e219-3fad-4749-80de-651dc7faace5-host-var-lib-cni-multus\") pod \"multus-bqsfl\" (UID: \"7848e219-3fad-4749-80de-651dc7faace5\") " pod="openshift-multus/multus-bqsfl" May 26 16:08:31.876092 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.875626 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e88baa86-d2fb-4052-9453-0fb254a02aa1-ovn-node-metrics-cert\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.876092 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.875641 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8fb3d31f-2753-4592-a4da-a8cbf5a69a38-sys-fs\") pod \"aws-ebs-csi-driver-node-4cn7v\" (UID: \"8fb3d31f-2753-4592-a4da-a8cbf5a69a38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cn7v" May 26 16:08:31.876092 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.875655 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7848e219-3fad-4749-80de-651dc7faace5-hostroot\") pod \"multus-bqsfl\" (UID: \"7848e219-3fad-4749-80de-651dc7faace5\") " pod="openshift-multus/multus-bqsfl" May 26 16:08:31.876092 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.875680 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e88baa86-d2fb-4052-9453-0fb254a02aa1-var-lib-openvswitch\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.876092 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.875709 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7848e219-3fad-4749-80de-651dc7faace5-etc-kubernetes\") pod \"multus-bqsfl\" (UID: \"7848e219-3fad-4749-80de-651dc7faace5\") " pod="openshift-multus/multus-bqsfl" May 26 16:08:31.876092 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.875769 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5h4k\" (UniqueName: \"kubernetes.io/projected/b8045062-09e4-495a-ba60-aefc78dd16b7-kube-api-access-x5h4k\") pod \"iptables-alerter-45qvm\" (UID: \"b8045062-09e4-495a-ba60-aefc78dd16b7\") " pod="openshift-network-operator/iptables-alerter-45qvm" May 26 16:08:31.876092 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.875796 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eae253a8-1f39-46f2-abe6-b677fff8aa74-system-cni-dir\") pod \"multus-additional-cni-plugins-2r6kq\" (UID: \"eae253a8-1f39-46f2-abe6-b677fff8aa74\") " pod="openshift-multus/multus-additional-cni-plugins-2r6kq" May 26 16:08:31.876092 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.875839 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e88baa86-d2fb-4052-9453-0fb254a02aa1-ovnkube-config\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.876092 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.875878 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7848e219-3fad-4749-80de-651dc7faace5-host-run-netns\") pod \"multus-bqsfl\" (UID: \"7848e219-3fad-4749-80de-651dc7faace5\") " pod="openshift-multus/multus-bqsfl" May 26 16:08:31.877090 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.875930 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncfsc\" (UniqueName: \"kubernetes.io/projected/ce8f2e7d-5806-41f9-aed0-49e4edec1092-kube-api-access-ncfsc\") pod \"node-ca-5rp4s\" (UID: \"ce8f2e7d-5806-41f9-aed0-49e4edec1092\") " pod="openshift-image-registry/node-ca-5rp4s" May 26 16:08:31.877090 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.875953 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e88baa86-d2fb-4052-9453-0fb254a02aa1-host-slash\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.877090 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.875977 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e88baa86-d2fb-4052-9453-0fb254a02aa1-etc-openvswitch\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.877090 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.875999 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8fb3d31f-2753-4592-a4da-a8cbf5a69a38-registration-dir\") pod \"aws-ebs-csi-driver-node-4cn7v\" (UID: \"8fb3d31f-2753-4592-a4da-a8cbf5a69a38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cn7v" May 26 16:08:31.877090 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.876022 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8fb3d31f-2753-4592-a4da-a8cbf5a69a38-etc-selinux\") pod \"aws-ebs-csi-driver-node-4cn7v\" (UID: \"8fb3d31f-2753-4592-a4da-a8cbf5a69a38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cn7v" May 26 16:08:31.877090 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.876053 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8045062-09e4-495a-ba60-aefc78dd16b7-host-slash\") pod \"iptables-alerter-45qvm\" (UID: \"b8045062-09e4-495a-ba60-aefc78dd16b7\") " pod="openshift-network-operator/iptables-alerter-45qvm" May 26 16:08:31.877090 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.876111 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eae253a8-1f39-46f2-abe6-b677fff8aa74-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2r6kq\" (UID: \"eae253a8-1f39-46f2-abe6-b677fff8aa74\") " pod="openshift-multus/multus-additional-cni-plugins-2r6kq" May 26 16:08:31.877090 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.876124 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 26 16:08:31.877090 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.876263 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-p45s7\"" May 26 16:08:31.877090 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.877050 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 26 16:08:31.877675 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.877380 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 26 16:08:31.877910 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.877868 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ms765" May 26 16:08:31.877991 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:31.877970 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ms765" podUID="0ecc520c-06db-4173-ba8e-e18f25c05b2d" May 26 16:08:31.906175 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.906150 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 16:03:30 +0000 UTC" deadline="2028-01-25 14:13:32.704206189 +0000 UTC" May 26 16:08:31.906175 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.906175 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14614h5m0.798033885s" May 26 16:08:31.968407 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.966978 2560 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 26 16:08:31.976940 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.976908 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e88baa86-d2fb-4052-9453-0fb254a02aa1-host-kubelet\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.977107 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.976953 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7848e219-3fad-4749-80de-651dc7faace5-host-run-k8s-cni-cncf-io\") pod \"multus-bqsfl\" (UID: \"7848e219-3fad-4749-80de-651dc7faace5\") " pod="openshift-multus/multus-bqsfl" May 26 16:08:31.977107 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.976979 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/45ada7c3-c4cd-423d-b8b9-a3ed76d9e56e-agent-certs\") pod \"konnectivity-agent-6kkzr\" (UID: \"45ada7c3-c4cd-423d-b8b9-a3ed76d9e56e\") " pod="kube-system/konnectivity-agent-6kkzr" May 26 16:08:31.977107 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.977003 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/45ada7c3-c4cd-423d-b8b9-a3ed76d9e56e-konnectivity-ca\") pod \"konnectivity-agent-6kkzr\" (UID: \"45ada7c3-c4cd-423d-b8b9-a3ed76d9e56e\") " pod="kube-system/konnectivity-agent-6kkzr" May 26 16:08:31.977107 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.977030 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/12be562e-cf78-49bc-bf71-4a661981f451-etc-sysconfig\") pod \"tuned-vqcfh\" (UID: \"12be562e-cf78-49bc-bf71-4a661981f451\") " pod="openshift-cluster-node-tuning-operator/tuned-vqcfh" May 26 16:08:31.977107 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.977044 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7848e219-3fad-4749-80de-651dc7faace5-host-run-k8s-cni-cncf-io\") pod \"multus-bqsfl\" (UID: \"7848e219-3fad-4749-80de-651dc7faace5\") " pod="openshift-multus/multus-bqsfl" May 26 16:08:31.977107 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.977055 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/12be562e-cf78-49bc-bf71-4a661981f451-sys\") pod \"tuned-vqcfh\" (UID: \"12be562e-cf78-49bc-bf71-4a661981f451\") " pod="openshift-cluster-node-tuning-operator/tuned-vqcfh" May 26 16:08:31.977107 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.977082 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e88baa86-d2fb-4052-9453-0fb254a02aa1-host-kubelet\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.977369 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.977104 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eae253a8-1f39-46f2-abe6-b677fff8aa74-cni-binary-copy\") pod \"multus-additional-cni-plugins-2r6kq\" (UID: \"eae253a8-1f39-46f2-abe6-b677fff8aa74\") " pod="openshift-multus/multus-additional-cni-plugins-2r6kq" May 26 16:08:31.977369 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.977148 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e88baa86-d2fb-4052-9453-0fb254a02aa1-run-openvswitch\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.977369 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.977190 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d3a8f3a-02fd-4849-a169-2b72451d600a-tmp-dir\") pod \"node-resolver-nqcwn\" (UID: \"2d3a8f3a-02fd-4849-a169-2b72451d600a\") " pod="openshift-dns/node-resolver-nqcwn" May 26 16:08:31.977369 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.977218 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7848e219-3fad-4749-80de-651dc7faace5-multus-cni-dir\") pod \"multus-bqsfl\" (UID: \"7848e219-3fad-4749-80de-651dc7faace5\") " pod="openshift-multus/multus-bqsfl" May 26 16:08:31.977369 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.977243 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7848e219-3fad-4749-80de-651dc7faace5-host-var-lib-cni-bin\") pod \"multus-bqsfl\" (UID: \"7848e219-3fad-4749-80de-651dc7faace5\") " pod="openshift-multus/multus-bqsfl" May 26 16:08:31.977369 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.977273 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/12be562e-cf78-49bc-bf71-4a661981f451-lib-modules\") pod \"tuned-vqcfh\" (UID: \"12be562e-cf78-49bc-bf71-4a661981f451\") " pod="openshift-cluster-node-tuning-operator/tuned-vqcfh" May 26 16:08:31.977369 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.977312 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ce8f2e7d-5806-41f9-aed0-49e4edec1092-serviceca\") pod \"node-ca-5rp4s\" (UID: \"ce8f2e7d-5806-41f9-aed0-49e4edec1092\") " pod="openshift-image-registry/node-ca-5rp4s" May 26 16:08:31.977369 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.977336 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e88baa86-d2fb-4052-9453-0fb254a02aa1-host-cni-netd\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.977369 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.977359 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8fb3d31f-2753-4592-a4da-a8cbf5a69a38-device-dir\") pod \"aws-ebs-csi-driver-node-4cn7v\" (UID: \"8fb3d31f-2753-4592-a4da-a8cbf5a69a38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cn7v" May 26 16:08:31.977776 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.977382 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9plpm\" (UniqueName: \"kubernetes.io/projected/8fb3d31f-2753-4592-a4da-a8cbf5a69a38-kube-api-access-9plpm\") pod \"aws-ebs-csi-driver-node-4cn7v\" (UID: \"8fb3d31f-2753-4592-a4da-a8cbf5a69a38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cn7v" May 26 16:08:31.977776 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.977407 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2d3a8f3a-02fd-4849-a169-2b72451d600a-hosts-file\") pod \"node-resolver-nqcwn\" (UID: \"2d3a8f3a-02fd-4849-a169-2b72451d600a\") " pod="openshift-dns/node-resolver-nqcwn" May 26 16:08:31.977776 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.977457 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/eae253a8-1f39-46f2-abe6-b677fff8aa74-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2r6kq\" (UID: \"eae253a8-1f39-46f2-abe6-b677fff8aa74\") " pod="openshift-multus/multus-additional-cni-plugins-2r6kq" May 26 16:08:31.977776 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.977512 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e88baa86-d2fb-4052-9453-0fb254a02aa1-run-ovn\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.977776 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.977518 2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 26 16:08:31.977776 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.977579 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e88baa86-d2fb-4052-9453-0fb254a02aa1-host-cni-netd\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.977776 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.977588 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8fb3d31f-2753-4592-a4da-a8cbf5a69a38-device-dir\") pod \"aws-ebs-csi-driver-node-4cn7v\" (UID: \"8fb3d31f-2753-4592-a4da-a8cbf5a69a38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cn7v" May 26 16:08:31.977776 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.977656 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7848e219-3fad-4749-80de-651dc7faace5-multus-cni-dir\") pod \"multus-bqsfl\" (UID: \"7848e219-3fad-4749-80de-651dc7faace5\") " pod="openshift-multus/multus-bqsfl" May 26 16:08:31.977776 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.977701 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e88baa86-d2fb-4052-9453-0fb254a02aa1-run-openvswitch\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.977776 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.977719 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/45ada7c3-c4cd-423d-b8b9-a3ed76d9e56e-konnectivity-ca\") pod \"konnectivity-agent-6kkzr\" (UID: \"45ada7c3-c4cd-423d-b8b9-a3ed76d9e56e\") " pod="kube-system/konnectivity-agent-6kkzr" May 26 16:08:31.977776 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.977737 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eae253a8-1f39-46f2-abe6-b677fff8aa74-cni-binary-copy\") pod \"multus-additional-cni-plugins-2r6kq\" (UID: \"eae253a8-1f39-46f2-abe6-b677fff8aa74\") " pod="openshift-multus/multus-additional-cni-plugins-2r6kq" May 26 16:08:31.978262 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.977823 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7848e219-3fad-4749-80de-651dc7faace5-host-var-lib-cni-bin\") pod \"multus-bqsfl\" (UID: \"7848e219-3fad-4749-80de-651dc7faace5\") " pod="openshift-multus/multus-bqsfl" May 26 16:08:31.978262 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.977836 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2d3a8f3a-02fd-4849-a169-2b72451d600a-hosts-file\") pod \"node-resolver-nqcwn\" (UID: \"2d3a8f3a-02fd-4849-a169-2b72451d600a\") " pod="openshift-dns/node-resolver-nqcwn" May 26 16:08:31.978262 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.977865 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e88baa86-d2fb-4052-9453-0fb254a02aa1-run-ovn\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.978262 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.977874 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7848e219-3fad-4749-80de-651dc7faace5-host-run-multus-certs\") pod \"multus-bqsfl\" (UID: \"7848e219-3fad-4749-80de-651dc7faace5\") " pod="openshift-multus/multus-bqsfl" May 26 16:08:31.978262 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.977902 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7848e219-3fad-4749-80de-651dc7faace5-host-run-multus-certs\") pod \"multus-bqsfl\" (UID: \"7848e219-3fad-4749-80de-651dc7faace5\") " pod="openshift-multus/multus-bqsfl" May 26 16:08:31.978262 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.977904 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e88baa86-d2fb-4052-9453-0fb254a02aa1-host-cni-bin\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.978262 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.977936 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e88baa86-d2fb-4052-9453-0fb254a02aa1-host-cni-bin\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.978262 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.977937 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c5s5v\" (UniqueName: \"kubernetes.io/projected/e88baa86-d2fb-4052-9453-0fb254a02aa1-kube-api-access-c5s5v\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.978262 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.977973 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/eae253a8-1f39-46f2-abe6-b677fff8aa74-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2r6kq\" (UID: \"eae253a8-1f39-46f2-abe6-b677fff8aa74\") " pod="openshift-multus/multus-additional-cni-plugins-2r6kq" May 26 16:08:31.978262 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.977993 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ce8f2e7d-5806-41f9-aed0-49e4edec1092-serviceca\") pod \"node-ca-5rp4s\" (UID: \"ce8f2e7d-5806-41f9-aed0-49e4edec1092\") " pod="openshift-image-registry/node-ca-5rp4s" May 26 16:08:31.978262 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.978021 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d3a8f3a-02fd-4849-a169-2b72451d600a-tmp-dir\") pod \"node-resolver-nqcwn\" (UID: \"2d3a8f3a-02fd-4849-a169-2b72451d600a\") " pod="openshift-dns/node-resolver-nqcwn" May 26 16:08:31.978262 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.978068 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8fb3d31f-2753-4592-a4da-a8cbf5a69a38-socket-dir\") pod \"aws-ebs-csi-driver-node-4cn7v\" (UID: \"8fb3d31f-2753-4592-a4da-a8cbf5a69a38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cn7v" May 26 16:08:31.978262 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.978098 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pm554\" (UniqueName: \"kubernetes.io/projected/2d3a8f3a-02fd-4849-a169-2b72451d600a-kube-api-access-pm554\") pod \"node-resolver-nqcwn\" (UID: \"2d3a8f3a-02fd-4849-a169-2b72451d600a\") " pod="openshift-dns/node-resolver-nqcwn" May 26 16:08:31.978262 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.978125 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/12be562e-cf78-49bc-bf71-4a661981f451-run\") pod \"tuned-vqcfh\" (UID: \"12be562e-cf78-49bc-bf71-4a661981f451\") " pod="openshift-cluster-node-tuning-operator/tuned-vqcfh" May 26 16:08:31.978262 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.978152 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vw86q\" (UniqueName: \"kubernetes.io/projected/eae253a8-1f39-46f2-abe6-b677fff8aa74-kube-api-access-vw86q\") pod \"multus-additional-cni-plugins-2r6kq\" (UID: \"eae253a8-1f39-46f2-abe6-b677fff8aa74\") " pod="openshift-multus/multus-additional-cni-plugins-2r6kq" May 26 16:08:31.978262 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.978189 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/12be562e-cf78-49bc-bf71-4a661981f451-var-lib-kubelet\") pod \"tuned-vqcfh\" (UID: \"12be562e-cf78-49bc-bf71-4a661981f451\") " pod="openshift-cluster-node-tuning-operator/tuned-vqcfh" May 26 16:08:31.978262 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.978221 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/12be562e-cf78-49bc-bf71-4a661981f451-host\") pod \"tuned-vqcfh\" (UID: \"12be562e-cf78-49bc-bf71-4a661981f451\") " pod="openshift-cluster-node-tuning-operator/tuned-vqcfh" May 26 16:08:31.979065 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.978246 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8fb3d31f-2753-4592-a4da-a8cbf5a69a38-socket-dir\") pod \"aws-ebs-csi-driver-node-4cn7v\" (UID: \"8fb3d31f-2753-4592-a4da-a8cbf5a69a38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cn7v" May 26 16:08:31.979065 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.978249 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/12be562e-cf78-49bc-bf71-4a661981f451-etc-tuned\") pod \"tuned-vqcfh\" (UID: \"12be562e-cf78-49bc-bf71-4a661981f451\") " pod="openshift-cluster-node-tuning-operator/tuned-vqcfh" May 26 16:08:31.979065 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.978296 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wh5b\" (UniqueName: \"kubernetes.io/projected/eec5f0e1-7fd2-4597-a1a0-3b5b10517934-kube-api-access-7wh5b\") pod \"network-metrics-daemon-ws4lv\" (UID: \"eec5f0e1-7fd2-4597-a1a0-3b5b10517934\") " pod="openshift-multus/network-metrics-daemon-ws4lv" May 26 16:08:31.979065 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.978334 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e88baa86-d2fb-4052-9453-0fb254a02aa1-log-socket\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.979065 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.978372 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7848e219-3fad-4749-80de-651dc7faace5-system-cni-dir\") pod \"multus-bqsfl\" (UID: \"7848e219-3fad-4749-80de-651dc7faace5\") " pod="openshift-multus/multus-bqsfl" May 26 16:08:31.979065 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.978421 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e88baa86-d2fb-4052-9453-0fb254a02aa1-log-socket\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.979065 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.978455 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7848e219-3fad-4749-80de-651dc7faace5-os-release\") pod \"multus-bqsfl\" (UID: \"7848e219-3fad-4749-80de-651dc7faace5\") " pod="openshift-multus/multus-bqsfl" May 26 16:08:31.979065 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.978467 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7848e219-3fad-4749-80de-651dc7faace5-system-cni-dir\") pod \"multus-bqsfl\" (UID: \"7848e219-3fad-4749-80de-651dc7faace5\") " pod="openshift-multus/multus-bqsfl" May 26 16:08:31.979065 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.978486 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7848e219-3fad-4749-80de-651dc7faace5-host-var-lib-kubelet\") pod \"multus-bqsfl\" (UID: \"7848e219-3fad-4749-80de-651dc7faace5\") " pod="openshift-multus/multus-bqsfl" May 26 16:08:31.979065 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.978512 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hm967\" (UniqueName: \"kubernetes.io/projected/7848e219-3fad-4749-80de-651dc7faace5-kube-api-access-hm967\") pod \"multus-bqsfl\" (UID: \"7848e219-3fad-4749-80de-651dc7faace5\") " pod="openshift-multus/multus-bqsfl" May 26 16:08:31.979065 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.978537 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b8045062-09e4-495a-ba60-aefc78dd16b7-iptables-alerter-script\") pod \"iptables-alerter-45qvm\" (UID: \"b8045062-09e4-495a-ba60-aefc78dd16b7\") " pod="openshift-network-operator/iptables-alerter-45qvm" May 26 16:08:31.979065 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.978548 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7848e219-3fad-4749-80de-651dc7faace5-host-var-lib-kubelet\") pod \"multus-bqsfl\" (UID: \"7848e219-3fad-4749-80de-651dc7faace5\") " pod="openshift-multus/multus-bqsfl" May 26 16:08:31.979065 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.978561 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eae253a8-1f39-46f2-abe6-b677fff8aa74-cnibin\") pod \"multus-additional-cni-plugins-2r6kq\" (UID: \"eae253a8-1f39-46f2-abe6-b677fff8aa74\") " pod="openshift-multus/multus-additional-cni-plugins-2r6kq" May 26 16:08:31.979065 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.978587 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e88baa86-d2fb-4052-9453-0fb254a02aa1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.979065 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.978618 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eae253a8-1f39-46f2-abe6-b677fff8aa74-cnibin\") pod \"multus-additional-cni-plugins-2r6kq\" (UID: \"eae253a8-1f39-46f2-abe6-b677fff8aa74\") " pod="openshift-multus/multus-additional-cni-plugins-2r6kq" May 26 16:08:31.979065 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.978620 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7848e219-3fad-4749-80de-651dc7faace5-cnibin\") pod \"multus-bqsfl\" (UID: \"7848e219-3fad-4749-80de-651dc7faace5\") " pod="openshift-multus/multus-bqsfl" May 26 16:08:31.979065 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.978563 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7848e219-3fad-4749-80de-651dc7faace5-os-release\") pod \"multus-bqsfl\" (UID: \"7848e219-3fad-4749-80de-651dc7faace5\") " pod="openshift-multus/multus-bqsfl" May 26 16:08:31.979853 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.978661 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7848e219-3fad-4749-80de-651dc7faace5-multus-socket-dir-parent\") pod \"multus-bqsfl\" (UID: \"7848e219-3fad-4749-80de-651dc7faace5\") " pod="openshift-multus/multus-bqsfl" May 26 16:08:31.979853 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.978691 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/12be562e-cf78-49bc-bf71-4a661981f451-etc-modprobe-d\") pod \"tuned-vqcfh\" (UID: \"12be562e-cf78-49bc-bf71-4a661981f451\") " pod="openshift-cluster-node-tuning-operator/tuned-vqcfh" May 26 16:08:31.979853 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.978699 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7848e219-3fad-4749-80de-651dc7faace5-cnibin\") pod \"multus-bqsfl\" (UID: \"7848e219-3fad-4749-80de-651dc7faace5\") " pod="openshift-multus/multus-bqsfl" May 26 16:08:31.979853 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.978690 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e88baa86-d2fb-4052-9453-0fb254a02aa1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.979853 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.978717 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eec5f0e1-7fd2-4597-a1a0-3b5b10517934-metrics-certs\") pod \"network-metrics-daemon-ws4lv\" (UID: \"eec5f0e1-7fd2-4597-a1a0-3b5b10517934\") " pod="openshift-multus/network-metrics-daemon-ws4lv" May 26 16:08:31.979853 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.978734 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7848e219-3fad-4749-80de-651dc7faace5-multus-socket-dir-parent\") pod \"multus-bqsfl\" (UID: \"7848e219-3fad-4749-80de-651dc7faace5\") " pod="openshift-multus/multus-bqsfl" May 26 16:08:31.979853 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.978744 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t622m\" (UniqueName: \"kubernetes.io/projected/0ecc520c-06db-4173-ba8e-e18f25c05b2d-kube-api-access-t622m\") pod \"network-check-target-ms765\" (UID: \"0ecc520c-06db-4173-ba8e-e18f25c05b2d\") " pod="openshift-network-diagnostics/network-check-target-ms765" May 26 16:08:31.979853 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.978778 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e88baa86-d2fb-4052-9453-0fb254a02aa1-node-log\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.979853 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.978808 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ce8f2e7d-5806-41f9-aed0-49e4edec1092-host\") pod \"node-ca-5rp4s\" (UID: \"ce8f2e7d-5806-41f9-aed0-49e4edec1092\") " pod="openshift-image-registry/node-ca-5rp4s" May 26 16:08:31.979853 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.978848 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/eae253a8-1f39-46f2-abe6-b677fff8aa74-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2r6kq\" (UID: \"eae253a8-1f39-46f2-abe6-b677fff8aa74\") " pod="openshift-multus/multus-additional-cni-plugins-2r6kq" May 26 16:08:31.979853 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.978864 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e88baa86-d2fb-4052-9453-0fb254a02aa1-node-log\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.979853 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.978874 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e88baa86-d2fb-4052-9453-0fb254a02aa1-systemd-units\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.979853 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.978902 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ce8f2e7d-5806-41f9-aed0-49e4edec1092-host\") pod \"node-ca-5rp4s\" (UID: \"ce8f2e7d-5806-41f9-aed0-49e4edec1092\") " pod="openshift-image-registry/node-ca-5rp4s" May 26 16:08:31.979853 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.978912 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e88baa86-d2fb-4052-9453-0fb254a02aa1-run-systemd\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.979853 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.978938 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8fb3d31f-2753-4592-a4da-a8cbf5a69a38-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4cn7v\" (UID: \"8fb3d31f-2753-4592-a4da-a8cbf5a69a38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cn7v" May 26 16:08:31.979853 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.978955 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e88baa86-d2fb-4052-9453-0fb254a02aa1-systemd-units\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.979853 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.978963 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7848e219-3fad-4749-80de-651dc7faace5-host-var-lib-cni-multus\") pod \"multus-bqsfl\" (UID: \"7848e219-3fad-4749-80de-651dc7faace5\") " pod="openshift-multus/multus-bqsfl" May 26 16:08:31.980640 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.978981 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e88baa86-d2fb-4052-9453-0fb254a02aa1-run-systemd\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.980640 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.978988 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e88baa86-d2fb-4052-9453-0fb254a02aa1-ovn-node-metrics-cert\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.980640 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.979010 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8fb3d31f-2753-4592-a4da-a8cbf5a69a38-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4cn7v\" (UID: \"8fb3d31f-2753-4592-a4da-a8cbf5a69a38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cn7v" May 26 16:08:31.980640 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.979023 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8fb3d31f-2753-4592-a4da-a8cbf5a69a38-sys-fs\") pod \"aws-ebs-csi-driver-node-4cn7v\" (UID: \"8fb3d31f-2753-4592-a4da-a8cbf5a69a38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cn7v" May 26 16:08:31.980640 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.979055 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7848e219-3fad-4749-80de-651dc7faace5-host-var-lib-cni-multus\") pod \"multus-bqsfl\" (UID: \"7848e219-3fad-4749-80de-651dc7faace5\") " pod="openshift-multus/multus-bqsfl" May 26 16:08:31.980640 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.979064 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7848e219-3fad-4749-80de-651dc7faace5-hostroot\") pod \"multus-bqsfl\" (UID: \"7848e219-3fad-4749-80de-651dc7faace5\") " pod="openshift-multus/multus-bqsfl" May 26 16:08:31.980640 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.979078 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b8045062-09e4-495a-ba60-aefc78dd16b7-iptables-alerter-script\") pod \"iptables-alerter-45qvm\" (UID: \"b8045062-09e4-495a-ba60-aefc78dd16b7\") " pod="openshift-network-operator/iptables-alerter-45qvm" May 26 16:08:31.980640 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.979093 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/12be562e-cf78-49bc-bf71-4a661981f451-etc-sysctl-d\") pod \"tuned-vqcfh\" (UID: \"12be562e-cf78-49bc-bf71-4a661981f451\") " pod="openshift-cluster-node-tuning-operator/tuned-vqcfh" May 26 16:08:31.980640 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.979106 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8fb3d31f-2753-4592-a4da-a8cbf5a69a38-sys-fs\") pod \"aws-ebs-csi-driver-node-4cn7v\" (UID: \"8fb3d31f-2753-4592-a4da-a8cbf5a69a38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cn7v" May 26 16:08:31.980640 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.979133 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7848e219-3fad-4749-80de-651dc7faace5-hostroot\") pod \"multus-bqsfl\" (UID: \"7848e219-3fad-4749-80de-651dc7faace5\") " pod="openshift-multus/multus-bqsfl" May 26 16:08:31.980640 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.979167 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/12be562e-cf78-49bc-bf71-4a661981f451-etc-sysctl-conf\") pod \"tuned-vqcfh\" (UID: \"12be562e-cf78-49bc-bf71-4a661981f451\") " pod="openshift-cluster-node-tuning-operator/tuned-vqcfh" May 26 16:08:31.980640 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.979203 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/12be562e-cf78-49bc-bf71-4a661981f451-etc-systemd\") pod \"tuned-vqcfh\" (UID: \"12be562e-cf78-49bc-bf71-4a661981f451\") " pod="openshift-cluster-node-tuning-operator/tuned-vqcfh" May 26 16:08:31.980640 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.979227 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12be562e-cf78-49bc-bf71-4a661981f451-tmp\") pod \"tuned-vqcfh\" (UID: \"12be562e-cf78-49bc-bf71-4a661981f451\") " pod="openshift-cluster-node-tuning-operator/tuned-vqcfh" May 26 16:08:31.980640 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.979256 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e88baa86-d2fb-4052-9453-0fb254a02aa1-var-lib-openvswitch\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.980640 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.979280 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7848e219-3fad-4749-80de-651dc7faace5-etc-kubernetes\") pod \"multus-bqsfl\" (UID: \"7848e219-3fad-4749-80de-651dc7faace5\") " pod="openshift-multus/multus-bqsfl" May 26 16:08:31.980640 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.979309 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x5h4k\" (UniqueName: \"kubernetes.io/projected/b8045062-09e4-495a-ba60-aefc78dd16b7-kube-api-access-x5h4k\") pod \"iptables-alerter-45qvm\" (UID: \"b8045062-09e4-495a-ba60-aefc78dd16b7\") " pod="openshift-network-operator/iptables-alerter-45qvm" May 26 16:08:31.980640 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.979336 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eae253a8-1f39-46f2-abe6-b677fff8aa74-system-cni-dir\") pod \"multus-additional-cni-plugins-2r6kq\" (UID: \"eae253a8-1f39-46f2-abe6-b677fff8aa74\") " pod="openshift-multus/multus-additional-cni-plugins-2r6kq" May 26 16:08:31.981391 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.979379 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7848e219-3fad-4749-80de-651dc7faace5-etc-kubernetes\") pod \"multus-bqsfl\" (UID: \"7848e219-3fad-4749-80de-651dc7faace5\") " pod="openshift-multus/multus-bqsfl" May 26 16:08:31.981391 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.979393 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eae253a8-1f39-46f2-abe6-b677fff8aa74-system-cni-dir\") pod \"multus-additional-cni-plugins-2r6kq\" (UID: \"eae253a8-1f39-46f2-abe6-b677fff8aa74\") " pod="openshift-multus/multus-additional-cni-plugins-2r6kq" May 26 16:08:31.981391 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.979396 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/eae253a8-1f39-46f2-abe6-b677fff8aa74-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2r6kq\" (UID: \"eae253a8-1f39-46f2-abe6-b677fff8aa74\") " pod="openshift-multus/multus-additional-cni-plugins-2r6kq" May 26 16:08:31.981391 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.979459 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e88baa86-d2fb-4052-9453-0fb254a02aa1-var-lib-openvswitch\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.981391 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.979544 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e88baa86-d2fb-4052-9453-0fb254a02aa1-ovnkube-config\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.981391 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.979573 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7848e219-3fad-4749-80de-651dc7faace5-host-run-netns\") pod \"multus-bqsfl\" (UID: \"7848e219-3fad-4749-80de-651dc7faace5\") " pod="openshift-multus/multus-bqsfl" May 26 16:08:31.981391 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.979599 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ncfsc\" (UniqueName: \"kubernetes.io/projected/ce8f2e7d-5806-41f9-aed0-49e4edec1092-kube-api-access-ncfsc\") pod \"node-ca-5rp4s\" (UID: \"ce8f2e7d-5806-41f9-aed0-49e4edec1092\") " pod="openshift-image-registry/node-ca-5rp4s" May 26 16:08:31.981391 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.979623 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e88baa86-d2fb-4052-9453-0fb254a02aa1-host-slash\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.981391 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.979646 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7848e219-3fad-4749-80de-651dc7faace5-host-run-netns\") pod \"multus-bqsfl\" (UID: \"7848e219-3fad-4749-80de-651dc7faace5\") " pod="openshift-multus/multus-bqsfl" May 26 16:08:31.981391 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.979656 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e88baa86-d2fb-4052-9453-0fb254a02aa1-etc-openvswitch\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.981391 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.979684 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8fb3d31f-2753-4592-a4da-a8cbf5a69a38-registration-dir\") pod \"aws-ebs-csi-driver-node-4cn7v\" (UID: \"8fb3d31f-2753-4592-a4da-a8cbf5a69a38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cn7v" May 26 16:08:31.981391 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.979730 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8fb3d31f-2753-4592-a4da-a8cbf5a69a38-etc-selinux\") pod \"aws-ebs-csi-driver-node-4cn7v\" (UID: \"8fb3d31f-2753-4592-a4da-a8cbf5a69a38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cn7v" May 26 16:08:31.981391 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.979763 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8zms\" (UniqueName: \"kubernetes.io/projected/12be562e-cf78-49bc-bf71-4a661981f451-kube-api-access-j8zms\") pod \"tuned-vqcfh\" (UID: \"12be562e-cf78-49bc-bf71-4a661981f451\") " pod="openshift-cluster-node-tuning-operator/tuned-vqcfh" May 26 16:08:31.981391 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.979789 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8045062-09e4-495a-ba60-aefc78dd16b7-host-slash\") pod \"iptables-alerter-45qvm\" (UID: \"b8045062-09e4-495a-ba60-aefc78dd16b7\") " pod="openshift-network-operator/iptables-alerter-45qvm" May 26 16:08:31.981391 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.979827 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e88baa86-d2fb-4052-9453-0fb254a02aa1-etc-openvswitch\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.981391 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.979817 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eae253a8-1f39-46f2-abe6-b677fff8aa74-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2r6kq\" (UID: \"eae253a8-1f39-46f2-abe6-b677fff8aa74\") " pod="openshift-multus/multus-additional-cni-plugins-2r6kq" May 26 16:08:31.981391 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.979859 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e88baa86-d2fb-4052-9453-0fb254a02aa1-host-run-netns\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.982163 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.979882 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e88baa86-d2fb-4052-9453-0fb254a02aa1-host-slash\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.982163 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.979886 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e88baa86-d2fb-4052-9453-0fb254a02aa1-host-run-ovn-kubernetes\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.982163 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.979912 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e88baa86-d2fb-4052-9453-0fb254a02aa1-env-overrides\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.982163 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.979942 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7848e219-3fad-4749-80de-651dc7faace5-multus-daemon-config\") pod \"multus-bqsfl\" (UID: \"7848e219-3fad-4749-80de-651dc7faace5\") " pod="openshift-multus/multus-bqsfl" May 26 16:08:31.982163 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.979966 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eae253a8-1f39-46f2-abe6-b677fff8aa74-os-release\") pod \"multus-additional-cni-plugins-2r6kq\" (UID: \"eae253a8-1f39-46f2-abe6-b677fff8aa74\") " pod="openshift-multus/multus-additional-cni-plugins-2r6kq" May 26 16:08:31.982163 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.979987 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8fb3d31f-2753-4592-a4da-a8cbf5a69a38-registration-dir\") pod \"aws-ebs-csi-driver-node-4cn7v\" (UID: \"8fb3d31f-2753-4592-a4da-a8cbf5a69a38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cn7v" May 26 16:08:31.982163 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.979991 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e88baa86-d2fb-4052-9453-0fb254a02aa1-ovnkube-script-lib\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.982163 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.980018 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8fb3d31f-2753-4592-a4da-a8cbf5a69a38-etc-selinux\") pod \"aws-ebs-csi-driver-node-4cn7v\" (UID: \"8fb3d31f-2753-4592-a4da-a8cbf5a69a38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cn7v" May 26 16:08:31.982163 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.979943 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8045062-09e4-495a-ba60-aefc78dd16b7-host-slash\") pod \"iptables-alerter-45qvm\" (UID: \"b8045062-09e4-495a-ba60-aefc78dd16b7\") " pod="openshift-network-operator/iptables-alerter-45qvm" May 26 16:08:31.982163 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.980032 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e88baa86-d2fb-4052-9453-0fb254a02aa1-host-run-netns\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.982163 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.980083 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eae253a8-1f39-46f2-abe6-b677fff8aa74-os-release\") pod \"multus-additional-cni-plugins-2r6kq\" (UID: \"eae253a8-1f39-46f2-abe6-b677fff8aa74\") " pod="openshift-multus/multus-additional-cni-plugins-2r6kq" May 26 16:08:31.982163 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.980117 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e88baa86-d2fb-4052-9453-0fb254a02aa1-ovnkube-config\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.982163 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.980123 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eae253a8-1f39-46f2-abe6-b677fff8aa74-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2r6kq\" (UID: \"eae253a8-1f39-46f2-abe6-b677fff8aa74\") " pod="openshift-multus/multus-additional-cni-plugins-2r6kq" May 26 16:08:31.982163 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.980184 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7848e219-3fad-4749-80de-651dc7faace5-cni-binary-copy\") pod \"multus-bqsfl\" (UID: \"7848e219-3fad-4749-80de-651dc7faace5\") " pod="openshift-multus/multus-bqsfl" May 26 16:08:31.982163 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.980193 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e88baa86-d2fb-4052-9453-0fb254a02aa1-host-run-ovn-kubernetes\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.982163 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.980216 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7848e219-3fad-4749-80de-651dc7faace5-multus-conf-dir\") pod \"multus-bqsfl\" (UID: \"7848e219-3fad-4749-80de-651dc7faace5\") " pod="openshift-multus/multus-bqsfl" May 26 16:08:31.982163 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.980243 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12be562e-cf78-49bc-bf71-4a661981f451-etc-kubernetes\") pod \"tuned-vqcfh\" (UID: \"12be562e-cf78-49bc-bf71-4a661981f451\") " pod="openshift-cluster-node-tuning-operator/tuned-vqcfh" May 26 16:08:31.982924 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.980451 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e88baa86-d2fb-4052-9453-0fb254a02aa1-env-overrides\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.982924 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.980460 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7848e219-3fad-4749-80de-651dc7faace5-multus-conf-dir\") pod \"multus-bqsfl\" (UID: \"7848e219-3fad-4749-80de-651dc7faace5\") " pod="openshift-multus/multus-bqsfl" May 26 16:08:31.982924 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.980744 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7848e219-3fad-4749-80de-651dc7faace5-multus-daemon-config\") pod \"multus-bqsfl\" (UID: \"7848e219-3fad-4749-80de-651dc7faace5\") " pod="openshift-multus/multus-bqsfl" May 26 16:08:31.982924 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.981025 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e88baa86-d2fb-4052-9453-0fb254a02aa1-ovnkube-script-lib\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.982924 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.981105 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7848e219-3fad-4749-80de-651dc7faace5-cni-binary-copy\") pod \"multus-bqsfl\" (UID: \"7848e219-3fad-4749-80de-651dc7faace5\") " pod="openshift-multus/multus-bqsfl" May 26 16:08:31.983882 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.983829 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e88baa86-d2fb-4052-9453-0fb254a02aa1-ovn-node-metrics-cert\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:31.983999 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.983886 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/45ada7c3-c4cd-423d-b8b9-a3ed76d9e56e-agent-certs\") pod \"konnectivity-agent-6kkzr\" (UID: \"45ada7c3-c4cd-423d-b8b9-a3ed76d9e56e\") " pod="kube-system/konnectivity-agent-6kkzr" May 26 16:08:31.987668 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.987642 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm967\" (UniqueName: \"kubernetes.io/projected/7848e219-3fad-4749-80de-651dc7faace5-kube-api-access-hm967\") pod \"multus-bqsfl\" (UID: \"7848e219-3fad-4749-80de-651dc7faace5\") " pod="openshift-multus/multus-bqsfl" May 26 16:08:31.988139 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.988117 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncfsc\" (UniqueName: \"kubernetes.io/projected/ce8f2e7d-5806-41f9-aed0-49e4edec1092-kube-api-access-ncfsc\") pod \"node-ca-5rp4s\" (UID: \"ce8f2e7d-5806-41f9-aed0-49e4edec1092\") " pod="openshift-image-registry/node-ca-5rp4s" May 26 16:08:31.988229 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.988139 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pm554\" (UniqueName: \"kubernetes.io/projected/2d3a8f3a-02fd-4849-a169-2b72451d600a-kube-api-access-pm554\") pod \"node-resolver-nqcwn\" (UID: \"2d3a8f3a-02fd-4849-a169-2b72451d600a\") " pod="openshift-dns/node-resolver-nqcwn" May 26 16:08:31.988822 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.988801 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9plpm\" (UniqueName: \"kubernetes.io/projected/8fb3d31f-2753-4592-a4da-a8cbf5a69a38-kube-api-access-9plpm\") pod \"aws-ebs-csi-driver-node-4cn7v\" (UID: \"8fb3d31f-2753-4592-a4da-a8cbf5a69a38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cn7v" May 26 16:08:31.989275 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.989256 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vw86q\" (UniqueName: \"kubernetes.io/projected/eae253a8-1f39-46f2-abe6-b677fff8aa74-kube-api-access-vw86q\") pod \"multus-additional-cni-plugins-2r6kq\" (UID: \"eae253a8-1f39-46f2-abe6-b677fff8aa74\") " pod="openshift-multus/multus-additional-cni-plugins-2r6kq" May 26 16:08:31.990836 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.990817 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5h4k\" (UniqueName: \"kubernetes.io/projected/b8045062-09e4-495a-ba60-aefc78dd16b7-kube-api-access-x5h4k\") pod \"iptables-alerter-45qvm\" (UID: \"b8045062-09e4-495a-ba60-aefc78dd16b7\") " pod="openshift-network-operator/iptables-alerter-45qvm" May 26 16:08:31.990836 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:31.990826 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5s5v\" (UniqueName: \"kubernetes.io/projected/e88baa86-d2fb-4052-9453-0fb254a02aa1-kube-api-access-c5s5v\") pod \"ovnkube-node-7xvh4\" (UID: \"e88baa86-d2fb-4052-9453-0fb254a02aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:32.007019 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:32.006962 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-102.ec2.internal" event={"ID":"2e1cb75f0e94e5eb2d26b2c46dee4fa3","Type":"ContainerStarted","Data":"b5de0a40a84068124be2c21daa050cd44ad879e235dbc4f42e8a1a52793be30b"} May 26 16:08:32.007952 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:32.007927 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-102.ec2.internal" event={"ID":"3fee12dcae6578402519bc5aede8750c","Type":"ContainerStarted","Data":"f69fec5d81b3e5e9dbff2d60241e11cbb78e3dbd5f7761b621c2ea75b2ec6390"} May 26 16:08:32.080717 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:32.080619 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12be562e-cf78-49bc-bf71-4a661981f451-etc-kubernetes\") pod \"tuned-vqcfh\" (UID: \"12be562e-cf78-49bc-bf71-4a661981f451\") " pod="openshift-cluster-node-tuning-operator/tuned-vqcfh" May 26 16:08:32.080717 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:32.080666 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/12be562e-cf78-49bc-bf71-4a661981f451-etc-sysconfig\") pod \"tuned-vqcfh\" (UID: \"12be562e-cf78-49bc-bf71-4a661981f451\") " pod="openshift-cluster-node-tuning-operator/tuned-vqcfh" May 26 16:08:32.080717 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:32.080687 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/12be562e-cf78-49bc-bf71-4a661981f451-sys\") pod \"tuned-vqcfh\" (UID: \"12be562e-cf78-49bc-bf71-4a661981f451\") " pod="openshift-cluster-node-tuning-operator/tuned-vqcfh" May 26 16:08:32.080717 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:32.080712 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/12be562e-cf78-49bc-bf71-4a661981f451-lib-modules\") pod \"tuned-vqcfh\" (UID: \"12be562e-cf78-49bc-bf71-4a661981f451\") " pod="openshift-cluster-node-tuning-operator/tuned-vqcfh" May 26 16:08:32.080953 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:32.080741 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/12be562e-cf78-49bc-bf71-4a661981f451-run\") pod \"tuned-vqcfh\" (UID: \"12be562e-cf78-49bc-bf71-4a661981f451\") " pod="openshift-cluster-node-tuning-operator/tuned-vqcfh" May 26 16:08:32.080953 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:32.080764 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/12be562e-cf78-49bc-bf71-4a661981f451-var-lib-kubelet\") pod \"tuned-vqcfh\" (UID: \"12be562e-cf78-49bc-bf71-4a661981f451\") " pod="openshift-cluster-node-tuning-operator/tuned-vqcfh" May 26 16:08:32.080953 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:32.080762 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/12be562e-cf78-49bc-bf71-4a661981f451-etc-sysconfig\") pod \"tuned-vqcfh\" (UID: \"12be562e-cf78-49bc-bf71-4a661981f451\") " pod="openshift-cluster-node-tuning-operator/tuned-vqcfh" May 26 16:08:32.080953 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:32.080789 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/12be562e-cf78-49bc-bf71-4a661981f451-host\") pod \"tuned-vqcfh\" (UID: \"12be562e-cf78-49bc-bf71-4a661981f451\") " pod="openshift-cluster-node-tuning-operator/tuned-vqcfh" May 26 16:08:32.080953 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:32.080790 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/12be562e-cf78-49bc-bf71-4a661981f451-sys\") pod \"tuned-vqcfh\" (UID: \"12be562e-cf78-49bc-bf71-4a661981f451\") " pod="openshift-cluster-node-tuning-operator/tuned-vqcfh" May 26 16:08:32.080953 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:32.080810 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/12be562e-cf78-49bc-bf71-4a661981f451-etc-tuned\") pod \"tuned-vqcfh\" (UID: \"12be562e-cf78-49bc-bf71-4a661981f451\") " pod="openshift-cluster-node-tuning-operator/tuned-vqcfh" May 26 16:08:32.080953 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:32.080827 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/12be562e-cf78-49bc-bf71-4a661981f451-var-lib-kubelet\") pod \"tuned-vqcfh\" (UID: \"12be562e-cf78-49bc-bf71-4a661981f451\") " pod="openshift-cluster-node-tuning-operator/tuned-vqcfh" May 26 16:08:32.080953 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:32.080836 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7wh5b\" (UniqueName: \"kubernetes.io/projected/eec5f0e1-7fd2-4597-a1a0-3b5b10517934-kube-api-access-7wh5b\") pod \"network-metrics-daemon-ws4lv\" (UID: \"eec5f0e1-7fd2-4597-a1a0-3b5b10517934\") " pod="openshift-multus/network-metrics-daemon-ws4lv" May 26 16:08:32.080953 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:32.080762 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12be562e-cf78-49bc-bf71-4a661981f451-etc-kubernetes\") pod \"tuned-vqcfh\" (UID: \"12be562e-cf78-49bc-bf71-4a661981f451\") " pod="openshift-cluster-node-tuning-operator/tuned-vqcfh" May 26 16:08:32.080953 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:32.080848 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/12be562e-cf78-49bc-bf71-4a661981f451-run\") pod \"tuned-vqcfh\" (UID: \"12be562e-cf78-49bc-bf71-4a661981f451\") " pod="openshift-cluster-node-tuning-operator/tuned-vqcfh" May 26 16:08:32.080953 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:32.080868 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/12be562e-cf78-49bc-bf71-4a661981f451-etc-modprobe-d\") pod \"tuned-vqcfh\" (UID: \"12be562e-cf78-49bc-bf71-4a661981f451\") " pod="openshift-cluster-node-tuning-operator/tuned-vqcfh" May 26 16:08:32.080953 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:32.080889 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/12be562e-cf78-49bc-bf71-4a661981f451-lib-modules\") pod \"tuned-vqcfh\" (UID: \"12be562e-cf78-49bc-bf71-4a661981f451\") " pod="openshift-cluster-node-tuning-operator/tuned-vqcfh" May 26 16:08:32.080953 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:32.080899 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/12be562e-cf78-49bc-bf71-4a661981f451-host\") pod \"tuned-vqcfh\" (UID: \"12be562e-cf78-49bc-bf71-4a661981f451\") " pod="openshift-cluster-node-tuning-operator/tuned-vqcfh" May 26 16:08:32.080953 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:32.080894 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eec5f0e1-7fd2-4597-a1a0-3b5b10517934-metrics-certs\") pod \"network-metrics-daemon-ws4lv\" (UID: \"eec5f0e1-7fd2-4597-a1a0-3b5b10517934\") " pod="openshift-multus/network-metrics-daemon-ws4lv" May 26 16:08:32.080953 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:32.080939 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t622m\" (UniqueName: \"kubernetes.io/projected/0ecc520c-06db-4173-ba8e-e18f25c05b2d-kube-api-access-t622m\") pod \"network-check-target-ms765\" (UID: \"0ecc520c-06db-4173-ba8e-e18f25c05b2d\") " pod="openshift-network-diagnostics/network-check-target-ms765" May 26 16:08:32.080953 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:32.080957 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 16:08:32.081673 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:32.080969 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/12be562e-cf78-49bc-bf71-4a661981f451-etc-sysctl-d\") pod \"tuned-vqcfh\" (UID: \"12be562e-cf78-49bc-bf71-4a661981f451\") " pod="openshift-cluster-node-tuning-operator/tuned-vqcfh" May 26 16:08:32.081673 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:32.080976 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/12be562e-cf78-49bc-bf71-4a661981f451-etc-modprobe-d\") pod \"tuned-vqcfh\" (UID: \"12be562e-cf78-49bc-bf71-4a661981f451\") " pod="openshift-cluster-node-tuning-operator/tuned-vqcfh" May 26 16:08:32.081673 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:32.081001 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/12be562e-cf78-49bc-bf71-4a661981f451-etc-sysctl-conf\") pod \"tuned-vqcfh\" (UID: \"12be562e-cf78-49bc-bf71-4a661981f451\") " pod="openshift-cluster-node-tuning-operator/tuned-vqcfh" May 26 16:08:32.081673 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:32.081044 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eec5f0e1-7fd2-4597-a1a0-3b5b10517934-metrics-certs podName:eec5f0e1-7fd2-4597-a1a0-3b5b10517934 nodeName:}" failed. No retries permitted until 2026-05-26 16:08:32.581008719 +0000 UTC m=+3.111502322 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eec5f0e1-7fd2-4597-a1a0-3b5b10517934-metrics-certs") pod "network-metrics-daemon-ws4lv" (UID: "eec5f0e1-7fd2-4597-a1a0-3b5b10517934") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 16:08:32.081673 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:32.081062 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/12be562e-cf78-49bc-bf71-4a661981f451-etc-systemd\") pod \"tuned-vqcfh\" (UID: \"12be562e-cf78-49bc-bf71-4a661981f451\") " pod="openshift-cluster-node-tuning-operator/tuned-vqcfh" May 26 16:08:32.081673 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:32.081068 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/12be562e-cf78-49bc-bf71-4a661981f451-etc-sysctl-d\") pod \"tuned-vqcfh\" (UID: \"12be562e-cf78-49bc-bf71-4a661981f451\") " pod="openshift-cluster-node-tuning-operator/tuned-vqcfh" May 26 16:08:32.081673 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:32.081083 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/12be562e-cf78-49bc-bf71-4a661981f451-etc-sysctl-conf\") pod \"tuned-vqcfh\" (UID: \"12be562e-cf78-49bc-bf71-4a661981f451\") " pod="openshift-cluster-node-tuning-operator/tuned-vqcfh" May 26 16:08:32.081673 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:32.081101 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12be562e-cf78-49bc-bf71-4a661981f451-tmp\") pod \"tuned-vqcfh\" (UID: \"12be562e-cf78-49bc-bf71-4a661981f451\") " pod="openshift-cluster-node-tuning-operator/tuned-vqcfh" May 26 16:08:32.081673 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:32.081140 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j8zms\" (UniqueName: \"kubernetes.io/projected/12be562e-cf78-49bc-bf71-4a661981f451-kube-api-access-j8zms\") pod \"tuned-vqcfh\" (UID: \"12be562e-cf78-49bc-bf71-4a661981f451\") " pod="openshift-cluster-node-tuning-operator/tuned-vqcfh" May 26 16:08:32.081673 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:32.081241 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/12be562e-cf78-49bc-bf71-4a661981f451-etc-systemd\") pod \"tuned-vqcfh\" (UID: \"12be562e-cf78-49bc-bf71-4a661981f451\") " pod="openshift-cluster-node-tuning-operator/tuned-vqcfh" May 26 16:08:32.083408 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:32.083361 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12be562e-cf78-49bc-bf71-4a661981f451-tmp\") pod \"tuned-vqcfh\" (UID: \"12be562e-cf78-49bc-bf71-4a661981f451\") " pod="openshift-cluster-node-tuning-operator/tuned-vqcfh" May 26 16:08:32.083542 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:32.083421 2560 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 26 16:08:32.083542 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:32.083452 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/12be562e-cf78-49bc-bf71-4a661981f451-etc-tuned\") pod \"tuned-vqcfh\" (UID: \"12be562e-cf78-49bc-bf71-4a661981f451\") " pod="openshift-cluster-node-tuning-operator/tuned-vqcfh" May 26 16:08:32.087384 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:32.087361 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 16:08:32.087384 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:32.087386 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 16:08:32.087552 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:32.087399 2560 projected.go:194] Error preparing data for projected volume kube-api-access-t622m for pod openshift-network-diagnostics/network-check-target-ms765: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 16:08:32.087552 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:32.087494 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ecc520c-06db-4173-ba8e-e18f25c05b2d-kube-api-access-t622m podName:0ecc520c-06db-4173-ba8e-e18f25c05b2d nodeName:}" failed. No retries permitted until 2026-05-26 16:08:32.587475458 +0000 UTC m=+3.117969059 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-t622m" (UniqueName: "kubernetes.io/projected/0ecc520c-06db-4173-ba8e-e18f25c05b2d-kube-api-access-t622m") pod "network-check-target-ms765" (UID: "0ecc520c-06db-4173-ba8e-e18f25c05b2d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 16:08:32.089923 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:32.089904 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8zms\" (UniqueName: \"kubernetes.io/projected/12be562e-cf78-49bc-bf71-4a661981f451-kube-api-access-j8zms\") pod \"tuned-vqcfh\" (UID: \"12be562e-cf78-49bc-bf71-4a661981f451\") " pod="openshift-cluster-node-tuning-operator/tuned-vqcfh" May 26 16:08:32.090016 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:32.089954 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wh5b\" (UniqueName: \"kubernetes.io/projected/eec5f0e1-7fd2-4597-a1a0-3b5b10517934-kube-api-access-7wh5b\") pod \"network-metrics-daemon-ws4lv\" (UID: \"eec5f0e1-7fd2-4597-a1a0-3b5b10517934\") " pod="openshift-multus/network-metrics-daemon-ws4lv" May 26 16:08:32.167830 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:32.167791 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-45qvm" May 26 16:08:32.177631 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:32.177604 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nqcwn" May 26 16:08:32.188263 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:32.188233 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5rp4s" May 26 16:08:32.193777 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:32.193760 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2r6kq" May 26 16:08:32.199046 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:32.199025 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bqsfl" May 26 16:08:32.207028 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:32.207007 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6kkzr" May 26 16:08:32.213618 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:32.213594 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:32.223236 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:32.223213 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cn7v" May 26 16:08:32.227850 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:32.227828 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vqcfh" May 26 16:08:32.583749 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:32.583719 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eec5f0e1-7fd2-4597-a1a0-3b5b10517934-metrics-certs\") pod \"network-metrics-daemon-ws4lv\" (UID: \"eec5f0e1-7fd2-4597-a1a0-3b5b10517934\") " pod="openshift-multus/network-metrics-daemon-ws4lv" May 26 16:08:32.583909 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:32.583885 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 16:08:32.583963 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:32.583952 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eec5f0e1-7fd2-4597-a1a0-3b5b10517934-metrics-certs podName:eec5f0e1-7fd2-4597-a1a0-3b5b10517934 nodeName:}" failed. No retries permitted until 2026-05-26 16:08:33.58393619 +0000 UTC m=+4.114429790 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eec5f0e1-7fd2-4597-a1a0-3b5b10517934-metrics-certs") pod "network-metrics-daemon-ws4lv" (UID: "eec5f0e1-7fd2-4597-a1a0-3b5b10517934") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 16:08:32.649917 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:32.649821 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8045062_09e4_495a_ba60_aefc78dd16b7.slice/crio-7401ad8a902a824a92348036b1b6323c65def49bbe59170599177ba8f23b4b7c WatchSource:0}: Error finding container 7401ad8a902a824a92348036b1b6323c65def49bbe59170599177ba8f23b4b7c: Status 404 returned error can't find the container with id 7401ad8a902a824a92348036b1b6323c65def49bbe59170599177ba8f23b4b7c May 26 16:08:32.651461 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:32.651423 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45ada7c3_c4cd_423d_b8b9_a3ed76d9e56e.slice/crio-5fa114131b0470580b94f26fe5b8b5bbdd3626cf873cedb2359fedcc61f3c319 WatchSource:0}: Error finding container 5fa114131b0470580b94f26fe5b8b5bbdd3626cf873cedb2359fedcc61f3c319: Status 404 returned error can't find the container with id 5fa114131b0470580b94f26fe5b8b5bbdd3626cf873cedb2359fedcc61f3c319 May 26 16:08:32.652728 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:32.652642 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeae253a8_1f39_46f2_abe6_b677fff8aa74.slice/crio-3b20b6b3a7ee1043f1276546e1dcc9310879bdf0bca00bc8cb39ee0500a168d1 WatchSource:0}: Error finding container 3b20b6b3a7ee1043f1276546e1dcc9310879bdf0bca00bc8cb39ee0500a168d1: Status 404 returned error can't find the container with id 3b20b6b3a7ee1043f1276546e1dcc9310879bdf0bca00bc8cb39ee0500a168d1 May 26 16:08:32.654731 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:32.654612 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7848e219_3fad_4749_80de_651dc7faace5.slice/crio-b3c6e0885f6d656c9fdc9cc09c6585a34a22c74025e2aa9c998ae2312eff0227 WatchSource:0}: Error finding container b3c6e0885f6d656c9fdc9cc09c6585a34a22c74025e2aa9c998ae2312eff0227: Status 404 returned error can't find the container with id b3c6e0885f6d656c9fdc9cc09c6585a34a22c74025e2aa9c998ae2312eff0227 May 26 16:08:32.655414 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:32.655391 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode88baa86_d2fb_4052_9453_0fb254a02aa1.slice/crio-0e19feccb7695d5aef176f4023980f53aa8e83c73f1e063a56771312e1fd75b7 WatchSource:0}: Error finding container 0e19feccb7695d5aef176f4023980f53aa8e83c73f1e063a56771312e1fd75b7: Status 404 returned error can't find the container with id 0e19feccb7695d5aef176f4023980f53aa8e83c73f1e063a56771312e1fd75b7 May 26 16:08:32.659376 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:32.659084 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12be562e_cf78_49bc_bf71_4a661981f451.slice/crio-16dd5afe02f3984b49c34215b6694ddb1acbd0c0d3f98dbe9a10fbb87bd1b910 WatchSource:0}: Error finding container 16dd5afe02f3984b49c34215b6694ddb1acbd0c0d3f98dbe9a10fbb87bd1b910: Status 404 returned error can't find the container with id 16dd5afe02f3984b49c34215b6694ddb1acbd0c0d3f98dbe9a10fbb87bd1b910 May 26 16:08:32.663274 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:32.663249 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d3a8f3a_02fd_4849_a169_2b72451d600a.slice/crio-b243f03c419cea659f1c5bab205c4a1a3144ec87c70a34bacfde6ec427f3b689 WatchSource:0}: Error finding container b243f03c419cea659f1c5bab205c4a1a3144ec87c70a34bacfde6ec427f3b689: Status 404 returned error can't find the container with id b243f03c419cea659f1c5bab205c4a1a3144ec87c70a34bacfde6ec427f3b689 May 26 16:08:32.664261 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:08:32.663947 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fb3d31f_2753_4592_a4da_a8cbf5a69a38.slice/crio-d42d44867cd147d0dc9a9516233cf56505f56525e4cdc7d299c78b90e3c2f670 WatchSource:0}: Error finding container d42d44867cd147d0dc9a9516233cf56505f56525e4cdc7d299c78b90e3c2f670: Status 404 returned error can't find the container with id d42d44867cd147d0dc9a9516233cf56505f56525e4cdc7d299c78b90e3c2f670 May 26 16:08:32.684232 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:32.684071 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t622m\" (UniqueName: \"kubernetes.io/projected/0ecc520c-06db-4173-ba8e-e18f25c05b2d-kube-api-access-t622m\") pod \"network-check-target-ms765\" (UID: \"0ecc520c-06db-4173-ba8e-e18f25c05b2d\") " pod="openshift-network-diagnostics/network-check-target-ms765" May 26 16:08:32.684311 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:32.684217 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 16:08:32.684311 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:32.684289 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 16:08:32.684311 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:32.684300 2560 projected.go:194] Error preparing data for projected volume kube-api-access-t622m for pod openshift-network-diagnostics/network-check-target-ms765: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 16:08:32.684404 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:32.684359 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ecc520c-06db-4173-ba8e-e18f25c05b2d-kube-api-access-t622m podName:0ecc520c-06db-4173-ba8e-e18f25c05b2d nodeName:}" failed. No retries permitted until 2026-05-26 16:08:33.684344393 +0000 UTC m=+4.214837979 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-t622m" (UniqueName: "kubernetes.io/projected/0ecc520c-06db-4173-ba8e-e18f25c05b2d-kube-api-access-t622m") pod "network-check-target-ms765" (UID: "0ecc520c-06db-4173-ba8e-e18f25c05b2d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 16:08:32.906976 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:32.906874 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 16:03:30 +0000 UTC" deadline="2027-11-27 20:50:10.479805957 +0000 UTC" May 26 16:08:32.906976 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:32.906904 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13204h41m37.572903723s" May 26 16:08:33.002905 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:33.002879 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ms765" May 26 16:08:33.003012 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:33.002887 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ws4lv" May 26 16:08:33.003012 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:33.002993 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ms765" podUID="0ecc520c-06db-4173-ba8e-e18f25c05b2d" May 26 16:08:33.003077 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:33.003048 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ws4lv" podUID="eec5f0e1-7fd2-4597-a1a0-3b5b10517934" May 26 16:08:33.011657 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:33.011626 2560 generic.go:358] "Generic (PLEG): container finished" podID="3fee12dcae6578402519bc5aede8750c" containerID="186f78e57c25fc5258b0bef735445881c013b23578eb0b3feb52c1d305e1ed79" exitCode=0 May 26 16:08:33.011861 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:33.011711 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-102.ec2.internal" event={"ID":"3fee12dcae6578402519bc5aede8750c","Type":"ContainerDied","Data":"186f78e57c25fc5258b0bef735445881c013b23578eb0b3feb52c1d305e1ed79"} May 26 16:08:33.012986 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:33.012959 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cn7v" event={"ID":"8fb3d31f-2753-4592-a4da-a8cbf5a69a38","Type":"ContainerStarted","Data":"d42d44867cd147d0dc9a9516233cf56505f56525e4cdc7d299c78b90e3c2f670"} May 26 16:08:33.014103 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:33.014046 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5rp4s" event={"ID":"ce8f2e7d-5806-41f9-aed0-49e4edec1092","Type":"ContainerStarted","Data":"406a1b7090d300fcfe256cba555eeb7ab20d8aa2f5b6e344cca9857394c953c8"} May 26 16:08:33.015230 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:33.015210 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bqsfl" event={"ID":"7848e219-3fad-4749-80de-651dc7faace5","Type":"ContainerStarted","Data":"b3c6e0885f6d656c9fdc9cc09c6585a34a22c74025e2aa9c998ae2312eff0227"} May 26 16:08:33.016401 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:33.016379 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6kkzr" event={"ID":"45ada7c3-c4cd-423d-b8b9-a3ed76d9e56e","Type":"ContainerStarted","Data":"5fa114131b0470580b94f26fe5b8b5bbdd3626cf873cedb2359fedcc61f3c319"} May 26 16:08:33.017725 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:33.017611 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2r6kq" event={"ID":"eae253a8-1f39-46f2-abe6-b677fff8aa74","Type":"ContainerStarted","Data":"3b20b6b3a7ee1043f1276546e1dcc9310879bdf0bca00bc8cb39ee0500a168d1"} May 26 16:08:33.018847 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:33.018823 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-45qvm" event={"ID":"b8045062-09e4-495a-ba60-aefc78dd16b7","Type":"ContainerStarted","Data":"7401ad8a902a824a92348036b1b6323c65def49bbe59170599177ba8f23b4b7c"} May 26 16:08:33.020283 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:33.020243 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-102.ec2.internal" event={"ID":"2e1cb75f0e94e5eb2d26b2c46dee4fa3","Type":"ContainerStarted","Data":"1b7b5803b7f4085ef85fa28b041afa317cb50685a16b87e5a4e2ca71002eb69b"} May 26 16:08:33.021694 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:33.021668 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nqcwn" event={"ID":"2d3a8f3a-02fd-4849-a169-2b72451d600a","Type":"ContainerStarted","Data":"b243f03c419cea659f1c5bab205c4a1a3144ec87c70a34bacfde6ec427f3b689"} May 26 16:08:33.023019 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:33.022980 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vqcfh" event={"ID":"12be562e-cf78-49bc-bf71-4a661981f451","Type":"ContainerStarted","Data":"16dd5afe02f3984b49c34215b6694ddb1acbd0c0d3f98dbe9a10fbb87bd1b910"} May 26 16:08:33.025290 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:33.025266 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" event={"ID":"e88baa86-d2fb-4052-9453-0fb254a02aa1","Type":"ContainerStarted","Data":"0e19feccb7695d5aef176f4023980f53aa8e83c73f1e063a56771312e1fd75b7"} May 26 16:08:33.592577 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:33.591992 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eec5f0e1-7fd2-4597-a1a0-3b5b10517934-metrics-certs\") pod \"network-metrics-daemon-ws4lv\" (UID: \"eec5f0e1-7fd2-4597-a1a0-3b5b10517934\") " pod="openshift-multus/network-metrics-daemon-ws4lv" May 26 16:08:33.592577 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:33.592150 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 16:08:33.592577 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:33.592219 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eec5f0e1-7fd2-4597-a1a0-3b5b10517934-metrics-certs podName:eec5f0e1-7fd2-4597-a1a0-3b5b10517934 nodeName:}" failed. No retries permitted until 2026-05-26 16:08:35.592198485 +0000 UTC m=+6.122692072 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eec5f0e1-7fd2-4597-a1a0-3b5b10517934-metrics-certs") pod "network-metrics-daemon-ws4lv" (UID: "eec5f0e1-7fd2-4597-a1a0-3b5b10517934") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 16:08:33.693174 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:33.693135 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t622m\" (UniqueName: \"kubernetes.io/projected/0ecc520c-06db-4173-ba8e-e18f25c05b2d-kube-api-access-t622m\") pod \"network-check-target-ms765\" (UID: \"0ecc520c-06db-4173-ba8e-e18f25c05b2d\") " pod="openshift-network-diagnostics/network-check-target-ms765" May 26 16:08:33.693344 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:33.693317 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 16:08:33.693344 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:33.693336 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 16:08:33.693479 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:33.693349 2560 projected.go:194] Error preparing data for projected volume kube-api-access-t622m for pod openshift-network-diagnostics/network-check-target-ms765: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 16:08:33.693479 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:33.693412 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ecc520c-06db-4173-ba8e-e18f25c05b2d-kube-api-access-t622m podName:0ecc520c-06db-4173-ba8e-e18f25c05b2d nodeName:}" failed. No retries permitted until 2026-05-26 16:08:35.693391845 +0000 UTC m=+6.223885448 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-t622m" (UniqueName: "kubernetes.io/projected/0ecc520c-06db-4173-ba8e-e18f25c05b2d-kube-api-access-t622m") pod "network-check-target-ms765" (UID: "0ecc520c-06db-4173-ba8e-e18f25c05b2d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 16:08:34.050553 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:34.050489 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-102.ec2.internal" event={"ID":"3fee12dcae6578402519bc5aede8750c","Type":"ContainerStarted","Data":"30ef8b259b0d3259f493018bbe3399c826d9297ccce6481ca4befd41d7d4662e"} May 26 16:08:34.065792 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:34.065732 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-102.ec2.internal" podStartSLOduration=3.065712961 podStartE2EDuration="3.065712961s" podCreationTimestamp="2026-05-26 16:08:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 16:08:33.038066319 +0000 UTC m=+3.568559927" watchObservedRunningTime="2026-05-26 16:08:34.065712961 +0000 UTC m=+4.596206573" May 26 16:08:35.003182 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:35.003117 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ms765" May 26 16:08:35.003362 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:35.003249 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ms765" podUID="0ecc520c-06db-4173-ba8e-e18f25c05b2d" May 26 16:08:35.003736 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:35.003713 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ws4lv" May 26 16:08:35.003837 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:35.003819 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ws4lv" podUID="eec5f0e1-7fd2-4597-a1a0-3b5b10517934" May 26 16:08:35.044306 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:35.044223 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-102.ec2.internal" podStartSLOduration=4.044202626 podStartE2EDuration="4.044202626s" podCreationTimestamp="2026-05-26 16:08:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 16:08:34.066048656 +0000 UTC m=+4.596542262" watchObservedRunningTime="2026-05-26 16:08:35.044202626 +0000 UTC m=+5.574696236" May 26 16:08:35.044891 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:35.044864 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-6s4f7"] May 26 16:08:35.047833 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:35.047812 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6s4f7" May 26 16:08:35.047935 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:35.047897 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6s4f7" podUID="abe6e974-b6ff-4fa6-93d5-8aa4be27b866" May 26 16:08:35.109903 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:35.109864 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/abe6e974-b6ff-4fa6-93d5-8aa4be27b866-original-pull-secret\") pod \"global-pull-secret-syncer-6s4f7\" (UID: \"abe6e974-b6ff-4fa6-93d5-8aa4be27b866\") " pod="kube-system/global-pull-secret-syncer-6s4f7" May 26 16:08:35.109903 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:35.109919 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/abe6e974-b6ff-4fa6-93d5-8aa4be27b866-kubelet-config\") pod \"global-pull-secret-syncer-6s4f7\" (UID: \"abe6e974-b6ff-4fa6-93d5-8aa4be27b866\") " pod="kube-system/global-pull-secret-syncer-6s4f7" May 26 16:08:35.110513 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:35.109948 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/abe6e974-b6ff-4fa6-93d5-8aa4be27b866-dbus\") pod \"global-pull-secret-syncer-6s4f7\" (UID: \"abe6e974-b6ff-4fa6-93d5-8aa4be27b866\") " pod="kube-system/global-pull-secret-syncer-6s4f7" May 26 16:08:35.211819 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:35.211064 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/abe6e974-b6ff-4fa6-93d5-8aa4be27b866-original-pull-secret\") pod \"global-pull-secret-syncer-6s4f7\" (UID: \"abe6e974-b6ff-4fa6-93d5-8aa4be27b866\") " pod="kube-system/global-pull-secret-syncer-6s4f7" May 26 16:08:35.211819 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:35.211114 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/abe6e974-b6ff-4fa6-93d5-8aa4be27b866-kubelet-config\") pod \"global-pull-secret-syncer-6s4f7\" (UID: \"abe6e974-b6ff-4fa6-93d5-8aa4be27b866\") " pod="kube-system/global-pull-secret-syncer-6s4f7" May 26 16:08:35.211819 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:35.211141 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/abe6e974-b6ff-4fa6-93d5-8aa4be27b866-dbus\") pod \"global-pull-secret-syncer-6s4f7\" (UID: \"abe6e974-b6ff-4fa6-93d5-8aa4be27b866\") " pod="kube-system/global-pull-secret-syncer-6s4f7" May 26 16:08:35.211819 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:35.211320 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/abe6e974-b6ff-4fa6-93d5-8aa4be27b866-dbus\") pod \"global-pull-secret-syncer-6s4f7\" (UID: \"abe6e974-b6ff-4fa6-93d5-8aa4be27b866\") " pod="kube-system/global-pull-secret-syncer-6s4f7" May 26 16:08:35.211819 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:35.211458 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 26 16:08:35.211819 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:35.211516 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abe6e974-b6ff-4fa6-93d5-8aa4be27b866-original-pull-secret podName:abe6e974-b6ff-4fa6-93d5-8aa4be27b866 nodeName:}" failed. No retries permitted until 2026-05-26 16:08:35.71149806 +0000 UTC m=+6.241991660 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/abe6e974-b6ff-4fa6-93d5-8aa4be27b866-original-pull-secret") pod "global-pull-secret-syncer-6s4f7" (UID: "abe6e974-b6ff-4fa6-93d5-8aa4be27b866") : object "kube-system"/"original-pull-secret" not registered May 26 16:08:35.211819 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:35.211773 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/abe6e974-b6ff-4fa6-93d5-8aa4be27b866-kubelet-config\") pod \"global-pull-secret-syncer-6s4f7\" (UID: \"abe6e974-b6ff-4fa6-93d5-8aa4be27b866\") " pod="kube-system/global-pull-secret-syncer-6s4f7" May 26 16:08:35.615553 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:35.614961 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eec5f0e1-7fd2-4597-a1a0-3b5b10517934-metrics-certs\") pod \"network-metrics-daemon-ws4lv\" (UID: \"eec5f0e1-7fd2-4597-a1a0-3b5b10517934\") " pod="openshift-multus/network-metrics-daemon-ws4lv" May 26 16:08:35.615553 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:35.615129 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 16:08:35.615553 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:35.615191 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eec5f0e1-7fd2-4597-a1a0-3b5b10517934-metrics-certs podName:eec5f0e1-7fd2-4597-a1a0-3b5b10517934 nodeName:}" failed. No retries permitted until 2026-05-26 16:08:39.615173358 +0000 UTC m=+10.145666953 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eec5f0e1-7fd2-4597-a1a0-3b5b10517934-metrics-certs") pod "network-metrics-daemon-ws4lv" (UID: "eec5f0e1-7fd2-4597-a1a0-3b5b10517934") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 16:08:35.715771 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:35.715734 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t622m\" (UniqueName: \"kubernetes.io/projected/0ecc520c-06db-4173-ba8e-e18f25c05b2d-kube-api-access-t622m\") pod \"network-check-target-ms765\" (UID: \"0ecc520c-06db-4173-ba8e-e18f25c05b2d\") " pod="openshift-network-diagnostics/network-check-target-ms765" May 26 16:08:35.715987 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:35.715827 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/abe6e974-b6ff-4fa6-93d5-8aa4be27b866-original-pull-secret\") pod \"global-pull-secret-syncer-6s4f7\" (UID: \"abe6e974-b6ff-4fa6-93d5-8aa4be27b866\") " pod="kube-system/global-pull-secret-syncer-6s4f7" May 26 16:08:35.715987 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:35.715939 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 26 16:08:35.716107 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:35.716007 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abe6e974-b6ff-4fa6-93d5-8aa4be27b866-original-pull-secret podName:abe6e974-b6ff-4fa6-93d5-8aa4be27b866 nodeName:}" failed. No retries permitted until 2026-05-26 16:08:36.71598528 +0000 UTC m=+7.246478887 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/abe6e974-b6ff-4fa6-93d5-8aa4be27b866-original-pull-secret") pod "global-pull-secret-syncer-6s4f7" (UID: "abe6e974-b6ff-4fa6-93d5-8aa4be27b866") : object "kube-system"/"original-pull-secret" not registered May 26 16:08:35.716107 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:35.715939 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 16:08:35.716107 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:35.716067 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 16:08:35.716107 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:35.716083 2560 projected.go:194] Error preparing data for projected volume kube-api-access-t622m for pod openshift-network-diagnostics/network-check-target-ms765: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 16:08:35.716300 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:35.716176 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ecc520c-06db-4173-ba8e-e18f25c05b2d-kube-api-access-t622m podName:0ecc520c-06db-4173-ba8e-e18f25c05b2d nodeName:}" failed. No retries permitted until 2026-05-26 16:08:39.716138483 +0000 UTC m=+10.246632092 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-t622m" (UniqueName: "kubernetes.io/projected/0ecc520c-06db-4173-ba8e-e18f25c05b2d-kube-api-access-t622m") pod "network-check-target-ms765" (UID: "0ecc520c-06db-4173-ba8e-e18f25c05b2d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 16:08:36.725722 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:36.725681 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/abe6e974-b6ff-4fa6-93d5-8aa4be27b866-original-pull-secret\") pod \"global-pull-secret-syncer-6s4f7\" (UID: \"abe6e974-b6ff-4fa6-93d5-8aa4be27b866\") " pod="kube-system/global-pull-secret-syncer-6s4f7" May 26 16:08:36.726189 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:36.725807 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 26 16:08:36.726189 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:36.725888 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abe6e974-b6ff-4fa6-93d5-8aa4be27b866-original-pull-secret podName:abe6e974-b6ff-4fa6-93d5-8aa4be27b866 nodeName:}" failed. No retries permitted until 2026-05-26 16:08:38.725868209 +0000 UTC m=+9.256361812 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/abe6e974-b6ff-4fa6-93d5-8aa4be27b866-original-pull-secret") pod "global-pull-secret-syncer-6s4f7" (UID: "abe6e974-b6ff-4fa6-93d5-8aa4be27b866") : object "kube-system"/"original-pull-secret" not registered May 26 16:08:37.003648 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:37.003564 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ms765" May 26 16:08:37.003815 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:37.003573 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6s4f7" May 26 16:08:37.003815 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:37.003701 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ms765" podUID="0ecc520c-06db-4173-ba8e-e18f25c05b2d" May 26 16:08:37.003815 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:37.003714 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ws4lv" May 26 16:08:37.003815 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:37.003794 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6s4f7" podUID="abe6e974-b6ff-4fa6-93d5-8aa4be27b866" May 26 16:08:37.004078 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:37.003891 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ws4lv" podUID="eec5f0e1-7fd2-4597-a1a0-3b5b10517934" May 26 16:08:38.743578 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:38.743542 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/abe6e974-b6ff-4fa6-93d5-8aa4be27b866-original-pull-secret\") pod \"global-pull-secret-syncer-6s4f7\" (UID: \"abe6e974-b6ff-4fa6-93d5-8aa4be27b866\") " pod="kube-system/global-pull-secret-syncer-6s4f7" May 26 16:08:38.744020 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:38.743661 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 26 16:08:38.744020 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:38.743736 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abe6e974-b6ff-4fa6-93d5-8aa4be27b866-original-pull-secret podName:abe6e974-b6ff-4fa6-93d5-8aa4be27b866 nodeName:}" failed. No retries permitted until 2026-05-26 16:08:42.743716135 +0000 UTC m=+13.274209920 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/abe6e974-b6ff-4fa6-93d5-8aa4be27b866-original-pull-secret") pod "global-pull-secret-syncer-6s4f7" (UID: "abe6e974-b6ff-4fa6-93d5-8aa4be27b866") : object "kube-system"/"original-pull-secret" not registered May 26 16:08:39.002929 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:39.002838 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ws4lv" May 26 16:08:39.002929 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:39.002873 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6s4f7" May 26 16:08:39.003145 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:39.002838 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ms765" May 26 16:08:39.003145 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:39.002985 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ws4lv" podUID="eec5f0e1-7fd2-4597-a1a0-3b5b10517934" May 26 16:08:39.003145 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:39.003054 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ms765" podUID="0ecc520c-06db-4173-ba8e-e18f25c05b2d" May 26 16:08:39.003305 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:39.003150 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6s4f7" podUID="abe6e974-b6ff-4fa6-93d5-8aa4be27b866" May 26 16:08:39.653301 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:39.653207 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eec5f0e1-7fd2-4597-a1a0-3b5b10517934-metrics-certs\") pod \"network-metrics-daemon-ws4lv\" (UID: \"eec5f0e1-7fd2-4597-a1a0-3b5b10517934\") " pod="openshift-multus/network-metrics-daemon-ws4lv" May 26 16:08:39.653533 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:39.653372 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 16:08:39.653533 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:39.653477 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eec5f0e1-7fd2-4597-a1a0-3b5b10517934-metrics-certs podName:eec5f0e1-7fd2-4597-a1a0-3b5b10517934 nodeName:}" failed. No retries permitted until 2026-05-26 16:08:47.653453984 +0000 UTC m=+18.183947584 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eec5f0e1-7fd2-4597-a1a0-3b5b10517934-metrics-certs") pod "network-metrics-daemon-ws4lv" (UID: "eec5f0e1-7fd2-4597-a1a0-3b5b10517934") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 16:08:39.754663 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:39.754599 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t622m\" (UniqueName: \"kubernetes.io/projected/0ecc520c-06db-4173-ba8e-e18f25c05b2d-kube-api-access-t622m\") pod \"network-check-target-ms765\" (UID: \"0ecc520c-06db-4173-ba8e-e18f25c05b2d\") " pod="openshift-network-diagnostics/network-check-target-ms765" May 26 16:08:39.755113 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:39.754776 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 16:08:39.755113 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:39.754795 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 16:08:39.755113 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:39.754808 2560 projected.go:194] Error preparing data for projected volume kube-api-access-t622m for pod openshift-network-diagnostics/network-check-target-ms765: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 16:08:39.755113 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:39.754876 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ecc520c-06db-4173-ba8e-e18f25c05b2d-kube-api-access-t622m podName:0ecc520c-06db-4173-ba8e-e18f25c05b2d nodeName:}" failed. No retries permitted until 2026-05-26 16:08:47.75485825 +0000 UTC m=+18.285351858 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-t622m" (UniqueName: "kubernetes.io/projected/0ecc520c-06db-4173-ba8e-e18f25c05b2d-kube-api-access-t622m") pod "network-check-target-ms765" (UID: "0ecc520c-06db-4173-ba8e-e18f25c05b2d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 16:08:41.003411 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:41.003363 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6s4f7" May 26 16:08:41.003882 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:41.003512 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6s4f7" podUID="abe6e974-b6ff-4fa6-93d5-8aa4be27b866" May 26 16:08:41.003882 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:41.003863 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ws4lv" May 26 16:08:41.003994 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:41.003975 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ws4lv" podUID="eec5f0e1-7fd2-4597-a1a0-3b5b10517934" May 26 16:08:41.004053 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:41.003982 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ms765" May 26 16:08:41.004105 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:41.004070 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ms765" podUID="0ecc520c-06db-4173-ba8e-e18f25c05b2d" May 26 16:08:42.776857 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:42.776817 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/abe6e974-b6ff-4fa6-93d5-8aa4be27b866-original-pull-secret\") pod \"global-pull-secret-syncer-6s4f7\" (UID: \"abe6e974-b6ff-4fa6-93d5-8aa4be27b866\") " pod="kube-system/global-pull-secret-syncer-6s4f7" May 26 16:08:42.777284 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:42.776933 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 26 16:08:42.777284 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:42.777012 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abe6e974-b6ff-4fa6-93d5-8aa4be27b866-original-pull-secret podName:abe6e974-b6ff-4fa6-93d5-8aa4be27b866 nodeName:}" failed. No retries permitted until 2026-05-26 16:08:50.776988758 +0000 UTC m=+21.307482354 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/abe6e974-b6ff-4fa6-93d5-8aa4be27b866-original-pull-secret") pod "global-pull-secret-syncer-6s4f7" (UID: "abe6e974-b6ff-4fa6-93d5-8aa4be27b866") : object "kube-system"/"original-pull-secret" not registered May 26 16:08:43.003122 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:43.003088 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6s4f7" May 26 16:08:43.003272 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:43.003088 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ms765" May 26 16:08:43.003272 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:43.003200 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6s4f7" podUID="abe6e974-b6ff-4fa6-93d5-8aa4be27b866" May 26 16:08:43.003388 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:43.003094 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ws4lv" May 26 16:08:43.003388 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:43.003278 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ms765" podUID="0ecc520c-06db-4173-ba8e-e18f25c05b2d" May 26 16:08:43.003497 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:43.003396 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ws4lv" podUID="eec5f0e1-7fd2-4597-a1a0-3b5b10517934" May 26 16:08:45.003212 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:45.003172 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6s4f7" May 26 16:08:45.003212 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:45.003204 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ms765" May 26 16:08:45.003724 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:45.003182 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ws4lv" May 26 16:08:45.003724 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:45.003291 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6s4f7" podUID="abe6e974-b6ff-4fa6-93d5-8aa4be27b866" May 26 16:08:45.003724 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:45.003385 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ms765" podUID="0ecc520c-06db-4173-ba8e-e18f25c05b2d" May 26 16:08:45.003724 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:45.003486 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ws4lv" podUID="eec5f0e1-7fd2-4597-a1a0-3b5b10517934" May 26 16:08:47.003805 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:47.003758 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6s4f7" May 26 16:08:47.004300 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:47.003758 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ws4lv" May 26 16:08:47.004300 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:47.003887 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6s4f7" podUID="abe6e974-b6ff-4fa6-93d5-8aa4be27b866" May 26 16:08:47.004300 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:47.003771 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ms765" May 26 16:08:47.004300 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:47.003981 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ws4lv" podUID="eec5f0e1-7fd2-4597-a1a0-3b5b10517934" May 26 16:08:47.004300 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:47.004074 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ms765" podUID="0ecc520c-06db-4173-ba8e-e18f25c05b2d" May 26 16:08:47.715617 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:47.715580 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eec5f0e1-7fd2-4597-a1a0-3b5b10517934-metrics-certs\") pod \"network-metrics-daemon-ws4lv\" (UID: \"eec5f0e1-7fd2-4597-a1a0-3b5b10517934\") " pod="openshift-multus/network-metrics-daemon-ws4lv" May 26 16:08:47.715890 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:47.715731 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 16:08:47.715890 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:47.715806 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eec5f0e1-7fd2-4597-a1a0-3b5b10517934-metrics-certs podName:eec5f0e1-7fd2-4597-a1a0-3b5b10517934 nodeName:}" failed. No retries permitted until 2026-05-26 16:09:03.715787042 +0000 UTC m=+34.246280646 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eec5f0e1-7fd2-4597-a1a0-3b5b10517934-metrics-certs") pod "network-metrics-daemon-ws4lv" (UID: "eec5f0e1-7fd2-4597-a1a0-3b5b10517934") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 16:08:47.816557 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:47.816523 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t622m\" (UniqueName: \"kubernetes.io/projected/0ecc520c-06db-4173-ba8e-e18f25c05b2d-kube-api-access-t622m\") pod \"network-check-target-ms765\" (UID: \"0ecc520c-06db-4173-ba8e-e18f25c05b2d\") " pod="openshift-network-diagnostics/network-check-target-ms765" May 26 16:08:47.816722 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:47.816701 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 16:08:47.816722 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:47.816723 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 16:08:47.816813 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:47.816734 2560 projected.go:194] Error preparing data for projected volume kube-api-access-t622m for pod openshift-network-diagnostics/network-check-target-ms765: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 16:08:47.816813 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:47.816790 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ecc520c-06db-4173-ba8e-e18f25c05b2d-kube-api-access-t622m podName:0ecc520c-06db-4173-ba8e-e18f25c05b2d nodeName:}" failed. No retries permitted until 2026-05-26 16:09:03.816775177 +0000 UTC m=+34.347268777 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-t622m" (UniqueName: "kubernetes.io/projected/0ecc520c-06db-4173-ba8e-e18f25c05b2d-kube-api-access-t622m") pod "network-check-target-ms765" (UID: "0ecc520c-06db-4173-ba8e-e18f25c05b2d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 16:08:49.003504 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:49.003464 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6s4f7" May 26 16:08:49.003504 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:49.003486 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ws4lv" May 26 16:08:49.003938 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:49.003478 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ms765" May 26 16:08:49.003938 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:49.003607 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6s4f7" podUID="abe6e974-b6ff-4fa6-93d5-8aa4be27b866" May 26 16:08:49.003938 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:49.003646 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ms765" podUID="0ecc520c-06db-4173-ba8e-e18f25c05b2d" May 26 16:08:49.003938 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:49.003699 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ws4lv" podUID="eec5f0e1-7fd2-4597-a1a0-3b5b10517934" May 26 16:08:50.842619 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:50.842565 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/abe6e974-b6ff-4fa6-93d5-8aa4be27b866-original-pull-secret\") pod \"global-pull-secret-syncer-6s4f7\" (UID: \"abe6e974-b6ff-4fa6-93d5-8aa4be27b866\") " pod="kube-system/global-pull-secret-syncer-6s4f7" May 26 16:08:50.842976 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:50.842758 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 26 16:08:50.842976 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:50.842812 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abe6e974-b6ff-4fa6-93d5-8aa4be27b866-original-pull-secret podName:abe6e974-b6ff-4fa6-93d5-8aa4be27b866 nodeName:}" failed. No retries permitted until 2026-05-26 16:09:06.842793592 +0000 UTC m=+37.373287180 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/abe6e974-b6ff-4fa6-93d5-8aa4be27b866-original-pull-secret") pod "global-pull-secret-syncer-6s4f7" (UID: "abe6e974-b6ff-4fa6-93d5-8aa4be27b866") : object "kube-system"/"original-pull-secret" not registered May 26 16:08:51.003309 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:51.003096 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6s4f7" May 26 16:08:51.003467 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:51.003440 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6s4f7" podUID="abe6e974-b6ff-4fa6-93d5-8aa4be27b866" May 26 16:08:51.003880 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:51.003858 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ws4lv" May 26 16:08:51.003998 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:51.003971 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ws4lv" podUID="eec5f0e1-7fd2-4597-a1a0-3b5b10517934" May 26 16:08:51.004062 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:51.004046 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ms765" May 26 16:08:51.004180 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:51.004160 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ms765" podUID="0ecc520c-06db-4173-ba8e-e18f25c05b2d" May 26 16:08:51.080288 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:51.080257 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" event={"ID":"e88baa86-d2fb-4052-9453-0fb254a02aa1","Type":"ContainerStarted","Data":"a9a962aed8e6a3bf57919e73e4ddc1210ec884b8fd589542bf833daace4847e2"} May 26 16:08:51.081797 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:51.081760 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cn7v" event={"ID":"8fb3d31f-2753-4592-a4da-a8cbf5a69a38","Type":"ContainerStarted","Data":"c0a4246d9189492ee7b9714506eb26adafd9acd11ea7404d30ab80386447a559"} May 26 16:08:51.083158 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:51.083120 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5rp4s" event={"ID":"ce8f2e7d-5806-41f9-aed0-49e4edec1092","Type":"ContainerStarted","Data":"ace1000265f4def677d4c85fc28ca0b6d6d8f02d181b6668b40553deea733cd5"} May 26 16:08:51.084899 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:51.084844 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bqsfl" event={"ID":"7848e219-3fad-4749-80de-651dc7faace5","Type":"ContainerStarted","Data":"e0749dadb48c92d011df26791096b259d7abe53a8cd3b9ca75941480024e1244"} May 26 16:08:51.089250 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:51.089226 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6kkzr" event={"ID":"45ada7c3-c4cd-423d-b8b9-a3ed76d9e56e","Type":"ContainerStarted","Data":"108dfb428e3dfab3ad29e92ecab53a81d972b3b0830984d785ce844851ffcdf2"} May 26 16:08:51.091039 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:51.091010 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2r6kq" event={"ID":"eae253a8-1f39-46f2-abe6-b677fff8aa74","Type":"ContainerStarted","Data":"6e2d44589519395513fe4a30448cf2e3982ffba02b36560541154200b0688aee"} May 26 16:08:51.092471 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:51.092451 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nqcwn" event={"ID":"2d3a8f3a-02fd-4849-a169-2b72451d600a","Type":"ContainerStarted","Data":"323d7b0a5ca1742cdf1e141eda0b1d432b4fd36cf2cc2e35bfdc175145ea4071"} May 26 16:08:51.093810 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:51.093709 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vqcfh" event={"ID":"12be562e-cf78-49bc-bf71-4a661981f451","Type":"ContainerStarted","Data":"248f4fd3612302e4c2b6dc8fb34c424ece380b0ce11aae330c07aa907eba51de"} May 26 16:08:51.099547 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:51.099505 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5rp4s" podStartSLOduration=2.959727329 podStartE2EDuration="21.099493305s" podCreationTimestamp="2026-05-26 16:08:30 +0000 UTC" firstStartedPulling="2026-05-26 16:08:32.662360484 +0000 UTC m=+3.192854085" lastFinishedPulling="2026-05-26 16:08:50.802126475 +0000 UTC m=+21.332620061" observedRunningTime="2026-05-26 16:08:51.099366882 +0000 UTC m=+21.629860490" watchObservedRunningTime="2026-05-26 16:08:51.099493305 +0000 UTC m=+21.629986914" May 26 16:08:51.115096 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:51.115044 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-nqcwn" podStartSLOduration=2.954561938 podStartE2EDuration="21.115027875s" podCreationTimestamp="2026-05-26 16:08:30 +0000 UTC" firstStartedPulling="2026-05-26 16:08:32.665580836 +0000 UTC m=+3.196074427" lastFinishedPulling="2026-05-26 16:08:50.826046764 +0000 UTC m=+21.356540364" observedRunningTime="2026-05-26 16:08:51.114692819 +0000 UTC m=+21.645186427" watchObservedRunningTime="2026-05-26 16:08:51.115027875 +0000 UTC m=+21.645521516" May 26 16:08:51.133343 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:51.133180 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-bqsfl" podStartSLOduration=2.95344716 podStartE2EDuration="21.13316575s" podCreationTimestamp="2026-05-26 16:08:30 +0000 UTC" firstStartedPulling="2026-05-26 16:08:32.656768745 +0000 UTC m=+3.187262348" lastFinishedPulling="2026-05-26 16:08:50.836487352 +0000 UTC m=+21.366980938" observedRunningTime="2026-05-26 16:08:51.132137169 +0000 UTC m=+21.662630776" watchObservedRunningTime="2026-05-26 16:08:51.13316575 +0000 UTC m=+21.663659357" May 26 16:08:51.147291 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:51.147250 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6kkzr" podStartSLOduration=7.800062946 podStartE2EDuration="21.147236963s" podCreationTimestamp="2026-05-26 16:08:30 +0000 UTC" firstStartedPulling="2026-05-26 16:08:32.653345553 +0000 UTC m=+3.183839152" lastFinishedPulling="2026-05-26 16:08:46.000519572 +0000 UTC m=+16.531013169" observedRunningTime="2026-05-26 16:08:51.146792138 +0000 UTC m=+21.677285747" watchObservedRunningTime="2026-05-26 16:08:51.147236963 +0000 UTC m=+21.677730571" May 26 16:08:51.190735 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:51.190674 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vqcfh" podStartSLOduration=3.028519143 podStartE2EDuration="21.19065553s" podCreationTimestamp="2026-05-26 16:08:30 +0000 UTC" firstStartedPulling="2026-05-26 16:08:32.664169808 +0000 UTC m=+3.194663407" lastFinishedPulling="2026-05-26 16:08:50.826306192 +0000 UTC m=+21.356799794" observedRunningTime="2026-05-26 16:08:51.189870287 +0000 UTC m=+21.720363897" watchObservedRunningTime="2026-05-26 16:08:51.19065553 +0000 UTC m=+21.721149138" May 26 16:08:52.096836 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:52.096760 2560 generic.go:358] "Generic (PLEG): container finished" podID="eae253a8-1f39-46f2-abe6-b677fff8aa74" containerID="6e2d44589519395513fe4a30448cf2e3982ffba02b36560541154200b0688aee" exitCode=0 May 26 16:08:52.096836 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:52.096828 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2r6kq" event={"ID":"eae253a8-1f39-46f2-abe6-b677fff8aa74","Type":"ContainerDied","Data":"6e2d44589519395513fe4a30448cf2e3982ffba02b36560541154200b0688aee"} May 26 16:08:52.098254 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:52.098203 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-45qvm" event={"ID":"b8045062-09e4-495a-ba60-aefc78dd16b7","Type":"ContainerStarted","Data":"45a8517fc83320162b7a9abebf27633c9ec2a7e5dcc6a60586e4c7e251cf8427"} May 26 16:08:52.100840 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:52.100813 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" event={"ID":"e88baa86-d2fb-4052-9453-0fb254a02aa1","Type":"ContainerStarted","Data":"9fa76dfcd0e0108733f1b85cdb84e3375ae50cd01190d3a525d2c2acd267aa2a"} May 26 16:08:52.100927 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:52.100849 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" event={"ID":"e88baa86-d2fb-4052-9453-0fb254a02aa1","Type":"ContainerStarted","Data":"04c8b74a4ecb8008446f2259910494b5cf91518599413dcee5f233719351a01a"} May 26 16:08:52.100927 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:52.100863 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" event={"ID":"e88baa86-d2fb-4052-9453-0fb254a02aa1","Type":"ContainerStarted","Data":"ced5bbb7e67459c7550a9668719fd3f6556e0f3a3aeff999cb13392d85f1eeaf"} May 26 16:08:52.100927 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:52.100875 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" event={"ID":"e88baa86-d2fb-4052-9453-0fb254a02aa1","Type":"ContainerStarted","Data":"1feae86151046bd97f92a0e6c3533f22f6454b10bc086dc46fb2330a1486effb"} May 26 16:08:52.100927 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:52.100883 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" event={"ID":"e88baa86-d2fb-4052-9453-0fb254a02aa1","Type":"ContainerStarted","Data":"20995a15a622031f725ac61e5e80189558aa79fa7f97c611716d0d36a800679b"} May 26 16:08:52.131878 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:52.131828 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-45qvm" podStartSLOduration=3.981254966 podStartE2EDuration="22.13181515s" podCreationTimestamp="2026-05-26 16:08:30 +0000 UTC" firstStartedPulling="2026-05-26 16:08:32.651552091 +0000 UTC m=+3.182045678" lastFinishedPulling="2026-05-26 16:08:50.802112263 +0000 UTC m=+21.332605862" observedRunningTime="2026-05-26 16:08:52.13177143 +0000 UTC m=+22.662265038" watchObservedRunningTime="2026-05-26 16:08:52.13181515 +0000 UTC m=+22.662308758" May 26 16:08:52.482916 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:52.482887 2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 26 16:08:52.944558 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:52.944418 2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-26T16:08:52.482911214Z","UUID":"0497e1a0-4b8b-41e2-8108-1afd62912ea9","Handler":null,"Name":"","Endpoint":""} May 26 16:08:52.949671 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:52.948671 2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 26 16:08:52.949671 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:52.948715 2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 26 16:08:53.002872 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:53.002843 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ms765" May 26 16:08:53.003037 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:53.002951 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6s4f7" May 26 16:08:53.003112 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:53.002974 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ms765" podUID="0ecc520c-06db-4173-ba8e-e18f25c05b2d" May 26 16:08:53.003112 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:53.003093 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6s4f7" podUID="abe6e974-b6ff-4fa6-93d5-8aa4be27b866" May 26 16:08:53.003215 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:53.003124 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ws4lv" May 26 16:08:53.003265 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:53.003232 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ws4lv" podUID="eec5f0e1-7fd2-4597-a1a0-3b5b10517934" May 26 16:08:53.104012 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:53.103981 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cn7v" event={"ID":"8fb3d31f-2753-4592-a4da-a8cbf5a69a38","Type":"ContainerStarted","Data":"e9535e70e43c133d0dc1c9a0ec6616735482f65d45e6bb5895aec153eb3880c6"} May 26 16:08:54.108266 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:54.107994 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cn7v" event={"ID":"8fb3d31f-2753-4592-a4da-a8cbf5a69a38","Type":"ContainerStarted","Data":"d4244f311901264cd8cb1e95bcfbb06ca9fd14a479ddd1c593ac427a70a8e48c"} May 26 16:08:54.111158 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:54.111134 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" event={"ID":"e88baa86-d2fb-4052-9453-0fb254a02aa1","Type":"ContainerStarted","Data":"6ac5cf7a9667e8f68893540bed5cebeed214679f821cc7cac8c912366edb1b04"} May 26 16:08:54.126750 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:54.126693 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4cn7v" podStartSLOduration=3.155922642 podStartE2EDuration="24.126677697s" podCreationTimestamp="2026-05-26 16:08:30 +0000 UTC" firstStartedPulling="2026-05-26 16:08:32.6659467 +0000 UTC m=+3.196440286" lastFinishedPulling="2026-05-26 16:08:53.636701755 +0000 UTC m=+24.167195341" observedRunningTime="2026-05-26 16:08:54.126642988 +0000 UTC m=+24.657136613" watchObservedRunningTime="2026-05-26 16:08:54.126677697 +0000 UTC m=+24.657171303" May 26 16:08:54.867251 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:54.867218 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6kkzr" May 26 16:08:54.867916 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:54.867882 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6kkzr" May 26 16:08:55.003385 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:55.003356 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ws4lv" May 26 16:08:55.003385 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:55.003386 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6s4f7" May 26 16:08:55.003633 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:55.003394 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ms765" May 26 16:08:55.003633 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:55.003497 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ws4lv" podUID="eec5f0e1-7fd2-4597-a1a0-3b5b10517934" May 26 16:08:55.003633 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:55.003583 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6s4f7" podUID="abe6e974-b6ff-4fa6-93d5-8aa4be27b866" May 26 16:08:55.003796 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:55.003682 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ms765" podUID="0ecc520c-06db-4173-ba8e-e18f25c05b2d" May 26 16:08:55.113609 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:55.113570 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6kkzr" May 26 16:08:55.114164 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:55.114126 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6kkzr" May 26 16:08:57.003007 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:57.002808 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6s4f7" May 26 16:08:57.003646 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:57.002852 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ms765" May 26 16:08:57.003646 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:57.003087 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6s4f7" podUID="abe6e974-b6ff-4fa6-93d5-8aa4be27b866" May 26 16:08:57.003646 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:57.003148 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ms765" podUID="0ecc520c-06db-4173-ba8e-e18f25c05b2d" May 26 16:08:57.003646 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:57.002876 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ws4lv" May 26 16:08:57.003646 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:57.003226 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ws4lv" podUID="eec5f0e1-7fd2-4597-a1a0-3b5b10517934" May 26 16:08:57.121603 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:57.121568 2560 generic.go:358] "Generic (PLEG): container finished" podID="eae253a8-1f39-46f2-abe6-b677fff8aa74" containerID="976ddfffa9eef458b5e6add9d0c7ae50d924ec10cd84ac4f09aeec6b15412e5e" exitCode=0 May 26 16:08:57.121768 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:57.121643 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2r6kq" event={"ID":"eae253a8-1f39-46f2-abe6-b677fff8aa74","Type":"ContainerDied","Data":"976ddfffa9eef458b5e6add9d0c7ae50d924ec10cd84ac4f09aeec6b15412e5e"} May 26 16:08:57.124793 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:57.124770 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" event={"ID":"e88baa86-d2fb-4052-9453-0fb254a02aa1","Type":"ContainerStarted","Data":"6f143aaf68de6b9b242d6c01528b731bdba296857efe9626508560437fe9ac43"} May 26 16:08:57.125084 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:57.125063 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:57.125184 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:57.125091 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:57.140534 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:57.140509 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:57.171551 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:57.171495 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" podStartSLOduration=8.84686147 podStartE2EDuration="27.171481245s" podCreationTimestamp="2026-05-26 16:08:30 +0000 UTC" firstStartedPulling="2026-05-26 16:08:32.659566502 +0000 UTC m=+3.190060097" lastFinishedPulling="2026-05-26 16:08:50.984186269 +0000 UTC m=+21.514679872" observedRunningTime="2026-05-26 16:08:57.170016572 +0000 UTC m=+27.700510179" watchObservedRunningTime="2026-05-26 16:08:57.171481245 +0000 UTC m=+27.701974853" May 26 16:08:58.058995 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:58.058953 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6s4f7"] May 26 16:08:58.059557 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:58.059071 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6s4f7" May 26 16:08:58.059557 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:58.059149 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6s4f7" podUID="abe6e974-b6ff-4fa6-93d5-8aa4be27b866" May 26 16:08:58.063152 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:58.063123 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ws4lv"] May 26 16:08:58.063283 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:58.063252 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ws4lv" May 26 16:08:58.063387 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:58.063365 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ws4lv" podUID="eec5f0e1-7fd2-4597-a1a0-3b5b10517934" May 26 16:08:58.063914 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:58.063893 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ms765"] May 26 16:08:58.064009 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:58.063996 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ms765" May 26 16:08:58.064107 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:08:58.064090 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ms765" podUID="0ecc520c-06db-4173-ba8e-e18f25c05b2d" May 26 16:08:58.129126 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:58.129092 2560 generic.go:358] "Generic (PLEG): container finished" podID="eae253a8-1f39-46f2-abe6-b677fff8aa74" containerID="a3a5e5bedf6422120fa9e7b213376364ff74a1e1727e8c3e60a32a9d5dbd5b52" exitCode=0 May 26 16:08:58.129262 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:58.129177 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2r6kq" event={"ID":"eae253a8-1f39-46f2-abe6-b677fff8aa74","Type":"ContainerDied","Data":"a3a5e5bedf6422120fa9e7b213376364ff74a1e1727e8c3e60a32a9d5dbd5b52"} May 26 16:08:58.130364 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:58.129723 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:58.145259 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:58.145233 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:08:59.132633 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:59.132545 2560 generic.go:358] "Generic (PLEG): container finished" podID="eae253a8-1f39-46f2-abe6-b677fff8aa74" containerID="b1030a071f7c67cf04ef6e773f12aa19d56942f498adb7a347f367f087fbae4b" exitCode=0 May 26 16:08:59.132976 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:08:59.132628 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2r6kq" event={"ID":"eae253a8-1f39-46f2-abe6-b677fff8aa74","Type":"ContainerDied","Data":"b1030a071f7c67cf04ef6e773f12aa19d56942f498adb7a347f367f087fbae4b"} May 26 16:09:00.005162 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:00.004908 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6s4f7" May 26 16:09:00.005312 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:00.004973 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ms765" May 26 16:09:00.005312 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:09:00.005284 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6s4f7" podUID="abe6e974-b6ff-4fa6-93d5-8aa4be27b866" May 26 16:09:00.005418 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:09:00.005336 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ms765" podUID="0ecc520c-06db-4173-ba8e-e18f25c05b2d" May 26 16:09:00.005418 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:00.005008 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ws4lv" May 26 16:09:00.005554 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:09:00.005462 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ws4lv" podUID="eec5f0e1-7fd2-4597-a1a0-3b5b10517934" May 26 16:09:02.003292 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:02.003258 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ms765" May 26 16:09:02.003292 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:02.003279 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ws4lv" May 26 16:09:02.004144 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:02.003258 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6s4f7" May 26 16:09:02.004144 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:09:02.003383 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ms765" podUID="0ecc520c-06db-4173-ba8e-e18f25c05b2d" May 26 16:09:02.004144 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:09:02.003451 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6s4f7" podUID="abe6e974-b6ff-4fa6-93d5-8aa4be27b866" May 26 16:09:02.004144 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:09:02.003555 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ws4lv" podUID="eec5f0e1-7fd2-4597-a1a0-3b5b10517934" May 26 16:09:03.737934 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:03.737900 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eec5f0e1-7fd2-4597-a1a0-3b5b10517934-metrics-certs\") pod \"network-metrics-daemon-ws4lv\" (UID: \"eec5f0e1-7fd2-4597-a1a0-3b5b10517934\") " pod="openshift-multus/network-metrics-daemon-ws4lv" May 26 16:09:03.738538 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:09:03.738023 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 16:09:03.738538 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:09:03.738083 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eec5f0e1-7fd2-4597-a1a0-3b5b10517934-metrics-certs podName:eec5f0e1-7fd2-4597-a1a0-3b5b10517934 nodeName:}" failed. No retries permitted until 2026-05-26 16:09:35.738069928 +0000 UTC m=+66.268563513 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eec5f0e1-7fd2-4597-a1a0-3b5b10517934-metrics-certs") pod "network-metrics-daemon-ws4lv" (UID: "eec5f0e1-7fd2-4597-a1a0-3b5b10517934") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 16:09:03.839006 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:03.838955 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t622m\" (UniqueName: \"kubernetes.io/projected/0ecc520c-06db-4173-ba8e-e18f25c05b2d-kube-api-access-t622m\") pod \"network-check-target-ms765\" (UID: \"0ecc520c-06db-4173-ba8e-e18f25c05b2d\") " pod="openshift-network-diagnostics/network-check-target-ms765" May 26 16:09:03.839212 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:09:03.839093 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 16:09:03.839212 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:09:03.839119 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 16:09:03.839212 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:09:03.839129 2560 projected.go:194] Error preparing data for projected volume kube-api-access-t622m for pod openshift-network-diagnostics/network-check-target-ms765: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 16:09:03.839212 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:09:03.839190 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ecc520c-06db-4173-ba8e-e18f25c05b2d-kube-api-access-t622m podName:0ecc520c-06db-4173-ba8e-e18f25c05b2d nodeName:}" failed. No retries permitted until 2026-05-26 16:09:35.839169395 +0000 UTC m=+66.369662985 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-t622m" (UniqueName: "kubernetes.io/projected/0ecc520c-06db-4173-ba8e-e18f25c05b2d-kube-api-access-t622m") pod "network-check-target-ms765" (UID: "0ecc520c-06db-4173-ba8e-e18f25c05b2d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 16:09:04.003657 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:04.003574 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ms765" May 26 16:09:04.003881 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:09:04.003687 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ms765" podUID="0ecc520c-06db-4173-ba8e-e18f25c05b2d" May 26 16:09:04.003881 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:04.003702 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ws4lv" May 26 16:09:04.003881 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:04.003728 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6s4f7" May 26 16:09:04.003881 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:09:04.003819 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ws4lv" podUID="eec5f0e1-7fd2-4597-a1a0-3b5b10517934" May 26 16:09:04.004096 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:09:04.003901 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6s4f7" podUID="abe6e974-b6ff-4fa6-93d5-8aa4be27b866" May 26 16:09:04.839023 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:04.838998 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-102.ec2.internal" event="NodeReady" May 26 16:09:04.839510 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:04.839134 2560 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 26 16:09:04.891212 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:04.891182 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rk9bl"] May 26 16:09:04.905618 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:04.905582 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rqtzd"] May 26 16:09:04.905785 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:04.905745 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rk9bl" May 26 16:09:04.908681 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:04.908655 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 26 16:09:04.908819 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:04.908708 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kfnx9\"" May 26 16:09:04.908872 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:04.908839 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 26 16:09:04.924232 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:04.924206 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rk9bl"] May 26 16:09:04.924232 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:04.924237 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rqtzd"] May 26 16:09:04.924458 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:04.924354 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rqtzd" May 26 16:09:04.926815 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:04.926793 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 26 16:09:04.926943 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:04.926898 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 26 16:09:04.927236 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:04.927200 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 26 16:09:04.927672 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:04.927494 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dfl8l\"" May 26 16:09:05.045396 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:05.045373 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/198e0563-480e-4643-8cc7-ffbcdd9d6096-metrics-tls\") pod \"dns-default-rk9bl\" (UID: \"198e0563-480e-4643-8cc7-ffbcdd9d6096\") " pod="openshift-dns/dns-default-rk9bl" May 26 16:09:05.045510 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:05.045405 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2d7v\" (UniqueName: \"kubernetes.io/projected/198e0563-480e-4643-8cc7-ffbcdd9d6096-kube-api-access-z2d7v\") pod \"dns-default-rk9bl\" (UID: \"198e0563-480e-4643-8cc7-ffbcdd9d6096\") " pod="openshift-dns/dns-default-rk9bl" May 26 16:09:05.045510 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:05.045461 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/198e0563-480e-4643-8cc7-ffbcdd9d6096-tmp-dir\") pod \"dns-default-rk9bl\" (UID: \"198e0563-480e-4643-8cc7-ffbcdd9d6096\") " pod="openshift-dns/dns-default-rk9bl" May 26 16:09:05.045510 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:05.045498 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/198e0563-480e-4643-8cc7-ffbcdd9d6096-config-volume\") pod \"dns-default-rk9bl\" (UID: \"198e0563-480e-4643-8cc7-ffbcdd9d6096\") " pod="openshift-dns/dns-default-rk9bl" May 26 16:09:05.045604 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:05.045550 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpl6w\" (UniqueName: \"kubernetes.io/projected/074a7bdb-b46a-4d92-93be-4934b7e5c55b-kube-api-access-dpl6w\") pod \"ingress-canary-rqtzd\" (UID: \"074a7bdb-b46a-4d92-93be-4934b7e5c55b\") " pod="openshift-ingress-canary/ingress-canary-rqtzd" May 26 16:09:05.045604 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:05.045578 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/074a7bdb-b46a-4d92-93be-4934b7e5c55b-cert\") pod \"ingress-canary-rqtzd\" (UID: \"074a7bdb-b46a-4d92-93be-4934b7e5c55b\") " pod="openshift-ingress-canary/ingress-canary-rqtzd" May 26 16:09:05.146741 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:05.146710 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/198e0563-480e-4643-8cc7-ffbcdd9d6096-metrics-tls\") pod \"dns-default-rk9bl\" (UID: \"198e0563-480e-4643-8cc7-ffbcdd9d6096\") " pod="openshift-dns/dns-default-rk9bl" May 26 16:09:05.146741 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:05.146745 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z2d7v\" (UniqueName: \"kubernetes.io/projected/198e0563-480e-4643-8cc7-ffbcdd9d6096-kube-api-access-z2d7v\") pod \"dns-default-rk9bl\" (UID: \"198e0563-480e-4643-8cc7-ffbcdd9d6096\") " pod="openshift-dns/dns-default-rk9bl" May 26 16:09:05.146945 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:05.146769 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/198e0563-480e-4643-8cc7-ffbcdd9d6096-tmp-dir\") pod \"dns-default-rk9bl\" (UID: \"198e0563-480e-4643-8cc7-ffbcdd9d6096\") " pod="openshift-dns/dns-default-rk9bl" May 26 16:09:05.146945 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:05.146817 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/198e0563-480e-4643-8cc7-ffbcdd9d6096-config-volume\") pod \"dns-default-rk9bl\" (UID: \"198e0563-480e-4643-8cc7-ffbcdd9d6096\") " pod="openshift-dns/dns-default-rk9bl" May 26 16:09:05.146945 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:05.146843 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dpl6w\" (UniqueName: \"kubernetes.io/projected/074a7bdb-b46a-4d92-93be-4934b7e5c55b-kube-api-access-dpl6w\") pod \"ingress-canary-rqtzd\" (UID: \"074a7bdb-b46a-4d92-93be-4934b7e5c55b\") " pod="openshift-ingress-canary/ingress-canary-rqtzd" May 26 16:09:05.146945 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:09:05.146845 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 16:09:05.146945 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:05.146868 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/074a7bdb-b46a-4d92-93be-4934b7e5c55b-cert\") pod \"ingress-canary-rqtzd\" (UID: \"074a7bdb-b46a-4d92-93be-4934b7e5c55b\") " pod="openshift-ingress-canary/ingress-canary-rqtzd" May 26 16:09:05.146945 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:09:05.146902 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/198e0563-480e-4643-8cc7-ffbcdd9d6096-metrics-tls podName:198e0563-480e-4643-8cc7-ffbcdd9d6096 nodeName:}" failed. No retries permitted until 2026-05-26 16:09:05.646882197 +0000 UTC m=+36.177375783 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/198e0563-480e-4643-8cc7-ffbcdd9d6096-metrics-tls") pod "dns-default-rk9bl" (UID: "198e0563-480e-4643-8cc7-ffbcdd9d6096") : secret "dns-default-metrics-tls" not found May 26 16:09:05.146945 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:09:05.146937 2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 16:09:05.147280 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:09:05.146979 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/074a7bdb-b46a-4d92-93be-4934b7e5c55b-cert podName:074a7bdb-b46a-4d92-93be-4934b7e5c55b nodeName:}" failed. No retries permitted until 2026-05-26 16:09:05.646964666 +0000 UTC m=+36.177458269 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/074a7bdb-b46a-4d92-93be-4934b7e5c55b-cert") pod "ingress-canary-rqtzd" (UID: "074a7bdb-b46a-4d92-93be-4934b7e5c55b") : secret "canary-serving-cert" not found May 26 16:09:05.147280 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:05.147157 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/198e0563-480e-4643-8cc7-ffbcdd9d6096-tmp-dir\") pod \"dns-default-rk9bl\" (UID: \"198e0563-480e-4643-8cc7-ffbcdd9d6096\") " pod="openshift-dns/dns-default-rk9bl" May 26 16:09:05.147505 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:05.147484 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/198e0563-480e-4643-8cc7-ffbcdd9d6096-config-volume\") pod \"dns-default-rk9bl\" (UID: \"198e0563-480e-4643-8cc7-ffbcdd9d6096\") " pod="openshift-dns/dns-default-rk9bl" May 26 16:09:05.160141 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:05.160120 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2d7v\" (UniqueName: \"kubernetes.io/projected/198e0563-480e-4643-8cc7-ffbcdd9d6096-kube-api-access-z2d7v\") pod \"dns-default-rk9bl\" (UID: \"198e0563-480e-4643-8cc7-ffbcdd9d6096\") " pod="openshift-dns/dns-default-rk9bl" May 26 16:09:05.160267 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:05.160124 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpl6w\" (UniqueName: \"kubernetes.io/projected/074a7bdb-b46a-4d92-93be-4934b7e5c55b-kube-api-access-dpl6w\") pod \"ingress-canary-rqtzd\" (UID: \"074a7bdb-b46a-4d92-93be-4934b7e5c55b\") " pod="openshift-ingress-canary/ingress-canary-rqtzd" May 26 16:09:05.650184 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:05.650141 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/074a7bdb-b46a-4d92-93be-4934b7e5c55b-cert\") pod \"ingress-canary-rqtzd\" (UID: \"074a7bdb-b46a-4d92-93be-4934b7e5c55b\") " pod="openshift-ingress-canary/ingress-canary-rqtzd" May 26 16:09:05.650355 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:05.650227 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/198e0563-480e-4643-8cc7-ffbcdd9d6096-metrics-tls\") pod \"dns-default-rk9bl\" (UID: \"198e0563-480e-4643-8cc7-ffbcdd9d6096\") " pod="openshift-dns/dns-default-rk9bl" May 26 16:09:05.650355 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:09:05.650291 2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 16:09:05.650355 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:09:05.650317 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 16:09:05.650477 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:09:05.650360 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/074a7bdb-b46a-4d92-93be-4934b7e5c55b-cert podName:074a7bdb-b46a-4d92-93be-4934b7e5c55b nodeName:}" failed. No retries permitted until 2026-05-26 16:09:06.650344373 +0000 UTC m=+37.180837959 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/074a7bdb-b46a-4d92-93be-4934b7e5c55b-cert") pod "ingress-canary-rqtzd" (UID: "074a7bdb-b46a-4d92-93be-4934b7e5c55b") : secret "canary-serving-cert" not found May 26 16:09:05.650477 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:09:05.650383 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/198e0563-480e-4643-8cc7-ffbcdd9d6096-metrics-tls podName:198e0563-480e-4643-8cc7-ffbcdd9d6096 nodeName:}" failed. No retries permitted until 2026-05-26 16:09:06.650368656 +0000 UTC m=+37.180862244 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/198e0563-480e-4643-8cc7-ffbcdd9d6096-metrics-tls") pod "dns-default-rk9bl" (UID: "198e0563-480e-4643-8cc7-ffbcdd9d6096") : secret "dns-default-metrics-tls" not found May 26 16:09:06.003320 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:06.003059 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ws4lv" May 26 16:09:06.003894 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:06.003078 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6s4f7" May 26 16:09:06.003894 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:06.003113 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ms765" May 26 16:09:06.006578 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:06.006554 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 26 16:09:06.006687 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:06.006615 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 26 16:09:06.007662 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:06.007646 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f72wj\"" May 26 16:09:06.007662 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:06.007659 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 26 16:09:06.007746 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:06.007648 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 26 16:09:06.007746 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:06.007693 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4s662\"" May 26 16:09:06.148656 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:06.148626 2560 generic.go:358] "Generic (PLEG): container finished" podID="eae253a8-1f39-46f2-abe6-b677fff8aa74" containerID="cc43041c39170b0baaffc8da06527ffaaf38d322c543ff67d4dd647c5fe3928b" exitCode=0 May 26 16:09:06.148806 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:06.148682 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2r6kq" event={"ID":"eae253a8-1f39-46f2-abe6-b677fff8aa74","Type":"ContainerDied","Data":"cc43041c39170b0baaffc8da06527ffaaf38d322c543ff67d4dd647c5fe3928b"} May 26 16:09:06.658110 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:06.658017 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/074a7bdb-b46a-4d92-93be-4934b7e5c55b-cert\") pod \"ingress-canary-rqtzd\" (UID: \"074a7bdb-b46a-4d92-93be-4934b7e5c55b\") " pod="openshift-ingress-canary/ingress-canary-rqtzd" May 26 16:09:06.658239 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:06.658118 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/198e0563-480e-4643-8cc7-ffbcdd9d6096-metrics-tls\") pod \"dns-default-rk9bl\" (UID: \"198e0563-480e-4643-8cc7-ffbcdd9d6096\") " pod="openshift-dns/dns-default-rk9bl" May 26 16:09:06.658239 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:09:06.658159 2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 16:09:06.658239 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:09:06.658220 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/074a7bdb-b46a-4d92-93be-4934b7e5c55b-cert podName:074a7bdb-b46a-4d92-93be-4934b7e5c55b nodeName:}" failed. No retries permitted until 2026-05-26 16:09:08.658203511 +0000 UTC m=+39.188697100 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/074a7bdb-b46a-4d92-93be-4934b7e5c55b-cert") pod "ingress-canary-rqtzd" (UID: "074a7bdb-b46a-4d92-93be-4934b7e5c55b") : secret "canary-serving-cert" not found May 26 16:09:06.658239 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:09:06.658226 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 16:09:06.658375 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:09:06.658281 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/198e0563-480e-4643-8cc7-ffbcdd9d6096-metrics-tls podName:198e0563-480e-4643-8cc7-ffbcdd9d6096 nodeName:}" failed. No retries permitted until 2026-05-26 16:09:08.658264393 +0000 UTC m=+39.188757996 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/198e0563-480e-4643-8cc7-ffbcdd9d6096-metrics-tls") pod "dns-default-rk9bl" (UID: "198e0563-480e-4643-8cc7-ffbcdd9d6096") : secret "dns-default-metrics-tls" not found May 26 16:09:06.860022 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:06.859978 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/abe6e974-b6ff-4fa6-93d5-8aa4be27b866-original-pull-secret\") pod \"global-pull-secret-syncer-6s4f7\" (UID: \"abe6e974-b6ff-4fa6-93d5-8aa4be27b866\") " pod="kube-system/global-pull-secret-syncer-6s4f7" May 26 16:09:06.863065 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:06.863041 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/abe6e974-b6ff-4fa6-93d5-8aa4be27b866-original-pull-secret\") pod \"global-pull-secret-syncer-6s4f7\" (UID: \"abe6e974-b6ff-4fa6-93d5-8aa4be27b866\") " pod="kube-system/global-pull-secret-syncer-6s4f7" May 26 16:09:06.918233 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:06.918160 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6s4f7" May 26 16:09:07.067708 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:07.067671 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6s4f7"] May 26 16:09:07.072028 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:09:07.071997 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabe6e974_b6ff_4fa6_93d5_8aa4be27b866.slice/crio-bee27dcf5741e108dba4a4411475ad683e7b5ab94a13c489b388274756c0222f WatchSource:0}: Error finding container bee27dcf5741e108dba4a4411475ad683e7b5ab94a13c489b388274756c0222f: Status 404 returned error can't find the container with id bee27dcf5741e108dba4a4411475ad683e7b5ab94a13c489b388274756c0222f May 26 16:09:07.153268 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:07.153232 2560 generic.go:358] "Generic (PLEG): container finished" podID="eae253a8-1f39-46f2-abe6-b677fff8aa74" containerID="0699f07cff5b79dfcb611b327cdb44f69f2690e842c1ee8322c6d89ac6f42b0c" exitCode=0 May 26 16:09:07.153447 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:07.153317 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2r6kq" event={"ID":"eae253a8-1f39-46f2-abe6-b677fff8aa74","Type":"ContainerDied","Data":"0699f07cff5b79dfcb611b327cdb44f69f2690e842c1ee8322c6d89ac6f42b0c"} May 26 16:09:07.154645 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:07.154329 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6s4f7" event={"ID":"abe6e974-b6ff-4fa6-93d5-8aa4be27b866","Type":"ContainerStarted","Data":"bee27dcf5741e108dba4a4411475ad683e7b5ab94a13c489b388274756c0222f"} May 26 16:09:08.160018 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:08.159975 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2r6kq" event={"ID":"eae253a8-1f39-46f2-abe6-b677fff8aa74","Type":"ContainerStarted","Data":"891cf5aab0bab5736426bc3910374cc1ca91474e2dfbe5fe090253a8f0db0b1b"} May 26 16:09:08.184333 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:08.184278 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2r6kq" podStartSLOduration=5.79404745 podStartE2EDuration="38.184261855s" podCreationTimestamp="2026-05-26 16:08:30 +0000 UTC" firstStartedPulling="2026-05-26 16:08:32.654704651 +0000 UTC m=+3.185198251" lastFinishedPulling="2026-05-26 16:09:05.04491906 +0000 UTC m=+35.575412656" observedRunningTime="2026-05-26 16:09:08.182759811 +0000 UTC m=+38.713253419" watchObservedRunningTime="2026-05-26 16:09:08.184261855 +0000 UTC m=+38.714755464" May 26 16:09:08.675119 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:08.675076 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/198e0563-480e-4643-8cc7-ffbcdd9d6096-metrics-tls\") pod \"dns-default-rk9bl\" (UID: \"198e0563-480e-4643-8cc7-ffbcdd9d6096\") " pod="openshift-dns/dns-default-rk9bl" May 26 16:09:08.675364 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:08.675171 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/074a7bdb-b46a-4d92-93be-4934b7e5c55b-cert\") pod \"ingress-canary-rqtzd\" (UID: \"074a7bdb-b46a-4d92-93be-4934b7e5c55b\") " pod="openshift-ingress-canary/ingress-canary-rqtzd" May 26 16:09:08.675364 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:09:08.675245 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 16:09:08.675364 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:09:08.675308 2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 16:09:08.675364 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:09:08.675330 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/198e0563-480e-4643-8cc7-ffbcdd9d6096-metrics-tls podName:198e0563-480e-4643-8cc7-ffbcdd9d6096 nodeName:}" failed. No retries permitted until 2026-05-26 16:09:12.675305743 +0000 UTC m=+43.205799345 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/198e0563-480e-4643-8cc7-ffbcdd9d6096-metrics-tls") pod "dns-default-rk9bl" (UID: "198e0563-480e-4643-8cc7-ffbcdd9d6096") : secret "dns-default-metrics-tls" not found May 26 16:09:08.675364 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:09:08.675356 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/074a7bdb-b46a-4d92-93be-4934b7e5c55b-cert podName:074a7bdb-b46a-4d92-93be-4934b7e5c55b nodeName:}" failed. No retries permitted until 2026-05-26 16:09:12.675341196 +0000 UTC m=+43.205834782 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/074a7bdb-b46a-4d92-93be-4934b7e5c55b-cert") pod "ingress-canary-rqtzd" (UID: "074a7bdb-b46a-4d92-93be-4934b7e5c55b") : secret "canary-serving-cert" not found May 26 16:09:12.170054 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:12.170011 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6s4f7" event={"ID":"abe6e974-b6ff-4fa6-93d5-8aa4be27b866","Type":"ContainerStarted","Data":"d18e34c0f992129d9fe7cf95fff26c7e6a9d8c6a0edc19d617ee3f15085a5097"} May 26 16:09:12.186146 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:12.186091 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6s4f7" podStartSLOduration=33.168232445 podStartE2EDuration="37.186073219s" podCreationTimestamp="2026-05-26 16:08:35 +0000 UTC" firstStartedPulling="2026-05-26 16:09:07.073634586 +0000 UTC m=+37.604128175" lastFinishedPulling="2026-05-26 16:09:11.091475359 +0000 UTC m=+41.621968949" observedRunningTime="2026-05-26 16:09:12.185693077 +0000 UTC m=+42.716186682" watchObservedRunningTime="2026-05-26 16:09:12.186073219 +0000 UTC m=+42.716566828" May 26 16:09:12.703019 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:12.702975 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/074a7bdb-b46a-4d92-93be-4934b7e5c55b-cert\") pod \"ingress-canary-rqtzd\" (UID: \"074a7bdb-b46a-4d92-93be-4934b7e5c55b\") " pod="openshift-ingress-canary/ingress-canary-rqtzd" May 26 16:09:12.703221 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:09:12.703145 2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 16:09:12.703221 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:12.703160 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/198e0563-480e-4643-8cc7-ffbcdd9d6096-metrics-tls\") pod \"dns-default-rk9bl\" (UID: \"198e0563-480e-4643-8cc7-ffbcdd9d6096\") " pod="openshift-dns/dns-default-rk9bl" May 26 16:09:12.703221 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:09:12.703212 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/074a7bdb-b46a-4d92-93be-4934b7e5c55b-cert podName:074a7bdb-b46a-4d92-93be-4934b7e5c55b nodeName:}" failed. No retries permitted until 2026-05-26 16:09:20.703188787 +0000 UTC m=+51.233682372 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/074a7bdb-b46a-4d92-93be-4934b7e5c55b-cert") pod "ingress-canary-rqtzd" (UID: "074a7bdb-b46a-4d92-93be-4934b7e5c55b") : secret "canary-serving-cert" not found May 26 16:09:12.703397 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:09:12.703301 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 16:09:12.703397 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:09:12.703359 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/198e0563-480e-4643-8cc7-ffbcdd9d6096-metrics-tls podName:198e0563-480e-4643-8cc7-ffbcdd9d6096 nodeName:}" failed. No retries permitted until 2026-05-26 16:09:20.703342449 +0000 UTC m=+51.233836050 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/198e0563-480e-4643-8cc7-ffbcdd9d6096-metrics-tls") pod "dns-default-rk9bl" (UID: "198e0563-480e-4643-8cc7-ffbcdd9d6096") : secret "dns-default-metrics-tls" not found May 26 16:09:20.761778 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:20.761735 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/198e0563-480e-4643-8cc7-ffbcdd9d6096-metrics-tls\") pod \"dns-default-rk9bl\" (UID: \"198e0563-480e-4643-8cc7-ffbcdd9d6096\") " pod="openshift-dns/dns-default-rk9bl" May 26 16:09:20.761778 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:20.761796 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/074a7bdb-b46a-4d92-93be-4934b7e5c55b-cert\") pod \"ingress-canary-rqtzd\" (UID: \"074a7bdb-b46a-4d92-93be-4934b7e5c55b\") " pod="openshift-ingress-canary/ingress-canary-rqtzd" May 26 16:09:20.762382 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:09:20.761882 2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 16:09:20.762382 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:09:20.761886 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 16:09:20.762382 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:09:20.761949 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/074a7bdb-b46a-4d92-93be-4934b7e5c55b-cert podName:074a7bdb-b46a-4d92-93be-4934b7e5c55b nodeName:}" failed. No retries permitted until 2026-05-26 16:09:36.761927778 +0000 UTC m=+67.292421365 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/074a7bdb-b46a-4d92-93be-4934b7e5c55b-cert") pod "ingress-canary-rqtzd" (UID: "074a7bdb-b46a-4d92-93be-4934b7e5c55b") : secret "canary-serving-cert" not found May 26 16:09:20.762382 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:09:20.761962 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/198e0563-480e-4643-8cc7-ffbcdd9d6096-metrics-tls podName:198e0563-480e-4643-8cc7-ffbcdd9d6096 nodeName:}" failed. No retries permitted until 2026-05-26 16:09:36.761955552 +0000 UTC m=+67.292449137 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/198e0563-480e-4643-8cc7-ffbcdd9d6096-metrics-tls") pod "dns-default-rk9bl" (UID: "198e0563-480e-4643-8cc7-ffbcdd9d6096") : secret "dns-default-metrics-tls" not found May 26 16:09:30.145210 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:30.145184 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7xvh4" May 26 16:09:35.770670 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:35.770624 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eec5f0e1-7fd2-4597-a1a0-3b5b10517934-metrics-certs\") pod \"network-metrics-daemon-ws4lv\" (UID: \"eec5f0e1-7fd2-4597-a1a0-3b5b10517934\") " pod="openshift-multus/network-metrics-daemon-ws4lv" May 26 16:09:35.773603 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:35.773580 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 26 16:09:35.781857 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:09:35.781834 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 26 16:09:35.781953 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:09:35.781902 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eec5f0e1-7fd2-4597-a1a0-3b5b10517934-metrics-certs podName:eec5f0e1-7fd2-4597-a1a0-3b5b10517934 nodeName:}" failed. No retries permitted until 2026-05-26 16:10:39.78188341 +0000 UTC m=+130.312376996 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eec5f0e1-7fd2-4597-a1a0-3b5b10517934-metrics-certs") pod "network-metrics-daemon-ws4lv" (UID: "eec5f0e1-7fd2-4597-a1a0-3b5b10517934") : secret "metrics-daemon-secret" not found May 26 16:09:35.871224 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:35.871184 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t622m\" (UniqueName: \"kubernetes.io/projected/0ecc520c-06db-4173-ba8e-e18f25c05b2d-kube-api-access-t622m\") pod \"network-check-target-ms765\" (UID: \"0ecc520c-06db-4173-ba8e-e18f25c05b2d\") " pod="openshift-network-diagnostics/network-check-target-ms765" May 26 16:09:35.874342 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:35.874325 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 26 16:09:35.884028 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:35.883997 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 26 16:09:35.895192 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:35.895163 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t622m\" (UniqueName: \"kubernetes.io/projected/0ecc520c-06db-4173-ba8e-e18f25c05b2d-kube-api-access-t622m\") pod \"network-check-target-ms765\" (UID: \"0ecc520c-06db-4173-ba8e-e18f25c05b2d\") " pod="openshift-network-diagnostics/network-check-target-ms765" May 26 16:09:36.026405 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:36.026315 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f72wj\"" May 26 16:09:36.033592 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:36.033567 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ms765" May 26 16:09:36.174911 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:36.174828 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ms765"] May 26 16:09:36.178780 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:09:36.178747 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ecc520c_06db_4173_ba8e_e18f25c05b2d.slice/crio-a3005a8ea9b41d1d9e675ecdca8fe0eecd5c05edef23e7b99901d7ae28e37f50 WatchSource:0}: Error finding container a3005a8ea9b41d1d9e675ecdca8fe0eecd5c05edef23e7b99901d7ae28e37f50: Status 404 returned error can't find the container with id a3005a8ea9b41d1d9e675ecdca8fe0eecd5c05edef23e7b99901d7ae28e37f50 May 26 16:09:36.214392 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:36.214356 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ms765" event={"ID":"0ecc520c-06db-4173-ba8e-e18f25c05b2d","Type":"ContainerStarted","Data":"a3005a8ea9b41d1d9e675ecdca8fe0eecd5c05edef23e7b99901d7ae28e37f50"} May 26 16:09:36.778213 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:36.778174 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/198e0563-480e-4643-8cc7-ffbcdd9d6096-metrics-tls\") pod \"dns-default-rk9bl\" (UID: \"198e0563-480e-4643-8cc7-ffbcdd9d6096\") " pod="openshift-dns/dns-default-rk9bl" May 26 16:09:36.778736 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:36.778234 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/074a7bdb-b46a-4d92-93be-4934b7e5c55b-cert\") pod \"ingress-canary-rqtzd\" (UID: \"074a7bdb-b46a-4d92-93be-4934b7e5c55b\") " pod="openshift-ingress-canary/ingress-canary-rqtzd" May 26 16:09:36.778736 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:09:36.778342 2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 16:09:36.778736 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:09:36.778350 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 16:09:36.778736 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:09:36.778415 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/074a7bdb-b46a-4d92-93be-4934b7e5c55b-cert podName:074a7bdb-b46a-4d92-93be-4934b7e5c55b nodeName:}" failed. No retries permitted until 2026-05-26 16:10:08.778395591 +0000 UTC m=+99.308889177 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/074a7bdb-b46a-4d92-93be-4934b7e5c55b-cert") pod "ingress-canary-rqtzd" (UID: "074a7bdb-b46a-4d92-93be-4934b7e5c55b") : secret "canary-serving-cert" not found May 26 16:09:36.778736 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:09:36.778451 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/198e0563-480e-4643-8cc7-ffbcdd9d6096-metrics-tls podName:198e0563-480e-4643-8cc7-ffbcdd9d6096 nodeName:}" failed. No retries permitted until 2026-05-26 16:10:08.778441497 +0000 UTC m=+99.308935090 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/198e0563-480e-4643-8cc7-ffbcdd9d6096-metrics-tls") pod "dns-default-rk9bl" (UID: "198e0563-480e-4643-8cc7-ffbcdd9d6096") : secret "dns-default-metrics-tls" not found May 26 16:09:39.221859 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:39.221830 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ms765" event={"ID":"0ecc520c-06db-4173-ba8e-e18f25c05b2d","Type":"ContainerStarted","Data":"460b391ed23ff71591da58a96844ccde5c7e670493f501e02dcd5fa8f4854cf4"} May 26 16:09:39.222241 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:39.221970 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ms765" May 26 16:09:39.238487 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:09:39.238409 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ms765" podStartSLOduration=66.580718692 podStartE2EDuration="1m9.238393129s" podCreationTimestamp="2026-05-26 16:08:30 +0000 UTC" firstStartedPulling="2026-05-26 16:09:36.180618598 +0000 UTC m=+66.711112198" lastFinishedPulling="2026-05-26 16:09:38.838293046 +0000 UTC m=+69.368786635" observedRunningTime="2026-05-26 16:09:39.238049302 +0000 UTC m=+69.768542910" watchObservedRunningTime="2026-05-26 16:09:39.238393129 +0000 UTC m=+69.768886737" May 26 16:10:08.802758 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:08.802712 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/074a7bdb-b46a-4d92-93be-4934b7e5c55b-cert\") pod \"ingress-canary-rqtzd\" (UID: \"074a7bdb-b46a-4d92-93be-4934b7e5c55b\") " pod="openshift-ingress-canary/ingress-canary-rqtzd" May 26 16:10:08.803186 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:08.802802 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/198e0563-480e-4643-8cc7-ffbcdd9d6096-metrics-tls\") pod \"dns-default-rk9bl\" (UID: \"198e0563-480e-4643-8cc7-ffbcdd9d6096\") " pod="openshift-dns/dns-default-rk9bl" May 26 16:10:08.803186 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:10:08.802866 2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 16:10:08.803186 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:10:08.802884 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 16:10:08.803186 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:10:08.802945 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/198e0563-480e-4643-8cc7-ffbcdd9d6096-metrics-tls podName:198e0563-480e-4643-8cc7-ffbcdd9d6096 nodeName:}" failed. No retries permitted until 2026-05-26 16:11:12.802926609 +0000 UTC m=+163.333420198 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/198e0563-480e-4643-8cc7-ffbcdd9d6096-metrics-tls") pod "dns-default-rk9bl" (UID: "198e0563-480e-4643-8cc7-ffbcdd9d6096") : secret "dns-default-metrics-tls" not found May 26 16:10:08.803186 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:10:08.802961 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/074a7bdb-b46a-4d92-93be-4934b7e5c55b-cert podName:074a7bdb-b46a-4d92-93be-4934b7e5c55b nodeName:}" failed. No retries permitted until 2026-05-26 16:11:12.802954653 +0000 UTC m=+163.333448239 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/074a7bdb-b46a-4d92-93be-4934b7e5c55b-cert") pod "ingress-canary-rqtzd" (UID: "074a7bdb-b46a-4d92-93be-4934b7e5c55b") : secret "canary-serving-cert" not found May 26 16:10:10.225851 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:10.225818 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ms765" May 26 16:10:39.817477 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:39.817405 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eec5f0e1-7fd2-4597-a1a0-3b5b10517934-metrics-certs\") pod \"network-metrics-daemon-ws4lv\" (UID: \"eec5f0e1-7fd2-4597-a1a0-3b5b10517934\") " pod="openshift-multus/network-metrics-daemon-ws4lv" May 26 16:10:39.817981 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:10:39.817557 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 26 16:10:39.817981 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:10:39.817636 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eec5f0e1-7fd2-4597-a1a0-3b5b10517934-metrics-certs podName:eec5f0e1-7fd2-4597-a1a0-3b5b10517934 nodeName:}" failed. No retries permitted until 2026-05-26 16:12:41.817620136 +0000 UTC m=+252.348113726 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eec5f0e1-7fd2-4597-a1a0-3b5b10517934-metrics-certs") pod "network-metrics-daemon-ws4lv" (UID: "eec5f0e1-7fd2-4597-a1a0-3b5b10517934") : secret "metrics-daemon-secret" not found May 26 16:10:40.000117 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.000078 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-sjdlv"] May 26 16:10:40.002878 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.002850 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6bbfbf574b-l5b7d"] May 26 16:10:40.003790 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.003771 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-sjdlv" May 26 16:10:40.006596 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.006576 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6bbfbf574b-l5b7d" May 26 16:10:40.007059 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.007036 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" May 26 16:10:40.007158 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.007044 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" May 26 16:10:40.007373 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.007356 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-kg5ck\"" May 26 16:10:40.007463 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.007389 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" May 26 16:10:40.013038 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.013018 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-jlmcm\"" May 26 16:10:40.013276 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.013027 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 26 16:10:40.013629 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.013609 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" May 26 16:10:40.013629 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.013627 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" May 26 16:10:40.013892 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.013638 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" May 26 16:10:40.013892 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.013779 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 26 16:10:40.014341 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.014237 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" May 26 16:10:40.014474 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.014412 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" May 26 16:10:40.016596 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.016558 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-sjdlv"] May 26 16:10:40.017164 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.017147 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" May 26 16:10:40.023400 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.023379 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6bbfbf574b-l5b7d"] May 26 16:10:40.089792 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.089705 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-zxjrk"] May 26 16:10:40.092494 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.092469 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-zxjrk" May 26 16:10:40.093522 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.093498 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-dh5hg"] May 26 16:10:40.095116 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.095097 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-wfbvk\"" May 26 16:10:40.095971 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.095954 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dh5hg" May 26 16:10:40.098348 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.098331 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-jktv2\"" May 26 16:10:40.099550 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.099512 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" May 26 16:10:40.099550 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.099538 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 26 16:10:40.099683 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.099619 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 26 16:10:40.099911 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.099892 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" May 26 16:10:40.106301 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.106280 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-zxjrk"] May 26 16:10:40.107446 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.107410 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-dh5hg"] May 26 16:10:40.119003 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.118977 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0248426a-06ce-4715-90e4-ceb857b98580-service-ca-bundle\") pod \"router-default-6bbfbf574b-l5b7d\" (UID: \"0248426a-06ce-4715-90e4-ceb857b98580\") " pod="openshift-ingress/router-default-6bbfbf574b-l5b7d" May 26 16:10:40.119123 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.119009 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c7a1e813-7c0b-4f31-8ba2-1204fefee3e3-serving-cert\") pod \"console-operator-76dff48d59-sjdlv\" (UID: \"c7a1e813-7c0b-4f31-8ba2-1204fefee3e3\") " pod="openshift-console-operator/console-operator-76dff48d59-sjdlv" May 26 16:10:40.119123 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.119039 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdjvm\" (UniqueName: \"kubernetes.io/projected/c7a1e813-7c0b-4f31-8ba2-1204fefee3e3-kube-api-access-wdjvm\") pod \"console-operator-76dff48d59-sjdlv\" (UID: \"c7a1e813-7c0b-4f31-8ba2-1204fefee3e3\") " pod="openshift-console-operator/console-operator-76dff48d59-sjdlv" May 26 16:10:40.119195 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.119115 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0248426a-06ce-4715-90e4-ceb857b98580-stats-auth\") pod \"router-default-6bbfbf574b-l5b7d\" (UID: \"0248426a-06ce-4715-90e4-ceb857b98580\") " pod="openshift-ingress/router-default-6bbfbf574b-l5b7d" May 26 16:10:40.119195 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.119184 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0248426a-06ce-4715-90e4-ceb857b98580-metrics-certs\") pod \"router-default-6bbfbf574b-l5b7d\" (UID: \"0248426a-06ce-4715-90e4-ceb857b98580\") " pod="openshift-ingress/router-default-6bbfbf574b-l5b7d" May 26 16:10:40.119257 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.119204 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c7a1e813-7c0b-4f31-8ba2-1204fefee3e3-config\") pod \"console-operator-76dff48d59-sjdlv\" (UID: \"c7a1e813-7c0b-4f31-8ba2-1204fefee3e3\") " pod="openshift-console-operator/console-operator-76dff48d59-sjdlv" May 26 16:10:40.119257 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.119223 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0248426a-06ce-4715-90e4-ceb857b98580-default-certificate\") pod \"router-default-6bbfbf574b-l5b7d\" (UID: \"0248426a-06ce-4715-90e4-ceb857b98580\") " pod="openshift-ingress/router-default-6bbfbf574b-l5b7d" May 26 16:10:40.119257 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.119239 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67r52\" (UniqueName: \"kubernetes.io/projected/0248426a-06ce-4715-90e4-ceb857b98580-kube-api-access-67r52\") pod \"router-default-6bbfbf574b-l5b7d\" (UID: \"0248426a-06ce-4715-90e4-ceb857b98580\") " pod="openshift-ingress/router-default-6bbfbf574b-l5b7d" May 26 16:10:40.119346 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.119314 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c7a1e813-7c0b-4f31-8ba2-1204fefee3e3-trusted-ca\") pod \"console-operator-76dff48d59-sjdlv\" (UID: \"c7a1e813-7c0b-4f31-8ba2-1204fefee3e3\") " pod="openshift-console-operator/console-operator-76dff48d59-sjdlv" May 26 16:10:40.219915 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.219861 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae0d6eb0-655f-464f-88f4-74ee7cf2a7af-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-dh5hg\" (UID: \"ae0d6eb0-655f-464f-88f4-74ee7cf2a7af\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dh5hg" May 26 16:10:40.220089 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.219946 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c7a1e813-7c0b-4f31-8ba2-1204fefee3e3-trusted-ca\") pod \"console-operator-76dff48d59-sjdlv\" (UID: \"c7a1e813-7c0b-4f31-8ba2-1204fefee3e3\") " pod="openshift-console-operator/console-operator-76dff48d59-sjdlv" May 26 16:10:40.220089 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.219969 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0248426a-06ce-4715-90e4-ceb857b98580-service-ca-bundle\") pod \"router-default-6bbfbf574b-l5b7d\" (UID: \"0248426a-06ce-4715-90e4-ceb857b98580\") " pod="openshift-ingress/router-default-6bbfbf574b-l5b7d" May 26 16:10:40.220089 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.219988 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c7a1e813-7c0b-4f31-8ba2-1204fefee3e3-serving-cert\") pod \"console-operator-76dff48d59-sjdlv\" (UID: \"c7a1e813-7c0b-4f31-8ba2-1204fefee3e3\") " pod="openshift-console-operator/console-operator-76dff48d59-sjdlv" May 26 16:10:40.220089 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.220023 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mll86\" (UniqueName: \"kubernetes.io/projected/ae0d6eb0-655f-464f-88f4-74ee7cf2a7af-kube-api-access-mll86\") pod \"cluster-monitoring-operator-6c75959455-dh5hg\" (UID: \"ae0d6eb0-655f-464f-88f4-74ee7cf2a7af\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dh5hg" May 26 16:10:40.220089 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.220052 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wdjvm\" (UniqueName: \"kubernetes.io/projected/c7a1e813-7c0b-4f31-8ba2-1204fefee3e3-kube-api-access-wdjvm\") pod \"console-operator-76dff48d59-sjdlv\" (UID: \"c7a1e813-7c0b-4f31-8ba2-1204fefee3e3\") " pod="openshift-console-operator/console-operator-76dff48d59-sjdlv" May 26 16:10:40.220089 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.220080 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0248426a-06ce-4715-90e4-ceb857b98580-stats-auth\") pod \"router-default-6bbfbf574b-l5b7d\" (UID: \"0248426a-06ce-4715-90e4-ceb857b98580\") " pod="openshift-ingress/router-default-6bbfbf574b-l5b7d" May 26 16:10:40.220354 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.220104 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4j5fb\" (UniqueName: \"kubernetes.io/projected/5291cc31-98fc-4551-95f6-1c8cd3d6934a-kube-api-access-4j5fb\") pod \"network-check-source-7f44b6dd87-zxjrk\" (UID: \"5291cc31-98fc-4551-95f6-1c8cd3d6934a\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-zxjrk" May 26 16:10:40.220354 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:10:40.220142 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0248426a-06ce-4715-90e4-ceb857b98580-service-ca-bundle podName:0248426a-06ce-4715-90e4-ceb857b98580 nodeName:}" failed. No retries permitted until 2026-05-26 16:10:40.720121535 +0000 UTC m=+131.250615164 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0248426a-06ce-4715-90e4-ceb857b98580-service-ca-bundle") pod "router-default-6bbfbf574b-l5b7d" (UID: "0248426a-06ce-4715-90e4-ceb857b98580") : configmap references non-existent config key: service-ca.crt May 26 16:10:40.220354 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.220172 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ae0d6eb0-655f-464f-88f4-74ee7cf2a7af-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-dh5hg\" (UID: \"ae0d6eb0-655f-464f-88f4-74ee7cf2a7af\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dh5hg" May 26 16:10:40.220354 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.220218 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0248426a-06ce-4715-90e4-ceb857b98580-metrics-certs\") pod \"router-default-6bbfbf574b-l5b7d\" (UID: \"0248426a-06ce-4715-90e4-ceb857b98580\") " pod="openshift-ingress/router-default-6bbfbf574b-l5b7d" May 26 16:10:40.220354 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.220249 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c7a1e813-7c0b-4f31-8ba2-1204fefee3e3-config\") pod \"console-operator-76dff48d59-sjdlv\" (UID: \"c7a1e813-7c0b-4f31-8ba2-1204fefee3e3\") " pod="openshift-console-operator/console-operator-76dff48d59-sjdlv" May 26 16:10:40.220354 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.220273 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0248426a-06ce-4715-90e4-ceb857b98580-default-certificate\") pod \"router-default-6bbfbf574b-l5b7d\" (UID: \"0248426a-06ce-4715-90e4-ceb857b98580\") " pod="openshift-ingress/router-default-6bbfbf574b-l5b7d" May 26 16:10:40.220354 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:10:40.220287 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 26 16:10:40.220354 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.220298 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-67r52\" (UniqueName: \"kubernetes.io/projected/0248426a-06ce-4715-90e4-ceb857b98580-kube-api-access-67r52\") pod \"router-default-6bbfbf574b-l5b7d\" (UID: \"0248426a-06ce-4715-90e4-ceb857b98580\") " pod="openshift-ingress/router-default-6bbfbf574b-l5b7d" May 26 16:10:40.220779 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:10:40.220374 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0248426a-06ce-4715-90e4-ceb857b98580-metrics-certs podName:0248426a-06ce-4715-90e4-ceb857b98580 nodeName:}" failed. No retries permitted until 2026-05-26 16:10:40.720354239 +0000 UTC m=+131.250847824 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0248426a-06ce-4715-90e4-ceb857b98580-metrics-certs") pod "router-default-6bbfbf574b-l5b7d" (UID: "0248426a-06ce-4715-90e4-ceb857b98580") : secret "router-metrics-certs-default" not found May 26 16:10:40.221012 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.220988 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c7a1e813-7c0b-4f31-8ba2-1204fefee3e3-config\") pod \"console-operator-76dff48d59-sjdlv\" (UID: \"c7a1e813-7c0b-4f31-8ba2-1204fefee3e3\") " pod="openshift-console-operator/console-operator-76dff48d59-sjdlv" May 26 16:10:40.221317 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.221300 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c7a1e813-7c0b-4f31-8ba2-1204fefee3e3-trusted-ca\") pod \"console-operator-76dff48d59-sjdlv\" (UID: \"c7a1e813-7c0b-4f31-8ba2-1204fefee3e3\") " pod="openshift-console-operator/console-operator-76dff48d59-sjdlv" May 26 16:10:40.222572 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.222551 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0248426a-06ce-4715-90e4-ceb857b98580-default-certificate\") pod \"router-default-6bbfbf574b-l5b7d\" (UID: \"0248426a-06ce-4715-90e4-ceb857b98580\") " pod="openshift-ingress/router-default-6bbfbf574b-l5b7d" May 26 16:10:40.222954 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.222934 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c7a1e813-7c0b-4f31-8ba2-1204fefee3e3-serving-cert\") pod \"console-operator-76dff48d59-sjdlv\" (UID: \"c7a1e813-7c0b-4f31-8ba2-1204fefee3e3\") " pod="openshift-console-operator/console-operator-76dff48d59-sjdlv" May 26 16:10:40.222996 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.222939 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0248426a-06ce-4715-90e4-ceb857b98580-stats-auth\") pod \"router-default-6bbfbf574b-l5b7d\" (UID: \"0248426a-06ce-4715-90e4-ceb857b98580\") " pod="openshift-ingress/router-default-6bbfbf574b-l5b7d" May 26 16:10:40.229545 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.229517 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdjvm\" (UniqueName: \"kubernetes.io/projected/c7a1e813-7c0b-4f31-8ba2-1204fefee3e3-kube-api-access-wdjvm\") pod \"console-operator-76dff48d59-sjdlv\" (UID: \"c7a1e813-7c0b-4f31-8ba2-1204fefee3e3\") " pod="openshift-console-operator/console-operator-76dff48d59-sjdlv" May 26 16:10:40.229730 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.229714 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67r52\" (UniqueName: \"kubernetes.io/projected/0248426a-06ce-4715-90e4-ceb857b98580-kube-api-access-67r52\") pod \"router-default-6bbfbf574b-l5b7d\" (UID: \"0248426a-06ce-4715-90e4-ceb857b98580\") " pod="openshift-ingress/router-default-6bbfbf574b-l5b7d" May 26 16:10:40.316538 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.316502 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-sjdlv" May 26 16:10:40.321482 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.321449 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mll86\" (UniqueName: \"kubernetes.io/projected/ae0d6eb0-655f-464f-88f4-74ee7cf2a7af-kube-api-access-mll86\") pod \"cluster-monitoring-operator-6c75959455-dh5hg\" (UID: \"ae0d6eb0-655f-464f-88f4-74ee7cf2a7af\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dh5hg" May 26 16:10:40.321623 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.321509 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4j5fb\" (UniqueName: \"kubernetes.io/projected/5291cc31-98fc-4551-95f6-1c8cd3d6934a-kube-api-access-4j5fb\") pod \"network-check-source-7f44b6dd87-zxjrk\" (UID: \"5291cc31-98fc-4551-95f6-1c8cd3d6934a\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-zxjrk" May 26 16:10:40.321623 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.321557 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ae0d6eb0-655f-464f-88f4-74ee7cf2a7af-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-dh5hg\" (UID: \"ae0d6eb0-655f-464f-88f4-74ee7cf2a7af\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dh5hg" May 26 16:10:40.321724 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.321631 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae0d6eb0-655f-464f-88f4-74ee7cf2a7af-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-dh5hg\" (UID: \"ae0d6eb0-655f-464f-88f4-74ee7cf2a7af\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dh5hg" May 26 16:10:40.321775 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:10:40.321761 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 26 16:10:40.321855 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:10:40.321831 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae0d6eb0-655f-464f-88f4-74ee7cf2a7af-cluster-monitoring-operator-tls podName:ae0d6eb0-655f-464f-88f4-74ee7cf2a7af nodeName:}" failed. No retries permitted until 2026-05-26 16:10:40.821811866 +0000 UTC m=+131.352305469 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ae0d6eb0-655f-464f-88f4-74ee7cf2a7af-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-dh5hg" (UID: "ae0d6eb0-655f-464f-88f4-74ee7cf2a7af") : secret "cluster-monitoring-operator-tls" not found May 26 16:10:40.322236 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.322204 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ae0d6eb0-655f-464f-88f4-74ee7cf2a7af-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-dh5hg\" (UID: \"ae0d6eb0-655f-464f-88f4-74ee7cf2a7af\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dh5hg" May 26 16:10:40.337666 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.337638 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4j5fb\" (UniqueName: \"kubernetes.io/projected/5291cc31-98fc-4551-95f6-1c8cd3d6934a-kube-api-access-4j5fb\") pod \"network-check-source-7f44b6dd87-zxjrk\" (UID: \"5291cc31-98fc-4551-95f6-1c8cd3d6934a\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-zxjrk" May 26 16:10:40.337832 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.337710 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mll86\" (UniqueName: \"kubernetes.io/projected/ae0d6eb0-655f-464f-88f4-74ee7cf2a7af-kube-api-access-mll86\") pod \"cluster-monitoring-operator-6c75959455-dh5hg\" (UID: \"ae0d6eb0-655f-464f-88f4-74ee7cf2a7af\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dh5hg" May 26 16:10:40.402748 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.402712 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-zxjrk" May 26 16:10:40.440644 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.440606 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-sjdlv"] May 26 16:10:40.444148 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:10:40.444122 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7a1e813_7c0b_4f31_8ba2_1204fefee3e3.slice/crio-3ebfc60a3e7906c95494274740cf7511e0c1a855aab90f63da5857741b72f89f WatchSource:0}: Error finding container 3ebfc60a3e7906c95494274740cf7511e0c1a855aab90f63da5857741b72f89f: Status 404 returned error can't find the container with id 3ebfc60a3e7906c95494274740cf7511e0c1a855aab90f63da5857741b72f89f May 26 16:10:40.524979 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.524945 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-zxjrk"] May 26 16:10:40.528349 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:10:40.528323 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5291cc31_98fc_4551_95f6_1c8cd3d6934a.slice/crio-36d4b6523de7b94fdc9a4520b0cd1522e5b7e48e92539ecbeda9da6dd70d3bf2 WatchSource:0}: Error finding container 36d4b6523de7b94fdc9a4520b0cd1522e5b7e48e92539ecbeda9da6dd70d3bf2: Status 404 returned error can't find the container with id 36d4b6523de7b94fdc9a4520b0cd1522e5b7e48e92539ecbeda9da6dd70d3bf2 May 26 16:10:40.725596 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.725541 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0248426a-06ce-4715-90e4-ceb857b98580-metrics-certs\") pod \"router-default-6bbfbf574b-l5b7d\" (UID: \"0248426a-06ce-4715-90e4-ceb857b98580\") " pod="openshift-ingress/router-default-6bbfbf574b-l5b7d" May 26 16:10:40.725791 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.725631 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0248426a-06ce-4715-90e4-ceb857b98580-service-ca-bundle\") pod \"router-default-6bbfbf574b-l5b7d\" (UID: \"0248426a-06ce-4715-90e4-ceb857b98580\") " pod="openshift-ingress/router-default-6bbfbf574b-l5b7d" May 26 16:10:40.725791 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:10:40.725700 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 26 16:10:40.725791 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:10:40.725774 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0248426a-06ce-4715-90e4-ceb857b98580-metrics-certs podName:0248426a-06ce-4715-90e4-ceb857b98580 nodeName:}" failed. No retries permitted until 2026-05-26 16:10:41.725757211 +0000 UTC m=+132.256250801 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0248426a-06ce-4715-90e4-ceb857b98580-metrics-certs") pod "router-default-6bbfbf574b-l5b7d" (UID: "0248426a-06ce-4715-90e4-ceb857b98580") : secret "router-metrics-certs-default" not found May 26 16:10:40.726034 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:10:40.725802 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0248426a-06ce-4715-90e4-ceb857b98580-service-ca-bundle podName:0248426a-06ce-4715-90e4-ceb857b98580 nodeName:}" failed. No retries permitted until 2026-05-26 16:10:41.725783159 +0000 UTC m=+132.256276749 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0248426a-06ce-4715-90e4-ceb857b98580-service-ca-bundle") pod "router-default-6bbfbf574b-l5b7d" (UID: "0248426a-06ce-4715-90e4-ceb857b98580") : configmap references non-existent config key: service-ca.crt May 26 16:10:40.826348 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:40.826306 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae0d6eb0-655f-464f-88f4-74ee7cf2a7af-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-dh5hg\" (UID: \"ae0d6eb0-655f-464f-88f4-74ee7cf2a7af\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dh5hg" May 26 16:10:40.826739 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:10:40.826471 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 26 16:10:40.826739 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:10:40.826535 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae0d6eb0-655f-464f-88f4-74ee7cf2a7af-cluster-monitoring-operator-tls podName:ae0d6eb0-655f-464f-88f4-74ee7cf2a7af nodeName:}" failed. No retries permitted until 2026-05-26 16:10:41.826517344 +0000 UTC m=+132.357010947 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ae0d6eb0-655f-464f-88f4-74ee7cf2a7af-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-dh5hg" (UID: "ae0d6eb0-655f-464f-88f4-74ee7cf2a7af") : secret "cluster-monitoring-operator-tls" not found May 26 16:10:41.342447 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:41.342397 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-sjdlv" event={"ID":"c7a1e813-7c0b-4f31-8ba2-1204fefee3e3","Type":"ContainerStarted","Data":"3ebfc60a3e7906c95494274740cf7511e0c1a855aab90f63da5857741b72f89f"} May 26 16:10:41.343787 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:41.343756 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-zxjrk" event={"ID":"5291cc31-98fc-4551-95f6-1c8cd3d6934a","Type":"ContainerStarted","Data":"ec1b5504c00027dedff2fef40ac7eb4fe4acb223e56a1bc5323ed0bd36551c5a"} May 26 16:10:41.343787 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:41.343787 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-zxjrk" event={"ID":"5291cc31-98fc-4551-95f6-1c8cd3d6934a","Type":"ContainerStarted","Data":"36d4b6523de7b94fdc9a4520b0cd1522e5b7e48e92539ecbeda9da6dd70d3bf2"} May 26 16:10:41.359839 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:41.359752 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-zxjrk" podStartSLOduration=1.359738186 podStartE2EDuration="1.359738186s" podCreationTimestamp="2026-05-26 16:10:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 16:10:41.358915727 +0000 UTC m=+131.889409335" watchObservedRunningTime="2026-05-26 16:10:41.359738186 +0000 UTC m=+131.890231794" May 26 16:10:41.733832 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:41.733784 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0248426a-06ce-4715-90e4-ceb857b98580-service-ca-bundle\") pod \"router-default-6bbfbf574b-l5b7d\" (UID: \"0248426a-06ce-4715-90e4-ceb857b98580\") " pod="openshift-ingress/router-default-6bbfbf574b-l5b7d" May 26 16:10:41.734013 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:41.733892 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0248426a-06ce-4715-90e4-ceb857b98580-metrics-certs\") pod \"router-default-6bbfbf574b-l5b7d\" (UID: \"0248426a-06ce-4715-90e4-ceb857b98580\") " pod="openshift-ingress/router-default-6bbfbf574b-l5b7d" May 26 16:10:41.734013 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:10:41.733996 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 26 16:10:41.734122 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:10:41.733997 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0248426a-06ce-4715-90e4-ceb857b98580-service-ca-bundle podName:0248426a-06ce-4715-90e4-ceb857b98580 nodeName:}" failed. No retries permitted until 2026-05-26 16:10:43.733974249 +0000 UTC m=+134.264467838 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0248426a-06ce-4715-90e4-ceb857b98580-service-ca-bundle") pod "router-default-6bbfbf574b-l5b7d" (UID: "0248426a-06ce-4715-90e4-ceb857b98580") : configmap references non-existent config key: service-ca.crt May 26 16:10:41.734122 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:10:41.734051 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0248426a-06ce-4715-90e4-ceb857b98580-metrics-certs podName:0248426a-06ce-4715-90e4-ceb857b98580 nodeName:}" failed. No retries permitted until 2026-05-26 16:10:43.73403555 +0000 UTC m=+134.264529144 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0248426a-06ce-4715-90e4-ceb857b98580-metrics-certs") pod "router-default-6bbfbf574b-l5b7d" (UID: "0248426a-06ce-4715-90e4-ceb857b98580") : secret "router-metrics-certs-default" not found May 26 16:10:41.835195 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:41.835155 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae0d6eb0-655f-464f-88f4-74ee7cf2a7af-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-dh5hg\" (UID: \"ae0d6eb0-655f-464f-88f4-74ee7cf2a7af\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dh5hg" May 26 16:10:41.835690 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:10:41.835317 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 26 16:10:41.835690 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:10:41.835384 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae0d6eb0-655f-464f-88f4-74ee7cf2a7af-cluster-monitoring-operator-tls podName:ae0d6eb0-655f-464f-88f4-74ee7cf2a7af nodeName:}" failed. No retries permitted until 2026-05-26 16:10:43.835368415 +0000 UTC m=+134.365862006 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ae0d6eb0-655f-464f-88f4-74ee7cf2a7af-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-dh5hg" (UID: "ae0d6eb0-655f-464f-88f4-74ee7cf2a7af") : secret "cluster-monitoring-operator-tls" not found May 26 16:10:43.349492 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:43.349463 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-sjdlv_c7a1e813-7c0b-4f31-8ba2-1204fefee3e3/console-operator/0.log" May 26 16:10:43.349925 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:43.349505 2560 generic.go:358] "Generic (PLEG): container finished" podID="c7a1e813-7c0b-4f31-8ba2-1204fefee3e3" containerID="b2f33e71ccb01180e31eeae2b6227781a2761b7cf2a828ab7596a59c6d2026e5" exitCode=255 May 26 16:10:43.349925 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:43.349537 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-sjdlv" event={"ID":"c7a1e813-7c0b-4f31-8ba2-1204fefee3e3","Type":"ContainerDied","Data":"b2f33e71ccb01180e31eeae2b6227781a2761b7cf2a828ab7596a59c6d2026e5"} May 26 16:10:43.349925 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:43.349776 2560 scope.go:117] "RemoveContainer" containerID="b2f33e71ccb01180e31eeae2b6227781a2761b7cf2a828ab7596a59c6d2026e5" May 26 16:10:43.750827 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:43.750766 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0248426a-06ce-4715-90e4-ceb857b98580-metrics-certs\") pod \"router-default-6bbfbf574b-l5b7d\" (UID: \"0248426a-06ce-4715-90e4-ceb857b98580\") " pod="openshift-ingress/router-default-6bbfbf574b-l5b7d" May 26 16:10:43.751007 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:43.750864 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0248426a-06ce-4715-90e4-ceb857b98580-service-ca-bundle\") pod \"router-default-6bbfbf574b-l5b7d\" (UID: \"0248426a-06ce-4715-90e4-ceb857b98580\") " pod="openshift-ingress/router-default-6bbfbf574b-l5b7d" May 26 16:10:43.751007 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:10:43.750936 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 26 16:10:43.751007 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:10:43.750992 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0248426a-06ce-4715-90e4-ceb857b98580-service-ca-bundle podName:0248426a-06ce-4715-90e4-ceb857b98580 nodeName:}" failed. No retries permitted until 2026-05-26 16:10:47.75097655 +0000 UTC m=+138.281470140 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0248426a-06ce-4715-90e4-ceb857b98580-service-ca-bundle") pod "router-default-6bbfbf574b-l5b7d" (UID: "0248426a-06ce-4715-90e4-ceb857b98580") : configmap references non-existent config key: service-ca.crt May 26 16:10:43.751111 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:10:43.751010 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0248426a-06ce-4715-90e4-ceb857b98580-metrics-certs podName:0248426a-06ce-4715-90e4-ceb857b98580 nodeName:}" failed. No retries permitted until 2026-05-26 16:10:47.751003352 +0000 UTC m=+138.281496937 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0248426a-06ce-4715-90e4-ceb857b98580-metrics-certs") pod "router-default-6bbfbf574b-l5b7d" (UID: "0248426a-06ce-4715-90e4-ceb857b98580") : secret "router-metrics-certs-default" not found May 26 16:10:43.851518 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:43.851476 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae0d6eb0-655f-464f-88f4-74ee7cf2a7af-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-dh5hg\" (UID: \"ae0d6eb0-655f-464f-88f4-74ee7cf2a7af\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dh5hg" May 26 16:10:43.851675 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:10:43.851617 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 26 16:10:43.851713 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:10:43.851678 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae0d6eb0-655f-464f-88f4-74ee7cf2a7af-cluster-monitoring-operator-tls podName:ae0d6eb0-655f-464f-88f4-74ee7cf2a7af nodeName:}" failed. No retries permitted until 2026-05-26 16:10:47.851659857 +0000 UTC m=+138.382153460 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ae0d6eb0-655f-464f-88f4-74ee7cf2a7af-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-dh5hg" (UID: "ae0d6eb0-655f-464f-88f4-74ee7cf2a7af") : secret "cluster-monitoring-operator-tls" not found May 26 16:10:44.352962 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:44.352936 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-sjdlv_c7a1e813-7c0b-4f31-8ba2-1204fefee3e3/console-operator/1.log" May 26 16:10:44.353367 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:44.353244 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-sjdlv_c7a1e813-7c0b-4f31-8ba2-1204fefee3e3/console-operator/0.log" May 26 16:10:44.353367 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:44.353272 2560 generic.go:358] "Generic (PLEG): container finished" podID="c7a1e813-7c0b-4f31-8ba2-1204fefee3e3" containerID="82b37bd56714a1255fbec41d20853f8ef2c2333dc80eb562f08306661c0a1580" exitCode=255 May 26 16:10:44.353367 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:44.353328 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-sjdlv" event={"ID":"c7a1e813-7c0b-4f31-8ba2-1204fefee3e3","Type":"ContainerDied","Data":"82b37bd56714a1255fbec41d20853f8ef2c2333dc80eb562f08306661c0a1580"} May 26 16:10:44.353367 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:44.353358 2560 scope.go:117] "RemoveContainer" containerID="b2f33e71ccb01180e31eeae2b6227781a2761b7cf2a828ab7596a59c6d2026e5" May 26 16:10:44.353656 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:44.353640 2560 scope.go:117] "RemoveContainer" containerID="82b37bd56714a1255fbec41d20853f8ef2c2333dc80eb562f08306661c0a1580" May 26 16:10:44.353869 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:10:44.353850 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-sjdlv_openshift-console-operator(c7a1e813-7c0b-4f31-8ba2-1204fefee3e3)\"" pod="openshift-console-operator/console-operator-76dff48d59-sjdlv" podUID="c7a1e813-7c0b-4f31-8ba2-1204fefee3e3" May 26 16:10:45.360316 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:45.360289 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-sjdlv_c7a1e813-7c0b-4f31-8ba2-1204fefee3e3/console-operator/1.log" May 26 16:10:45.360815 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:45.360637 2560 scope.go:117] "RemoveContainer" containerID="82b37bd56714a1255fbec41d20853f8ef2c2333dc80eb562f08306661c0a1580" May 26 16:10:45.360815 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:10:45.360785 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-sjdlv_openshift-console-operator(c7a1e813-7c0b-4f31-8ba2-1204fefee3e3)\"" pod="openshift-console-operator/console-operator-76dff48d59-sjdlv" podUID="c7a1e813-7c0b-4f31-8ba2-1204fefee3e3" May 26 16:10:45.605160 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:45.605122 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-9q7hf"] May 26 16:10:45.608190 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:45.608173 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-9q7hf" May 26 16:10:45.610917 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:45.610856 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" May 26 16:10:45.610917 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:45.610912 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" May 26 16:10:45.611063 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:45.611048 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-lhvfl\"" May 26 16:10:45.616078 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:45.616027 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-9q7hf"] May 26 16:10:45.768071 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:45.768037 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4p564\" (UniqueName: \"kubernetes.io/projected/73f03199-74ec-4981-9eef-34c97b2fc8ea-kube-api-access-4p564\") pod \"migrator-b985f5d89-9q7hf\" (UID: \"73f03199-74ec-4981-9eef-34c97b2fc8ea\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-9q7hf" May 26 16:10:45.868655 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:45.868565 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4p564\" (UniqueName: \"kubernetes.io/projected/73f03199-74ec-4981-9eef-34c97b2fc8ea-kube-api-access-4p564\") pod \"migrator-b985f5d89-9q7hf\" (UID: \"73f03199-74ec-4981-9eef-34c97b2fc8ea\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-9q7hf" May 26 16:10:45.878747 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:45.878718 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4p564\" (UniqueName: \"kubernetes.io/projected/73f03199-74ec-4981-9eef-34c97b2fc8ea-kube-api-access-4p564\") pod \"migrator-b985f5d89-9q7hf\" (UID: \"73f03199-74ec-4981-9eef-34c97b2fc8ea\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-9q7hf" May 26 16:10:45.917792 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:45.917748 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-9q7hf" May 26 16:10:46.037536 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:46.037506 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-9q7hf"] May 26 16:10:46.040382 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:10:46.040355 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73f03199_74ec_4981_9eef_34c97b2fc8ea.slice/crio-f85050995109880af0a2c719f99fbcb658868f8454767d5d8a62a3414337c034 WatchSource:0}: Error finding container f85050995109880af0a2c719f99fbcb658868f8454767d5d8a62a3414337c034: Status 404 returned error can't find the container with id f85050995109880af0a2c719f99fbcb658868f8454767d5d8a62a3414337c034 May 26 16:10:46.363122 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:46.363083 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-9q7hf" event={"ID":"73f03199-74ec-4981-9eef-34c97b2fc8ea","Type":"ContainerStarted","Data":"f85050995109880af0a2c719f99fbcb658868f8454767d5d8a62a3414337c034"} May 26 16:10:46.819234 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:46.819195 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-bmw5m"] May 26 16:10:46.822286 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:46.822264 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-bmw5m" May 26 16:10:46.824765 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:46.824740 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" May 26 16:10:46.824868 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:46.824796 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" May 26 16:10:46.825945 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:46.825924 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-jq5t8\"" May 26 16:10:46.826051 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:46.825931 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" May 26 16:10:46.826051 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:46.825981 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" May 26 16:10:46.840173 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:46.840134 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-bmw5m"] May 26 16:10:46.976634 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:46.976601 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4905863c-c257-4fd4-a423-aaf0889d7edf-signing-key\") pod \"service-ca-67d667c7d-bmw5m\" (UID: \"4905863c-c257-4fd4-a423-aaf0889d7edf\") " pod="openshift-service-ca/service-ca-67d667c7d-bmw5m" May 26 16:10:46.976791 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:46.976711 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4905863c-c257-4fd4-a423-aaf0889d7edf-signing-cabundle\") pod \"service-ca-67d667c7d-bmw5m\" (UID: \"4905863c-c257-4fd4-a423-aaf0889d7edf\") " pod="openshift-service-ca/service-ca-67d667c7d-bmw5m" May 26 16:10:46.976791 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:46.976731 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slbdg\" (UniqueName: \"kubernetes.io/projected/4905863c-c257-4fd4-a423-aaf0889d7edf-kube-api-access-slbdg\") pod \"service-ca-67d667c7d-bmw5m\" (UID: \"4905863c-c257-4fd4-a423-aaf0889d7edf\") " pod="openshift-service-ca/service-ca-67d667c7d-bmw5m" May 26 16:10:47.077763 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:47.077667 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4905863c-c257-4fd4-a423-aaf0889d7edf-signing-cabundle\") pod \"service-ca-67d667c7d-bmw5m\" (UID: \"4905863c-c257-4fd4-a423-aaf0889d7edf\") " pod="openshift-service-ca/service-ca-67d667c7d-bmw5m" May 26 16:10:47.077763 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:47.077718 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-slbdg\" (UniqueName: \"kubernetes.io/projected/4905863c-c257-4fd4-a423-aaf0889d7edf-kube-api-access-slbdg\") pod \"service-ca-67d667c7d-bmw5m\" (UID: \"4905863c-c257-4fd4-a423-aaf0889d7edf\") " pod="openshift-service-ca/service-ca-67d667c7d-bmw5m" May 26 16:10:47.077972 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:47.077891 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4905863c-c257-4fd4-a423-aaf0889d7edf-signing-key\") pod \"service-ca-67d667c7d-bmw5m\" (UID: \"4905863c-c257-4fd4-a423-aaf0889d7edf\") " pod="openshift-service-ca/service-ca-67d667c7d-bmw5m" May 26 16:10:47.078510 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:47.078485 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4905863c-c257-4fd4-a423-aaf0889d7edf-signing-cabundle\") pod \"service-ca-67d667c7d-bmw5m\" (UID: \"4905863c-c257-4fd4-a423-aaf0889d7edf\") " pod="openshift-service-ca/service-ca-67d667c7d-bmw5m" May 26 16:10:47.080505 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:47.080485 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4905863c-c257-4fd4-a423-aaf0889d7edf-signing-key\") pod \"service-ca-67d667c7d-bmw5m\" (UID: \"4905863c-c257-4fd4-a423-aaf0889d7edf\") " pod="openshift-service-ca/service-ca-67d667c7d-bmw5m" May 26 16:10:47.087860 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:47.087830 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slbdg\" (UniqueName: \"kubernetes.io/projected/4905863c-c257-4fd4-a423-aaf0889d7edf-kube-api-access-slbdg\") pod \"service-ca-67d667c7d-bmw5m\" (UID: \"4905863c-c257-4fd4-a423-aaf0889d7edf\") " pod="openshift-service-ca/service-ca-67d667c7d-bmw5m" May 26 16:10:47.133537 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:47.133504 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-bmw5m" May 26 16:10:47.332004 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:47.331981 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-bmw5m"] May 26 16:10:47.335276 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:10:47.335250 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4905863c_c257_4fd4_a423_aaf0889d7edf.slice/crio-7fc9b314412a62fbd4c5d2a11710338653ff24b2c617eceb0d81cc07b2598a5d WatchSource:0}: Error finding container 7fc9b314412a62fbd4c5d2a11710338653ff24b2c617eceb0d81cc07b2598a5d: Status 404 returned error can't find the container with id 7fc9b314412a62fbd4c5d2a11710338653ff24b2c617eceb0d81cc07b2598a5d May 26 16:10:47.366145 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:47.366114 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-9q7hf" event={"ID":"73f03199-74ec-4981-9eef-34c97b2fc8ea","Type":"ContainerStarted","Data":"a9bc02046f8185b5a2825d517891936008473d0a23bf800398143f11c73daa54"} May 26 16:10:47.367142 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:47.367120 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-bmw5m" event={"ID":"4905863c-c257-4fd4-a423-aaf0889d7edf","Type":"ContainerStarted","Data":"7fc9b314412a62fbd4c5d2a11710338653ff24b2c617eceb0d81cc07b2598a5d"} May 26 16:10:47.509362 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:47.509333 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nqcwn_2d3a8f3a-02fd-4849-a169-2b72451d600a/dns-node-resolver/0.log" May 26 16:10:47.783152 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:47.783116 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0248426a-06ce-4715-90e4-ceb857b98580-service-ca-bundle\") pod \"router-default-6bbfbf574b-l5b7d\" (UID: \"0248426a-06ce-4715-90e4-ceb857b98580\") " pod="openshift-ingress/router-default-6bbfbf574b-l5b7d" May 26 16:10:47.783340 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:47.783193 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0248426a-06ce-4715-90e4-ceb857b98580-metrics-certs\") pod \"router-default-6bbfbf574b-l5b7d\" (UID: \"0248426a-06ce-4715-90e4-ceb857b98580\") " pod="openshift-ingress/router-default-6bbfbf574b-l5b7d" May 26 16:10:47.783340 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:10:47.783318 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 26 16:10:47.783478 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:10:47.783316 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0248426a-06ce-4715-90e4-ceb857b98580-service-ca-bundle podName:0248426a-06ce-4715-90e4-ceb857b98580 nodeName:}" failed. No retries permitted until 2026-05-26 16:10:55.783293249 +0000 UTC m=+146.313786842 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0248426a-06ce-4715-90e4-ceb857b98580-service-ca-bundle") pod "router-default-6bbfbf574b-l5b7d" (UID: "0248426a-06ce-4715-90e4-ceb857b98580") : configmap references non-existent config key: service-ca.crt May 26 16:10:47.783478 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:10:47.783374 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0248426a-06ce-4715-90e4-ceb857b98580-metrics-certs podName:0248426a-06ce-4715-90e4-ceb857b98580 nodeName:}" failed. No retries permitted until 2026-05-26 16:10:55.783359607 +0000 UTC m=+146.313853193 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0248426a-06ce-4715-90e4-ceb857b98580-metrics-certs") pod "router-default-6bbfbf574b-l5b7d" (UID: "0248426a-06ce-4715-90e4-ceb857b98580") : secret "router-metrics-certs-default" not found May 26 16:10:47.884337 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:47.884296 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae0d6eb0-655f-464f-88f4-74ee7cf2a7af-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-dh5hg\" (UID: \"ae0d6eb0-655f-464f-88f4-74ee7cf2a7af\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dh5hg" May 26 16:10:47.884533 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:10:47.884460 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 26 16:10:47.884533 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:10:47.884531 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae0d6eb0-655f-464f-88f4-74ee7cf2a7af-cluster-monitoring-operator-tls podName:ae0d6eb0-655f-464f-88f4-74ee7cf2a7af nodeName:}" failed. No retries permitted until 2026-05-26 16:10:55.884511353 +0000 UTC m=+146.415004939 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ae0d6eb0-655f-464f-88f4-74ee7cf2a7af-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-dh5hg" (UID: "ae0d6eb0-655f-464f-88f4-74ee7cf2a7af") : secret "cluster-monitoring-operator-tls" not found May 26 16:10:48.309748 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:48.309714 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5rp4s_ce8f2e7d-5806-41f9-aed0-49e4edec1092/node-ca/0.log" May 26 16:10:48.372307 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:48.372267 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-9q7hf" event={"ID":"73f03199-74ec-4981-9eef-34c97b2fc8ea","Type":"ContainerStarted","Data":"3768c2139f1e009978a529ba3dc862a17759b2cb2dbda8d939380a3963441462"} May 26 16:10:48.389653 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:48.389602 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-9q7hf" podStartSLOduration=2.1797064600000002 podStartE2EDuration="3.38958323s" podCreationTimestamp="2026-05-26 16:10:45 +0000 UTC" firstStartedPulling="2026-05-26 16:10:46.042163232 +0000 UTC m=+136.572656818" lastFinishedPulling="2026-05-26 16:10:47.252040001 +0000 UTC m=+137.782533588" observedRunningTime="2026-05-26 16:10:48.387991464 +0000 UTC m=+138.918485073" watchObservedRunningTime="2026-05-26 16:10:48.38958323 +0000 UTC m=+138.920076834" May 26 16:10:50.317243 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:50.317199 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-sjdlv" May 26 16:10:50.317243 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:50.317244 2560 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-sjdlv" May 26 16:10:50.317698 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:50.317624 2560 scope.go:117] "RemoveContainer" containerID="82b37bd56714a1255fbec41d20853f8ef2c2333dc80eb562f08306661c0a1580" May 26 16:10:50.317796 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:10:50.317780 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-sjdlv_openshift-console-operator(c7a1e813-7c0b-4f31-8ba2-1204fefee3e3)\"" pod="openshift-console-operator/console-operator-76dff48d59-sjdlv" podUID="c7a1e813-7c0b-4f31-8ba2-1204fefee3e3" May 26 16:10:50.378474 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:50.378423 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-bmw5m" event={"ID":"4905863c-c257-4fd4-a423-aaf0889d7edf","Type":"ContainerStarted","Data":"962ff73c9e6f69c582e14726804447dc95164d1fcde1759f767b2e8f010fb78d"} May 26 16:10:50.395756 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:50.395692 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-bmw5m" podStartSLOduration=2.119674249 podStartE2EDuration="4.395675355s" podCreationTimestamp="2026-05-26 16:10:46 +0000 UTC" firstStartedPulling="2026-05-26 16:10:47.338279184 +0000 UTC m=+137.868772770" lastFinishedPulling="2026-05-26 16:10:49.614280287 +0000 UTC m=+140.144773876" observedRunningTime="2026-05-26 16:10:50.393913842 +0000 UTC m=+140.924407449" watchObservedRunningTime="2026-05-26 16:10:50.395675355 +0000 UTC m=+140.926168965" May 26 16:10:55.850395 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:55.850345 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0248426a-06ce-4715-90e4-ceb857b98580-service-ca-bundle\") pod \"router-default-6bbfbf574b-l5b7d\" (UID: \"0248426a-06ce-4715-90e4-ceb857b98580\") " pod="openshift-ingress/router-default-6bbfbf574b-l5b7d" May 26 16:10:55.850803 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:55.850451 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0248426a-06ce-4715-90e4-ceb857b98580-metrics-certs\") pod \"router-default-6bbfbf574b-l5b7d\" (UID: \"0248426a-06ce-4715-90e4-ceb857b98580\") " pod="openshift-ingress/router-default-6bbfbf574b-l5b7d" May 26 16:10:55.850803 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:10:55.850531 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0248426a-06ce-4715-90e4-ceb857b98580-service-ca-bundle podName:0248426a-06ce-4715-90e4-ceb857b98580 nodeName:}" failed. No retries permitted until 2026-05-26 16:11:11.850512004 +0000 UTC m=+162.381005607 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0248426a-06ce-4715-90e4-ceb857b98580-service-ca-bundle") pod "router-default-6bbfbf574b-l5b7d" (UID: "0248426a-06ce-4715-90e4-ceb857b98580") : configmap references non-existent config key: service-ca.crt May 26 16:10:55.852759 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:55.852734 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0248426a-06ce-4715-90e4-ceb857b98580-metrics-certs\") pod \"router-default-6bbfbf574b-l5b7d\" (UID: \"0248426a-06ce-4715-90e4-ceb857b98580\") " pod="openshift-ingress/router-default-6bbfbf574b-l5b7d" May 26 16:10:55.951343 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:10:55.951293 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae0d6eb0-655f-464f-88f4-74ee7cf2a7af-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-dh5hg\" (UID: \"ae0d6eb0-655f-464f-88f4-74ee7cf2a7af\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dh5hg" May 26 16:10:55.951536 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:10:55.951443 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 26 16:10:55.951536 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:10:55.951513 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae0d6eb0-655f-464f-88f4-74ee7cf2a7af-cluster-monitoring-operator-tls podName:ae0d6eb0-655f-464f-88f4-74ee7cf2a7af nodeName:}" failed. No retries permitted until 2026-05-26 16:11:11.951497302 +0000 UTC m=+162.481990894 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ae0d6eb0-655f-464f-88f4-74ee7cf2a7af-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-dh5hg" (UID: "ae0d6eb0-655f-464f-88f4-74ee7cf2a7af") : secret "cluster-monitoring-operator-tls" not found May 26 16:11:06.003704 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.003665 2560 scope.go:117] "RemoveContainer" containerID="82b37bd56714a1255fbec41d20853f8ef2c2333dc80eb562f08306661c0a1580" May 26 16:11:06.068868 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.068833 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-b64fdffcf-5gf69"] May 26 16:11:06.071765 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.071739 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b64fdffcf-5gf69" May 26 16:11:06.074071 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.074049 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 26 16:11:06.074391 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.074375 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 26 16:11:06.075302 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.075286 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 26 16:11:06.075732 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.075709 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xtgwl\"" May 26 16:11:06.079568 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.079547 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 26 16:11:06.085297 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.085273 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mrvlm"] May 26 16:11:06.088373 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.088349 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b64fdffcf-5gf69"] May 26 16:11:06.088528 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.088481 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mrvlm" May 26 16:11:06.090972 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.090945 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ppj7g\"" May 26 16:11:06.091098 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.090954 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 26 16:11:06.091098 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.091012 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 26 16:11:06.091690 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.091481 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 26 16:11:06.091690 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.091564 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 26 16:11:06.104617 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.104577 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mrvlm"] May 26 16:11:06.134399 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.134362 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4182d435-42d4-46cf-be5b-ed67334ea3ff-registry-certificates\") pod \"image-registry-b64fdffcf-5gf69\" (UID: \"4182d435-42d4-46cf-be5b-ed67334ea3ff\") " pod="openshift-image-registry/image-registry-b64fdffcf-5gf69" May 26 16:11:06.134562 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.134404 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4182d435-42d4-46cf-be5b-ed67334ea3ff-ca-trust-extracted\") pod \"image-registry-b64fdffcf-5gf69\" (UID: \"4182d435-42d4-46cf-be5b-ed67334ea3ff\") " pod="openshift-image-registry/image-registry-b64fdffcf-5gf69" May 26 16:11:06.134562 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.134446 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4182d435-42d4-46cf-be5b-ed67334ea3ff-trusted-ca\") pod \"image-registry-b64fdffcf-5gf69\" (UID: \"4182d435-42d4-46cf-be5b-ed67334ea3ff\") " pod="openshift-image-registry/image-registry-b64fdffcf-5gf69" May 26 16:11:06.134562 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.134539 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4182d435-42d4-46cf-be5b-ed67334ea3ff-bound-sa-token\") pod \"image-registry-b64fdffcf-5gf69\" (UID: \"4182d435-42d4-46cf-be5b-ed67334ea3ff\") " pod="openshift-image-registry/image-registry-b64fdffcf-5gf69" May 26 16:11:06.134717 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.134566 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2e558e02-9fbc-4145-9d3e-33f91a7197a2-data-volume\") pod \"insights-runtime-extractor-mrvlm\" (UID: \"2e558e02-9fbc-4145-9d3e-33f91a7197a2\") " pod="openshift-insights/insights-runtime-extractor-mrvlm" May 26 16:11:06.134717 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.134599 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2e558e02-9fbc-4145-9d3e-33f91a7197a2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mrvlm\" (UID: \"2e558e02-9fbc-4145-9d3e-33f91a7197a2\") " pod="openshift-insights/insights-runtime-extractor-mrvlm" May 26 16:11:06.134807 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.134714 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4182d435-42d4-46cf-be5b-ed67334ea3ff-registry-tls\") pod \"image-registry-b64fdffcf-5gf69\" (UID: \"4182d435-42d4-46cf-be5b-ed67334ea3ff\") " pod="openshift-image-registry/image-registry-b64fdffcf-5gf69" May 26 16:11:06.134807 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.134760 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4182d435-42d4-46cf-be5b-ed67334ea3ff-image-registry-private-configuration\") pod \"image-registry-b64fdffcf-5gf69\" (UID: \"4182d435-42d4-46cf-be5b-ed67334ea3ff\") " pod="openshift-image-registry/image-registry-b64fdffcf-5gf69" May 26 16:11:06.134883 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.134806 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bnwm\" (UniqueName: \"kubernetes.io/projected/4182d435-42d4-46cf-be5b-ed67334ea3ff-kube-api-access-9bnwm\") pod \"image-registry-b64fdffcf-5gf69\" (UID: \"4182d435-42d4-46cf-be5b-ed67334ea3ff\") " pod="openshift-image-registry/image-registry-b64fdffcf-5gf69" May 26 16:11:06.134883 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.134835 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2e558e02-9fbc-4145-9d3e-33f91a7197a2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mrvlm\" (UID: \"2e558e02-9fbc-4145-9d3e-33f91a7197a2\") " pod="openshift-insights/insights-runtime-extractor-mrvlm" May 26 16:11:06.134883 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.134858 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2e558e02-9fbc-4145-9d3e-33f91a7197a2-crio-socket\") pod \"insights-runtime-extractor-mrvlm\" (UID: \"2e558e02-9fbc-4145-9d3e-33f91a7197a2\") " pod="openshift-insights/insights-runtime-extractor-mrvlm" May 26 16:11:06.134999 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.134885 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4182d435-42d4-46cf-be5b-ed67334ea3ff-installation-pull-secrets\") pod \"image-registry-b64fdffcf-5gf69\" (UID: \"4182d435-42d4-46cf-be5b-ed67334ea3ff\") " pod="openshift-image-registry/image-registry-b64fdffcf-5gf69" May 26 16:11:06.134999 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.134911 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjhtw\" (UniqueName: \"kubernetes.io/projected/2e558e02-9fbc-4145-9d3e-33f91a7197a2-kube-api-access-kjhtw\") pod \"insights-runtime-extractor-mrvlm\" (UID: \"2e558e02-9fbc-4145-9d3e-33f91a7197a2\") " pod="openshift-insights/insights-runtime-extractor-mrvlm" May 26 16:11:06.236145 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.236106 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4182d435-42d4-46cf-be5b-ed67334ea3ff-registry-certificates\") pod \"image-registry-b64fdffcf-5gf69\" (UID: \"4182d435-42d4-46cf-be5b-ed67334ea3ff\") " pod="openshift-image-registry/image-registry-b64fdffcf-5gf69" May 26 16:11:06.236145 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.236149 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4182d435-42d4-46cf-be5b-ed67334ea3ff-ca-trust-extracted\") pod \"image-registry-b64fdffcf-5gf69\" (UID: \"4182d435-42d4-46cf-be5b-ed67334ea3ff\") " pod="openshift-image-registry/image-registry-b64fdffcf-5gf69" May 26 16:11:06.236382 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.236170 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4182d435-42d4-46cf-be5b-ed67334ea3ff-trusted-ca\") pod \"image-registry-b64fdffcf-5gf69\" (UID: \"4182d435-42d4-46cf-be5b-ed67334ea3ff\") " pod="openshift-image-registry/image-registry-b64fdffcf-5gf69" May 26 16:11:06.236382 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.236300 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4182d435-42d4-46cf-be5b-ed67334ea3ff-bound-sa-token\") pod \"image-registry-b64fdffcf-5gf69\" (UID: \"4182d435-42d4-46cf-be5b-ed67334ea3ff\") " pod="openshift-image-registry/image-registry-b64fdffcf-5gf69" May 26 16:11:06.236382 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.236332 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2e558e02-9fbc-4145-9d3e-33f91a7197a2-data-volume\") pod \"insights-runtime-extractor-mrvlm\" (UID: \"2e558e02-9fbc-4145-9d3e-33f91a7197a2\") " pod="openshift-insights/insights-runtime-extractor-mrvlm" May 26 16:11:06.236567 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.236383 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2e558e02-9fbc-4145-9d3e-33f91a7197a2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mrvlm\" (UID: \"2e558e02-9fbc-4145-9d3e-33f91a7197a2\") " pod="openshift-insights/insights-runtime-extractor-mrvlm" May 26 16:11:06.236567 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.236413 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4182d435-42d4-46cf-be5b-ed67334ea3ff-registry-tls\") pod \"image-registry-b64fdffcf-5gf69\" (UID: \"4182d435-42d4-46cf-be5b-ed67334ea3ff\") " pod="openshift-image-registry/image-registry-b64fdffcf-5gf69" May 26 16:11:06.236567 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.236482 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4182d435-42d4-46cf-be5b-ed67334ea3ff-image-registry-private-configuration\") pod \"image-registry-b64fdffcf-5gf69\" (UID: \"4182d435-42d4-46cf-be5b-ed67334ea3ff\") " pod="openshift-image-registry/image-registry-b64fdffcf-5gf69" May 26 16:11:06.236567 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.236525 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9bnwm\" (UniqueName: \"kubernetes.io/projected/4182d435-42d4-46cf-be5b-ed67334ea3ff-kube-api-access-9bnwm\") pod \"image-registry-b64fdffcf-5gf69\" (UID: \"4182d435-42d4-46cf-be5b-ed67334ea3ff\") " pod="openshift-image-registry/image-registry-b64fdffcf-5gf69" May 26 16:11:06.236567 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.236564 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2e558e02-9fbc-4145-9d3e-33f91a7197a2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mrvlm\" (UID: \"2e558e02-9fbc-4145-9d3e-33f91a7197a2\") " pod="openshift-insights/insights-runtime-extractor-mrvlm" May 26 16:11:06.236800 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.236593 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2e558e02-9fbc-4145-9d3e-33f91a7197a2-crio-socket\") pod \"insights-runtime-extractor-mrvlm\" (UID: \"2e558e02-9fbc-4145-9d3e-33f91a7197a2\") " pod="openshift-insights/insights-runtime-extractor-mrvlm" May 26 16:11:06.236800 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.236626 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4182d435-42d4-46cf-be5b-ed67334ea3ff-installation-pull-secrets\") pod \"image-registry-b64fdffcf-5gf69\" (UID: \"4182d435-42d4-46cf-be5b-ed67334ea3ff\") " pod="openshift-image-registry/image-registry-b64fdffcf-5gf69" May 26 16:11:06.236800 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.236649 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kjhtw\" (UniqueName: \"kubernetes.io/projected/2e558e02-9fbc-4145-9d3e-33f91a7197a2-kube-api-access-kjhtw\") pod \"insights-runtime-extractor-mrvlm\" (UID: \"2e558e02-9fbc-4145-9d3e-33f91a7197a2\") " pod="openshift-insights/insights-runtime-extractor-mrvlm" May 26 16:11:06.236800 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.236696 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4182d435-42d4-46cf-be5b-ed67334ea3ff-ca-trust-extracted\") pod \"image-registry-b64fdffcf-5gf69\" (UID: \"4182d435-42d4-46cf-be5b-ed67334ea3ff\") " pod="openshift-image-registry/image-registry-b64fdffcf-5gf69" May 26 16:11:06.236800 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.236748 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2e558e02-9fbc-4145-9d3e-33f91a7197a2-data-volume\") pod \"insights-runtime-extractor-mrvlm\" (UID: \"2e558e02-9fbc-4145-9d3e-33f91a7197a2\") " pod="openshift-insights/insights-runtime-extractor-mrvlm" May 26 16:11:06.237032 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.236831 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2e558e02-9fbc-4145-9d3e-33f91a7197a2-crio-socket\") pod \"insights-runtime-extractor-mrvlm\" (UID: \"2e558e02-9fbc-4145-9d3e-33f91a7197a2\") " pod="openshift-insights/insights-runtime-extractor-mrvlm" May 26 16:11:06.237169 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.237146 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4182d435-42d4-46cf-be5b-ed67334ea3ff-registry-certificates\") pod \"image-registry-b64fdffcf-5gf69\" (UID: \"4182d435-42d4-46cf-be5b-ed67334ea3ff\") " pod="openshift-image-registry/image-registry-b64fdffcf-5gf69" May 26 16:11:06.237238 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.237203 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4182d435-42d4-46cf-be5b-ed67334ea3ff-trusted-ca\") pod \"image-registry-b64fdffcf-5gf69\" (UID: \"4182d435-42d4-46cf-be5b-ed67334ea3ff\") " pod="openshift-image-registry/image-registry-b64fdffcf-5gf69" May 26 16:11:06.237238 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.237210 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2e558e02-9fbc-4145-9d3e-33f91a7197a2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mrvlm\" (UID: \"2e558e02-9fbc-4145-9d3e-33f91a7197a2\") " pod="openshift-insights/insights-runtime-extractor-mrvlm" May 26 16:11:06.239241 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.239215 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4182d435-42d4-46cf-be5b-ed67334ea3ff-installation-pull-secrets\") pod \"image-registry-b64fdffcf-5gf69\" (UID: \"4182d435-42d4-46cf-be5b-ed67334ea3ff\") " pod="openshift-image-registry/image-registry-b64fdffcf-5gf69" May 26 16:11:06.239386 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.239361 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4182d435-42d4-46cf-be5b-ed67334ea3ff-image-registry-private-configuration\") pod \"image-registry-b64fdffcf-5gf69\" (UID: \"4182d435-42d4-46cf-be5b-ed67334ea3ff\") " pod="openshift-image-registry/image-registry-b64fdffcf-5gf69" May 26 16:11:06.239493 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.239459 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4182d435-42d4-46cf-be5b-ed67334ea3ff-registry-tls\") pod \"image-registry-b64fdffcf-5gf69\" (UID: \"4182d435-42d4-46cf-be5b-ed67334ea3ff\") " pod="openshift-image-registry/image-registry-b64fdffcf-5gf69" May 26 16:11:06.239659 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.239643 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2e558e02-9fbc-4145-9d3e-33f91a7197a2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mrvlm\" (UID: \"2e558e02-9fbc-4145-9d3e-33f91a7197a2\") " pod="openshift-insights/insights-runtime-extractor-mrvlm" May 26 16:11:06.246656 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.246628 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bnwm\" (UniqueName: \"kubernetes.io/projected/4182d435-42d4-46cf-be5b-ed67334ea3ff-kube-api-access-9bnwm\") pod \"image-registry-b64fdffcf-5gf69\" (UID: \"4182d435-42d4-46cf-be5b-ed67334ea3ff\") " pod="openshift-image-registry/image-registry-b64fdffcf-5gf69" May 26 16:11:06.246818 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.246800 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjhtw\" (UniqueName: \"kubernetes.io/projected/2e558e02-9fbc-4145-9d3e-33f91a7197a2-kube-api-access-kjhtw\") pod \"insights-runtime-extractor-mrvlm\" (UID: \"2e558e02-9fbc-4145-9d3e-33f91a7197a2\") " pod="openshift-insights/insights-runtime-extractor-mrvlm" May 26 16:11:06.246889 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.246839 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4182d435-42d4-46cf-be5b-ed67334ea3ff-bound-sa-token\") pod \"image-registry-b64fdffcf-5gf69\" (UID: \"4182d435-42d4-46cf-be5b-ed67334ea3ff\") " pod="openshift-image-registry/image-registry-b64fdffcf-5gf69" May 26 16:11:06.382867 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.382779 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b64fdffcf-5gf69" May 26 16:11:06.399380 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.399354 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mrvlm" May 26 16:11:06.418665 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.418546 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-sjdlv_c7a1e813-7c0b-4f31-8ba2-1204fefee3e3/console-operator/1.log" May 26 16:11:06.418665 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.418621 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-sjdlv" event={"ID":"c7a1e813-7c0b-4f31-8ba2-1204fefee3e3","Type":"ContainerStarted","Data":"b3b84c9c9a7b82214098e6b869828ecbc0e3e5f82a9849860ba63f3eda383d2b"} May 26 16:11:06.419099 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.419076 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-sjdlv" May 26 16:11:06.523287 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.523232 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-sjdlv" podStartSLOduration=25.672844165 podStartE2EDuration="27.523215026s" podCreationTimestamp="2026-05-26 16:10:39 +0000 UTC" firstStartedPulling="2026-05-26 16:10:40.445967265 +0000 UTC m=+130.976460852" lastFinishedPulling="2026-05-26 16:10:42.296338123 +0000 UTC m=+132.826831713" observedRunningTime="2026-05-26 16:11:06.438409888 +0000 UTC m=+156.968903498" watchObservedRunningTime="2026-05-26 16:11:06.523215026 +0000 UTC m=+157.053708645" May 26 16:11:06.527693 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.527659 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b64fdffcf-5gf69"] May 26 16:11:06.537228 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.537201 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mrvlm"] May 26 16:11:06.541921 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:11:06.541900 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e558e02_9fbc_4145_9d3e_33f91a7197a2.slice/crio-5d5b89c60b02a5e635058d401254c3da37fa305cd16cb9452d80bd79f7e0920b WatchSource:0}: Error finding container 5d5b89c60b02a5e635058d401254c3da37fa305cd16cb9452d80bd79f7e0920b: Status 404 returned error can't find the container with id 5d5b89c60b02a5e635058d401254c3da37fa305cd16cb9452d80bd79f7e0920b May 26 16:11:06.544501 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:06.544483 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-sjdlv" May 26 16:11:07.422393 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:07.422305 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b64fdffcf-5gf69" event={"ID":"4182d435-42d4-46cf-be5b-ed67334ea3ff","Type":"ContainerStarted","Data":"00d05be5fd0706742c24bf183b57d82e9bd0fdfe8a8db478cca1bb3dff91eb73"} May 26 16:11:07.422393 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:07.422340 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b64fdffcf-5gf69" event={"ID":"4182d435-42d4-46cf-be5b-ed67334ea3ff","Type":"ContainerStarted","Data":"3743e6df18a6a90e70cda5ab2a1e90ed16914da1f7127bac343af8042853da3d"} May 26 16:11:07.422393 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:07.422375 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-b64fdffcf-5gf69" May 26 16:11:07.423918 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:07.423900 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mrvlm" event={"ID":"2e558e02-9fbc-4145-9d3e-33f91a7197a2","Type":"ContainerStarted","Data":"babb9edfd1daa05d5930dfad0b631c09018146d9362e83ba7e2903970a576b90"} May 26 16:11:07.423981 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:07.423924 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mrvlm" event={"ID":"2e558e02-9fbc-4145-9d3e-33f91a7197a2","Type":"ContainerStarted","Data":"87893a128d8f7c54462fae46d5623dbbce62096dbe423694ff35f7fa203f3326"} May 26 16:11:07.423981 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:07.423935 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mrvlm" event={"ID":"2e558e02-9fbc-4145-9d3e-33f91a7197a2","Type":"ContainerStarted","Data":"5d5b89c60b02a5e635058d401254c3da37fa305cd16cb9452d80bd79f7e0920b"} May 26 16:11:07.455516 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:07.455467 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-b64fdffcf-5gf69" podStartSLOduration=1.455454527 podStartE2EDuration="1.455454527s" podCreationTimestamp="2026-05-26 16:11:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 16:11:07.453786065 +0000 UTC m=+157.984279672" watchObservedRunningTime="2026-05-26 16:11:07.455454527 +0000 UTC m=+157.985948131" May 26 16:11:07.915761 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:11:07.915721 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-rk9bl" podUID="198e0563-480e-4643-8cc7-ffbcdd9d6096" May 26 16:11:07.935143 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:11:07.935099 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-rqtzd" podUID="074a7bdb-b46a-4d92-93be-4934b7e5c55b" May 26 16:11:08.426953 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:08.426927 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rk9bl" May 26 16:11:09.012852 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:11:09.012809 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-ws4lv" podUID="eec5f0e1-7fd2-4597-a1a0-3b5b10517934" May 26 16:11:09.431419 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:09.431337 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mrvlm" event={"ID":"2e558e02-9fbc-4145-9d3e-33f91a7197a2","Type":"ContainerStarted","Data":"a4fbc2406f07936529a376bc1bf0489f5aa0a319d4d3c366b1f487f05dbf2bb9"} May 26 16:11:09.451608 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:09.451556 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mrvlm" podStartSLOduration=1.479953012 podStartE2EDuration="3.451541349s" podCreationTimestamp="2026-05-26 16:11:06 +0000 UTC" firstStartedPulling="2026-05-26 16:11:06.600979728 +0000 UTC m=+157.131473329" lastFinishedPulling="2026-05-26 16:11:08.572568072 +0000 UTC m=+159.103061666" observedRunningTime="2026-05-26 16:11:09.449665941 +0000 UTC m=+159.980159548" watchObservedRunningTime="2026-05-26 16:11:09.451541349 +0000 UTC m=+159.982034957" May 26 16:11:11.880817 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:11.880775 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0248426a-06ce-4715-90e4-ceb857b98580-service-ca-bundle\") pod \"router-default-6bbfbf574b-l5b7d\" (UID: \"0248426a-06ce-4715-90e4-ceb857b98580\") " pod="openshift-ingress/router-default-6bbfbf574b-l5b7d" May 26 16:11:11.881485 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:11.881464 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0248426a-06ce-4715-90e4-ceb857b98580-service-ca-bundle\") pod \"router-default-6bbfbf574b-l5b7d\" (UID: \"0248426a-06ce-4715-90e4-ceb857b98580\") " pod="openshift-ingress/router-default-6bbfbf574b-l5b7d" May 26 16:11:11.981754 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:11.981719 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae0d6eb0-655f-464f-88f4-74ee7cf2a7af-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-dh5hg\" (UID: \"ae0d6eb0-655f-464f-88f4-74ee7cf2a7af\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dh5hg" May 26 16:11:11.984077 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:11.984058 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae0d6eb0-655f-464f-88f4-74ee7cf2a7af-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-dh5hg\" (UID: \"ae0d6eb0-655f-464f-88f4-74ee7cf2a7af\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dh5hg" May 26 16:11:12.122146 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:12.122112 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6bbfbf574b-l5b7d" May 26 16:11:12.206741 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:12.206703 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dh5hg" May 26 16:11:12.245786 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:12.245757 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6bbfbf574b-l5b7d"] May 26 16:11:12.247583 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:11:12.247540 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0248426a_06ce_4715_90e4_ceb857b98580.slice/crio-9ed2fc40f0bad7a30ec28f915737eb8745d9d908c72ffbbb10094acad9cecec0 WatchSource:0}: Error finding container 9ed2fc40f0bad7a30ec28f915737eb8745d9d908c72ffbbb10094acad9cecec0: Status 404 returned error can't find the container with id 9ed2fc40f0bad7a30ec28f915737eb8745d9d908c72ffbbb10094acad9cecec0 May 26 16:11:12.358488 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:12.358457 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-dh5hg"] May 26 16:11:12.362191 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:11:12.362165 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae0d6eb0_655f_464f_88f4_74ee7cf2a7af.slice/crio-f0426930dfb856e85580b0c2aec0e1fed21c60192ef2ca25ba4367564943b93f WatchSource:0}: Error finding container f0426930dfb856e85580b0c2aec0e1fed21c60192ef2ca25ba4367564943b93f: Status 404 returned error can't find the container with id f0426930dfb856e85580b0c2aec0e1fed21c60192ef2ca25ba4367564943b93f May 26 16:11:12.441118 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:12.441029 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6bbfbf574b-l5b7d" event={"ID":"0248426a-06ce-4715-90e4-ceb857b98580","Type":"ContainerStarted","Data":"66f09aa299762fa1308db501f7f7669a43838d8fe2bf17296c01a6e17e3d0891"} May 26 16:11:12.441118 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:12.441070 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6bbfbf574b-l5b7d" event={"ID":"0248426a-06ce-4715-90e4-ceb857b98580","Type":"ContainerStarted","Data":"9ed2fc40f0bad7a30ec28f915737eb8745d9d908c72ffbbb10094acad9cecec0"} May 26 16:11:12.442054 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:12.442033 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dh5hg" event={"ID":"ae0d6eb0-655f-464f-88f4-74ee7cf2a7af","Type":"ContainerStarted","Data":"f0426930dfb856e85580b0c2aec0e1fed21c60192ef2ca25ba4367564943b93f"} May 26 16:11:12.460505 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:12.460458 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-6bbfbf574b-l5b7d" podStartSLOduration=33.460416913 podStartE2EDuration="33.460416913s" podCreationTimestamp="2026-05-26 16:10:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 16:11:12.459989475 +0000 UTC m=+162.990483098" watchObservedRunningTime="2026-05-26 16:11:12.460416913 +0000 UTC m=+162.990910523" May 26 16:11:12.891584 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:12.891537 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/074a7bdb-b46a-4d92-93be-4934b7e5c55b-cert\") pod \"ingress-canary-rqtzd\" (UID: \"074a7bdb-b46a-4d92-93be-4934b7e5c55b\") " pod="openshift-ingress-canary/ingress-canary-rqtzd" May 26 16:11:12.891584 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:12.891589 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/198e0563-480e-4643-8cc7-ffbcdd9d6096-metrics-tls\") pod \"dns-default-rk9bl\" (UID: \"198e0563-480e-4643-8cc7-ffbcdd9d6096\") " pod="openshift-dns/dns-default-rk9bl" May 26 16:11:12.893928 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:12.893900 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/198e0563-480e-4643-8cc7-ffbcdd9d6096-metrics-tls\") pod \"dns-default-rk9bl\" (UID: \"198e0563-480e-4643-8cc7-ffbcdd9d6096\") " pod="openshift-dns/dns-default-rk9bl" May 26 16:11:12.894034 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:12.893946 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/074a7bdb-b46a-4d92-93be-4934b7e5c55b-cert\") pod \"ingress-canary-rqtzd\" (UID: \"074a7bdb-b46a-4d92-93be-4934b7e5c55b\") " pod="openshift-ingress-canary/ingress-canary-rqtzd" May 26 16:11:12.930306 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:12.930280 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kfnx9\"" May 26 16:11:12.938481 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:12.938464 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rk9bl" May 26 16:11:13.073711 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:13.073682 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rk9bl"] May 26 16:11:13.077834 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:11:13.077800 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod198e0563_480e_4643_8cc7_ffbcdd9d6096.slice/crio-0bd73bcab720c8a16b38c3b3168ba55cc935208631134b5c383d992bad5200f5 WatchSource:0}: Error finding container 0bd73bcab720c8a16b38c3b3168ba55cc935208631134b5c383d992bad5200f5: Status 404 returned error can't find the container with id 0bd73bcab720c8a16b38c3b3168ba55cc935208631134b5c383d992bad5200f5 May 26 16:11:13.122821 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:13.122791 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6bbfbf574b-l5b7d" May 26 16:11:13.125271 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:13.125242 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6bbfbf574b-l5b7d" May 26 16:11:13.445332 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:13.445296 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rk9bl" event={"ID":"198e0563-480e-4643-8cc7-ffbcdd9d6096","Type":"ContainerStarted","Data":"0bd73bcab720c8a16b38c3b3168ba55cc935208631134b5c383d992bad5200f5"} May 26 16:11:13.445662 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:13.445641 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6bbfbf574b-l5b7d" May 26 16:11:13.446944 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:13.446918 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6bbfbf574b-l5b7d" May 26 16:11:15.452530 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:15.452489 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dh5hg" event={"ID":"ae0d6eb0-655f-464f-88f4-74ee7cf2a7af","Type":"ContainerStarted","Data":"4fcfd8cf10d162100c20bc4580f30e3c1729b08125d2a2108fe7c4afbc9ca258"} May 26 16:11:15.453867 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:15.453842 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rk9bl" event={"ID":"198e0563-480e-4643-8cc7-ffbcdd9d6096","Type":"ContainerStarted","Data":"bb233d14b948bce9a2987f8553f94ac891dd25706ce7765217e43bacc6468daa"} May 26 16:11:15.453971 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:15.453873 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rk9bl" event={"ID":"198e0563-480e-4643-8cc7-ffbcdd9d6096","Type":"ContainerStarted","Data":"a26b9aceed50ca4ba646aef70899fd4b8b06f7199e4317d79c04c9907f2c4be1"} May 26 16:11:15.470604 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:15.470554 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dh5hg" podStartSLOduration=33.297737584 podStartE2EDuration="35.470538553s" podCreationTimestamp="2026-05-26 16:10:40 +0000 UTC" firstStartedPulling="2026-05-26 16:11:12.364034678 +0000 UTC m=+162.894528264" lastFinishedPulling="2026-05-26 16:11:14.536835647 +0000 UTC m=+165.067329233" observedRunningTime="2026-05-26 16:11:15.469127838 +0000 UTC m=+165.999621445" watchObservedRunningTime="2026-05-26 16:11:15.470538553 +0000 UTC m=+166.001032162" May 26 16:11:15.488501 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:15.488452 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-rk9bl" podStartSLOduration=129.98456725 podStartE2EDuration="2m11.488438533s" podCreationTimestamp="2026-05-26 16:09:04 +0000 UTC" firstStartedPulling="2026-05-26 16:11:13.080013962 +0000 UTC m=+163.610507548" lastFinishedPulling="2026-05-26 16:11:14.583885233 +0000 UTC m=+165.114378831" observedRunningTime="2026-05-26 16:11:15.487248135 +0000 UTC m=+166.017741743" watchObservedRunningTime="2026-05-26 16:11:15.488438533 +0000 UTC m=+166.018932133" May 26 16:11:16.457060 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:16.456987 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rk9bl" May 26 16:11:19.003322 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:19.003276 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rqtzd" May 26 16:11:19.006055 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:19.006038 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dfl8l\"" May 26 16:11:19.014212 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:19.014193 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rqtzd" May 26 16:11:19.139275 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:19.136800 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rqtzd"] May 26 16:11:19.141923 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:11:19.141886 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod074a7bdb_b46a_4d92_93be_4934b7e5c55b.slice/crio-e53840779acb026f3cb6931b2c0a82fcaaf17c54c3086735148df8490b96aa61 WatchSource:0}: Error finding container e53840779acb026f3cb6931b2c0a82fcaaf17c54c3086735148df8490b96aa61: Status 404 returned error can't find the container with id e53840779acb026f3cb6931b2c0a82fcaaf17c54c3086735148df8490b96aa61 May 26 16:11:19.465107 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:19.465073 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rqtzd" event={"ID":"074a7bdb-b46a-4d92-93be-4934b7e5c55b","Type":"ContainerStarted","Data":"e53840779acb026f3cb6931b2c0a82fcaaf17c54c3086735148df8490b96aa61"} May 26 16:11:21.471562 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:21.471528 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rqtzd" event={"ID":"074a7bdb-b46a-4d92-93be-4934b7e5c55b","Type":"ContainerStarted","Data":"7b10010fc0b22cb7ee04baadd94b15de5fe6f57496d77ea1f8d8f54642f01466"} May 26 16:11:21.486515 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:21.486472 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rqtzd" podStartSLOduration=135.436224508 podStartE2EDuration="2m17.486457679s" podCreationTimestamp="2026-05-26 16:09:04 +0000 UTC" firstStartedPulling="2026-05-26 16:11:19.143808312 +0000 UTC m=+169.674301902" lastFinishedPulling="2026-05-26 16:11:21.194041483 +0000 UTC m=+171.724535073" observedRunningTime="2026-05-26 16:11:21.486198249 +0000 UTC m=+172.016691859" watchObservedRunningTime="2026-05-26 16:11:21.486457679 +0000 UTC m=+172.016951287" May 26 16:11:22.006937 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:22.006907 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ws4lv" May 26 16:11:26.387466 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:26.387403 2560 patch_prober.go:28] interesting pod/image-registry-b64fdffcf-5gf69 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 26 16:11:26.387858 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:26.387487 2560 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-b64fdffcf-5gf69" podUID="4182d435-42d4-46cf-be5b-ed67334ea3ff" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 26 16:11:26.461150 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:26.461119 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rk9bl" May 26 16:11:28.430776 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:28.430748 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-b64fdffcf-5gf69" May 26 16:11:34.542898 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:34.542859 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nnhvz"] May 26 16:11:34.545982 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:34.545962 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nnhvz" May 26 16:11:34.548415 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:34.548386 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 26 16:11:34.548552 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:34.548526 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 26 16:11:34.552210 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:34.552185 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 26 16:11:34.552573 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:34.552552 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 26 16:11:34.552573 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:34.552570 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-khbg7\"" May 26 16:11:34.664493 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:34.664452 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/92b6ff44-d505-4441-9dbd-d9a6090ab976-node-exporter-textfile\") pod \"node-exporter-nnhvz\" (UID: \"92b6ff44-d505-4441-9dbd-d9a6090ab976\") " pod="openshift-monitoring/node-exporter-nnhvz" May 26 16:11:34.664711 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:34.664527 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92b6ff44-d505-4441-9dbd-d9a6090ab976-metrics-client-ca\") pod \"node-exporter-nnhvz\" (UID: \"92b6ff44-d505-4441-9dbd-d9a6090ab976\") " pod="openshift-monitoring/node-exporter-nnhvz" May 26 16:11:34.664711 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:34.664580 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/92b6ff44-d505-4441-9dbd-d9a6090ab976-node-exporter-tls\") pod \"node-exporter-nnhvz\" (UID: \"92b6ff44-d505-4441-9dbd-d9a6090ab976\") " pod="openshift-monitoring/node-exporter-nnhvz" May 26 16:11:34.664711 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:34.664654 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p28wc\" (UniqueName: \"kubernetes.io/projected/92b6ff44-d505-4441-9dbd-d9a6090ab976-kube-api-access-p28wc\") pod \"node-exporter-nnhvz\" (UID: \"92b6ff44-d505-4441-9dbd-d9a6090ab976\") " pod="openshift-monitoring/node-exporter-nnhvz" May 26 16:11:34.664861 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:34.664715 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/92b6ff44-d505-4441-9dbd-d9a6090ab976-root\") pod \"node-exporter-nnhvz\" (UID: \"92b6ff44-d505-4441-9dbd-d9a6090ab976\") " pod="openshift-monitoring/node-exporter-nnhvz" May 26 16:11:34.664861 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:34.664751 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/92b6ff44-d505-4441-9dbd-d9a6090ab976-node-exporter-wtmp\") pod \"node-exporter-nnhvz\" (UID: \"92b6ff44-d505-4441-9dbd-d9a6090ab976\") " pod="openshift-monitoring/node-exporter-nnhvz" May 26 16:11:34.664861 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:34.664776 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92b6ff44-d505-4441-9dbd-d9a6090ab976-sys\") pod \"node-exporter-nnhvz\" (UID: \"92b6ff44-d505-4441-9dbd-d9a6090ab976\") " pod="openshift-monitoring/node-exporter-nnhvz" May 26 16:11:34.664861 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:34.664834 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/92b6ff44-d505-4441-9dbd-d9a6090ab976-node-exporter-accelerators-collector-config\") pod \"node-exporter-nnhvz\" (UID: \"92b6ff44-d505-4441-9dbd-d9a6090ab976\") " pod="openshift-monitoring/node-exporter-nnhvz" May 26 16:11:34.664861 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:34.664857 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/92b6ff44-d505-4441-9dbd-d9a6090ab976-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nnhvz\" (UID: \"92b6ff44-d505-4441-9dbd-d9a6090ab976\") " pod="openshift-monitoring/node-exporter-nnhvz" May 26 16:11:34.765320 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:34.765282 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92b6ff44-d505-4441-9dbd-d9a6090ab976-metrics-client-ca\") pod \"node-exporter-nnhvz\" (UID: \"92b6ff44-d505-4441-9dbd-d9a6090ab976\") " pod="openshift-monitoring/node-exporter-nnhvz" May 26 16:11:34.765539 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:34.765343 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/92b6ff44-d505-4441-9dbd-d9a6090ab976-node-exporter-tls\") pod \"node-exporter-nnhvz\" (UID: \"92b6ff44-d505-4441-9dbd-d9a6090ab976\") " pod="openshift-monitoring/node-exporter-nnhvz" May 26 16:11:34.765539 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:34.765379 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p28wc\" (UniqueName: \"kubernetes.io/projected/92b6ff44-d505-4441-9dbd-d9a6090ab976-kube-api-access-p28wc\") pod \"node-exporter-nnhvz\" (UID: \"92b6ff44-d505-4441-9dbd-d9a6090ab976\") " pod="openshift-monitoring/node-exporter-nnhvz" May 26 16:11:34.765653 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:34.765548 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/92b6ff44-d505-4441-9dbd-d9a6090ab976-root\") pod \"node-exporter-nnhvz\" (UID: \"92b6ff44-d505-4441-9dbd-d9a6090ab976\") " pod="openshift-monitoring/node-exporter-nnhvz" May 26 16:11:34.765653 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:34.765587 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/92b6ff44-d505-4441-9dbd-d9a6090ab976-node-exporter-wtmp\") pod \"node-exporter-nnhvz\" (UID: \"92b6ff44-d505-4441-9dbd-d9a6090ab976\") " pod="openshift-monitoring/node-exporter-nnhvz" May 26 16:11:34.765653 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:34.765614 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92b6ff44-d505-4441-9dbd-d9a6090ab976-sys\") pod \"node-exporter-nnhvz\" (UID: \"92b6ff44-d505-4441-9dbd-d9a6090ab976\") " pod="openshift-monitoring/node-exporter-nnhvz" May 26 16:11:34.765846 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:34.765702 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/92b6ff44-d505-4441-9dbd-d9a6090ab976-root\") pod \"node-exporter-nnhvz\" (UID: \"92b6ff44-d505-4441-9dbd-d9a6090ab976\") " pod="openshift-monitoring/node-exporter-nnhvz" May 26 16:11:34.765846 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:34.765686 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/92b6ff44-d505-4441-9dbd-d9a6090ab976-node-exporter-accelerators-collector-config\") pod \"node-exporter-nnhvz\" (UID: \"92b6ff44-d505-4441-9dbd-d9a6090ab976\") " pod="openshift-monitoring/node-exporter-nnhvz" May 26 16:11:34.765846 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:34.765754 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/92b6ff44-d505-4441-9dbd-d9a6090ab976-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nnhvz\" (UID: \"92b6ff44-d505-4441-9dbd-d9a6090ab976\") " pod="openshift-monitoring/node-exporter-nnhvz" May 26 16:11:34.765846 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:34.765774 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/92b6ff44-d505-4441-9dbd-d9a6090ab976-node-exporter-wtmp\") pod \"node-exporter-nnhvz\" (UID: \"92b6ff44-d505-4441-9dbd-d9a6090ab976\") " pod="openshift-monitoring/node-exporter-nnhvz" May 26 16:11:34.765846 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:34.765794 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/92b6ff44-d505-4441-9dbd-d9a6090ab976-node-exporter-textfile\") pod \"node-exporter-nnhvz\" (UID: \"92b6ff44-d505-4441-9dbd-d9a6090ab976\") " pod="openshift-monitoring/node-exporter-nnhvz" May 26 16:11:34.765846 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:34.765824 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92b6ff44-d505-4441-9dbd-d9a6090ab976-sys\") pod \"node-exporter-nnhvz\" (UID: \"92b6ff44-d505-4441-9dbd-d9a6090ab976\") " pod="openshift-monitoring/node-exporter-nnhvz" May 26 16:11:34.766228 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:34.766209 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/92b6ff44-d505-4441-9dbd-d9a6090ab976-node-exporter-textfile\") pod \"node-exporter-nnhvz\" (UID: \"92b6ff44-d505-4441-9dbd-d9a6090ab976\") " pod="openshift-monitoring/node-exporter-nnhvz" May 26 16:11:34.766724 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:34.766703 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92b6ff44-d505-4441-9dbd-d9a6090ab976-metrics-client-ca\") pod \"node-exporter-nnhvz\" (UID: \"92b6ff44-d505-4441-9dbd-d9a6090ab976\") " pod="openshift-monitoring/node-exporter-nnhvz" May 26 16:11:34.766903 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:34.766722 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/92b6ff44-d505-4441-9dbd-d9a6090ab976-node-exporter-accelerators-collector-config\") pod \"node-exporter-nnhvz\" (UID: \"92b6ff44-d505-4441-9dbd-d9a6090ab976\") " pod="openshift-monitoring/node-exporter-nnhvz" May 26 16:11:34.768763 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:34.768740 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/92b6ff44-d505-4441-9dbd-d9a6090ab976-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nnhvz\" (UID: \"92b6ff44-d505-4441-9dbd-d9a6090ab976\") " pod="openshift-monitoring/node-exporter-nnhvz" May 26 16:11:34.768871 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:34.768831 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/92b6ff44-d505-4441-9dbd-d9a6090ab976-node-exporter-tls\") pod \"node-exporter-nnhvz\" (UID: \"92b6ff44-d505-4441-9dbd-d9a6090ab976\") " pod="openshift-monitoring/node-exporter-nnhvz" May 26 16:11:34.775162 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:34.775138 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p28wc\" (UniqueName: \"kubernetes.io/projected/92b6ff44-d505-4441-9dbd-d9a6090ab976-kube-api-access-p28wc\") pod \"node-exporter-nnhvz\" (UID: \"92b6ff44-d505-4441-9dbd-d9a6090ab976\") " pod="openshift-monitoring/node-exporter-nnhvz" May 26 16:11:34.857088 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:34.857004 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nnhvz" May 26 16:11:34.864938 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:11:34.864909 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92b6ff44_d505_4441_9dbd_d9a6090ab976.slice/crio-8c669365a437e0d22985334ce655f0bce51d1ddc8b40b0a1b52dd6d5e12647a5 WatchSource:0}: Error finding container 8c669365a437e0d22985334ce655f0bce51d1ddc8b40b0a1b52dd6d5e12647a5: Status 404 returned error can't find the container with id 8c669365a437e0d22985334ce655f0bce51d1ddc8b40b0a1b52dd6d5e12647a5 May 26 16:11:35.509739 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:35.509692 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nnhvz" event={"ID":"92b6ff44-d505-4441-9dbd-d9a6090ab976","Type":"ContainerStarted","Data":"8c669365a437e0d22985334ce655f0bce51d1ddc8b40b0a1b52dd6d5e12647a5"} May 26 16:11:36.482236 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:36.482201 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-85d8bd4786-vtxp2"] May 26 16:11:36.484421 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:36.484404 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-85d8bd4786-vtxp2" May 26 16:11:36.487189 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:36.487146 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" May 26 16:11:36.487334 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:36.487206 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" May 26 16:11:36.487334 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:36.487219 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-ans6tspqnkt8n\"" May 26 16:11:36.487334 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:36.487252 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-4q5sx\"" May 26 16:11:36.487334 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:36.487310 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" May 26 16:11:36.487584 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:36.487535 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" May 26 16:11:36.488316 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:36.488300 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" May 26 16:11:36.495177 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:36.495155 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-85d8bd4786-vtxp2"] May 26 16:11:36.513542 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:36.513507 2560 generic.go:358] "Generic (PLEG): container finished" podID="92b6ff44-d505-4441-9dbd-d9a6090ab976" containerID="a67045bcd7a3e18aefe665eb0f06ff1825440aaf64306a2654b2ede8fe21389e" exitCode=0 May 26 16:11:36.513710 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:36.513583 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nnhvz" event={"ID":"92b6ff44-d505-4441-9dbd-d9a6090ab976","Type":"ContainerDied","Data":"a67045bcd7a3e18aefe665eb0f06ff1825440aaf64306a2654b2ede8fe21389e"} May 26 16:11:36.580188 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:36.580162 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/235bb816-f1b6-4818-8a19-c400d0011009-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-85d8bd4786-vtxp2\" (UID: \"235bb816-f1b6-4818-8a19-c400d0011009\") " pod="openshift-monitoring/thanos-querier-85d8bd4786-vtxp2" May 26 16:11:36.580305 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:36.580203 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/235bb816-f1b6-4818-8a19-c400d0011009-secret-grpc-tls\") pod \"thanos-querier-85d8bd4786-vtxp2\" (UID: \"235bb816-f1b6-4818-8a19-c400d0011009\") " pod="openshift-monitoring/thanos-querier-85d8bd4786-vtxp2" May 26 16:11:36.580305 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:36.580232 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/235bb816-f1b6-4818-8a19-c400d0011009-secret-thanos-querier-tls\") pod \"thanos-querier-85d8bd4786-vtxp2\" (UID: \"235bb816-f1b6-4818-8a19-c400d0011009\") " pod="openshift-monitoring/thanos-querier-85d8bd4786-vtxp2" May 26 16:11:36.580305 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:36.580250 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/235bb816-f1b6-4818-8a19-c400d0011009-metrics-client-ca\") pod \"thanos-querier-85d8bd4786-vtxp2\" (UID: \"235bb816-f1b6-4818-8a19-c400d0011009\") " pod="openshift-monitoring/thanos-querier-85d8bd4786-vtxp2" May 26 16:11:36.580415 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:36.580339 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kqc6\" (UniqueName: \"kubernetes.io/projected/235bb816-f1b6-4818-8a19-c400d0011009-kube-api-access-7kqc6\") pod \"thanos-querier-85d8bd4786-vtxp2\" (UID: \"235bb816-f1b6-4818-8a19-c400d0011009\") " pod="openshift-monitoring/thanos-querier-85d8bd4786-vtxp2" May 26 16:11:36.580477 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:36.580418 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/235bb816-f1b6-4818-8a19-c400d0011009-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-85d8bd4786-vtxp2\" (UID: \"235bb816-f1b6-4818-8a19-c400d0011009\") " pod="openshift-monitoring/thanos-querier-85d8bd4786-vtxp2" May 26 16:11:36.580513 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:36.580476 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/235bb816-f1b6-4818-8a19-c400d0011009-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-85d8bd4786-vtxp2\" (UID: \"235bb816-f1b6-4818-8a19-c400d0011009\") " pod="openshift-monitoring/thanos-querier-85d8bd4786-vtxp2" May 26 16:11:36.580552 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:36.580509 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/235bb816-f1b6-4818-8a19-c400d0011009-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-85d8bd4786-vtxp2\" (UID: \"235bb816-f1b6-4818-8a19-c400d0011009\") " pod="openshift-monitoring/thanos-querier-85d8bd4786-vtxp2" May 26 16:11:36.681656 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:36.681613 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/235bb816-f1b6-4818-8a19-c400d0011009-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-85d8bd4786-vtxp2\" (UID: \"235bb816-f1b6-4818-8a19-c400d0011009\") " pod="openshift-monitoring/thanos-querier-85d8bd4786-vtxp2" May 26 16:11:36.681656 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:36.681658 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/235bb816-f1b6-4818-8a19-c400d0011009-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-85d8bd4786-vtxp2\" (UID: \"235bb816-f1b6-4818-8a19-c400d0011009\") " pod="openshift-monitoring/thanos-querier-85d8bd4786-vtxp2" May 26 16:11:36.681897 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:36.681682 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/235bb816-f1b6-4818-8a19-c400d0011009-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-85d8bd4786-vtxp2\" (UID: \"235bb816-f1b6-4818-8a19-c400d0011009\") " pod="openshift-monitoring/thanos-querier-85d8bd4786-vtxp2" May 26 16:11:36.681897 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:36.681806 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/235bb816-f1b6-4818-8a19-c400d0011009-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-85d8bd4786-vtxp2\" (UID: \"235bb816-f1b6-4818-8a19-c400d0011009\") " pod="openshift-monitoring/thanos-querier-85d8bd4786-vtxp2" May 26 16:11:36.681897 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:36.681847 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/235bb816-f1b6-4818-8a19-c400d0011009-secret-grpc-tls\") pod \"thanos-querier-85d8bd4786-vtxp2\" (UID: \"235bb816-f1b6-4818-8a19-c400d0011009\") " pod="openshift-monitoring/thanos-querier-85d8bd4786-vtxp2" May 26 16:11:36.681897 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:36.681886 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/235bb816-f1b6-4818-8a19-c400d0011009-secret-thanos-querier-tls\") pod \"thanos-querier-85d8bd4786-vtxp2\" (UID: \"235bb816-f1b6-4818-8a19-c400d0011009\") " pod="openshift-monitoring/thanos-querier-85d8bd4786-vtxp2" May 26 16:11:36.682096 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:36.681914 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/235bb816-f1b6-4818-8a19-c400d0011009-metrics-client-ca\") pod \"thanos-querier-85d8bd4786-vtxp2\" (UID: \"235bb816-f1b6-4818-8a19-c400d0011009\") " pod="openshift-monitoring/thanos-querier-85d8bd4786-vtxp2" May 26 16:11:36.682096 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:36.681980 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7kqc6\" (UniqueName: \"kubernetes.io/projected/235bb816-f1b6-4818-8a19-c400d0011009-kube-api-access-7kqc6\") pod \"thanos-querier-85d8bd4786-vtxp2\" (UID: \"235bb816-f1b6-4818-8a19-c400d0011009\") " pod="openshift-monitoring/thanos-querier-85d8bd4786-vtxp2" May 26 16:11:36.682808 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:36.682781 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/235bb816-f1b6-4818-8a19-c400d0011009-metrics-client-ca\") pod \"thanos-querier-85d8bd4786-vtxp2\" (UID: \"235bb816-f1b6-4818-8a19-c400d0011009\") " pod="openshift-monitoring/thanos-querier-85d8bd4786-vtxp2" May 26 16:11:36.684481 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:36.684456 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/235bb816-f1b6-4818-8a19-c400d0011009-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-85d8bd4786-vtxp2\" (UID: \"235bb816-f1b6-4818-8a19-c400d0011009\") " pod="openshift-monitoring/thanos-querier-85d8bd4786-vtxp2" May 26 16:11:36.684851 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:36.684829 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/235bb816-f1b6-4818-8a19-c400d0011009-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-85d8bd4786-vtxp2\" (UID: \"235bb816-f1b6-4818-8a19-c400d0011009\") " pod="openshift-monitoring/thanos-querier-85d8bd4786-vtxp2" May 26 16:11:36.684972 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:36.684950 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/235bb816-f1b6-4818-8a19-c400d0011009-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-85d8bd4786-vtxp2\" (UID: \"235bb816-f1b6-4818-8a19-c400d0011009\") " pod="openshift-monitoring/thanos-querier-85d8bd4786-vtxp2" May 26 16:11:36.685032 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:36.684950 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/235bb816-f1b6-4818-8a19-c400d0011009-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-85d8bd4786-vtxp2\" (UID: \"235bb816-f1b6-4818-8a19-c400d0011009\") " pod="openshift-monitoring/thanos-querier-85d8bd4786-vtxp2" May 26 16:11:36.685089 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:36.685049 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/235bb816-f1b6-4818-8a19-c400d0011009-secret-thanos-querier-tls\") pod \"thanos-querier-85d8bd4786-vtxp2\" (UID: \"235bb816-f1b6-4818-8a19-c400d0011009\") " pod="openshift-monitoring/thanos-querier-85d8bd4786-vtxp2" May 26 16:11:36.685089 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:36.685070 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/235bb816-f1b6-4818-8a19-c400d0011009-secret-grpc-tls\") pod \"thanos-querier-85d8bd4786-vtxp2\" (UID: \"235bb816-f1b6-4818-8a19-c400d0011009\") " pod="openshift-monitoring/thanos-querier-85d8bd4786-vtxp2" May 26 16:11:36.691163 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:36.691140 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kqc6\" (UniqueName: \"kubernetes.io/projected/235bb816-f1b6-4818-8a19-c400d0011009-kube-api-access-7kqc6\") pod \"thanos-querier-85d8bd4786-vtxp2\" (UID: \"235bb816-f1b6-4818-8a19-c400d0011009\") " pod="openshift-monitoring/thanos-querier-85d8bd4786-vtxp2" May 26 16:11:36.793847 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:36.793769 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-85d8bd4786-vtxp2" May 26 16:11:36.921682 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:36.921644 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-85d8bd4786-vtxp2"] May 26 16:11:36.923958 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:11:36.923932 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod235bb816_f1b6_4818_8a19_c400d0011009.slice/crio-58c376b28056199f0a220aadabe248e74cf0b70cf8b8cb198bb2113ede2fafc3 WatchSource:0}: Error finding container 58c376b28056199f0a220aadabe248e74cf0b70cf8b8cb198bb2113ede2fafc3: Status 404 returned error can't find the container with id 58c376b28056199f0a220aadabe248e74cf0b70cf8b8cb198bb2113ede2fafc3 May 26 16:11:37.518885 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:37.518848 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nnhvz" event={"ID":"92b6ff44-d505-4441-9dbd-d9a6090ab976","Type":"ContainerStarted","Data":"21dfceacb73046ae601da757c2773a5315013de59fc11df8c83d6511554b0fc1"} May 26 16:11:37.519333 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:37.518893 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nnhvz" event={"ID":"92b6ff44-d505-4441-9dbd-d9a6090ab976","Type":"ContainerStarted","Data":"9a4609609a9b783b6059cabd65771faf0f5af9a613a454995a96fe57e781b7b4"} May 26 16:11:37.520768 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:37.520741 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85d8bd4786-vtxp2" event={"ID":"235bb816-f1b6-4818-8a19-c400d0011009","Type":"ContainerStarted","Data":"58c376b28056199f0a220aadabe248e74cf0b70cf8b8cb198bb2113ede2fafc3"} May 26 16:11:37.539792 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:37.539739 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nnhvz" podStartSLOduration=2.581957091 podStartE2EDuration="3.539722334s" podCreationTimestamp="2026-05-26 16:11:34 +0000 UTC" firstStartedPulling="2026-05-26 16:11:34.866629445 +0000 UTC m=+185.397123047" lastFinishedPulling="2026-05-26 16:11:35.824394702 +0000 UTC m=+186.354888290" observedRunningTime="2026-05-26 16:11:37.53937675 +0000 UTC m=+188.069870371" watchObservedRunningTime="2026-05-26 16:11:37.539722334 +0000 UTC m=+188.070215943" May 26 16:11:38.803508 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:38.803466 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5d69dfd56b-b4qzs"] May 26 16:11:38.806399 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:38.806372 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5d69dfd56b-b4qzs" May 26 16:11:38.809264 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:38.809238 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" May 26 16:11:38.810964 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:38.810742 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-7tnn7baqns54l\"" May 26 16:11:38.810964 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:38.810808 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 26 16:11:38.810964 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:38.810826 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" May 26 16:11:38.810964 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:38.810873 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" May 26 16:11:38.810964 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:38.810826 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-h4cv6\"" May 26 16:11:38.816129 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:38.816107 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5d69dfd56b-b4qzs"] May 26 16:11:38.904652 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:38.904624 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shq22\" (UniqueName: \"kubernetes.io/projected/e08e9d04-5a96-4ff5-9d58-cf8343d7bc03-kube-api-access-shq22\") pod \"metrics-server-5d69dfd56b-b4qzs\" (UID: \"e08e9d04-5a96-4ff5-9d58-cf8343d7bc03\") " pod="openshift-monitoring/metrics-server-5d69dfd56b-b4qzs" May 26 16:11:38.904748 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:38.904680 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e08e9d04-5a96-4ff5-9d58-cf8343d7bc03-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5d69dfd56b-b4qzs\" (UID: \"e08e9d04-5a96-4ff5-9d58-cf8343d7bc03\") " pod="openshift-monitoring/metrics-server-5d69dfd56b-b4qzs" May 26 16:11:38.904748 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:38.904711 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e08e9d04-5a96-4ff5-9d58-cf8343d7bc03-secret-metrics-server-client-certs\") pod \"metrics-server-5d69dfd56b-b4qzs\" (UID: \"e08e9d04-5a96-4ff5-9d58-cf8343d7bc03\") " pod="openshift-monitoring/metrics-server-5d69dfd56b-b4qzs" May 26 16:11:38.904855 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:38.904766 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e08e9d04-5a96-4ff5-9d58-cf8343d7bc03-secret-metrics-server-tls\") pod \"metrics-server-5d69dfd56b-b4qzs\" (UID: \"e08e9d04-5a96-4ff5-9d58-cf8343d7bc03\") " pod="openshift-monitoring/metrics-server-5d69dfd56b-b4qzs" May 26 16:11:38.904928 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:38.904908 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e08e9d04-5a96-4ff5-9d58-cf8343d7bc03-client-ca-bundle\") pod \"metrics-server-5d69dfd56b-b4qzs\" (UID: \"e08e9d04-5a96-4ff5-9d58-cf8343d7bc03\") " pod="openshift-monitoring/metrics-server-5d69dfd56b-b4qzs" May 26 16:11:38.904979 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:38.904947 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e08e9d04-5a96-4ff5-9d58-cf8343d7bc03-audit-log\") pod \"metrics-server-5d69dfd56b-b4qzs\" (UID: \"e08e9d04-5a96-4ff5-9d58-cf8343d7bc03\") " pod="openshift-monitoring/metrics-server-5d69dfd56b-b4qzs" May 26 16:11:38.905021 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:38.905000 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e08e9d04-5a96-4ff5-9d58-cf8343d7bc03-metrics-server-audit-profiles\") pod \"metrics-server-5d69dfd56b-b4qzs\" (UID: \"e08e9d04-5a96-4ff5-9d58-cf8343d7bc03\") " pod="openshift-monitoring/metrics-server-5d69dfd56b-b4qzs" May 26 16:11:39.005635 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:39.005596 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e08e9d04-5a96-4ff5-9d58-cf8343d7bc03-metrics-server-audit-profiles\") pod \"metrics-server-5d69dfd56b-b4qzs\" (UID: \"e08e9d04-5a96-4ff5-9d58-cf8343d7bc03\") " pod="openshift-monitoring/metrics-server-5d69dfd56b-b4qzs" May 26 16:11:39.005737 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:39.005661 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-shq22\" (UniqueName: \"kubernetes.io/projected/e08e9d04-5a96-4ff5-9d58-cf8343d7bc03-kube-api-access-shq22\") pod \"metrics-server-5d69dfd56b-b4qzs\" (UID: \"e08e9d04-5a96-4ff5-9d58-cf8343d7bc03\") " pod="openshift-monitoring/metrics-server-5d69dfd56b-b4qzs" May 26 16:11:39.005737 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:39.005698 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e08e9d04-5a96-4ff5-9d58-cf8343d7bc03-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5d69dfd56b-b4qzs\" (UID: \"e08e9d04-5a96-4ff5-9d58-cf8343d7bc03\") " pod="openshift-monitoring/metrics-server-5d69dfd56b-b4qzs" May 26 16:11:39.005737 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:39.005728 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e08e9d04-5a96-4ff5-9d58-cf8343d7bc03-secret-metrics-server-client-certs\") pod \"metrics-server-5d69dfd56b-b4qzs\" (UID: \"e08e9d04-5a96-4ff5-9d58-cf8343d7bc03\") " pod="openshift-monitoring/metrics-server-5d69dfd56b-b4qzs" May 26 16:11:39.006024 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:39.005912 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e08e9d04-5a96-4ff5-9d58-cf8343d7bc03-secret-metrics-server-tls\") pod \"metrics-server-5d69dfd56b-b4qzs\" (UID: \"e08e9d04-5a96-4ff5-9d58-cf8343d7bc03\") " pod="openshift-monitoring/metrics-server-5d69dfd56b-b4qzs" May 26 16:11:39.006086 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:39.006060 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e08e9d04-5a96-4ff5-9d58-cf8343d7bc03-client-ca-bundle\") pod \"metrics-server-5d69dfd56b-b4qzs\" (UID: \"e08e9d04-5a96-4ff5-9d58-cf8343d7bc03\") " pod="openshift-monitoring/metrics-server-5d69dfd56b-b4qzs" May 26 16:11:39.006139 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:39.006093 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e08e9d04-5a96-4ff5-9d58-cf8343d7bc03-audit-log\") pod \"metrics-server-5d69dfd56b-b4qzs\" (UID: \"e08e9d04-5a96-4ff5-9d58-cf8343d7bc03\") " pod="openshift-monitoring/metrics-server-5d69dfd56b-b4qzs" May 26 16:11:39.006493 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:39.006420 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e08e9d04-5a96-4ff5-9d58-cf8343d7bc03-audit-log\") pod \"metrics-server-5d69dfd56b-b4qzs\" (UID: \"e08e9d04-5a96-4ff5-9d58-cf8343d7bc03\") " pod="openshift-monitoring/metrics-server-5d69dfd56b-b4qzs" May 26 16:11:39.006493 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:39.006482 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e08e9d04-5a96-4ff5-9d58-cf8343d7bc03-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5d69dfd56b-b4qzs\" (UID: \"e08e9d04-5a96-4ff5-9d58-cf8343d7bc03\") " pod="openshift-monitoring/metrics-server-5d69dfd56b-b4qzs" May 26 16:11:39.006659 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:39.006638 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e08e9d04-5a96-4ff5-9d58-cf8343d7bc03-metrics-server-audit-profiles\") pod \"metrics-server-5d69dfd56b-b4qzs\" (UID: \"e08e9d04-5a96-4ff5-9d58-cf8343d7bc03\") " pod="openshift-monitoring/metrics-server-5d69dfd56b-b4qzs" May 26 16:11:39.008373 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:39.008351 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e08e9d04-5a96-4ff5-9d58-cf8343d7bc03-secret-metrics-server-tls\") pod \"metrics-server-5d69dfd56b-b4qzs\" (UID: \"e08e9d04-5a96-4ff5-9d58-cf8343d7bc03\") " pod="openshift-monitoring/metrics-server-5d69dfd56b-b4qzs" May 26 16:11:39.008651 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:39.008628 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e08e9d04-5a96-4ff5-9d58-cf8343d7bc03-secret-metrics-server-client-certs\") pod \"metrics-server-5d69dfd56b-b4qzs\" (UID: \"e08e9d04-5a96-4ff5-9d58-cf8343d7bc03\") " pod="openshift-monitoring/metrics-server-5d69dfd56b-b4qzs" May 26 16:11:39.008976 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:39.008954 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e08e9d04-5a96-4ff5-9d58-cf8343d7bc03-client-ca-bundle\") pod \"metrics-server-5d69dfd56b-b4qzs\" (UID: \"e08e9d04-5a96-4ff5-9d58-cf8343d7bc03\") " pod="openshift-monitoring/metrics-server-5d69dfd56b-b4qzs" May 26 16:11:39.015275 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:39.015236 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shq22\" (UniqueName: \"kubernetes.io/projected/e08e9d04-5a96-4ff5-9d58-cf8343d7bc03-kube-api-access-shq22\") pod \"metrics-server-5d69dfd56b-b4qzs\" (UID: \"e08e9d04-5a96-4ff5-9d58-cf8343d7bc03\") " pod="openshift-monitoring/metrics-server-5d69dfd56b-b4qzs" May 26 16:11:39.118842 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:39.118796 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5d69dfd56b-b4qzs" May 26 16:11:39.249009 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:39.248949 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5d69dfd56b-b4qzs"] May 26 16:11:39.253283 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:11:39.253253 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode08e9d04_5a96_4ff5_9d58_cf8343d7bc03.slice/crio-02df8a0d5de21dddfca4d1a9588015c634b03432e8028361cf32413253b0c418 WatchSource:0}: Error finding container 02df8a0d5de21dddfca4d1a9588015c634b03432e8028361cf32413253b0c418: Status 404 returned error can't find the container with id 02df8a0d5de21dddfca4d1a9588015c634b03432e8028361cf32413253b0c418 May 26 16:11:39.296880 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:39.296848 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-5gslg"] May 26 16:11:39.299353 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:39.299329 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-5gslg" May 26 16:11:39.302010 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:39.301986 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-bdqh7\"" May 26 16:11:39.302125 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:39.301992 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" May 26 16:11:39.307564 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:39.307537 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-5gslg"] May 26 16:11:39.409130 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:39.409042 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1a3001a7-1d76-412f-8d14-486d82e19883-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-5gslg\" (UID: \"1a3001a7-1d76-412f-8d14-486d82e19883\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-5gslg" May 26 16:11:39.510016 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:39.509973 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1a3001a7-1d76-412f-8d14-486d82e19883-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-5gslg\" (UID: \"1a3001a7-1d76-412f-8d14-486d82e19883\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-5gslg" May 26 16:11:39.510181 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:11:39.510130 2560 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found May 26 16:11:39.510220 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:11:39.510200 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a3001a7-1d76-412f-8d14-486d82e19883-monitoring-plugin-cert podName:1a3001a7-1d76-412f-8d14-486d82e19883 nodeName:}" failed. No retries permitted until 2026-05-26 16:11:40.010181069 +0000 UTC m=+190.540674670 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/1a3001a7-1d76-412f-8d14-486d82e19883-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-5gslg" (UID: "1a3001a7-1d76-412f-8d14-486d82e19883") : secret "monitoring-plugin-cert" not found May 26 16:11:39.527485 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:39.527451 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5d69dfd56b-b4qzs" event={"ID":"e08e9d04-5a96-4ff5-9d58-cf8343d7bc03","Type":"ContainerStarted","Data":"02df8a0d5de21dddfca4d1a9588015c634b03432e8028361cf32413253b0c418"} May 26 16:11:39.529252 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:39.529222 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85d8bd4786-vtxp2" event={"ID":"235bb816-f1b6-4818-8a19-c400d0011009","Type":"ContainerStarted","Data":"ed7f08dd6cd535f41a412af864c85a39184d6f7c6a6a224b29394ff5d3c40972"} May 26 16:11:39.529252 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:39.529248 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85d8bd4786-vtxp2" event={"ID":"235bb816-f1b6-4818-8a19-c400d0011009","Type":"ContainerStarted","Data":"35d2f838d64b9ad94e20f19c28a5854b6b90fc524b6ede7e90b4bfd1887b4745"} May 26 16:11:39.529472 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:39.529258 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85d8bd4786-vtxp2" event={"ID":"235bb816-f1b6-4818-8a19-c400d0011009","Type":"ContainerStarted","Data":"7feb799c137fb4365a753ab7a682c74f75297c56fe687e49a5c0a08a5b0da344"} May 26 16:11:40.014243 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:40.014212 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1a3001a7-1d76-412f-8d14-486d82e19883-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-5gslg\" (UID: \"1a3001a7-1d76-412f-8d14-486d82e19883\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-5gslg" May 26 16:11:40.016989 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:40.016966 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1a3001a7-1d76-412f-8d14-486d82e19883-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-5gslg\" (UID: \"1a3001a7-1d76-412f-8d14-486d82e19883\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-5gslg" May 26 16:11:40.209631 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:40.209550 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-5gslg" May 26 16:11:40.535843 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:40.535763 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85d8bd4786-vtxp2" event={"ID":"235bb816-f1b6-4818-8a19-c400d0011009","Type":"ContainerStarted","Data":"71c083015c24c582fab737ffaa71a203be9de1989d1cf603fab691d1f4c50b45"} May 26 16:11:40.535843 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:40.535809 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85d8bd4786-vtxp2" event={"ID":"235bb816-f1b6-4818-8a19-c400d0011009","Type":"ContainerStarted","Data":"f62daf19ce87408431c6bbdfe4c8f3e566b9e37bddea622afc57a539d8ad4234"} May 26 16:11:40.535843 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:40.535824 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85d8bd4786-vtxp2" event={"ID":"235bb816-f1b6-4818-8a19-c400d0011009","Type":"ContainerStarted","Data":"fb7ef91f77d1bdc3278169062016f951dd9a62fcfcf7229585f641016644453e"} May 26 16:11:40.536064 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:40.536017 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-85d8bd4786-vtxp2" May 26 16:11:40.559704 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:40.559643 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-85d8bd4786-vtxp2" podStartSLOduration=1.536362703 podStartE2EDuration="4.559630018s" podCreationTimestamp="2026-05-26 16:11:36 +0000 UTC" firstStartedPulling="2026-05-26 16:11:36.925980514 +0000 UTC m=+187.456474100" lastFinishedPulling="2026-05-26 16:11:39.949247814 +0000 UTC m=+190.479741415" observedRunningTime="2026-05-26 16:11:40.559002659 +0000 UTC m=+191.089496295" watchObservedRunningTime="2026-05-26 16:11:40.559630018 +0000 UTC m=+191.090123625" May 26 16:11:40.707501 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:40.707345 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-5gslg"] May 26 16:11:40.710048 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:11:40.710023 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a3001a7_1d76_412f_8d14_486d82e19883.slice/crio-fab51e32782b990099830e3757f3f9692ca5f2b7ced5344bc7321d0d30b3a7d1 WatchSource:0}: Error finding container fab51e32782b990099830e3757f3f9692ca5f2b7ced5344bc7321d0d30b3a7d1: Status 404 returned error can't find the container with id fab51e32782b990099830e3757f3f9692ca5f2b7ced5344bc7321d0d30b3a7d1 May 26 16:11:40.757479 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:40.757449 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 16:11:40.759936 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:40.759919 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:40.762953 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:40.762775 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3uj7g77oe615h\"" May 26 16:11:40.762953 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:40.762803 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 26 16:11:40.762953 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:40.762776 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 26 16:11:40.762953 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:40.762927 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 26 16:11:40.763208 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:40.763017 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 26 16:11:40.763208 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:40.763123 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 26 16:11:40.763304 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:40.763262 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-7sgv5\"" May 26 16:11:40.763772 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:40.763753 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 26 16:11:40.763832 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:40.763762 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 26 16:11:40.763881 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:40.763865 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 26 16:11:40.764159 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:40.764145 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 26 16:11:40.764322 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:40.764309 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 26 16:11:40.764462 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:40.764421 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 26 16:11:40.765633 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:40.765606 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 26 16:11:40.776465 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:40.776443 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 16:11:40.920863 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:40.920785 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fc737f2-16b2-4c4b-8eba-141e177c9616-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:40.920863 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:40.920851 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:40.921028 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:40.920878 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:40.921028 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:40.920897 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5fc737f2-16b2-4c4b-8eba-141e177c9616-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:40.921028 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:40.920923 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:40.921028 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:40.920978 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5fc737f2-16b2-4c4b-8eba-141e177c9616-config-out\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:40.921145 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:40.921023 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fc737f2-16b2-4c4b-8eba-141e177c9616-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:40.921145 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:40.921056 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5fc737f2-16b2-4c4b-8eba-141e177c9616-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:40.921145 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:40.921087 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5fc737f2-16b2-4c4b-8eba-141e177c9616-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:40.921145 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:40.921118 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:40.921260 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:40.921160 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xc9x\" (UniqueName: \"kubernetes.io/projected/5fc737f2-16b2-4c4b-8eba-141e177c9616-kube-api-access-6xc9x\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:40.921260 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:40.921186 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fc737f2-16b2-4c4b-8eba-141e177c9616-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:40.921260 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:40.921214 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-config\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:40.921260 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:40.921238 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:40.921374 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:40.921278 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:40.921374 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:40.921324 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-web-config\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:40.921374 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:40.921348 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:40.921503 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:40.921378 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5fc737f2-16b2-4c4b-8eba-141e177c9616-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:41.022393 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:41.022359 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:41.022393 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:41.022405 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6xc9x\" (UniqueName: \"kubernetes.io/projected/5fc737f2-16b2-4c4b-8eba-141e177c9616-kube-api-access-6xc9x\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:41.023049 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:41.022536 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fc737f2-16b2-4c4b-8eba-141e177c9616-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:41.023049 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:41.022579 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-config\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:41.023049 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:41.022603 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:41.023049 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:41.022639 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:41.023049 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:41.022663 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-web-config\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:41.023049 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:41.022686 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:41.023049 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:41.022721 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5fc737f2-16b2-4c4b-8eba-141e177c9616-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:41.023049 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:41.022752 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fc737f2-16b2-4c4b-8eba-141e177c9616-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:41.023049 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:41.022839 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:41.023049 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:41.022865 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:41.023049 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:41.022892 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5fc737f2-16b2-4c4b-8eba-141e177c9616-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:41.023049 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:41.022941 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:41.023049 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:41.022973 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5fc737f2-16b2-4c4b-8eba-141e177c9616-config-out\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:41.023049 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:41.022995 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fc737f2-16b2-4c4b-8eba-141e177c9616-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:41.023049 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:41.023023 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5fc737f2-16b2-4c4b-8eba-141e177c9616-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:41.023834 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:41.023059 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5fc737f2-16b2-4c4b-8eba-141e177c9616-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:41.023834 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:41.023313 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fc737f2-16b2-4c4b-8eba-141e177c9616-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:41.025374 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:41.025343 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:41.025512 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:41.025408 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-config\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:41.026177 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:41.026058 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5fc737f2-16b2-4c4b-8eba-141e177c9616-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:41.027333 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:41.026295 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fc737f2-16b2-4c4b-8eba-141e177c9616-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:41.027333 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:41.026358 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5fc737f2-16b2-4c4b-8eba-141e177c9616-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:41.027333 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:41.026623 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5fc737f2-16b2-4c4b-8eba-141e177c9616-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:41.027333 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:41.026889 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:41.027333 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:41.027259 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fc737f2-16b2-4c4b-8eba-141e177c9616-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:41.027605 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:41.027414 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:41.028359 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:41.028320 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:41.028597 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:41.028515 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:41.028978 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:41.028847 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:41.029064 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:41.028988 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5fc737f2-16b2-4c4b-8eba-141e177c9616-config-out\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:41.029700 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:41.029560 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:41.029946 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:41.029922 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5fc737f2-16b2-4c4b-8eba-141e177c9616-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:41.029946 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:41.029938 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-web-config\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:41.030904 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:41.030884 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xc9x\" (UniqueName: \"kubernetes.io/projected/5fc737f2-16b2-4c4b-8eba-141e177c9616-kube-api-access-6xc9x\") pod \"prometheus-k8s-0\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:41.071062 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:41.071024 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:41.207301 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:41.207248 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 16:11:41.209682 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:11:41.209652 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fc737f2_16b2_4c4b_8eba_141e177c9616.slice/crio-7ae78ba48cb8db5085f189f7a208e51366645869381055370c223dbf3db0da63 WatchSource:0}: Error finding container 7ae78ba48cb8db5085f189f7a208e51366645869381055370c223dbf3db0da63: Status 404 returned error can't find the container with id 7ae78ba48cb8db5085f189f7a208e51366645869381055370c223dbf3db0da63 May 26 16:11:41.540627 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:41.540541 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-5gslg" event={"ID":"1a3001a7-1d76-412f-8d14-486d82e19883","Type":"ContainerStarted","Data":"fab51e32782b990099830e3757f3f9692ca5f2b7ced5344bc7321d0d30b3a7d1"} May 26 16:11:41.541788 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:41.541755 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5fc737f2-16b2-4c4b-8eba-141e177c9616","Type":"ContainerStarted","Data":"7ae78ba48cb8db5085f189f7a208e51366645869381055370c223dbf3db0da63"} May 26 16:11:41.543165 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:41.543138 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5d69dfd56b-b4qzs" event={"ID":"e08e9d04-5a96-4ff5-9d58-cf8343d7bc03","Type":"ContainerStarted","Data":"752bf36d51e98672bfe5442b5030e1a8ca19d8d5c5b8709a1ab2186607bfd87d"} May 26 16:11:41.561472 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:41.561406 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5d69dfd56b-b4qzs" podStartSLOduration=2.212275451 podStartE2EDuration="3.561330022s" podCreationTimestamp="2026-05-26 16:11:38 +0000 UTC" firstStartedPulling="2026-05-26 16:11:39.255527952 +0000 UTC m=+189.786021539" lastFinishedPulling="2026-05-26 16:11:40.60458252 +0000 UTC m=+191.135076110" observedRunningTime="2026-05-26 16:11:41.559979617 +0000 UTC m=+192.090473237" watchObservedRunningTime="2026-05-26 16:11:41.561330022 +0000 UTC m=+192.091823630" May 26 16:11:42.547069 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:42.546975 2560 generic.go:358] "Generic (PLEG): container finished" podID="5fc737f2-16b2-4c4b-8eba-141e177c9616" containerID="516bde7668014ac782cb4a1d7095e4d4facf9cb1aad4d680f29a4f800ca3fbba" exitCode=0 May 26 16:11:42.547498 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:42.547068 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5fc737f2-16b2-4c4b-8eba-141e177c9616","Type":"ContainerDied","Data":"516bde7668014ac782cb4a1d7095e4d4facf9cb1aad4d680f29a4f800ca3fbba"} May 26 16:11:42.548406 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:42.548380 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-5gslg" event={"ID":"1a3001a7-1d76-412f-8d14-486d82e19883","Type":"ContainerStarted","Data":"0bf2a64dc79e2685f0cc9f38b2a9d6f71ec8bb9bfe2780bc2ee68a25bf8e9c34"} May 26 16:11:42.548728 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:42.548706 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-5gslg" May 26 16:11:42.553599 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:42.553576 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-5gslg" May 26 16:11:42.603385 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:42.603333 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-5gslg" podStartSLOduration=2.040581002 podStartE2EDuration="3.603317297s" podCreationTimestamp="2026-05-26 16:11:39 +0000 UTC" firstStartedPulling="2026-05-26 16:11:40.712247428 +0000 UTC m=+191.242741017" lastFinishedPulling="2026-05-26 16:11:42.274983723 +0000 UTC m=+192.805477312" observedRunningTime="2026-05-26 16:11:42.602620347 +0000 UTC m=+193.133113957" watchObservedRunningTime="2026-05-26 16:11:42.603317297 +0000 UTC m=+193.133810905" May 26 16:11:45.559938 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:45.559899 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5fc737f2-16b2-4c4b-8eba-141e177c9616","Type":"ContainerStarted","Data":"e8fbb96a079e19df32277e6b136a648f474f6944b1e5071c1c06d6bbebfddc0d"} May 26 16:11:45.560348 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:45.559945 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5fc737f2-16b2-4c4b-8eba-141e177c9616","Type":"ContainerStarted","Data":"861970fec379052cca4a4006a78a420e791b1d49c090f4b44f0615e5ce5b3369"} May 26 16:11:45.560348 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:45.559959 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5fc737f2-16b2-4c4b-8eba-141e177c9616","Type":"ContainerStarted","Data":"51b441e3782a74b0dba13e350788ad1717a986b3c278e0904e0b2b09c8f54a52"} May 26 16:11:45.560348 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:45.559970 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5fc737f2-16b2-4c4b-8eba-141e177c9616","Type":"ContainerStarted","Data":"ba04bccaef095105dea2028908a04807adad49944e50418f3e76d64b14f07d4e"} May 26 16:11:46.549093 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:46.549064 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-85d8bd4786-vtxp2" May 26 16:11:46.565500 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:46.565461 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5fc737f2-16b2-4c4b-8eba-141e177c9616","Type":"ContainerStarted","Data":"6eaf26f1009dae339da21e160fcb99c7dcc517b0a8800946ddc6fa7c8a556338"} May 26 16:11:46.565851 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:46.565505 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5fc737f2-16b2-4c4b-8eba-141e177c9616","Type":"ContainerStarted","Data":"faa6ae670da12aba80d0776a685cd91f95f4efcc5fb9d4cf297f5ca68f42d47b"} May 26 16:11:46.600687 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:46.600616 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.57827871 podStartE2EDuration="6.60059581s" podCreationTimestamp="2026-05-26 16:11:40 +0000 UTC" firstStartedPulling="2026-05-26 16:11:41.211538603 +0000 UTC m=+191.742032192" lastFinishedPulling="2026-05-26 16:11:45.233855694 +0000 UTC m=+195.764349292" observedRunningTime="2026-05-26 16:11:46.598554104 +0000 UTC m=+197.129047713" watchObservedRunningTime="2026-05-26 16:11:46.60059581 +0000 UTC m=+197.131089420" May 26 16:11:51.071725 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:51.071687 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 26 16:11:59.118927 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:59.118888 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5d69dfd56b-b4qzs" May 26 16:11:59.119304 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:11:59.118942 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5d69dfd56b-b4qzs" May 26 16:12:19.125087 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:19.125058 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5d69dfd56b-b4qzs" May 26 16:12:19.129157 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:19.129133 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5d69dfd56b-b4qzs" May 26 16:12:41.071306 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:41.071255 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 26 16:12:41.086662 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:41.086634 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 26 16:12:41.756174 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:41.756147 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 26 16:12:41.860527 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:41.860487 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eec5f0e1-7fd2-4597-a1a0-3b5b10517934-metrics-certs\") pod \"network-metrics-daemon-ws4lv\" (UID: \"eec5f0e1-7fd2-4597-a1a0-3b5b10517934\") " pod="openshift-multus/network-metrics-daemon-ws4lv" May 26 16:12:41.862702 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:41.862674 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eec5f0e1-7fd2-4597-a1a0-3b5b10517934-metrics-certs\") pod \"network-metrics-daemon-ws4lv\" (UID: \"eec5f0e1-7fd2-4597-a1a0-3b5b10517934\") " pod="openshift-multus/network-metrics-daemon-ws4lv" May 26 16:12:42.111270 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:42.111177 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4s662\"" May 26 16:12:42.118506 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:42.118485 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ws4lv" May 26 16:12:42.252758 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:42.252621 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ws4lv"] May 26 16:12:42.255368 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:12:42.255334 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeec5f0e1_7fd2_4597_a1a0_3b5b10517934.slice/crio-fd7ef1a0b08e087a1589258ab661e99bb27401c9c78378ea92c657844bb38e8a WatchSource:0}: Error finding container fd7ef1a0b08e087a1589258ab661e99bb27401c9c78378ea92c657844bb38e8a: Status 404 returned error can't find the container with id fd7ef1a0b08e087a1589258ab661e99bb27401c9c78378ea92c657844bb38e8a May 26 16:12:42.745100 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:42.745062 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ws4lv" event={"ID":"eec5f0e1-7fd2-4597-a1a0-3b5b10517934","Type":"ContainerStarted","Data":"fd7ef1a0b08e087a1589258ab661e99bb27401c9c78378ea92c657844bb38e8a"} May 26 16:12:43.749038 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:43.749005 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ws4lv" event={"ID":"eec5f0e1-7fd2-4597-a1a0-3b5b10517934","Type":"ContainerStarted","Data":"ba596dba93a8c8d76ed19d6837a575eec22f43e7a29f4b54afbdaeef5e0285f0"} May 26 16:12:43.749038 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:43.749040 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ws4lv" event={"ID":"eec5f0e1-7fd2-4597-a1a0-3b5b10517934","Type":"ContainerStarted","Data":"578a5912c9c18dd1d91ab5b63e8ca435a0e11614e5bc6f282026942edb126e41"} May 26 16:12:43.771915 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:43.771865 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ws4lv" podStartSLOduration=252.833952894 podStartE2EDuration="4m13.771850258s" podCreationTimestamp="2026-05-26 16:08:30 +0000 UTC" firstStartedPulling="2026-05-26 16:12:42.256962388 +0000 UTC m=+252.787455977" lastFinishedPulling="2026-05-26 16:12:43.194859752 +0000 UTC m=+253.725353341" observedRunningTime="2026-05-26 16:12:43.769735505 +0000 UTC m=+254.300229115" watchObservedRunningTime="2026-05-26 16:12:43.771850258 +0000 UTC m=+254.302343874" May 26 16:12:59.123414 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.123331 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 16:12:59.123964 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.123905 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5fc737f2-16b2-4c4b-8eba-141e177c9616" containerName="prometheus" containerID="cri-o://ba04bccaef095105dea2028908a04807adad49944e50418f3e76d64b14f07d4e" gracePeriod=600 May 26 16:12:59.124043 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.123934 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5fc737f2-16b2-4c4b-8eba-141e177c9616" containerName="kube-rbac-proxy" containerID="cri-o://faa6ae670da12aba80d0776a685cd91f95f4efcc5fb9d4cf297f5ca68f42d47b" gracePeriod=600 May 26 16:12:59.124043 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.123954 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5fc737f2-16b2-4c4b-8eba-141e177c9616" containerName="thanos-sidecar" containerID="cri-o://861970fec379052cca4a4006a78a420e791b1d49c090f4b44f0615e5ce5b3369" gracePeriod=600 May 26 16:12:59.124148 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.124068 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5fc737f2-16b2-4c4b-8eba-141e177c9616" containerName="kube-rbac-proxy-thanos" containerID="cri-o://6eaf26f1009dae339da21e160fcb99c7dcc517b0a8800946ddc6fa7c8a556338" gracePeriod=600 May 26 16:12:59.124148 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.124098 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5fc737f2-16b2-4c4b-8eba-141e177c9616" containerName="config-reloader" containerID="cri-o://51b441e3782a74b0dba13e350788ad1717a986b3c278e0904e0b2b09c8f54a52" gracePeriod=600 May 26 16:12:59.124240 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.123962 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5fc737f2-16b2-4c4b-8eba-141e177c9616" containerName="kube-rbac-proxy-web" containerID="cri-o://e8fbb96a079e19df32277e6b136a648f474f6944b1e5071c1c06d6bbebfddc0d" gracePeriod=600 May 26 16:12:59.361722 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.361656 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 26 16:12:59.408962 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.408874 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5fc737f2-16b2-4c4b-8eba-141e177c9616-configmap-metrics-client-ca\") pod \"5fc737f2-16b2-4c4b-8eba-141e177c9616\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " May 26 16:12:59.408962 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.408922 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-secret-prometheus-k8s-tls\") pod \"5fc737f2-16b2-4c4b-8eba-141e177c9616\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " May 26 16:12:59.408962 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.408943 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"5fc737f2-16b2-4c4b-8eba-141e177c9616\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " May 26 16:12:59.409227 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.408967 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fc737f2-16b2-4c4b-8eba-141e177c9616-configmap-serving-certs-ca-bundle\") pod \"5fc737f2-16b2-4c4b-8eba-141e177c9616\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " May 26 16:12:59.409227 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.408990 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fc737f2-16b2-4c4b-8eba-141e177c9616-prometheus-trusted-ca-bundle\") pod \"5fc737f2-16b2-4c4b-8eba-141e177c9616\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " May 26 16:12:59.409227 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.409024 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-web-config\") pod \"5fc737f2-16b2-4c4b-8eba-141e177c9616\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " May 26 16:12:59.409227 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.409060 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-secret-kube-rbac-proxy\") pod \"5fc737f2-16b2-4c4b-8eba-141e177c9616\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " May 26 16:12:59.409227 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.409117 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5fc737f2-16b2-4c4b-8eba-141e177c9616-tls-assets\") pod \"5fc737f2-16b2-4c4b-8eba-141e177c9616\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " May 26 16:12:59.409227 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.409143 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-config\") pod \"5fc737f2-16b2-4c4b-8eba-141e177c9616\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " May 26 16:12:59.409227 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.409157 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-secret-grpc-tls\") pod \"5fc737f2-16b2-4c4b-8eba-141e177c9616\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " May 26 16:12:59.409227 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.409180 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xc9x\" (UniqueName: \"kubernetes.io/projected/5fc737f2-16b2-4c4b-8eba-141e177c9616-kube-api-access-6xc9x\") pod \"5fc737f2-16b2-4c4b-8eba-141e177c9616\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " May 26 16:12:59.409227 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.409209 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"5fc737f2-16b2-4c4b-8eba-141e177c9616\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " May 26 16:12:59.409700 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.409237 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fc737f2-16b2-4c4b-8eba-141e177c9616-configmap-kubelet-serving-ca-bundle\") pod \"5fc737f2-16b2-4c4b-8eba-141e177c9616\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " May 26 16:12:59.409700 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.409267 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5fc737f2-16b2-4c4b-8eba-141e177c9616-prometheus-k8s-rulefiles-0\") pod \"5fc737f2-16b2-4c4b-8eba-141e177c9616\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " May 26 16:12:59.409700 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.409306 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-thanos-prometheus-http-client-file\") pod \"5fc737f2-16b2-4c4b-8eba-141e177c9616\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " May 26 16:12:59.409700 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.409333 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5fc737f2-16b2-4c4b-8eba-141e177c9616-prometheus-k8s-db\") pod \"5fc737f2-16b2-4c4b-8eba-141e177c9616\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " May 26 16:12:59.409700 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.409368 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5fc737f2-16b2-4c4b-8eba-141e177c9616-config-out\") pod \"5fc737f2-16b2-4c4b-8eba-141e177c9616\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " May 26 16:12:59.409700 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.409394 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-secret-metrics-client-certs\") pod \"5fc737f2-16b2-4c4b-8eba-141e177c9616\" (UID: \"5fc737f2-16b2-4c4b-8eba-141e177c9616\") " May 26 16:12:59.409700 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.409626 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fc737f2-16b2-4c4b-8eba-141e177c9616-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "5fc737f2-16b2-4c4b-8eba-141e177c9616" (UID: "5fc737f2-16b2-4c4b-8eba-141e177c9616"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 16:12:59.411649 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.410033 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fc737f2-16b2-4c4b-8eba-141e177c9616-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "5fc737f2-16b2-4c4b-8eba-141e177c9616" (UID: "5fc737f2-16b2-4c4b-8eba-141e177c9616"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 16:12:59.411649 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.410138 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fc737f2-16b2-4c4b-8eba-141e177c9616-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "5fc737f2-16b2-4c4b-8eba-141e177c9616" (UID: "5fc737f2-16b2-4c4b-8eba-141e177c9616"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 16:12:59.411649 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.410829 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fc737f2-16b2-4c4b-8eba-141e177c9616-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "5fc737f2-16b2-4c4b-8eba-141e177c9616" (UID: "5fc737f2-16b2-4c4b-8eba-141e177c9616"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 16:12:59.412270 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.412244 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "5fc737f2-16b2-4c4b-8eba-141e177c9616" (UID: "5fc737f2-16b2-4c4b-8eba-141e177c9616"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 16:12:59.413094 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.413068 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "5fc737f2-16b2-4c4b-8eba-141e177c9616" (UID: "5fc737f2-16b2-4c4b-8eba-141e177c9616"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 16:12:59.413195 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.413058 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fc737f2-16b2-4c4b-8eba-141e177c9616-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "5fc737f2-16b2-4c4b-8eba-141e177c9616" (UID: "5fc737f2-16b2-4c4b-8eba-141e177c9616"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 16:12:59.413259 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.413213 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "5fc737f2-16b2-4c4b-8eba-141e177c9616" (UID: "5fc737f2-16b2-4c4b-8eba-141e177c9616"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 16:12:59.413495 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.413451 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fc737f2-16b2-4c4b-8eba-141e177c9616-kube-api-access-6xc9x" (OuterVolumeSpecName: "kube-api-access-6xc9x") pod "5fc737f2-16b2-4c4b-8eba-141e177c9616" (UID: "5fc737f2-16b2-4c4b-8eba-141e177c9616"). InnerVolumeSpecName "kube-api-access-6xc9x". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 16:12:59.414297 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.414269 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fc737f2-16b2-4c4b-8eba-141e177c9616-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "5fc737f2-16b2-4c4b-8eba-141e177c9616" (UID: "5fc737f2-16b2-4c4b-8eba-141e177c9616"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 16:12:59.415146 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.415094 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "5fc737f2-16b2-4c4b-8eba-141e177c9616" (UID: "5fc737f2-16b2-4c4b-8eba-141e177c9616"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 16:12:59.415146 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.415109 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "5fc737f2-16b2-4c4b-8eba-141e177c9616" (UID: "5fc737f2-16b2-4c4b-8eba-141e177c9616"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 16:12:59.415146 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.415123 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "5fc737f2-16b2-4c4b-8eba-141e177c9616" (UID: "5fc737f2-16b2-4c4b-8eba-141e177c9616"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 16:12:59.415344 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.415240 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fc737f2-16b2-4c4b-8eba-141e177c9616-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5fc737f2-16b2-4c4b-8eba-141e177c9616" (UID: "5fc737f2-16b2-4c4b-8eba-141e177c9616"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 16:12:59.416406 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.416384 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fc737f2-16b2-4c4b-8eba-141e177c9616-config-out" (OuterVolumeSpecName: "config-out") pod "5fc737f2-16b2-4c4b-8eba-141e177c9616" (UID: "5fc737f2-16b2-4c4b-8eba-141e177c9616"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 16:12:59.416521 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.416384 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "5fc737f2-16b2-4c4b-8eba-141e177c9616" (UID: "5fc737f2-16b2-4c4b-8eba-141e177c9616"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 16:12:59.416673 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.416644 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-config" (OuterVolumeSpecName: "config") pod "5fc737f2-16b2-4c4b-8eba-141e177c9616" (UID: "5fc737f2-16b2-4c4b-8eba-141e177c9616"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 16:12:59.424725 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.424699 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-web-config" (OuterVolumeSpecName: "web-config") pod "5fc737f2-16b2-4c4b-8eba-141e177c9616" (UID: "5fc737f2-16b2-4c4b-8eba-141e177c9616"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 16:12:59.510181 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.510142 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5fc737f2-16b2-4c4b-8eba-141e177c9616-configmap-metrics-client-ca\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" May 26 16:12:59.510181 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.510176 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-secret-prometheus-k8s-tls\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" May 26 16:12:59.510181 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.510190 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" May 26 16:12:59.510412 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.510200 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fc737f2-16b2-4c4b-8eba-141e177c9616-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" May 26 16:12:59.510412 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.510211 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fc737f2-16b2-4c4b-8eba-141e177c9616-prometheus-trusted-ca-bundle\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" May 26 16:12:59.510412 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.510220 2560 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-web-config\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" May 26 16:12:59.510412 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.510229 2560 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-secret-kube-rbac-proxy\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" May 26 16:12:59.510412 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.510254 2560 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5fc737f2-16b2-4c4b-8eba-141e177c9616-tls-assets\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" May 26 16:12:59.510412 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.510265 2560 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-config\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" May 26 16:12:59.510412 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.510273 2560 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-secret-grpc-tls\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" May 26 16:12:59.510412 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.510281 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xc9x\" (UniqueName: \"kubernetes.io/projected/5fc737f2-16b2-4c4b-8eba-141e177c9616-kube-api-access-6xc9x\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" May 26 16:12:59.510412 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.510290 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" May 26 16:12:59.510412 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.510299 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fc737f2-16b2-4c4b-8eba-141e177c9616-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" May 26 16:12:59.510412 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.510307 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5fc737f2-16b2-4c4b-8eba-141e177c9616-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" May 26 16:12:59.510412 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.510317 2560 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" May 26 16:12:59.510412 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.510325 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5fc737f2-16b2-4c4b-8eba-141e177c9616-prometheus-k8s-db\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" May 26 16:12:59.510412 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.510333 2560 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5fc737f2-16b2-4c4b-8eba-141e177c9616-config-out\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" May 26 16:12:59.510412 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.510341 2560 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5fc737f2-16b2-4c4b-8eba-141e177c9616-secret-metrics-client-certs\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" May 26 16:12:59.798796 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.798764 2560 generic.go:358] "Generic (PLEG): container finished" podID="5fc737f2-16b2-4c4b-8eba-141e177c9616" containerID="6eaf26f1009dae339da21e160fcb99c7dcc517b0a8800946ddc6fa7c8a556338" exitCode=0 May 26 16:12:59.798796 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.798789 2560 generic.go:358] "Generic (PLEG): container finished" podID="5fc737f2-16b2-4c4b-8eba-141e177c9616" containerID="faa6ae670da12aba80d0776a685cd91f95f4efcc5fb9d4cf297f5ca68f42d47b" exitCode=0 May 26 16:12:59.798796 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.798795 2560 generic.go:358] "Generic (PLEG): container finished" podID="5fc737f2-16b2-4c4b-8eba-141e177c9616" containerID="e8fbb96a079e19df32277e6b136a648f474f6944b1e5071c1c06d6bbebfddc0d" exitCode=0 May 26 16:12:59.798796 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.798802 2560 generic.go:358] "Generic (PLEG): container finished" podID="5fc737f2-16b2-4c4b-8eba-141e177c9616" containerID="861970fec379052cca4a4006a78a420e791b1d49c090f4b44f0615e5ce5b3369" exitCode=0 May 26 16:12:59.798796 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.798807 2560 generic.go:358] "Generic (PLEG): container finished" podID="5fc737f2-16b2-4c4b-8eba-141e177c9616" containerID="51b441e3782a74b0dba13e350788ad1717a986b3c278e0904e0b2b09c8f54a52" exitCode=0 May 26 16:12:59.799097 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.798813 2560 generic.go:358] "Generic (PLEG): container finished" podID="5fc737f2-16b2-4c4b-8eba-141e177c9616" containerID="ba04bccaef095105dea2028908a04807adad49944e50418f3e76d64b14f07d4e" exitCode=0 May 26 16:12:59.799097 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.798867 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5fc737f2-16b2-4c4b-8eba-141e177c9616","Type":"ContainerDied","Data":"6eaf26f1009dae339da21e160fcb99c7dcc517b0a8800946ddc6fa7c8a556338"} May 26 16:12:59.799097 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.798910 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5fc737f2-16b2-4c4b-8eba-141e177c9616","Type":"ContainerDied","Data":"faa6ae670da12aba80d0776a685cd91f95f4efcc5fb9d4cf297f5ca68f42d47b"} May 26 16:12:59.799097 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.798922 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5fc737f2-16b2-4c4b-8eba-141e177c9616","Type":"ContainerDied","Data":"e8fbb96a079e19df32277e6b136a648f474f6944b1e5071c1c06d6bbebfddc0d"} May 26 16:12:59.799097 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.798932 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5fc737f2-16b2-4c4b-8eba-141e177c9616","Type":"ContainerDied","Data":"861970fec379052cca4a4006a78a420e791b1d49c090f4b44f0615e5ce5b3369"} May 26 16:12:59.799097 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.798941 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5fc737f2-16b2-4c4b-8eba-141e177c9616","Type":"ContainerDied","Data":"51b441e3782a74b0dba13e350788ad1717a986b3c278e0904e0b2b09c8f54a52"} May 26 16:12:59.799097 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.798950 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5fc737f2-16b2-4c4b-8eba-141e177c9616","Type":"ContainerDied","Data":"ba04bccaef095105dea2028908a04807adad49944e50418f3e76d64b14f07d4e"} May 26 16:12:59.799097 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.798959 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5fc737f2-16b2-4c4b-8eba-141e177c9616","Type":"ContainerDied","Data":"7ae78ba48cb8db5085f189f7a208e51366645869381055370c223dbf3db0da63"} May 26 16:12:59.799097 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.798961 2560 scope.go:117] "RemoveContainer" containerID="6eaf26f1009dae339da21e160fcb99c7dcc517b0a8800946ddc6fa7c8a556338" May 26 16:12:59.799097 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.798881 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 26 16:12:59.806672 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.806656 2560 scope.go:117] "RemoveContainer" containerID="faa6ae670da12aba80d0776a685cd91f95f4efcc5fb9d4cf297f5ca68f42d47b" May 26 16:12:59.813509 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.813487 2560 scope.go:117] "RemoveContainer" containerID="e8fbb96a079e19df32277e6b136a648f474f6944b1e5071c1c06d6bbebfddc0d" May 26 16:12:59.820298 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.820280 2560 scope.go:117] "RemoveContainer" containerID="861970fec379052cca4a4006a78a420e791b1d49c090f4b44f0615e5ce5b3369" May 26 16:12:59.828661 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.828640 2560 scope.go:117] "RemoveContainer" containerID="51b441e3782a74b0dba13e350788ad1717a986b3c278e0904e0b2b09c8f54a52" May 26 16:12:59.836922 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.836899 2560 scope.go:117] "RemoveContainer" containerID="ba04bccaef095105dea2028908a04807adad49944e50418f3e76d64b14f07d4e" May 26 16:12:59.839202 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.839138 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 16:12:59.840969 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.840934 2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 16:12:59.846823 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.846802 2560 scope.go:117] "RemoveContainer" containerID="516bde7668014ac782cb4a1d7095e4d4facf9cb1aad4d680f29a4f800ca3fbba" May 26 16:12:59.856544 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.856515 2560 scope.go:117] "RemoveContainer" containerID="6eaf26f1009dae339da21e160fcb99c7dcc517b0a8800946ddc6fa7c8a556338" May 26 16:12:59.856820 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:12:59.856801 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6eaf26f1009dae339da21e160fcb99c7dcc517b0a8800946ddc6fa7c8a556338\": container with ID starting with 6eaf26f1009dae339da21e160fcb99c7dcc517b0a8800946ddc6fa7c8a556338 not found: ID does not exist" containerID="6eaf26f1009dae339da21e160fcb99c7dcc517b0a8800946ddc6fa7c8a556338" May 26 16:12:59.856889 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.856826 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6eaf26f1009dae339da21e160fcb99c7dcc517b0a8800946ddc6fa7c8a556338"} err="failed to get container status \"6eaf26f1009dae339da21e160fcb99c7dcc517b0a8800946ddc6fa7c8a556338\": rpc error: code = NotFound desc = could not find container \"6eaf26f1009dae339da21e160fcb99c7dcc517b0a8800946ddc6fa7c8a556338\": container with ID starting with 6eaf26f1009dae339da21e160fcb99c7dcc517b0a8800946ddc6fa7c8a556338 not found: ID does not exist" May 26 16:12:59.856889 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.856859 2560 scope.go:117] "RemoveContainer" containerID="faa6ae670da12aba80d0776a685cd91f95f4efcc5fb9d4cf297f5ca68f42d47b" May 26 16:12:59.857090 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:12:59.857070 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"faa6ae670da12aba80d0776a685cd91f95f4efcc5fb9d4cf297f5ca68f42d47b\": container with ID starting with faa6ae670da12aba80d0776a685cd91f95f4efcc5fb9d4cf297f5ca68f42d47b not found: ID does not exist" containerID="faa6ae670da12aba80d0776a685cd91f95f4efcc5fb9d4cf297f5ca68f42d47b" May 26 16:12:59.857127 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.857098 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"faa6ae670da12aba80d0776a685cd91f95f4efcc5fb9d4cf297f5ca68f42d47b"} err="failed to get container status \"faa6ae670da12aba80d0776a685cd91f95f4efcc5fb9d4cf297f5ca68f42d47b\": rpc error: code = NotFound desc = could not find container \"faa6ae670da12aba80d0776a685cd91f95f4efcc5fb9d4cf297f5ca68f42d47b\": container with ID starting with faa6ae670da12aba80d0776a685cd91f95f4efcc5fb9d4cf297f5ca68f42d47b not found: ID does not exist" May 26 16:12:59.857127 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.857118 2560 scope.go:117] "RemoveContainer" containerID="e8fbb96a079e19df32277e6b136a648f474f6944b1e5071c1c06d6bbebfddc0d" May 26 16:12:59.857361 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:12:59.857341 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8fbb96a079e19df32277e6b136a648f474f6944b1e5071c1c06d6bbebfddc0d\": container with ID starting with e8fbb96a079e19df32277e6b136a648f474f6944b1e5071c1c06d6bbebfddc0d not found: ID does not exist" containerID="e8fbb96a079e19df32277e6b136a648f474f6944b1e5071c1c06d6bbebfddc0d" May 26 16:12:59.857417 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.857370 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8fbb96a079e19df32277e6b136a648f474f6944b1e5071c1c06d6bbebfddc0d"} err="failed to get container status \"e8fbb96a079e19df32277e6b136a648f474f6944b1e5071c1c06d6bbebfddc0d\": rpc error: code = NotFound desc = could not find container \"e8fbb96a079e19df32277e6b136a648f474f6944b1e5071c1c06d6bbebfddc0d\": container with ID starting with e8fbb96a079e19df32277e6b136a648f474f6944b1e5071c1c06d6bbebfddc0d not found: ID does not exist" May 26 16:12:59.857508 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.857393 2560 scope.go:117] "RemoveContainer" containerID="861970fec379052cca4a4006a78a420e791b1d49c090f4b44f0615e5ce5b3369" May 26 16:12:59.857680 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:12:59.857665 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"861970fec379052cca4a4006a78a420e791b1d49c090f4b44f0615e5ce5b3369\": container with ID starting with 861970fec379052cca4a4006a78a420e791b1d49c090f4b44f0615e5ce5b3369 not found: ID does not exist" containerID="861970fec379052cca4a4006a78a420e791b1d49c090f4b44f0615e5ce5b3369" May 26 16:12:59.857721 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.857693 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"861970fec379052cca4a4006a78a420e791b1d49c090f4b44f0615e5ce5b3369"} err="failed to get container status \"861970fec379052cca4a4006a78a420e791b1d49c090f4b44f0615e5ce5b3369\": rpc error: code = NotFound desc = could not find container \"861970fec379052cca4a4006a78a420e791b1d49c090f4b44f0615e5ce5b3369\": container with ID starting with 861970fec379052cca4a4006a78a420e791b1d49c090f4b44f0615e5ce5b3369 not found: ID does not exist" May 26 16:12:59.857721 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.857708 2560 scope.go:117] "RemoveContainer" containerID="51b441e3782a74b0dba13e350788ad1717a986b3c278e0904e0b2b09c8f54a52" May 26 16:12:59.857915 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:12:59.857900 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51b441e3782a74b0dba13e350788ad1717a986b3c278e0904e0b2b09c8f54a52\": container with ID starting with 51b441e3782a74b0dba13e350788ad1717a986b3c278e0904e0b2b09c8f54a52 not found: ID does not exist" containerID="51b441e3782a74b0dba13e350788ad1717a986b3c278e0904e0b2b09c8f54a52" May 26 16:12:59.857962 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.857918 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51b441e3782a74b0dba13e350788ad1717a986b3c278e0904e0b2b09c8f54a52"} err="failed to get container status \"51b441e3782a74b0dba13e350788ad1717a986b3c278e0904e0b2b09c8f54a52\": rpc error: code = NotFound desc = could not find container \"51b441e3782a74b0dba13e350788ad1717a986b3c278e0904e0b2b09c8f54a52\": container with ID starting with 51b441e3782a74b0dba13e350788ad1717a986b3c278e0904e0b2b09c8f54a52 not found: ID does not exist" May 26 16:12:59.857997 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.857966 2560 scope.go:117] "RemoveContainer" containerID="ba04bccaef095105dea2028908a04807adad49944e50418f3e76d64b14f07d4e" May 26 16:12:59.858245 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:12:59.858227 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba04bccaef095105dea2028908a04807adad49944e50418f3e76d64b14f07d4e\": container with ID starting with ba04bccaef095105dea2028908a04807adad49944e50418f3e76d64b14f07d4e not found: ID does not exist" containerID="ba04bccaef095105dea2028908a04807adad49944e50418f3e76d64b14f07d4e" May 26 16:12:59.858306 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.858246 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba04bccaef095105dea2028908a04807adad49944e50418f3e76d64b14f07d4e"} err="failed to get container status \"ba04bccaef095105dea2028908a04807adad49944e50418f3e76d64b14f07d4e\": rpc error: code = NotFound desc = could not find container \"ba04bccaef095105dea2028908a04807adad49944e50418f3e76d64b14f07d4e\": container with ID starting with ba04bccaef095105dea2028908a04807adad49944e50418f3e76d64b14f07d4e not found: ID does not exist" May 26 16:12:59.858306 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.858268 2560 scope.go:117] "RemoveContainer" containerID="516bde7668014ac782cb4a1d7095e4d4facf9cb1aad4d680f29a4f800ca3fbba" May 26 16:12:59.858599 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:12:59.858500 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"516bde7668014ac782cb4a1d7095e4d4facf9cb1aad4d680f29a4f800ca3fbba\": container with ID starting with 516bde7668014ac782cb4a1d7095e4d4facf9cb1aad4d680f29a4f800ca3fbba not found: ID does not exist" containerID="516bde7668014ac782cb4a1d7095e4d4facf9cb1aad4d680f29a4f800ca3fbba" May 26 16:12:59.858599 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.858528 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"516bde7668014ac782cb4a1d7095e4d4facf9cb1aad4d680f29a4f800ca3fbba"} err="failed to get container status \"516bde7668014ac782cb4a1d7095e4d4facf9cb1aad4d680f29a4f800ca3fbba\": rpc error: code = NotFound desc = could not find container \"516bde7668014ac782cb4a1d7095e4d4facf9cb1aad4d680f29a4f800ca3fbba\": container with ID starting with 516bde7668014ac782cb4a1d7095e4d4facf9cb1aad4d680f29a4f800ca3fbba not found: ID does not exist" May 26 16:12:59.858599 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.858550 2560 scope.go:117] "RemoveContainer" containerID="6eaf26f1009dae339da21e160fcb99c7dcc517b0a8800946ddc6fa7c8a556338" May 26 16:12:59.858811 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.858793 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6eaf26f1009dae339da21e160fcb99c7dcc517b0a8800946ddc6fa7c8a556338"} err="failed to get container status \"6eaf26f1009dae339da21e160fcb99c7dcc517b0a8800946ddc6fa7c8a556338\": rpc error: code = NotFound desc = could not find container \"6eaf26f1009dae339da21e160fcb99c7dcc517b0a8800946ddc6fa7c8a556338\": container with ID starting with 6eaf26f1009dae339da21e160fcb99c7dcc517b0a8800946ddc6fa7c8a556338 not found: ID does not exist" May 26 16:12:59.858853 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.858813 2560 scope.go:117] "RemoveContainer" containerID="faa6ae670da12aba80d0776a685cd91f95f4efcc5fb9d4cf297f5ca68f42d47b" May 26 16:12:59.859027 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.859011 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"faa6ae670da12aba80d0776a685cd91f95f4efcc5fb9d4cf297f5ca68f42d47b"} err="failed to get container status \"faa6ae670da12aba80d0776a685cd91f95f4efcc5fb9d4cf297f5ca68f42d47b\": rpc error: code = NotFound desc = could not find container \"faa6ae670da12aba80d0776a685cd91f95f4efcc5fb9d4cf297f5ca68f42d47b\": container with ID starting with faa6ae670da12aba80d0776a685cd91f95f4efcc5fb9d4cf297f5ca68f42d47b not found: ID does not exist" May 26 16:12:59.859027 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.859026 2560 scope.go:117] "RemoveContainer" containerID="e8fbb96a079e19df32277e6b136a648f474f6944b1e5071c1c06d6bbebfddc0d" May 26 16:12:59.859205 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.859192 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8fbb96a079e19df32277e6b136a648f474f6944b1e5071c1c06d6bbebfddc0d"} err="failed to get container status \"e8fbb96a079e19df32277e6b136a648f474f6944b1e5071c1c06d6bbebfddc0d\": rpc error: code = NotFound desc = could not find container \"e8fbb96a079e19df32277e6b136a648f474f6944b1e5071c1c06d6bbebfddc0d\": container with ID starting with e8fbb96a079e19df32277e6b136a648f474f6944b1e5071c1c06d6bbebfddc0d not found: ID does not exist" May 26 16:12:59.859205 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.859205 2560 scope.go:117] "RemoveContainer" containerID="861970fec379052cca4a4006a78a420e791b1d49c090f4b44f0615e5ce5b3369" May 26 16:12:59.859386 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.859369 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"861970fec379052cca4a4006a78a420e791b1d49c090f4b44f0615e5ce5b3369"} err="failed to get container status \"861970fec379052cca4a4006a78a420e791b1d49c090f4b44f0615e5ce5b3369\": rpc error: code = NotFound desc = could not find container \"861970fec379052cca4a4006a78a420e791b1d49c090f4b44f0615e5ce5b3369\": container with ID starting with 861970fec379052cca4a4006a78a420e791b1d49c090f4b44f0615e5ce5b3369 not found: ID does not exist" May 26 16:12:59.859386 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.859383 2560 scope.go:117] "RemoveContainer" containerID="51b441e3782a74b0dba13e350788ad1717a986b3c278e0904e0b2b09c8f54a52" May 26 16:12:59.859565 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.859544 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51b441e3782a74b0dba13e350788ad1717a986b3c278e0904e0b2b09c8f54a52"} err="failed to get container status \"51b441e3782a74b0dba13e350788ad1717a986b3c278e0904e0b2b09c8f54a52\": rpc error: code = NotFound desc = could not find container \"51b441e3782a74b0dba13e350788ad1717a986b3c278e0904e0b2b09c8f54a52\": container with ID starting with 51b441e3782a74b0dba13e350788ad1717a986b3c278e0904e0b2b09c8f54a52 not found: ID does not exist" May 26 16:12:59.859565 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.859555 2560 scope.go:117] "RemoveContainer" containerID="ba04bccaef095105dea2028908a04807adad49944e50418f3e76d64b14f07d4e" May 26 16:12:59.859740 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.859714 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba04bccaef095105dea2028908a04807adad49944e50418f3e76d64b14f07d4e"} err="failed to get container status \"ba04bccaef095105dea2028908a04807adad49944e50418f3e76d64b14f07d4e\": rpc error: code = NotFound desc = could not find container \"ba04bccaef095105dea2028908a04807adad49944e50418f3e76d64b14f07d4e\": container with ID starting with ba04bccaef095105dea2028908a04807adad49944e50418f3e76d64b14f07d4e not found: ID does not exist" May 26 16:12:59.859785 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.859741 2560 scope.go:117] "RemoveContainer" containerID="516bde7668014ac782cb4a1d7095e4d4facf9cb1aad4d680f29a4f800ca3fbba" May 26 16:12:59.859946 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.859932 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"516bde7668014ac782cb4a1d7095e4d4facf9cb1aad4d680f29a4f800ca3fbba"} err="failed to get container status \"516bde7668014ac782cb4a1d7095e4d4facf9cb1aad4d680f29a4f800ca3fbba\": rpc error: code = NotFound desc = could not find container \"516bde7668014ac782cb4a1d7095e4d4facf9cb1aad4d680f29a4f800ca3fbba\": container with ID starting with 516bde7668014ac782cb4a1d7095e4d4facf9cb1aad4d680f29a4f800ca3fbba not found: ID does not exist" May 26 16:12:59.859946 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.859945 2560 scope.go:117] "RemoveContainer" containerID="6eaf26f1009dae339da21e160fcb99c7dcc517b0a8800946ddc6fa7c8a556338" May 26 16:12:59.860163 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.860145 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6eaf26f1009dae339da21e160fcb99c7dcc517b0a8800946ddc6fa7c8a556338"} err="failed to get container status \"6eaf26f1009dae339da21e160fcb99c7dcc517b0a8800946ddc6fa7c8a556338\": rpc error: code = NotFound desc = could not find container \"6eaf26f1009dae339da21e160fcb99c7dcc517b0a8800946ddc6fa7c8a556338\": container with ID starting with 6eaf26f1009dae339da21e160fcb99c7dcc517b0a8800946ddc6fa7c8a556338 not found: ID does not exist" May 26 16:12:59.860203 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.860164 2560 scope.go:117] "RemoveContainer" containerID="faa6ae670da12aba80d0776a685cd91f95f4efcc5fb9d4cf297f5ca68f42d47b" May 26 16:12:59.860343 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.860329 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"faa6ae670da12aba80d0776a685cd91f95f4efcc5fb9d4cf297f5ca68f42d47b"} err="failed to get container status \"faa6ae670da12aba80d0776a685cd91f95f4efcc5fb9d4cf297f5ca68f42d47b\": rpc error: code = NotFound desc = could not find container \"faa6ae670da12aba80d0776a685cd91f95f4efcc5fb9d4cf297f5ca68f42d47b\": container with ID starting with faa6ae670da12aba80d0776a685cd91f95f4efcc5fb9d4cf297f5ca68f42d47b not found: ID does not exist" May 26 16:12:59.860385 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.860343 2560 scope.go:117] "RemoveContainer" containerID="e8fbb96a079e19df32277e6b136a648f474f6944b1e5071c1c06d6bbebfddc0d" May 26 16:12:59.860538 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.860523 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8fbb96a079e19df32277e6b136a648f474f6944b1e5071c1c06d6bbebfddc0d"} err="failed to get container status \"e8fbb96a079e19df32277e6b136a648f474f6944b1e5071c1c06d6bbebfddc0d\": rpc error: code = NotFound desc = could not find container \"e8fbb96a079e19df32277e6b136a648f474f6944b1e5071c1c06d6bbebfddc0d\": container with ID starting with e8fbb96a079e19df32277e6b136a648f474f6944b1e5071c1c06d6bbebfddc0d not found: ID does not exist" May 26 16:12:59.860589 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.860538 2560 scope.go:117] "RemoveContainer" containerID="861970fec379052cca4a4006a78a420e791b1d49c090f4b44f0615e5ce5b3369" May 26 16:12:59.860753 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.860735 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"861970fec379052cca4a4006a78a420e791b1d49c090f4b44f0615e5ce5b3369"} err="failed to get container status \"861970fec379052cca4a4006a78a420e791b1d49c090f4b44f0615e5ce5b3369\": rpc error: code = NotFound desc = could not find container \"861970fec379052cca4a4006a78a420e791b1d49c090f4b44f0615e5ce5b3369\": container with ID starting with 861970fec379052cca4a4006a78a420e791b1d49c090f4b44f0615e5ce5b3369 not found: ID does not exist" May 26 16:12:59.860807 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.860753 2560 scope.go:117] "RemoveContainer" containerID="51b441e3782a74b0dba13e350788ad1717a986b3c278e0904e0b2b09c8f54a52" May 26 16:12:59.860949 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.860933 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51b441e3782a74b0dba13e350788ad1717a986b3c278e0904e0b2b09c8f54a52"} err="failed to get container status \"51b441e3782a74b0dba13e350788ad1717a986b3c278e0904e0b2b09c8f54a52\": rpc error: code = NotFound desc = could not find container \"51b441e3782a74b0dba13e350788ad1717a986b3c278e0904e0b2b09c8f54a52\": container with ID starting with 51b441e3782a74b0dba13e350788ad1717a986b3c278e0904e0b2b09c8f54a52 not found: ID does not exist" May 26 16:12:59.861003 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.860950 2560 scope.go:117] "RemoveContainer" containerID="ba04bccaef095105dea2028908a04807adad49944e50418f3e76d64b14f07d4e" May 26 16:12:59.861209 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.861187 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba04bccaef095105dea2028908a04807adad49944e50418f3e76d64b14f07d4e"} err="failed to get container status \"ba04bccaef095105dea2028908a04807adad49944e50418f3e76d64b14f07d4e\": rpc error: code = NotFound desc = could not find container \"ba04bccaef095105dea2028908a04807adad49944e50418f3e76d64b14f07d4e\": container with ID starting with ba04bccaef095105dea2028908a04807adad49944e50418f3e76d64b14f07d4e not found: ID does not exist" May 26 16:12:59.861209 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.861207 2560 scope.go:117] "RemoveContainer" containerID="516bde7668014ac782cb4a1d7095e4d4facf9cb1aad4d680f29a4f800ca3fbba" May 26 16:12:59.861453 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.861422 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"516bde7668014ac782cb4a1d7095e4d4facf9cb1aad4d680f29a4f800ca3fbba"} err="failed to get container status \"516bde7668014ac782cb4a1d7095e4d4facf9cb1aad4d680f29a4f800ca3fbba\": rpc error: code = NotFound desc = could not find container \"516bde7668014ac782cb4a1d7095e4d4facf9cb1aad4d680f29a4f800ca3fbba\": container with ID starting with 516bde7668014ac782cb4a1d7095e4d4facf9cb1aad4d680f29a4f800ca3fbba not found: ID does not exist" May 26 16:12:59.861453 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.861453 2560 scope.go:117] "RemoveContainer" containerID="6eaf26f1009dae339da21e160fcb99c7dcc517b0a8800946ddc6fa7c8a556338" May 26 16:12:59.861680 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.861659 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6eaf26f1009dae339da21e160fcb99c7dcc517b0a8800946ddc6fa7c8a556338"} err="failed to get container status \"6eaf26f1009dae339da21e160fcb99c7dcc517b0a8800946ddc6fa7c8a556338\": rpc error: code = NotFound desc = could not find container \"6eaf26f1009dae339da21e160fcb99c7dcc517b0a8800946ddc6fa7c8a556338\": container with ID starting with 6eaf26f1009dae339da21e160fcb99c7dcc517b0a8800946ddc6fa7c8a556338 not found: ID does not exist" May 26 16:12:59.861753 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.861681 2560 scope.go:117] "RemoveContainer" containerID="faa6ae670da12aba80d0776a685cd91f95f4efcc5fb9d4cf297f5ca68f42d47b" May 26 16:12:59.861917 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.861889 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"faa6ae670da12aba80d0776a685cd91f95f4efcc5fb9d4cf297f5ca68f42d47b"} err="failed to get container status \"faa6ae670da12aba80d0776a685cd91f95f4efcc5fb9d4cf297f5ca68f42d47b\": rpc error: code = NotFound desc = could not find container \"faa6ae670da12aba80d0776a685cd91f95f4efcc5fb9d4cf297f5ca68f42d47b\": container with ID starting with faa6ae670da12aba80d0776a685cd91f95f4efcc5fb9d4cf297f5ca68f42d47b not found: ID does not exist" May 26 16:12:59.861917 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.861916 2560 scope.go:117] "RemoveContainer" containerID="e8fbb96a079e19df32277e6b136a648f474f6944b1e5071c1c06d6bbebfddc0d" May 26 16:12:59.862140 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.862122 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8fbb96a079e19df32277e6b136a648f474f6944b1e5071c1c06d6bbebfddc0d"} err="failed to get container status \"e8fbb96a079e19df32277e6b136a648f474f6944b1e5071c1c06d6bbebfddc0d\": rpc error: code = NotFound desc = could not find container \"e8fbb96a079e19df32277e6b136a648f474f6944b1e5071c1c06d6bbebfddc0d\": container with ID starting with e8fbb96a079e19df32277e6b136a648f474f6944b1e5071c1c06d6bbebfddc0d not found: ID does not exist" May 26 16:12:59.862182 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.862141 2560 scope.go:117] "RemoveContainer" containerID="861970fec379052cca4a4006a78a420e791b1d49c090f4b44f0615e5ce5b3369" May 26 16:12:59.862363 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.862346 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"861970fec379052cca4a4006a78a420e791b1d49c090f4b44f0615e5ce5b3369"} err="failed to get container status \"861970fec379052cca4a4006a78a420e791b1d49c090f4b44f0615e5ce5b3369\": rpc error: code = NotFound desc = could not find container \"861970fec379052cca4a4006a78a420e791b1d49c090f4b44f0615e5ce5b3369\": container with ID starting with 861970fec379052cca4a4006a78a420e791b1d49c090f4b44f0615e5ce5b3369 not found: ID does not exist" May 26 16:12:59.862399 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.862364 2560 scope.go:117] "RemoveContainer" containerID="51b441e3782a74b0dba13e350788ad1717a986b3c278e0904e0b2b09c8f54a52" May 26 16:12:59.862580 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.862562 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51b441e3782a74b0dba13e350788ad1717a986b3c278e0904e0b2b09c8f54a52"} err="failed to get container status \"51b441e3782a74b0dba13e350788ad1717a986b3c278e0904e0b2b09c8f54a52\": rpc error: code = NotFound desc = could not find container \"51b441e3782a74b0dba13e350788ad1717a986b3c278e0904e0b2b09c8f54a52\": container with ID starting with 51b441e3782a74b0dba13e350788ad1717a986b3c278e0904e0b2b09c8f54a52 not found: ID does not exist" May 26 16:12:59.862614 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.862582 2560 scope.go:117] "RemoveContainer" containerID="ba04bccaef095105dea2028908a04807adad49944e50418f3e76d64b14f07d4e" May 26 16:12:59.862764 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.862748 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba04bccaef095105dea2028908a04807adad49944e50418f3e76d64b14f07d4e"} err="failed to get container status \"ba04bccaef095105dea2028908a04807adad49944e50418f3e76d64b14f07d4e\": rpc error: code = NotFound desc = could not find container \"ba04bccaef095105dea2028908a04807adad49944e50418f3e76d64b14f07d4e\": container with ID starting with ba04bccaef095105dea2028908a04807adad49944e50418f3e76d64b14f07d4e not found: ID does not exist" May 26 16:12:59.862803 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.862765 2560 scope.go:117] "RemoveContainer" containerID="516bde7668014ac782cb4a1d7095e4d4facf9cb1aad4d680f29a4f800ca3fbba" May 26 16:12:59.862977 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.862961 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"516bde7668014ac782cb4a1d7095e4d4facf9cb1aad4d680f29a4f800ca3fbba"} err="failed to get container status \"516bde7668014ac782cb4a1d7095e4d4facf9cb1aad4d680f29a4f800ca3fbba\": rpc error: code = NotFound desc = could not find container \"516bde7668014ac782cb4a1d7095e4d4facf9cb1aad4d680f29a4f800ca3fbba\": container with ID starting with 516bde7668014ac782cb4a1d7095e4d4facf9cb1aad4d680f29a4f800ca3fbba not found: ID does not exist" May 26 16:12:59.863015 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.862981 2560 scope.go:117] "RemoveContainer" containerID="6eaf26f1009dae339da21e160fcb99c7dcc517b0a8800946ddc6fa7c8a556338" May 26 16:12:59.863212 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.863190 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6eaf26f1009dae339da21e160fcb99c7dcc517b0a8800946ddc6fa7c8a556338"} err="failed to get container status \"6eaf26f1009dae339da21e160fcb99c7dcc517b0a8800946ddc6fa7c8a556338\": rpc error: code = NotFound desc = could not find container \"6eaf26f1009dae339da21e160fcb99c7dcc517b0a8800946ddc6fa7c8a556338\": container with ID starting with 6eaf26f1009dae339da21e160fcb99c7dcc517b0a8800946ddc6fa7c8a556338 not found: ID does not exist" May 26 16:12:59.863212 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.863212 2560 scope.go:117] "RemoveContainer" containerID="faa6ae670da12aba80d0776a685cd91f95f4efcc5fb9d4cf297f5ca68f42d47b" May 26 16:12:59.863532 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.863412 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"faa6ae670da12aba80d0776a685cd91f95f4efcc5fb9d4cf297f5ca68f42d47b"} err="failed to get container status \"faa6ae670da12aba80d0776a685cd91f95f4efcc5fb9d4cf297f5ca68f42d47b\": rpc error: code = NotFound desc = could not find container \"faa6ae670da12aba80d0776a685cd91f95f4efcc5fb9d4cf297f5ca68f42d47b\": container with ID starting with faa6ae670da12aba80d0776a685cd91f95f4efcc5fb9d4cf297f5ca68f42d47b not found: ID does not exist" May 26 16:12:59.863617 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.863557 2560 scope.go:117] "RemoveContainer" containerID="e8fbb96a079e19df32277e6b136a648f474f6944b1e5071c1c06d6bbebfddc0d" May 26 16:12:59.863825 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.863802 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8fbb96a079e19df32277e6b136a648f474f6944b1e5071c1c06d6bbebfddc0d"} err="failed to get container status \"e8fbb96a079e19df32277e6b136a648f474f6944b1e5071c1c06d6bbebfddc0d\": rpc error: code = NotFound desc = could not find container \"e8fbb96a079e19df32277e6b136a648f474f6944b1e5071c1c06d6bbebfddc0d\": container with ID starting with e8fbb96a079e19df32277e6b136a648f474f6944b1e5071c1c06d6bbebfddc0d not found: ID does not exist" May 26 16:12:59.863825 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.863825 2560 scope.go:117] "RemoveContainer" containerID="861970fec379052cca4a4006a78a420e791b1d49c090f4b44f0615e5ce5b3369" May 26 16:12:59.864105 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.864068 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"861970fec379052cca4a4006a78a420e791b1d49c090f4b44f0615e5ce5b3369"} err="failed to get container status \"861970fec379052cca4a4006a78a420e791b1d49c090f4b44f0615e5ce5b3369\": rpc error: code = NotFound desc = could not find container \"861970fec379052cca4a4006a78a420e791b1d49c090f4b44f0615e5ce5b3369\": container with ID starting with 861970fec379052cca4a4006a78a420e791b1d49c090f4b44f0615e5ce5b3369 not found: ID does not exist" May 26 16:12:59.864105 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.864104 2560 scope.go:117] "RemoveContainer" containerID="51b441e3782a74b0dba13e350788ad1717a986b3c278e0904e0b2b09c8f54a52" May 26 16:12:59.864383 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.864346 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51b441e3782a74b0dba13e350788ad1717a986b3c278e0904e0b2b09c8f54a52"} err="failed to get container status \"51b441e3782a74b0dba13e350788ad1717a986b3c278e0904e0b2b09c8f54a52\": rpc error: code = NotFound desc = could not find container \"51b441e3782a74b0dba13e350788ad1717a986b3c278e0904e0b2b09c8f54a52\": container with ID starting with 51b441e3782a74b0dba13e350788ad1717a986b3c278e0904e0b2b09c8f54a52 not found: ID does not exist" May 26 16:12:59.864489 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.864384 2560 scope.go:117] "RemoveContainer" containerID="ba04bccaef095105dea2028908a04807adad49944e50418f3e76d64b14f07d4e" May 26 16:12:59.864612 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.864592 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba04bccaef095105dea2028908a04807adad49944e50418f3e76d64b14f07d4e"} err="failed to get container status \"ba04bccaef095105dea2028908a04807adad49944e50418f3e76d64b14f07d4e\": rpc error: code = NotFound desc = could not find container \"ba04bccaef095105dea2028908a04807adad49944e50418f3e76d64b14f07d4e\": container with ID starting with ba04bccaef095105dea2028908a04807adad49944e50418f3e76d64b14f07d4e not found: ID does not exist" May 26 16:12:59.864665 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.864616 2560 scope.go:117] "RemoveContainer" containerID="516bde7668014ac782cb4a1d7095e4d4facf9cb1aad4d680f29a4f800ca3fbba" May 26 16:12:59.864859 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.864843 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"516bde7668014ac782cb4a1d7095e4d4facf9cb1aad4d680f29a4f800ca3fbba"} err="failed to get container status \"516bde7668014ac782cb4a1d7095e4d4facf9cb1aad4d680f29a4f800ca3fbba\": rpc error: code = NotFound desc = could not find container \"516bde7668014ac782cb4a1d7095e4d4facf9cb1aad4d680f29a4f800ca3fbba\": container with ID starting with 516bde7668014ac782cb4a1d7095e4d4facf9cb1aad4d680f29a4f800ca3fbba not found: ID does not exist" May 26 16:12:59.864859 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.864859 2560 scope.go:117] "RemoveContainer" containerID="6eaf26f1009dae339da21e160fcb99c7dcc517b0a8800946ddc6fa7c8a556338" May 26 16:12:59.865101 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.865085 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6eaf26f1009dae339da21e160fcb99c7dcc517b0a8800946ddc6fa7c8a556338"} err="failed to get container status \"6eaf26f1009dae339da21e160fcb99c7dcc517b0a8800946ddc6fa7c8a556338\": rpc error: code = NotFound desc = could not find container \"6eaf26f1009dae339da21e160fcb99c7dcc517b0a8800946ddc6fa7c8a556338\": container with ID starting with 6eaf26f1009dae339da21e160fcb99c7dcc517b0a8800946ddc6fa7c8a556338 not found: ID does not exist" May 26 16:12:59.865143 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.865100 2560 scope.go:117] "RemoveContainer" containerID="faa6ae670da12aba80d0776a685cd91f95f4efcc5fb9d4cf297f5ca68f42d47b" May 26 16:12:59.865294 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.865274 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"faa6ae670da12aba80d0776a685cd91f95f4efcc5fb9d4cf297f5ca68f42d47b"} err="failed to get container status \"faa6ae670da12aba80d0776a685cd91f95f4efcc5fb9d4cf297f5ca68f42d47b\": rpc error: code = NotFound desc = could not find container \"faa6ae670da12aba80d0776a685cd91f95f4efcc5fb9d4cf297f5ca68f42d47b\": container with ID starting with faa6ae670da12aba80d0776a685cd91f95f4efcc5fb9d4cf297f5ca68f42d47b not found: ID does not exist" May 26 16:12:59.865332 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.865295 2560 scope.go:117] "RemoveContainer" containerID="e8fbb96a079e19df32277e6b136a648f474f6944b1e5071c1c06d6bbebfddc0d" May 26 16:12:59.865520 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.865494 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8fbb96a079e19df32277e6b136a648f474f6944b1e5071c1c06d6bbebfddc0d"} err="failed to get container status \"e8fbb96a079e19df32277e6b136a648f474f6944b1e5071c1c06d6bbebfddc0d\": rpc error: code = NotFound desc = could not find container \"e8fbb96a079e19df32277e6b136a648f474f6944b1e5071c1c06d6bbebfddc0d\": container with ID starting with e8fbb96a079e19df32277e6b136a648f474f6944b1e5071c1c06d6bbebfddc0d not found: ID does not exist" May 26 16:12:59.865600 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.865532 2560 scope.go:117] "RemoveContainer" containerID="861970fec379052cca4a4006a78a420e791b1d49c090f4b44f0615e5ce5b3369" May 26 16:12:59.865742 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.865725 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"861970fec379052cca4a4006a78a420e791b1d49c090f4b44f0615e5ce5b3369"} err="failed to get container status \"861970fec379052cca4a4006a78a420e791b1d49c090f4b44f0615e5ce5b3369\": rpc error: code = NotFound desc = could not find container \"861970fec379052cca4a4006a78a420e791b1d49c090f4b44f0615e5ce5b3369\": container with ID starting with 861970fec379052cca4a4006a78a420e791b1d49c090f4b44f0615e5ce5b3369 not found: ID does not exist" May 26 16:12:59.865788 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.865744 2560 scope.go:117] "RemoveContainer" containerID="51b441e3782a74b0dba13e350788ad1717a986b3c278e0904e0b2b09c8f54a52" May 26 16:12:59.865936 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.865919 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51b441e3782a74b0dba13e350788ad1717a986b3c278e0904e0b2b09c8f54a52"} err="failed to get container status \"51b441e3782a74b0dba13e350788ad1717a986b3c278e0904e0b2b09c8f54a52\": rpc error: code = NotFound desc = could not find container \"51b441e3782a74b0dba13e350788ad1717a986b3c278e0904e0b2b09c8f54a52\": container with ID starting with 51b441e3782a74b0dba13e350788ad1717a986b3c278e0904e0b2b09c8f54a52 not found: ID does not exist" May 26 16:12:59.865936 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.865936 2560 scope.go:117] "RemoveContainer" containerID="ba04bccaef095105dea2028908a04807adad49944e50418f3e76d64b14f07d4e" May 26 16:12:59.866119 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.866099 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba04bccaef095105dea2028908a04807adad49944e50418f3e76d64b14f07d4e"} err="failed to get container status \"ba04bccaef095105dea2028908a04807adad49944e50418f3e76d64b14f07d4e\": rpc error: code = NotFound desc = could not find container \"ba04bccaef095105dea2028908a04807adad49944e50418f3e76d64b14f07d4e\": container with ID starting with ba04bccaef095105dea2028908a04807adad49944e50418f3e76d64b14f07d4e not found: ID does not exist" May 26 16:12:59.866182 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.866120 2560 scope.go:117] "RemoveContainer" containerID="516bde7668014ac782cb4a1d7095e4d4facf9cb1aad4d680f29a4f800ca3fbba" May 26 16:12:59.866309 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.866291 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"516bde7668014ac782cb4a1d7095e4d4facf9cb1aad4d680f29a4f800ca3fbba"} err="failed to get container status \"516bde7668014ac782cb4a1d7095e4d4facf9cb1aad4d680f29a4f800ca3fbba\": rpc error: code = NotFound desc = could not find container \"516bde7668014ac782cb4a1d7095e4d4facf9cb1aad4d680f29a4f800ca3fbba\": container with ID starting with 516bde7668014ac782cb4a1d7095e4d4facf9cb1aad4d680f29a4f800ca3fbba not found: ID does not exist" May 26 16:12:59.869216 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.869190 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 16:12:59.869538 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.869523 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fc737f2-16b2-4c4b-8eba-141e177c9616" containerName="prometheus" May 26 16:12:59.869607 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.869539 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fc737f2-16b2-4c4b-8eba-141e177c9616" containerName="prometheus" May 26 16:12:59.869607 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.869548 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fc737f2-16b2-4c4b-8eba-141e177c9616" containerName="thanos-sidecar" May 26 16:12:59.869607 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.869553 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fc737f2-16b2-4c4b-8eba-141e177c9616" containerName="thanos-sidecar" May 26 16:12:59.869607 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.869564 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fc737f2-16b2-4c4b-8eba-141e177c9616" containerName="config-reloader" May 26 16:12:59.869607 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.869569 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fc737f2-16b2-4c4b-8eba-141e177c9616" containerName="config-reloader" May 26 16:12:59.869607 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.869574 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fc737f2-16b2-4c4b-8eba-141e177c9616" containerName="kube-rbac-proxy-thanos" May 26 16:12:59.869607 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.869581 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fc737f2-16b2-4c4b-8eba-141e177c9616" containerName="kube-rbac-proxy-thanos" May 26 16:12:59.869607 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.869589 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fc737f2-16b2-4c4b-8eba-141e177c9616" containerName="kube-rbac-proxy" May 26 16:12:59.869607 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.869594 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fc737f2-16b2-4c4b-8eba-141e177c9616" containerName="kube-rbac-proxy" May 26 16:12:59.869607 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.869602 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fc737f2-16b2-4c4b-8eba-141e177c9616" containerName="kube-rbac-proxy-web" May 26 16:12:59.869607 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.869607 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fc737f2-16b2-4c4b-8eba-141e177c9616" containerName="kube-rbac-proxy-web" May 26 16:12:59.869607 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.869613 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fc737f2-16b2-4c4b-8eba-141e177c9616" containerName="init-config-reloader" May 26 16:12:59.870142 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.869618 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fc737f2-16b2-4c4b-8eba-141e177c9616" containerName="init-config-reloader" May 26 16:12:59.870142 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.869686 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="5fc737f2-16b2-4c4b-8eba-141e177c9616" containerName="kube-rbac-proxy" May 26 16:12:59.870142 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.869696 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="5fc737f2-16b2-4c4b-8eba-141e177c9616" containerName="thanos-sidecar" May 26 16:12:59.870142 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.869702 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="5fc737f2-16b2-4c4b-8eba-141e177c9616" containerName="config-reloader" May 26 16:12:59.870142 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.869707 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="5fc737f2-16b2-4c4b-8eba-141e177c9616" containerName="prometheus" May 26 16:12:59.870142 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.869714 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="5fc737f2-16b2-4c4b-8eba-141e177c9616" containerName="kube-rbac-proxy-web" May 26 16:12:59.870142 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.869719 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="5fc737f2-16b2-4c4b-8eba-141e177c9616" containerName="kube-rbac-proxy-thanos" May 26 16:12:59.873334 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.873319 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 26 16:12:59.876015 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.875998 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 26 16:12:59.876151 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.876135 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 26 16:12:59.876222 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.876135 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 26 16:12:59.876305 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.876286 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 26 16:12:59.876390 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.876371 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 26 16:12:59.876483 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.876382 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 26 16:12:59.876660 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.876644 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 26 16:12:59.876710 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.876684 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 26 16:12:59.876798 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.876782 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 26 16:12:59.876870 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.876851 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-7sgv5\"" May 26 16:12:59.877002 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.876890 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3uj7g77oe615h\"" May 26 16:12:59.877002 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.876939 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 26 16:12:59.879125 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.879107 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 26 16:12:59.881938 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.881918 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 26 16:12:59.890695 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.890669 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 16:12:59.913926 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.913890 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b82837e0-0463-44d8-8da8-78773446f17f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:12:59.914089 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.913950 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b82837e0-0463-44d8-8da8-78773446f17f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:12:59.914089 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.913981 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b82837e0-0463-44d8-8da8-78773446f17f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:12:59.914089 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.914009 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b82837e0-0463-44d8-8da8-78773446f17f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:12:59.914089 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.914066 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b82837e0-0463-44d8-8da8-78773446f17f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:12:59.914241 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.914121 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b82837e0-0463-44d8-8da8-78773446f17f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:12:59.914241 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.914150 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b82837e0-0463-44d8-8da8-78773446f17f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:12:59.914241 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.914187 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b82837e0-0463-44d8-8da8-78773446f17f-web-config\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:12:59.914241 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.914215 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b82837e0-0463-44d8-8da8-78773446f17f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:12:59.914456 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.914254 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b82837e0-0463-44d8-8da8-78773446f17f-config\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:12:59.914456 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.914277 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b82837e0-0463-44d8-8da8-78773446f17f-config-out\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:12:59.914456 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.914311 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b82837e0-0463-44d8-8da8-78773446f17f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:12:59.914456 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.914361 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jgqf\" (UniqueName: \"kubernetes.io/projected/b82837e0-0463-44d8-8da8-78773446f17f-kube-api-access-8jgqf\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:12:59.914456 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.914401 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b82837e0-0463-44d8-8da8-78773446f17f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:12:59.914456 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.914456 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b82837e0-0463-44d8-8da8-78773446f17f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:12:59.914657 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.914475 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b82837e0-0463-44d8-8da8-78773446f17f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:12:59.914657 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.914496 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b82837e0-0463-44d8-8da8-78773446f17f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:12:59.914657 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:12:59.914519 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b82837e0-0463-44d8-8da8-78773446f17f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:13:00.006966 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:00.006935 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fc737f2-16b2-4c4b-8eba-141e177c9616" path="/var/lib/kubelet/pods/5fc737f2-16b2-4c4b-8eba-141e177c9616/volumes" May 26 16:13:00.015611 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:00.015590 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b82837e0-0463-44d8-8da8-78773446f17f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:13:00.015681 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:00.015628 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b82837e0-0463-44d8-8da8-78773446f17f-config\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:13:00.015681 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:00.015651 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b82837e0-0463-44d8-8da8-78773446f17f-config-out\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:13:00.015681 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:00.015675 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b82837e0-0463-44d8-8da8-78773446f17f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:13:00.015883 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:00.015860 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8jgqf\" (UniqueName: \"kubernetes.io/projected/b82837e0-0463-44d8-8da8-78773446f17f-kube-api-access-8jgqf\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:13:00.015929 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:00.015904 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b82837e0-0463-44d8-8da8-78773446f17f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:13:00.015982 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:00.015939 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b82837e0-0463-44d8-8da8-78773446f17f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:13:00.015982 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:00.015966 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b82837e0-0463-44d8-8da8-78773446f17f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:13:00.016077 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:00.015999 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b82837e0-0463-44d8-8da8-78773446f17f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:13:00.016077 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:00.016030 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b82837e0-0463-44d8-8da8-78773446f17f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:13:00.016162 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:00.016076 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b82837e0-0463-44d8-8da8-78773446f17f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:13:00.016162 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:00.016119 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b82837e0-0463-44d8-8da8-78773446f17f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:13:00.016162 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:00.016140 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b82837e0-0463-44d8-8da8-78773446f17f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:13:00.016299 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:00.016168 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b82837e0-0463-44d8-8da8-78773446f17f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:13:00.016299 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:00.016205 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b82837e0-0463-44d8-8da8-78773446f17f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:13:00.016530 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:00.016500 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b82837e0-0463-44d8-8da8-78773446f17f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:13:00.017597 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:00.017573 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b82837e0-0463-44d8-8da8-78773446f17f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:13:00.017715 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:00.017631 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b82837e0-0463-44d8-8da8-78773446f17f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:13:00.017715 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:00.017664 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b82837e0-0463-44d8-8da8-78773446f17f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:13:00.017715 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:00.017709 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b82837e0-0463-44d8-8da8-78773446f17f-web-config\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:13:00.018649 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:00.018626 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b82837e0-0463-44d8-8da8-78773446f17f-config-out\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:13:00.019056 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:00.019027 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b82837e0-0463-44d8-8da8-78773446f17f-config\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:13:00.019465 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:00.019411 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b82837e0-0463-44d8-8da8-78773446f17f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:13:00.019589 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:00.019422 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b82837e0-0463-44d8-8da8-78773446f17f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:13:00.019935 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:00.019912 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b82837e0-0463-44d8-8da8-78773446f17f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:13:00.020015 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:00.019919 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b82837e0-0463-44d8-8da8-78773446f17f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:13:00.020069 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:00.020019 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b82837e0-0463-44d8-8da8-78773446f17f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:13:00.020420 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:00.020398 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b82837e0-0463-44d8-8da8-78773446f17f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:13:00.020648 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:00.020624 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b82837e0-0463-44d8-8da8-78773446f17f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:13:00.020731 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:00.020693 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b82837e0-0463-44d8-8da8-78773446f17f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:13:00.020850 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:00.020785 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b82837e0-0463-44d8-8da8-78773446f17f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:13:00.020850 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:00.020792 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b82837e0-0463-44d8-8da8-78773446f17f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:13:00.021053 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:00.021037 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b82837e0-0463-44d8-8da8-78773446f17f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:13:00.021125 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:00.021111 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b82837e0-0463-44d8-8da8-78773446f17f-web-config\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:13:00.021747 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:00.021727 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b82837e0-0463-44d8-8da8-78773446f17f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:13:00.029871 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:00.029848 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jgqf\" (UniqueName: \"kubernetes.io/projected/b82837e0-0463-44d8-8da8-78773446f17f-kube-api-access-8jgqf\") pod \"prometheus-k8s-0\" (UID: \"b82837e0-0463-44d8-8da8-78773446f17f\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 16:13:00.183447 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:00.183393 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 26 16:13:00.322685 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:00.322652 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 16:13:00.325764 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:13:00.325736 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb82837e0_0463_44d8_8da8_78773446f17f.slice/crio-367c629856bea823c5da3c5a1d37eb07d5d41fa0b0bc6211f8d891bc32ba13b3 WatchSource:0}: Error finding container 367c629856bea823c5da3c5a1d37eb07d5d41fa0b0bc6211f8d891bc32ba13b3: Status 404 returned error can't find the container with id 367c629856bea823c5da3c5a1d37eb07d5d41fa0b0bc6211f8d891bc32ba13b3 May 26 16:13:00.803853 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:00.803817 2560 generic.go:358] "Generic (PLEG): container finished" podID="b82837e0-0463-44d8-8da8-78773446f17f" containerID="12228d1cc1e5bcff3c1e077666a1aa78959ad023b63de13fe8f366ecf91b387c" exitCode=0 May 26 16:13:00.804006 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:00.803913 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b82837e0-0463-44d8-8da8-78773446f17f","Type":"ContainerDied","Data":"12228d1cc1e5bcff3c1e077666a1aa78959ad023b63de13fe8f366ecf91b387c"} May 26 16:13:00.804006 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:00.803947 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b82837e0-0463-44d8-8da8-78773446f17f","Type":"ContainerStarted","Data":"367c629856bea823c5da3c5a1d37eb07d5d41fa0b0bc6211f8d891bc32ba13b3"} May 26 16:13:01.809538 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:01.809492 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b82837e0-0463-44d8-8da8-78773446f17f","Type":"ContainerStarted","Data":"5943b6d6280fe4428556e00e463c3f4608ad4ea5eb49777c247f66f85f269a1b"} May 26 16:13:01.809538 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:01.809541 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b82837e0-0463-44d8-8da8-78773446f17f","Type":"ContainerStarted","Data":"8aa082631ef7669e709f17fd9e0ef0378d60eb40a0b87a6e68e7e2c546effe94"} May 26 16:13:01.809946 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:01.809555 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b82837e0-0463-44d8-8da8-78773446f17f","Type":"ContainerStarted","Data":"9e300dbc469405a5f958d8695c518c4a52523c5cc93bd83b1b8e04734a979ecd"} May 26 16:13:01.809946 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:01.809568 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b82837e0-0463-44d8-8da8-78773446f17f","Type":"ContainerStarted","Data":"9b469754fb036149852ba46e32ec0545b1934ad25313bc21ee0d9ff3804eb382"} May 26 16:13:01.809946 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:01.809580 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b82837e0-0463-44d8-8da8-78773446f17f","Type":"ContainerStarted","Data":"1d285615c5ee0d80a3be59b0b596a6c6d1320cbc75ba17a215cddede782bfe23"} May 26 16:13:01.809946 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:01.809592 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b82837e0-0463-44d8-8da8-78773446f17f","Type":"ContainerStarted","Data":"0b895f7456bf7ba1665c695cd7411026e4234f3a536a193f8a869e20a2b1e0e1"} May 26 16:13:01.842265 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:01.842220 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.8422051489999998 podStartE2EDuration="2.842205149s" podCreationTimestamp="2026-05-26 16:12:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 16:13:01.840196815 +0000 UTC m=+272.370690423" watchObservedRunningTime="2026-05-26 16:13:01.842205149 +0000 UTC m=+272.372698757" May 26 16:13:05.184553 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:05.184504 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 26 16:13:29.876535 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:29.876506 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-sjdlv_c7a1e813-7c0b-4f31-8ba2-1204fefee3e3/console-operator/1.log" May 26 16:13:29.878724 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:29.878700 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-sjdlv_c7a1e813-7c0b-4f31-8ba2-1204fefee3e3/console-operator/1.log" May 26 16:13:29.886719 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:13:29.886696 2560 kubelet.go:1628] "Image garbage collection succeeded" May 26 16:14:00.183712 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:14:00.183674 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 26 16:14:00.198850 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:14:00.198821 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 26 16:14:00.991745 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:14:00.991714 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 26 16:15:00.500098 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:00.500061 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-575f8499b5-5xnh6"] May 26 16:15:00.503340 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:00.503324 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-575f8499b5-5xnh6" May 26 16:15:00.507632 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:00.507295 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 26 16:15:00.507632 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:00.507333 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 26 16:15:00.507632 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:00.507350 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-gsvbg\"" May 26 16:15:00.507632 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:00.507359 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 26 16:15:00.507632 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:00.507380 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 26 16:15:00.507632 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:00.507333 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 26 16:15:00.512851 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:00.512831 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-575f8499b5-5xnh6"] May 26 16:15:00.633081 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:00.633040 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jchm9\" (UniqueName: \"kubernetes.io/projected/2f813d63-518c-4f79-8a4b-3f055b8ff841-kube-api-access-jchm9\") pod \"lws-controller-manager-575f8499b5-5xnh6\" (UID: \"2f813d63-518c-4f79-8a4b-3f055b8ff841\") " pod="openshift-lws-operator/lws-controller-manager-575f8499b5-5xnh6" May 26 16:15:00.633258 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:00.633113 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2f813d63-518c-4f79-8a4b-3f055b8ff841-manager-config\") pod \"lws-controller-manager-575f8499b5-5xnh6\" (UID: \"2f813d63-518c-4f79-8a4b-3f055b8ff841\") " pod="openshift-lws-operator/lws-controller-manager-575f8499b5-5xnh6" May 26 16:15:00.633258 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:00.633140 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2f813d63-518c-4f79-8a4b-3f055b8ff841-cert\") pod \"lws-controller-manager-575f8499b5-5xnh6\" (UID: \"2f813d63-518c-4f79-8a4b-3f055b8ff841\") " pod="openshift-lws-operator/lws-controller-manager-575f8499b5-5xnh6" May 26 16:15:00.633258 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:00.633175 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2f813d63-518c-4f79-8a4b-3f055b8ff841-metrics-cert\") pod \"lws-controller-manager-575f8499b5-5xnh6\" (UID: \"2f813d63-518c-4f79-8a4b-3f055b8ff841\") " pod="openshift-lws-operator/lws-controller-manager-575f8499b5-5xnh6" May 26 16:15:00.733890 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:00.733854 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2f813d63-518c-4f79-8a4b-3f055b8ff841-manager-config\") pod \"lws-controller-manager-575f8499b5-5xnh6\" (UID: \"2f813d63-518c-4f79-8a4b-3f055b8ff841\") " pod="openshift-lws-operator/lws-controller-manager-575f8499b5-5xnh6" May 26 16:15:00.733890 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:00.733895 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2f813d63-518c-4f79-8a4b-3f055b8ff841-cert\") pod \"lws-controller-manager-575f8499b5-5xnh6\" (UID: \"2f813d63-518c-4f79-8a4b-3f055b8ff841\") " pod="openshift-lws-operator/lws-controller-manager-575f8499b5-5xnh6" May 26 16:15:00.734134 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:00.733936 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2f813d63-518c-4f79-8a4b-3f055b8ff841-metrics-cert\") pod \"lws-controller-manager-575f8499b5-5xnh6\" (UID: \"2f813d63-518c-4f79-8a4b-3f055b8ff841\") " pod="openshift-lws-operator/lws-controller-manager-575f8499b5-5xnh6" May 26 16:15:00.734134 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:00.733971 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jchm9\" (UniqueName: \"kubernetes.io/projected/2f813d63-518c-4f79-8a4b-3f055b8ff841-kube-api-access-jchm9\") pod \"lws-controller-manager-575f8499b5-5xnh6\" (UID: \"2f813d63-518c-4f79-8a4b-3f055b8ff841\") " pod="openshift-lws-operator/lws-controller-manager-575f8499b5-5xnh6" May 26 16:15:00.734578 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:00.734556 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2f813d63-518c-4f79-8a4b-3f055b8ff841-manager-config\") pod \"lws-controller-manager-575f8499b5-5xnh6\" (UID: \"2f813d63-518c-4f79-8a4b-3f055b8ff841\") " pod="openshift-lws-operator/lws-controller-manager-575f8499b5-5xnh6" May 26 16:15:00.736378 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:00.736357 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2f813d63-518c-4f79-8a4b-3f055b8ff841-metrics-cert\") pod \"lws-controller-manager-575f8499b5-5xnh6\" (UID: \"2f813d63-518c-4f79-8a4b-3f055b8ff841\") " pod="openshift-lws-operator/lws-controller-manager-575f8499b5-5xnh6" May 26 16:15:00.736476 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:00.736448 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2f813d63-518c-4f79-8a4b-3f055b8ff841-cert\") pod \"lws-controller-manager-575f8499b5-5xnh6\" (UID: \"2f813d63-518c-4f79-8a4b-3f055b8ff841\") " pod="openshift-lws-operator/lws-controller-manager-575f8499b5-5xnh6" May 26 16:15:00.745999 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:00.745968 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jchm9\" (UniqueName: \"kubernetes.io/projected/2f813d63-518c-4f79-8a4b-3f055b8ff841-kube-api-access-jchm9\") pod \"lws-controller-manager-575f8499b5-5xnh6\" (UID: \"2f813d63-518c-4f79-8a4b-3f055b8ff841\") " pod="openshift-lws-operator/lws-controller-manager-575f8499b5-5xnh6" May 26 16:15:00.813083 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:00.812991 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-575f8499b5-5xnh6" May 26 16:15:00.945950 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:00.945925 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-575f8499b5-5xnh6"] May 26 16:15:00.948407 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:15:00.948379 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f813d63_518c_4f79_8a4b_3f055b8ff841.slice/crio-ee684040b4e7f848c5e8ea0e2a19bc8e36df3be25644f8da644913b051a96c90 WatchSource:0}: Error finding container ee684040b4e7f848c5e8ea0e2a19bc8e36df3be25644f8da644913b051a96c90: Status 404 returned error can't find the container with id ee684040b4e7f848c5e8ea0e2a19bc8e36df3be25644f8da644913b051a96c90 May 26 16:15:00.950144 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:00.950128 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 26 16:15:01.150733 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:01.150632 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-575f8499b5-5xnh6" event={"ID":"2f813d63-518c-4f79-8a4b-3f055b8ff841","Type":"ContainerStarted","Data":"ee684040b4e7f848c5e8ea0e2a19bc8e36df3be25644f8da644913b051a96c90"} May 26 16:15:04.161322 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:04.161233 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-575f8499b5-5xnh6" event={"ID":"2f813d63-518c-4f79-8a4b-3f055b8ff841","Type":"ContainerStarted","Data":"360afbfd748233a7a448d70470e9539196eac719e364af6a95918854531b17a4"} May 26 16:15:04.161751 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:04.161343 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-575f8499b5-5xnh6" May 26 16:15:04.183900 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:04.183846 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-575f8499b5-5xnh6" podStartSLOduration=1.39053845 podStartE2EDuration="4.183830441s" podCreationTimestamp="2026-05-26 16:15:00 +0000 UTC" firstStartedPulling="2026-05-26 16:15:00.950257352 +0000 UTC m=+391.480750938" lastFinishedPulling="2026-05-26 16:15:03.74354934 +0000 UTC m=+394.274042929" observedRunningTime="2026-05-26 16:15:04.182456373 +0000 UTC m=+394.712949983" watchObservedRunningTime="2026-05-26 16:15:04.183830441 +0000 UTC m=+394.714324049" May 26 16:15:06.207814 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:06.207781 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74889b64d-kphlf"] May 26 16:15:06.210858 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:06.210842 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74889b64d-kphlf" May 26 16:15:06.213617 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:06.213593 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 26 16:15:06.213761 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:06.213704 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4wsd7\"" May 26 16:15:06.213761 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:06.213718 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 26 16:15:06.213761 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:06.213724 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 26 16:15:06.214028 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:06.214015 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 26 16:15:06.223115 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:06.223095 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74889b64d-kphlf"] May 26 16:15:06.290009 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:06.289971 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8aad3b8b-c38c-465e-be8e-dd7a4008ac9b-webhook-cert\") pod \"opendatahub-operator-controller-manager-74889b64d-kphlf\" (UID: \"8aad3b8b-c38c-465e-be8e-dd7a4008ac9b\") " pod="opendatahub/opendatahub-operator-controller-manager-74889b64d-kphlf" May 26 16:15:06.290177 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:06.290024 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bndbv\" (UniqueName: \"kubernetes.io/projected/8aad3b8b-c38c-465e-be8e-dd7a4008ac9b-kube-api-access-bndbv\") pod \"opendatahub-operator-controller-manager-74889b64d-kphlf\" (UID: \"8aad3b8b-c38c-465e-be8e-dd7a4008ac9b\") " pod="opendatahub/opendatahub-operator-controller-manager-74889b64d-kphlf" May 26 16:15:06.290177 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:06.290075 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8aad3b8b-c38c-465e-be8e-dd7a4008ac9b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74889b64d-kphlf\" (UID: \"8aad3b8b-c38c-465e-be8e-dd7a4008ac9b\") " pod="opendatahub/opendatahub-operator-controller-manager-74889b64d-kphlf" May 26 16:15:06.391190 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:06.391157 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8aad3b8b-c38c-465e-be8e-dd7a4008ac9b-webhook-cert\") pod \"opendatahub-operator-controller-manager-74889b64d-kphlf\" (UID: \"8aad3b8b-c38c-465e-be8e-dd7a4008ac9b\") " pod="opendatahub/opendatahub-operator-controller-manager-74889b64d-kphlf" May 26 16:15:06.391335 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:06.391199 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bndbv\" (UniqueName: \"kubernetes.io/projected/8aad3b8b-c38c-465e-be8e-dd7a4008ac9b-kube-api-access-bndbv\") pod \"opendatahub-operator-controller-manager-74889b64d-kphlf\" (UID: \"8aad3b8b-c38c-465e-be8e-dd7a4008ac9b\") " pod="opendatahub/opendatahub-operator-controller-manager-74889b64d-kphlf" May 26 16:15:06.391335 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:06.391226 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8aad3b8b-c38c-465e-be8e-dd7a4008ac9b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74889b64d-kphlf\" (UID: \"8aad3b8b-c38c-465e-be8e-dd7a4008ac9b\") " pod="opendatahub/opendatahub-operator-controller-manager-74889b64d-kphlf" May 26 16:15:06.393583 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:06.393557 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8aad3b8b-c38c-465e-be8e-dd7a4008ac9b-webhook-cert\") pod \"opendatahub-operator-controller-manager-74889b64d-kphlf\" (UID: \"8aad3b8b-c38c-465e-be8e-dd7a4008ac9b\") " pod="opendatahub/opendatahub-operator-controller-manager-74889b64d-kphlf" May 26 16:15:06.393677 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:06.393579 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8aad3b8b-c38c-465e-be8e-dd7a4008ac9b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74889b64d-kphlf\" (UID: \"8aad3b8b-c38c-465e-be8e-dd7a4008ac9b\") " pod="opendatahub/opendatahub-operator-controller-manager-74889b64d-kphlf" May 26 16:15:06.408513 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:06.407947 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bndbv\" (UniqueName: \"kubernetes.io/projected/8aad3b8b-c38c-465e-be8e-dd7a4008ac9b-kube-api-access-bndbv\") pod \"opendatahub-operator-controller-manager-74889b64d-kphlf\" (UID: \"8aad3b8b-c38c-465e-be8e-dd7a4008ac9b\") " pod="opendatahub/opendatahub-operator-controller-manager-74889b64d-kphlf" May 26 16:15:06.520899 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:06.520795 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74889b64d-kphlf" May 26 16:15:06.653857 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:06.653771 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74889b64d-kphlf"] May 26 16:15:06.656136 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:15:06.656103 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8aad3b8b_c38c_465e_be8e_dd7a4008ac9b.slice/crio-13e31c485ef3db9a086b5bfe72cd71411ea6910f5cd4540add12e17e653187db WatchSource:0}: Error finding container 13e31c485ef3db9a086b5bfe72cd71411ea6910f5cd4540add12e17e653187db: Status 404 returned error can't find the container with id 13e31c485ef3db9a086b5bfe72cd71411ea6910f5cd4540add12e17e653187db May 26 16:15:07.171693 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:07.171657 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74889b64d-kphlf" event={"ID":"8aad3b8b-c38c-465e-be8e-dd7a4008ac9b","Type":"ContainerStarted","Data":"13e31c485ef3db9a086b5bfe72cd71411ea6910f5cd4540add12e17e653187db"} May 26 16:15:10.186026 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:10.185989 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74889b64d-kphlf" event={"ID":"8aad3b8b-c38c-465e-be8e-dd7a4008ac9b","Type":"ContainerStarted","Data":"25a353c668910651b5a7edd3c8d22f1941bd4e8f3c85e46760af84e0f71840f9"} May 26 16:15:10.186459 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:10.186239 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-74889b64d-kphlf" May 26 16:15:10.212065 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:10.212015 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-74889b64d-kphlf" podStartSLOduration=1.54847051 podStartE2EDuration="4.2119994s" podCreationTimestamp="2026-05-26 16:15:06 +0000 UTC" firstStartedPulling="2026-05-26 16:15:06.657852592 +0000 UTC m=+397.188346177" lastFinishedPulling="2026-05-26 16:15:09.321381462 +0000 UTC m=+399.851875067" observedRunningTime="2026-05-26 16:15:10.210162733 +0000 UTC m=+400.740656340" watchObservedRunningTime="2026-05-26 16:15:10.2119994 +0000 UTC m=+400.742493009" May 26 16:15:15.166578 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:15.166545 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-575f8499b5-5xnh6" May 26 16:15:21.191659 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:15:21.191629 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-74889b64d-kphlf" May 26 16:16:11.068737 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:11.068706 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t"] May 26 16:16:11.072221 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:11.072197 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t" May 26 16:16:11.075062 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:11.075022 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-cwsf4\"" May 26 16:16:11.075486 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:11.075468 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 26 16:16:11.083479 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:11.082759 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t"] May 26 16:16:11.131802 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:11.131749 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cb0eb4c-2958-49a9-a9a8-8889129d3381-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t\" (UID: \"1cb0eb4c-2958-49a9-a9a8-8889129d3381\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t" May 26 16:16:11.131802 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:11.131816 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cb0eb4c-2958-49a9-a9a8-8889129d3381-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t\" (UID: \"1cb0eb4c-2958-49a9-a9a8-8889129d3381\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t" May 26 16:16:11.132061 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:11.131859 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cb0eb4c-2958-49a9-a9a8-8889129d3381-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t\" (UID: \"1cb0eb4c-2958-49a9-a9a8-8889129d3381\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t" May 26 16:16:11.132061 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:11.131901 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49vsv\" (UniqueName: \"kubernetes.io/projected/1cb0eb4c-2958-49a9-a9a8-8889129d3381-kube-api-access-49vsv\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t\" (UID: \"1cb0eb4c-2958-49a9-a9a8-8889129d3381\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t" May 26 16:16:11.132061 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:11.131923 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cb0eb4c-2958-49a9-a9a8-8889129d3381-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t\" (UID: \"1cb0eb4c-2958-49a9-a9a8-8889129d3381\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t" May 26 16:16:11.132061 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:11.131953 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cb0eb4c-2958-49a9-a9a8-8889129d3381-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t\" (UID: \"1cb0eb4c-2958-49a9-a9a8-8889129d3381\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t" May 26 16:16:11.132061 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:11.131969 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cb0eb4c-2958-49a9-a9a8-8889129d3381-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t\" (UID: \"1cb0eb4c-2958-49a9-a9a8-8889129d3381\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t" May 26 16:16:11.132061 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:11.132049 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cb0eb4c-2958-49a9-a9a8-8889129d3381-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t\" (UID: \"1cb0eb4c-2958-49a9-a9a8-8889129d3381\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t" May 26 16:16:11.132409 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:11.132105 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cb0eb4c-2958-49a9-a9a8-8889129d3381-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t\" (UID: \"1cb0eb4c-2958-49a9-a9a8-8889129d3381\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t" May 26 16:16:11.232875 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:11.232825 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cb0eb4c-2958-49a9-a9a8-8889129d3381-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t\" (UID: \"1cb0eb4c-2958-49a9-a9a8-8889129d3381\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t" May 26 16:16:11.233051 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:11.232903 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cb0eb4c-2958-49a9-a9a8-8889129d3381-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t\" (UID: \"1cb0eb4c-2958-49a9-a9a8-8889129d3381\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t" May 26 16:16:11.233051 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:11.232933 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-49vsv\" (UniqueName: \"kubernetes.io/projected/1cb0eb4c-2958-49a9-a9a8-8889129d3381-kube-api-access-49vsv\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t\" (UID: \"1cb0eb4c-2958-49a9-a9a8-8889129d3381\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t" May 26 16:16:11.233051 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:11.232961 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cb0eb4c-2958-49a9-a9a8-8889129d3381-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t\" (UID: \"1cb0eb4c-2958-49a9-a9a8-8889129d3381\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t" May 26 16:16:11.233051 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:11.232998 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cb0eb4c-2958-49a9-a9a8-8889129d3381-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t\" (UID: \"1cb0eb4c-2958-49a9-a9a8-8889129d3381\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t" May 26 16:16:11.233051 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:11.233026 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cb0eb4c-2958-49a9-a9a8-8889129d3381-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t\" (UID: \"1cb0eb4c-2958-49a9-a9a8-8889129d3381\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t" May 26 16:16:11.233329 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:11.233090 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cb0eb4c-2958-49a9-a9a8-8889129d3381-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t\" (UID: \"1cb0eb4c-2958-49a9-a9a8-8889129d3381\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t" May 26 16:16:11.233329 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:11.233139 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cb0eb4c-2958-49a9-a9a8-8889129d3381-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t\" (UID: \"1cb0eb4c-2958-49a9-a9a8-8889129d3381\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t" May 26 16:16:11.233329 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:11.233176 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cb0eb4c-2958-49a9-a9a8-8889129d3381-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t\" (UID: \"1cb0eb4c-2958-49a9-a9a8-8889129d3381\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t" May 26 16:16:11.233329 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:11.233306 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cb0eb4c-2958-49a9-a9a8-8889129d3381-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t\" (UID: \"1cb0eb4c-2958-49a9-a9a8-8889129d3381\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t" May 26 16:16:11.233569 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:11.233381 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cb0eb4c-2958-49a9-a9a8-8889129d3381-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t\" (UID: \"1cb0eb4c-2958-49a9-a9a8-8889129d3381\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t" May 26 16:16:11.233629 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:11.233588 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cb0eb4c-2958-49a9-a9a8-8889129d3381-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t\" (UID: \"1cb0eb4c-2958-49a9-a9a8-8889129d3381\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t" May 26 16:16:11.233728 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:11.233709 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cb0eb4c-2958-49a9-a9a8-8889129d3381-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t\" (UID: \"1cb0eb4c-2958-49a9-a9a8-8889129d3381\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t" May 26 16:16:11.233862 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:11.233843 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cb0eb4c-2958-49a9-a9a8-8889129d3381-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t\" (UID: \"1cb0eb4c-2958-49a9-a9a8-8889129d3381\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t" May 26 16:16:11.235821 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:11.235797 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cb0eb4c-2958-49a9-a9a8-8889129d3381-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t\" (UID: \"1cb0eb4c-2958-49a9-a9a8-8889129d3381\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t" May 26 16:16:11.236067 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:11.236045 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cb0eb4c-2958-49a9-a9a8-8889129d3381-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t\" (UID: \"1cb0eb4c-2958-49a9-a9a8-8889129d3381\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t" May 26 16:16:11.244983 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:11.244955 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cb0eb4c-2958-49a9-a9a8-8889129d3381-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t\" (UID: \"1cb0eb4c-2958-49a9-a9a8-8889129d3381\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t" May 26 16:16:11.245081 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:11.245062 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49vsv\" (UniqueName: \"kubernetes.io/projected/1cb0eb4c-2958-49a9-a9a8-8889129d3381-kube-api-access-49vsv\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t\" (UID: \"1cb0eb4c-2958-49a9-a9a8-8889129d3381\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t" May 26 16:16:11.386839 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:11.386754 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t" May 26 16:16:11.521371 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:11.521205 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t"] May 26 16:16:11.524098 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:16:11.524070 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cb0eb4c_2958_49a9_a9a8_8889129d3381.slice/crio-272faeb2e20be48ff30a4db3b7c2c644c319a84893f6b36187762fa8627ca6f0 WatchSource:0}: Error finding container 272faeb2e20be48ff30a4db3b7c2c644c319a84893f6b36187762fa8627ca6f0: Status 404 returned error can't find the container with id 272faeb2e20be48ff30a4db3b7c2c644c319a84893f6b36187762fa8627ca6f0 May 26 16:16:12.379783 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:12.379748 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t" event={"ID":"1cb0eb4c-2958-49a9-a9a8-8889129d3381","Type":"ContainerStarted","Data":"272faeb2e20be48ff30a4db3b7c2c644c319a84893f6b36187762fa8627ca6f0"} May 26 16:16:14.114469 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:14.114406 2560 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} May 26 16:16:14.114729 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:14.114505 2560 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} May 26 16:16:14.114729 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:14.114535 2560 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} May 26 16:16:14.388265 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:14.388162 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t" event={"ID":"1cb0eb4c-2958-49a9-a9a8-8889129d3381","Type":"ContainerStarted","Data":"7cafe81a7b375dbe971226b894c0dc9d883300cfb64d092e127be9ab76f9bc8a"} May 26 16:16:14.411245 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:14.411185 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t" podStartSLOduration=0.823088505 podStartE2EDuration="3.411167936s" podCreationTimestamp="2026-05-26 16:16:11 +0000 UTC" firstStartedPulling="2026-05-26 16:16:11.526067769 +0000 UTC m=+462.056561355" lastFinishedPulling="2026-05-26 16:16:14.1141472 +0000 UTC m=+464.644640786" observedRunningTime="2026-05-26 16:16:14.409174208 +0000 UTC m=+464.939667815" watchObservedRunningTime="2026-05-26 16:16:14.411167936 +0000 UTC m=+464.941661545" May 26 16:16:15.387313 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:15.387277 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t" May 26 16:16:15.392056 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:15.392029 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t" May 26 16:16:16.393990 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:16.393957 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t" May 26 16:16:16.395001 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:16.394984 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t" May 26 16:16:24.947301 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:24.947260 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fxmvr"] May 26 16:16:24.950753 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:24.950732 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fxmvr" May 26 16:16:24.953306 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:24.953283 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 26 16:16:24.953422 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:24.953285 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-44qbb\"" May 26 16:16:24.953422 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:24.953349 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 26 16:16:24.961504 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:24.961480 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fxmvr"] May 26 16:16:25.052998 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:25.052958 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpkqg\" (UniqueName: \"kubernetes.io/projected/bced1469-29b0-4192-a696-95cb5008ae81-kube-api-access-fpkqg\") pod \"kuadrant-operator-catalog-fxmvr\" (UID: \"bced1469-29b0-4192-a696-95cb5008ae81\") " pod="kuadrant-system/kuadrant-operator-catalog-fxmvr" May 26 16:16:25.154200 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:25.154159 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fpkqg\" (UniqueName: \"kubernetes.io/projected/bced1469-29b0-4192-a696-95cb5008ae81-kube-api-access-fpkqg\") pod \"kuadrant-operator-catalog-fxmvr\" (UID: \"bced1469-29b0-4192-a696-95cb5008ae81\") " pod="kuadrant-system/kuadrant-operator-catalog-fxmvr" May 26 16:16:25.167829 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:25.167806 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpkqg\" (UniqueName: \"kubernetes.io/projected/bced1469-29b0-4192-a696-95cb5008ae81-kube-api-access-fpkqg\") pod \"kuadrant-operator-catalog-fxmvr\" (UID: \"bced1469-29b0-4192-a696-95cb5008ae81\") " pod="kuadrant-system/kuadrant-operator-catalog-fxmvr" May 26 16:16:25.260337 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:25.260253 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fxmvr" May 26 16:16:25.302615 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:25.302577 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fxmvr"] May 26 16:16:25.385722 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:25.385594 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fxmvr"] May 26 16:16:25.388641 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:16:25.388619 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbced1469_29b0_4192_a696_95cb5008ae81.slice/crio-2d827ab0adc3aaad76f82870707c41fcfb9aef3d4d23d1d592d6c24f2ad78f41 WatchSource:0}: Error finding container 2d827ab0adc3aaad76f82870707c41fcfb9aef3d4d23d1d592d6c24f2ad78f41: Status 404 returned error can't find the container with id 2d827ab0adc3aaad76f82870707c41fcfb9aef3d4d23d1d592d6c24f2ad78f41 May 26 16:16:25.422597 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:25.422566 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fxmvr" event={"ID":"bced1469-29b0-4192-a696-95cb5008ae81","Type":"ContainerStarted","Data":"2d827ab0adc3aaad76f82870707c41fcfb9aef3d4d23d1d592d6c24f2ad78f41"} May 26 16:16:25.511372 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:25.511285 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vcvq9"] May 26 16:16:25.515743 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:25.515721 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vcvq9" May 26 16:16:25.523335 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:25.523314 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vcvq9"] May 26 16:16:25.658728 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:25.658689 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtsfm\" (UniqueName: \"kubernetes.io/projected/ee89c22b-4665-4f23-81cb-ef38b3aef072-kube-api-access-qtsfm\") pod \"kuadrant-operator-catalog-vcvq9\" (UID: \"ee89c22b-4665-4f23-81cb-ef38b3aef072\") " pod="kuadrant-system/kuadrant-operator-catalog-vcvq9" May 26 16:16:25.759563 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:25.759523 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qtsfm\" (UniqueName: \"kubernetes.io/projected/ee89c22b-4665-4f23-81cb-ef38b3aef072-kube-api-access-qtsfm\") pod \"kuadrant-operator-catalog-vcvq9\" (UID: \"ee89c22b-4665-4f23-81cb-ef38b3aef072\") " pod="kuadrant-system/kuadrant-operator-catalog-vcvq9" May 26 16:16:25.767885 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:25.767824 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtsfm\" (UniqueName: \"kubernetes.io/projected/ee89c22b-4665-4f23-81cb-ef38b3aef072-kube-api-access-qtsfm\") pod \"kuadrant-operator-catalog-vcvq9\" (UID: \"ee89c22b-4665-4f23-81cb-ef38b3aef072\") " pod="kuadrant-system/kuadrant-operator-catalog-vcvq9" May 26 16:16:25.826777 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:25.826736 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vcvq9" May 26 16:16:25.956598 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:25.956562 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vcvq9"] May 26 16:16:25.958693 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:16:25.958668 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee89c22b_4665_4f23_81cb_ef38b3aef072.slice/crio-fd6b7c09a634bac266c1010a5bf04b62e29035b3eb073d1f68fd1b92f8a6b676 WatchSource:0}: Error finding container fd6b7c09a634bac266c1010a5bf04b62e29035b3eb073d1f68fd1b92f8a6b676: Status 404 returned error can't find the container with id fd6b7c09a634bac266c1010a5bf04b62e29035b3eb073d1f68fd1b92f8a6b676 May 26 16:16:26.428385 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:26.428348 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vcvq9" event={"ID":"ee89c22b-4665-4f23-81cb-ef38b3aef072","Type":"ContainerStarted","Data":"fd6b7c09a634bac266c1010a5bf04b62e29035b3eb073d1f68fd1b92f8a6b676"} May 26 16:16:28.435674 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:28.435633 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fxmvr" event={"ID":"bced1469-29b0-4192-a696-95cb5008ae81","Type":"ContainerStarted","Data":"9059625f78433280007303199a3d51e8ade0d05bcaad010c64f96f0264e54f16"} May 26 16:16:28.436133 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:28.435716 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-fxmvr" podUID="bced1469-29b0-4192-a696-95cb5008ae81" containerName="registry-server" containerID="cri-o://9059625f78433280007303199a3d51e8ade0d05bcaad010c64f96f0264e54f16" gracePeriod=2 May 26 16:16:28.437011 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:28.436988 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vcvq9" event={"ID":"ee89c22b-4665-4f23-81cb-ef38b3aef072","Type":"ContainerStarted","Data":"9eb98bfb08e30440c2d450c4129f138ab7fe2f6df9acd47f3dd5bb522fa35134"} May 26 16:16:28.456540 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:28.456495 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-fxmvr" podStartSLOduration=1.92249017 podStartE2EDuration="4.456481281s" podCreationTimestamp="2026-05-26 16:16:24 +0000 UTC" firstStartedPulling="2026-05-26 16:16:25.390352957 +0000 UTC m=+475.920846547" lastFinishedPulling="2026-05-26 16:16:27.924344055 +0000 UTC m=+478.454837658" observedRunningTime="2026-05-26 16:16:28.454848481 +0000 UTC m=+478.985342088" watchObservedRunningTime="2026-05-26 16:16:28.456481281 +0000 UTC m=+478.986974889" May 26 16:16:28.473605 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:28.473554 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-vcvq9" podStartSLOduration=1.506136932 podStartE2EDuration="3.473536687s" podCreationTimestamp="2026-05-26 16:16:25 +0000 UTC" firstStartedPulling="2026-05-26 16:16:25.960143475 +0000 UTC m=+476.490637062" lastFinishedPulling="2026-05-26 16:16:27.927543218 +0000 UTC m=+478.458036817" observedRunningTime="2026-05-26 16:16:28.472638051 +0000 UTC m=+479.003131660" watchObservedRunningTime="2026-05-26 16:16:28.473536687 +0000 UTC m=+479.004030296" May 26 16:16:28.675213 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:28.675192 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fxmvr" May 26 16:16:28.788478 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:28.788437 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fpkqg\" (UniqueName: \"kubernetes.io/projected/bced1469-29b0-4192-a696-95cb5008ae81-kube-api-access-fpkqg\") pod \"bced1469-29b0-4192-a696-95cb5008ae81\" (UID: \"bced1469-29b0-4192-a696-95cb5008ae81\") " May 26 16:16:28.790578 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:28.790555 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bced1469-29b0-4192-a696-95cb5008ae81-kube-api-access-fpkqg" (OuterVolumeSpecName: "kube-api-access-fpkqg") pod "bced1469-29b0-4192-a696-95cb5008ae81" (UID: "bced1469-29b0-4192-a696-95cb5008ae81"). InnerVolumeSpecName "kube-api-access-fpkqg". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 16:16:28.890031 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:28.889993 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fpkqg\" (UniqueName: \"kubernetes.io/projected/bced1469-29b0-4192-a696-95cb5008ae81-kube-api-access-fpkqg\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" May 26 16:16:29.440972 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:29.440940 2560 generic.go:358] "Generic (PLEG): container finished" podID="bced1469-29b0-4192-a696-95cb5008ae81" containerID="9059625f78433280007303199a3d51e8ade0d05bcaad010c64f96f0264e54f16" exitCode=0 May 26 16:16:29.441381 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:29.440998 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fxmvr" May 26 16:16:29.441381 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:29.441021 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fxmvr" event={"ID":"bced1469-29b0-4192-a696-95cb5008ae81","Type":"ContainerDied","Data":"9059625f78433280007303199a3d51e8ade0d05bcaad010c64f96f0264e54f16"} May 26 16:16:29.441381 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:29.441057 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fxmvr" event={"ID":"bced1469-29b0-4192-a696-95cb5008ae81","Type":"ContainerDied","Data":"2d827ab0adc3aaad76f82870707c41fcfb9aef3d4d23d1d592d6c24f2ad78f41"} May 26 16:16:29.441381 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:29.441071 2560 scope.go:117] "RemoveContainer" containerID="9059625f78433280007303199a3d51e8ade0d05bcaad010c64f96f0264e54f16" May 26 16:16:29.449871 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:29.449856 2560 scope.go:117] "RemoveContainer" containerID="9059625f78433280007303199a3d51e8ade0d05bcaad010c64f96f0264e54f16" May 26 16:16:29.450096 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:16:29.450079 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9059625f78433280007303199a3d51e8ade0d05bcaad010c64f96f0264e54f16\": container with ID starting with 9059625f78433280007303199a3d51e8ade0d05bcaad010c64f96f0264e54f16 not found: ID does not exist" containerID="9059625f78433280007303199a3d51e8ade0d05bcaad010c64f96f0264e54f16" May 26 16:16:29.450154 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:29.450110 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9059625f78433280007303199a3d51e8ade0d05bcaad010c64f96f0264e54f16"} err="failed to get container status \"9059625f78433280007303199a3d51e8ade0d05bcaad010c64f96f0264e54f16\": rpc error: code = NotFound desc = could not find container \"9059625f78433280007303199a3d51e8ade0d05bcaad010c64f96f0264e54f16\": container with ID starting with 9059625f78433280007303199a3d51e8ade0d05bcaad010c64f96f0264e54f16 not found: ID does not exist" May 26 16:16:29.462786 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:29.462762 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fxmvr"] May 26 16:16:29.466297 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:29.466277 2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fxmvr"] May 26 16:16:30.008611 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:30.008580 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bced1469-29b0-4192-a696-95cb5008ae81" path="/var/lib/kubelet/pods/bced1469-29b0-4192-a696-95cb5008ae81/volumes" May 26 16:16:35.827213 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:35.827156 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-vcvq9" May 26 16:16:35.827759 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:35.827325 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-vcvq9" May 26 16:16:35.849732 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:35.849703 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-vcvq9" May 26 16:16:36.484533 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:36.484494 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-vcvq9" May 26 16:16:58.071199 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:58.071168 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-9lkj9"] May 26 16:16:58.071743 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:58.071552 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bced1469-29b0-4192-a696-95cb5008ae81" containerName="registry-server" May 26 16:16:58.071743 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:58.071565 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="bced1469-29b0-4192-a696-95cb5008ae81" containerName="registry-server" May 26 16:16:58.071743 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:58.071626 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="bced1469-29b0-4192-a696-95cb5008ae81" containerName="registry-server" May 26 16:16:58.081079 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:58.081053 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-9lkj9" May 26 16:16:58.083619 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:58.083591 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-9lkj9"] May 26 16:16:58.084236 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:58.084214 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-mln8g\"" May 26 16:16:58.136383 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:58.136351 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s69s2\" (UniqueName: \"kubernetes.io/projected/d5124bf7-d9cb-4f86-80b4-e8b6d84f6104-kube-api-access-s69s2\") pod \"authorino-operator-657f44b778-9lkj9\" (UID: \"d5124bf7-d9cb-4f86-80b4-e8b6d84f6104\") " pod="kuadrant-system/authorino-operator-657f44b778-9lkj9" May 26 16:16:58.237112 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:58.237064 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s69s2\" (UniqueName: \"kubernetes.io/projected/d5124bf7-d9cb-4f86-80b4-e8b6d84f6104-kube-api-access-s69s2\") pod \"authorino-operator-657f44b778-9lkj9\" (UID: \"d5124bf7-d9cb-4f86-80b4-e8b6d84f6104\") " pod="kuadrant-system/authorino-operator-657f44b778-9lkj9" May 26 16:16:58.246455 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:58.246404 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s69s2\" (UniqueName: \"kubernetes.io/projected/d5124bf7-d9cb-4f86-80b4-e8b6d84f6104-kube-api-access-s69s2\") pod \"authorino-operator-657f44b778-9lkj9\" (UID: \"d5124bf7-d9cb-4f86-80b4-e8b6d84f6104\") " pod="kuadrant-system/authorino-operator-657f44b778-9lkj9" May 26 16:16:58.392132 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:58.392042 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-9lkj9" May 26 16:16:58.519493 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:58.519461 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-9lkj9"] May 26 16:16:58.522711 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:16:58.522678 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5124bf7_d9cb_4f86_80b4_e8b6d84f6104.slice/crio-2d2bd6e259aa373b8cf82cdfa1a9317d4654be8111b6c09fe04e909898bad899 WatchSource:0}: Error finding container 2d2bd6e259aa373b8cf82cdfa1a9317d4654be8111b6c09fe04e909898bad899: Status 404 returned error can't find the container with id 2d2bd6e259aa373b8cf82cdfa1a9317d4654be8111b6c09fe04e909898bad899 May 26 16:16:58.532616 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:16:58.532585 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-9lkj9" event={"ID":"d5124bf7-d9cb-4f86-80b4-e8b6d84f6104","Type":"ContainerStarted","Data":"2d2bd6e259aa373b8cf82cdfa1a9317d4654be8111b6c09fe04e909898bad899"} May 26 16:17:01.546821 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:01.546783 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-9lkj9" event={"ID":"d5124bf7-d9cb-4f86-80b4-e8b6d84f6104","Type":"ContainerStarted","Data":"ef2aee469c6fdd443fa2b07350d2e90c78f0fbea0de8a845c0d53c0439a98836"} May 26 16:17:01.547200 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:01.546897 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-9lkj9" May 26 16:17:01.574565 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:01.574515 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-9lkj9" podStartSLOduration=1.182972596 podStartE2EDuration="3.574500133s" podCreationTimestamp="2026-05-26 16:16:58 +0000 UTC" firstStartedPulling="2026-05-26 16:16:58.524580637 +0000 UTC m=+509.055074223" lastFinishedPulling="2026-05-26 16:17:00.916108173 +0000 UTC m=+511.446601760" observedRunningTime="2026-05-26 16:17:01.573739142 +0000 UTC m=+512.104232750" watchObservedRunningTime="2026-05-26 16:17:01.574500133 +0000 UTC m=+512.104993740" May 26 16:17:08.057571 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:08.057538 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b8vdj"] May 26 16:17:08.059732 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:08.059715 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b8vdj" May 26 16:17:08.062254 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:08.062234 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-s2ppf\"" May 26 16:17:08.074373 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:08.074346 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b8vdj"] May 26 16:17:08.121357 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:08.121321 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9k4s\" (UniqueName: \"kubernetes.io/projected/abf6487f-532e-410a-b767-fb37c96642a1-kube-api-access-w9k4s\") pod \"limitador-operator-controller-manager-85c4996f8c-b8vdj\" (UID: \"abf6487f-532e-410a-b767-fb37c96642a1\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b8vdj" May 26 16:17:08.221802 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:08.221758 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w9k4s\" (UniqueName: \"kubernetes.io/projected/abf6487f-532e-410a-b767-fb37c96642a1-kube-api-access-w9k4s\") pod \"limitador-operator-controller-manager-85c4996f8c-b8vdj\" (UID: \"abf6487f-532e-410a-b767-fb37c96642a1\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b8vdj" May 26 16:17:08.230776 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:08.230745 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9k4s\" (UniqueName: \"kubernetes.io/projected/abf6487f-532e-410a-b767-fb37c96642a1-kube-api-access-w9k4s\") pod \"limitador-operator-controller-manager-85c4996f8c-b8vdj\" (UID: \"abf6487f-532e-410a-b767-fb37c96642a1\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b8vdj" May 26 16:17:08.376352 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:08.376259 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b8vdj" May 26 16:17:08.538177 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:08.538127 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b8vdj"] May 26 16:17:08.542709 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:17:08.542677 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabf6487f_532e_410a_b767_fb37c96642a1.slice/crio-d596486f62381a554cfb69fcfc626fc0ab8f0ecd80f82883d7df1b1538e67778 WatchSource:0}: Error finding container d596486f62381a554cfb69fcfc626fc0ab8f0ecd80f82883d7df1b1538e67778: Status 404 returned error can't find the container with id d596486f62381a554cfb69fcfc626fc0ab8f0ecd80f82883d7df1b1538e67778 May 26 16:17:08.569569 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:08.569534 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b8vdj" event={"ID":"abf6487f-532e-410a-b767-fb37c96642a1","Type":"ContainerStarted","Data":"d596486f62381a554cfb69fcfc626fc0ab8f0ecd80f82883d7df1b1538e67778"} May 26 16:17:10.576285 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:10.576243 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b8vdj" event={"ID":"abf6487f-532e-410a-b767-fb37c96642a1","Type":"ContainerStarted","Data":"d4615f858da41e12a3c45f1a726384d6c71415d250219a608162347192f61d84"} May 26 16:17:10.576626 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:10.576374 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b8vdj" May 26 16:17:10.598667 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:10.598597 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b8vdj" podStartSLOduration=0.631970981 podStartE2EDuration="2.598582613s" podCreationTimestamp="2026-05-26 16:17:08 +0000 UTC" firstStartedPulling="2026-05-26 16:17:08.544591986 +0000 UTC m=+519.075085573" lastFinishedPulling="2026-05-26 16:17:10.511203616 +0000 UTC m=+521.041697205" observedRunningTime="2026-05-26 16:17:10.597152227 +0000 UTC m=+521.127645829" watchObservedRunningTime="2026-05-26 16:17:10.598582613 +0000 UTC m=+521.129076221" May 26 16:17:12.551926 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:12.551896 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-9lkj9" May 26 16:17:21.581940 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:21.581863 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b8vdj" May 26 16:17:26.834436 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:26.834387 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b8vdj"] May 26 16:17:26.834808 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:26.834653 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b8vdj" podUID="abf6487f-532e-410a-b767-fb37c96642a1" containerName="manager" containerID="cri-o://d4615f858da41e12a3c45f1a726384d6c71415d250219a608162347192f61d84" gracePeriod=2 May 26 16:17:26.844244 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:26.844213 2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b8vdj"] May 26 16:17:26.883419 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:26.883383 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mrgkm"] May 26 16:17:26.883781 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:26.883764 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abf6487f-532e-410a-b767-fb37c96642a1" containerName="manager" May 26 16:17:26.883781 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:26.883780 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="abf6487f-532e-410a-b767-fb37c96642a1" containerName="manager" May 26 16:17:26.883977 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:26.883832 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="abf6487f-532e-410a-b767-fb37c96642a1" containerName="manager" May 26 16:17:26.886947 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:26.886921 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mrgkm" May 26 16:17:26.889584 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:26.889548 2560 status_manager.go:895] "Failed to get status for pod" podUID="abf6487f-532e-410a-b767-fb37c96642a1" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b8vdj" err="pods \"limitador-operator-controller-manager-85c4996f8c-b8vdj\" is forbidden: User \"system:node:ip-10-0-142-102.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-102.ec2.internal' and this object" May 26 16:17:26.905825 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:26.905794 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mrgkm"] May 26 16:17:26.992201 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:26.992164 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9pbj\" (UniqueName: \"kubernetes.io/projected/4893be95-dc64-442f-b3ff-71429354db30-kube-api-access-s9pbj\") pod \"limitador-operator-controller-manager-85c4996f8c-mrgkm\" (UID: \"4893be95-dc64-442f-b3ff-71429354db30\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mrgkm" May 26 16:17:27.074947 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:27.074923 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b8vdj" May 26 16:17:27.077390 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:27.077361 2560 status_manager.go:895] "Failed to get status for pod" podUID="abf6487f-532e-410a-b767-fb37c96642a1" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b8vdj" err="pods \"limitador-operator-controller-manager-85c4996f8c-b8vdj\" is forbidden: User \"system:node:ip-10-0-142-102.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-102.ec2.internal' and this object" May 26 16:17:27.092851 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:27.092790 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s9pbj\" (UniqueName: \"kubernetes.io/projected/4893be95-dc64-442f-b3ff-71429354db30-kube-api-access-s9pbj\") pod \"limitador-operator-controller-manager-85c4996f8c-mrgkm\" (UID: \"4893be95-dc64-442f-b3ff-71429354db30\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mrgkm" May 26 16:17:27.105314 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:27.105282 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9pbj\" (UniqueName: \"kubernetes.io/projected/4893be95-dc64-442f-b3ff-71429354db30-kube-api-access-s9pbj\") pod \"limitador-operator-controller-manager-85c4996f8c-mrgkm\" (UID: \"4893be95-dc64-442f-b3ff-71429354db30\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mrgkm" May 26 16:17:27.194217 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:27.194180 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w9k4s\" (UniqueName: \"kubernetes.io/projected/abf6487f-532e-410a-b767-fb37c96642a1-kube-api-access-w9k4s\") pod \"abf6487f-532e-410a-b767-fb37c96642a1\" (UID: \"abf6487f-532e-410a-b767-fb37c96642a1\") " May 26 16:17:27.196240 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:27.196215 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abf6487f-532e-410a-b767-fb37c96642a1-kube-api-access-w9k4s" (OuterVolumeSpecName: "kube-api-access-w9k4s") pod "abf6487f-532e-410a-b767-fb37c96642a1" (UID: "abf6487f-532e-410a-b767-fb37c96642a1"). InnerVolumeSpecName "kube-api-access-w9k4s". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 16:17:27.212423 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:27.212401 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mrgkm" May 26 16:17:27.295179 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:27.295139 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w9k4s\" (UniqueName: \"kubernetes.io/projected/abf6487f-532e-410a-b767-fb37c96642a1-kube-api-access-w9k4s\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" May 26 16:17:27.340746 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:27.340720 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mrgkm"] May 26 16:17:27.343671 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:17:27.343612 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4893be95_dc64_442f_b3ff_71429354db30.slice/crio-8dd7e6a3d12c9be8b7a75730afe7c300399878dbcad902f70525dbf29e2f3069 WatchSource:0}: Error finding container 8dd7e6a3d12c9be8b7a75730afe7c300399878dbcad902f70525dbf29e2f3069: Status 404 returned error can't find the container with id 8dd7e6a3d12c9be8b7a75730afe7c300399878dbcad902f70525dbf29e2f3069 May 26 16:17:27.632540 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:27.632444 2560 generic.go:358] "Generic (PLEG): container finished" podID="abf6487f-532e-410a-b767-fb37c96642a1" containerID="d4615f858da41e12a3c45f1a726384d6c71415d250219a608162347192f61d84" exitCode=0 May 26 16:17:27.632540 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:27.632494 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b8vdj" May 26 16:17:27.632540 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:27.632536 2560 scope.go:117] "RemoveContainer" containerID="d4615f858da41e12a3c45f1a726384d6c71415d250219a608162347192f61d84" May 26 16:17:27.634123 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:27.634098 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mrgkm" event={"ID":"4893be95-dc64-442f-b3ff-71429354db30","Type":"ContainerStarted","Data":"70ff07816f70976d82fdf851f795e3d47c5064161e15a2463da7a10b7cb4ac3c"} May 26 16:17:27.634239 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:27.634132 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mrgkm" event={"ID":"4893be95-dc64-442f-b3ff-71429354db30","Type":"ContainerStarted","Data":"8dd7e6a3d12c9be8b7a75730afe7c300399878dbcad902f70525dbf29e2f3069"} May 26 16:17:27.634280 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:27.634236 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mrgkm" May 26 16:17:27.635077 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:27.635053 2560 status_manager.go:895] "Failed to get status for pod" podUID="abf6487f-532e-410a-b767-fb37c96642a1" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b8vdj" err="pods \"limitador-operator-controller-manager-85c4996f8c-b8vdj\" is forbidden: User \"system:node:ip-10-0-142-102.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-102.ec2.internal' and this object" May 26 16:17:27.637145 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:27.637114 2560 status_manager.go:895] "Failed to get status for pod" podUID="abf6487f-532e-410a-b767-fb37c96642a1" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b8vdj" err="pods \"limitador-operator-controller-manager-85c4996f8c-b8vdj\" is forbidden: User \"system:node:ip-10-0-142-102.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-102.ec2.internal' and this object" May 26 16:17:27.641221 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:27.641188 2560 scope.go:117] "RemoveContainer" containerID="d4615f858da41e12a3c45f1a726384d6c71415d250219a608162347192f61d84" May 26 16:17:27.641476 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:17:27.641457 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4615f858da41e12a3c45f1a726384d6c71415d250219a608162347192f61d84\": container with ID starting with d4615f858da41e12a3c45f1a726384d6c71415d250219a608162347192f61d84 not found: ID does not exist" containerID="d4615f858da41e12a3c45f1a726384d6c71415d250219a608162347192f61d84" May 26 16:17:27.641595 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:27.641487 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4615f858da41e12a3c45f1a726384d6c71415d250219a608162347192f61d84"} err="failed to get container status \"d4615f858da41e12a3c45f1a726384d6c71415d250219a608162347192f61d84\": rpc error: code = NotFound desc = could not find container \"d4615f858da41e12a3c45f1a726384d6c71415d250219a608162347192f61d84\": container with ID starting with d4615f858da41e12a3c45f1a726384d6c71415d250219a608162347192f61d84 not found: ID does not exist" May 26 16:17:27.662762 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:27.662725 2560 status_manager.go:895] "Failed to get status for pod" podUID="abf6487f-532e-410a-b767-fb37c96642a1" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b8vdj" err="pods \"limitador-operator-controller-manager-85c4996f8c-b8vdj\" is forbidden: User \"system:node:ip-10-0-142-102.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-102.ec2.internal' and this object" May 26 16:17:27.662892 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:27.662782 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mrgkm" podStartSLOduration=1.6627702659999999 podStartE2EDuration="1.662770266s" podCreationTimestamp="2026-05-26 16:17:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 16:17:27.660808744 +0000 UTC m=+538.191302351" watchObservedRunningTime="2026-05-26 16:17:27.662770266 +0000 UTC m=+538.193263946" May 26 16:17:28.007284 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:28.007252 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abf6487f-532e-410a-b767-fb37c96642a1" path="/var/lib/kubelet/pods/abf6487f-532e-410a-b767-fb37c96642a1/volumes" May 26 16:17:38.640075 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:17:38.640042 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mrgkm" May 26 16:18:10.840862 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:18:10.840828 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:18:10.843330 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:18:10.843304 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-889q2" May 26 16:18:10.845860 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:18:10.845838 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 26 16:18:10.845957 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:18:10.845890 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-282kx\"" May 26 16:18:10.853204 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:18:10.853179 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:18:10.881920 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:18:10.881881 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:18:10.990720 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:18:10.990688 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7t4k\" (UniqueName: \"kubernetes.io/projected/af0c0b5e-2134-4bec-8472-5469f4c6501c-kube-api-access-g7t4k\") pod \"limitador-limitador-78c99df468-889q2\" (UID: \"af0c0b5e-2134-4bec-8472-5469f4c6501c\") " pod="kuadrant-system/limitador-limitador-78c99df468-889q2" May 26 16:18:10.990865 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:18:10.990729 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/af0c0b5e-2134-4bec-8472-5469f4c6501c-config-file\") pod \"limitador-limitador-78c99df468-889q2\" (UID: \"af0c0b5e-2134-4bec-8472-5469f4c6501c\") " pod="kuadrant-system/limitador-limitador-78c99df468-889q2" May 26 16:18:11.091405 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:18:11.091309 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g7t4k\" (UniqueName: \"kubernetes.io/projected/af0c0b5e-2134-4bec-8472-5469f4c6501c-kube-api-access-g7t4k\") pod \"limitador-limitador-78c99df468-889q2\" (UID: \"af0c0b5e-2134-4bec-8472-5469f4c6501c\") " pod="kuadrant-system/limitador-limitador-78c99df468-889q2" May 26 16:18:11.091405 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:18:11.091363 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/af0c0b5e-2134-4bec-8472-5469f4c6501c-config-file\") pod \"limitador-limitador-78c99df468-889q2\" (UID: \"af0c0b5e-2134-4bec-8472-5469f4c6501c\") " pod="kuadrant-system/limitador-limitador-78c99df468-889q2" May 26 16:18:11.091971 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:18:11.091953 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/af0c0b5e-2134-4bec-8472-5469f4c6501c-config-file\") pod \"limitador-limitador-78c99df468-889q2\" (UID: \"af0c0b5e-2134-4bec-8472-5469f4c6501c\") " pod="kuadrant-system/limitador-limitador-78c99df468-889q2" May 26 16:18:11.101507 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:18:11.101476 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7t4k\" (UniqueName: \"kubernetes.io/projected/af0c0b5e-2134-4bec-8472-5469f4c6501c-kube-api-access-g7t4k\") pod \"limitador-limitador-78c99df468-889q2\" (UID: \"af0c0b5e-2134-4bec-8472-5469f4c6501c\") " pod="kuadrant-system/limitador-limitador-78c99df468-889q2" May 26 16:18:11.155026 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:18:11.154987 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-889q2" May 26 16:18:11.287945 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:18:11.287913 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:18:11.291338 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:18:11.291309 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf0c0b5e_2134_4bec_8472_5469f4c6501c.slice/crio-7bfe40ad6d071be6b8dde521359800d4ceb5fcdb718698b9ebd4df68b217384d WatchSource:0}: Error finding container 7bfe40ad6d071be6b8dde521359800d4ceb5fcdb718698b9ebd4df68b217384d: Status 404 returned error can't find the container with id 7bfe40ad6d071be6b8dde521359800d4ceb5fcdb718698b9ebd4df68b217384d May 26 16:18:11.786641 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:18:11.786532 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-889q2" event={"ID":"af0c0b5e-2134-4bec-8472-5469f4c6501c","Type":"ContainerStarted","Data":"7bfe40ad6d071be6b8dde521359800d4ceb5fcdb718698b9ebd4df68b217384d"} May 26 16:18:13.795879 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:18:13.795839 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-889q2" event={"ID":"af0c0b5e-2134-4bec-8472-5469f4c6501c","Type":"ContainerStarted","Data":"6cb18b6fe289dc15df522fef9696640b295590aeeb8db771a767661aa42ff387"} May 26 16:18:13.796280 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:18:13.795966 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-889q2" May 26 16:18:13.814592 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:18:13.814542 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-889q2" podStartSLOduration=1.45910593 podStartE2EDuration="3.814527912s" podCreationTimestamp="2026-05-26 16:18:10 +0000 UTC" firstStartedPulling="2026-05-26 16:18:11.293048111 +0000 UTC m=+581.823541698" lastFinishedPulling="2026-05-26 16:18:13.648470091 +0000 UTC m=+584.178963680" observedRunningTime="2026-05-26 16:18:13.812931937 +0000 UTC m=+584.343425546" watchObservedRunningTime="2026-05-26 16:18:13.814527912 +0000 UTC m=+584.345021558" May 26 16:18:24.800353 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:18:24.800318 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-889q2" May 26 16:18:29.903749 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:18:29.903722 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-sjdlv_c7a1e813-7c0b-4f31-8ba2-1204fefee3e3/console-operator/1.log" May 26 16:18:29.904204 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:18:29.903996 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-sjdlv_c7a1e813-7c0b-4f31-8ba2-1204fefee3e3/console-operator/1.log" May 26 16:18:41.306321 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:18:41.306286 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-54bb8fb568-q5d97"] May 26 16:18:41.308644 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:18:41.308628 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54bb8fb568-q5d97" May 26 16:18:41.311037 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:18:41.311017 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-dd8vp\"" May 26 16:18:41.319219 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:18:41.319196 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-54bb8fb568-q5d97"] May 26 16:18:41.356269 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:18:41.356231 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rt96f\" (UniqueName: \"kubernetes.io/projected/21e4e9ca-1d13-463d-8d81-f5242a6b4a73-kube-api-access-rt96f\") pod \"authorino-54bb8fb568-q5d97\" (UID: \"21e4e9ca-1d13-463d-8d81-f5242a6b4a73\") " pod="kuadrant-system/authorino-54bb8fb568-q5d97" May 26 16:18:41.405585 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:18:41.405550 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-54bb8fb568-q5d97"] May 26 16:18:41.405842 ip-10-0-142-102 kubenswrapper[2560]: E0526 16:18:41.405822 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-rt96f], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-54bb8fb568-q5d97" podUID="21e4e9ca-1d13-463d-8d81-f5242a6b4a73" May 26 16:18:41.456871 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:18:41.456837 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rt96f\" (UniqueName: \"kubernetes.io/projected/21e4e9ca-1d13-463d-8d81-f5242a6b4a73-kube-api-access-rt96f\") pod \"authorino-54bb8fb568-q5d97\" (UID: \"21e4e9ca-1d13-463d-8d81-f5242a6b4a73\") " pod="kuadrant-system/authorino-54bb8fb568-q5d97" May 26 16:18:41.465006 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:18:41.464975 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rt96f\" (UniqueName: \"kubernetes.io/projected/21e4e9ca-1d13-463d-8d81-f5242a6b4a73-kube-api-access-rt96f\") pod \"authorino-54bb8fb568-q5d97\" (UID: \"21e4e9ca-1d13-463d-8d81-f5242a6b4a73\") " pod="kuadrant-system/authorino-54bb8fb568-q5d97" May 26 16:18:41.895241 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:18:41.895208 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54bb8fb568-q5d97" May 26 16:18:41.900051 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:18:41.900031 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54bb8fb568-q5d97" May 26 16:18:41.960984 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:18:41.960949 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rt96f\" (UniqueName: \"kubernetes.io/projected/21e4e9ca-1d13-463d-8d81-f5242a6b4a73-kube-api-access-rt96f\") pod \"21e4e9ca-1d13-463d-8d81-f5242a6b4a73\" (UID: \"21e4e9ca-1d13-463d-8d81-f5242a6b4a73\") " May 26 16:18:41.963080 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:18:41.963047 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21e4e9ca-1d13-463d-8d81-f5242a6b4a73-kube-api-access-rt96f" (OuterVolumeSpecName: "kube-api-access-rt96f") pod "21e4e9ca-1d13-463d-8d81-f5242a6b4a73" (UID: "21e4e9ca-1d13-463d-8d81-f5242a6b4a73"). InnerVolumeSpecName "kube-api-access-rt96f". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 16:18:42.061845 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:18:42.061807 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rt96f\" (UniqueName: \"kubernetes.io/projected/21e4e9ca-1d13-463d-8d81-f5242a6b4a73-kube-api-access-rt96f\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" May 26 16:18:42.899033 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:18:42.898999 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54bb8fb568-q5d97" May 26 16:18:42.928231 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:18:42.928186 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-54bb8fb568-q5d97"] May 26 16:18:42.932226 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:18:42.932199 2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-54bb8fb568-q5d97"] May 26 16:18:44.007422 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:18:44.007386 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21e4e9ca-1d13-463d-8d81-f5242a6b4a73" path="/var/lib/kubelet/pods/21e4e9ca-1d13-463d-8d81-f5242a6b4a73/volumes" May 26 16:19:23.712284 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:19:23.712246 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:19:48.690761 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:19:48.690722 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:19:54.498503 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:19:54.498464 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:19:56.990212 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:19:56.990173 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:20:12.475906 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:20:12.475872 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n7hbc"] May 26 16:20:12.478377 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:20:12.478358 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n7hbc" May 26 16:20:12.480938 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:20:12.480911 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 26 16:20:12.482103 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:20:12.482080 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-jrr2g\"" May 26 16:20:12.482221 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:20:12.482138 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" May 26 16:20:12.482221 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:20:12.482213 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 26 16:20:12.488468 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:20:12.488442 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n7hbc"] May 26 16:20:12.554783 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:20:12.554754 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b70c03b-41c4-4c6a-94a6-59b04ab62887-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-n7hbc\" (UID: \"4b70c03b-41c4-4c6a-94a6-59b04ab62887\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n7hbc" May 26 16:20:12.554951 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:20:12.554805 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4b70c03b-41c4-4c6a-94a6-59b04ab62887-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-n7hbc\" (UID: \"4b70c03b-41c4-4c6a-94a6-59b04ab62887\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n7hbc" May 26 16:20:12.554951 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:20:12.554846 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b70c03b-41c4-4c6a-94a6-59b04ab62887-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-n7hbc\" (UID: \"4b70c03b-41c4-4c6a-94a6-59b04ab62887\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n7hbc" May 26 16:20:12.554951 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:20:12.554866 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b70c03b-41c4-4c6a-94a6-59b04ab62887-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-n7hbc\" (UID: \"4b70c03b-41c4-4c6a-94a6-59b04ab62887\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n7hbc" May 26 16:20:12.554951 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:20:12.554927 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcfzk\" (UniqueName: \"kubernetes.io/projected/4b70c03b-41c4-4c6a-94a6-59b04ab62887-kube-api-access-vcfzk\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-n7hbc\" (UID: \"4b70c03b-41c4-4c6a-94a6-59b04ab62887\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n7hbc" May 26 16:20:12.555087 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:20:12.554975 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b70c03b-41c4-4c6a-94a6-59b04ab62887-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-n7hbc\" (UID: \"4b70c03b-41c4-4c6a-94a6-59b04ab62887\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n7hbc" May 26 16:20:12.656248 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:20:12.656205 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b70c03b-41c4-4c6a-94a6-59b04ab62887-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-n7hbc\" (UID: \"4b70c03b-41c4-4c6a-94a6-59b04ab62887\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n7hbc" May 26 16:20:12.656491 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:20:12.656270 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b70c03b-41c4-4c6a-94a6-59b04ab62887-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-n7hbc\" (UID: \"4b70c03b-41c4-4c6a-94a6-59b04ab62887\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n7hbc" May 26 16:20:12.656491 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:20:12.656351 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4b70c03b-41c4-4c6a-94a6-59b04ab62887-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-n7hbc\" (UID: \"4b70c03b-41c4-4c6a-94a6-59b04ab62887\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n7hbc" May 26 16:20:12.656491 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:20:12.656389 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b70c03b-41c4-4c6a-94a6-59b04ab62887-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-n7hbc\" (UID: \"4b70c03b-41c4-4c6a-94a6-59b04ab62887\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n7hbc" May 26 16:20:12.656491 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:20:12.656420 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b70c03b-41c4-4c6a-94a6-59b04ab62887-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-n7hbc\" (UID: \"4b70c03b-41c4-4c6a-94a6-59b04ab62887\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n7hbc" May 26 16:20:12.656491 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:20:12.656489 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vcfzk\" (UniqueName: \"kubernetes.io/projected/4b70c03b-41c4-4c6a-94a6-59b04ab62887-kube-api-access-vcfzk\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-n7hbc\" (UID: \"4b70c03b-41c4-4c6a-94a6-59b04ab62887\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n7hbc" May 26 16:20:12.656869 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:20:12.656841 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b70c03b-41c4-4c6a-94a6-59b04ab62887-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-n7hbc\" (UID: \"4b70c03b-41c4-4c6a-94a6-59b04ab62887\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n7hbc" May 26 16:20:12.656953 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:20:12.656872 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4b70c03b-41c4-4c6a-94a6-59b04ab62887-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-n7hbc\" (UID: \"4b70c03b-41c4-4c6a-94a6-59b04ab62887\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n7hbc" May 26 16:20:12.656953 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:20:12.656913 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b70c03b-41c4-4c6a-94a6-59b04ab62887-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-n7hbc\" (UID: \"4b70c03b-41c4-4c6a-94a6-59b04ab62887\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n7hbc" May 26 16:20:12.659184 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:20:12.659156 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b70c03b-41c4-4c6a-94a6-59b04ab62887-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-n7hbc\" (UID: \"4b70c03b-41c4-4c6a-94a6-59b04ab62887\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n7hbc" May 26 16:20:12.659349 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:20:12.659333 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b70c03b-41c4-4c6a-94a6-59b04ab62887-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-n7hbc\" (UID: \"4b70c03b-41c4-4c6a-94a6-59b04ab62887\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n7hbc" May 26 16:20:12.664364 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:20:12.664345 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcfzk\" (UniqueName: \"kubernetes.io/projected/4b70c03b-41c4-4c6a-94a6-59b04ab62887-kube-api-access-vcfzk\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-n7hbc\" (UID: \"4b70c03b-41c4-4c6a-94a6-59b04ab62887\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n7hbc" May 26 16:20:12.789666 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:20:12.789572 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n7hbc" May 26 16:20:12.920915 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:20:12.920879 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n7hbc"] May 26 16:20:12.923412 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:20:12.923388 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b70c03b_41c4_4c6a_94a6_59b04ab62887.slice/crio-75049b73d5c9d75d749582460f0ab5e6b900e6ca7bf7ad776e4d85be54fe273b WatchSource:0}: Error finding container 75049b73d5c9d75d749582460f0ab5e6b900e6ca7bf7ad776e4d85be54fe273b: Status 404 returned error can't find the container with id 75049b73d5c9d75d749582460f0ab5e6b900e6ca7bf7ad776e4d85be54fe273b May 26 16:20:12.925505 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:20:12.925484 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 26 16:20:13.209652 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:20:13.209609 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n7hbc" event={"ID":"4b70c03b-41c4-4c6a-94a6-59b04ab62887","Type":"ContainerStarted","Data":"75049b73d5c9d75d749582460f0ab5e6b900e6ca7bf7ad776e4d85be54fe273b"} May 26 16:20:13.388271 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:20:13.388228 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:20:19.233916 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:20:19.233882 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n7hbc" event={"ID":"4b70c03b-41c4-4c6a-94a6-59b04ab62887","Type":"ContainerStarted","Data":"d3b863c9c51bb15b5de40b95d4a108108071ddd3e82860f72cde9315b4759e0f"} May 26 16:20:24.259154 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:20:24.259118 2560 generic.go:358] "Generic (PLEG): container finished" podID="4b70c03b-41c4-4c6a-94a6-59b04ab62887" containerID="d3b863c9c51bb15b5de40b95d4a108108071ddd3e82860f72cde9315b4759e0f" exitCode=0 May 26 16:20:24.259627 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:20:24.259192 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n7hbc" event={"ID":"4b70c03b-41c4-4c6a-94a6-59b04ab62887","Type":"ContainerDied","Data":"d3b863c9c51bb15b5de40b95d4a108108071ddd3e82860f72cde9315b4759e0f"} May 26 16:20:24.792147 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:20:24.792103 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:20:26.267811 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:20:26.267775 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n7hbc" event={"ID":"4b70c03b-41c4-4c6a-94a6-59b04ab62887","Type":"ContainerStarted","Data":"16a6e7dc81310bdc5e6a5b22875786d9c25f51908ae4a03cf01dafc6a41fe729"} May 26 16:20:26.268193 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:20:26.267982 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n7hbc" May 26 16:20:26.287128 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:20:26.287073 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n7hbc" podStartSLOduration=1.47577219 podStartE2EDuration="14.287055203s" podCreationTimestamp="2026-05-26 16:20:12 +0000 UTC" firstStartedPulling="2026-05-26 16:20:12.925617693 +0000 UTC m=+703.456111279" lastFinishedPulling="2026-05-26 16:20:25.736900704 +0000 UTC m=+716.267394292" observedRunningTime="2026-05-26 16:20:26.285899239 +0000 UTC m=+716.816392849" watchObservedRunningTime="2026-05-26 16:20:26.287055203 +0000 UTC m=+716.817548812" May 26 16:20:29.391569 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:20:29.391526 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:20:37.284180 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:20:37.284149 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-n7hbc" May 26 16:21:39.393799 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:21:39.393763 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:21:43.992317 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:21:43.992277 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:21:50.099455 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:21:50.099365 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:22:01.087418 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:22:01.087379 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:22:10.093948 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:22:10.093911 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:22:20.191678 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:22:20.191644 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:22:29.199176 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:22:29.199139 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:22:40.009864 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:22:40.009827 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:23:29.931867 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:23:29.931839 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-sjdlv_c7a1e813-7c0b-4f31-8ba2-1204fefee3e3/console-operator/1.log" May 26 16:23:29.932730 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:23:29.932705 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-sjdlv_c7a1e813-7c0b-4f31-8ba2-1204fefee3e3/console-operator/1.log" May 26 16:23:53.392304 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:23:53.392266 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:24:09.190466 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:24:09.190415 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:24:47.112671 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:24:47.112574 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:25:04.083051 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:25:04.083015 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:25:18.787853 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:25:18.787814 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:25:35.500304 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:25:35.500268 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:26:29.478918 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:26:29.478836 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:26:39.190323 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:26:39.190284 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:26:55.783830 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:26:55.783791 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:27:03.801706 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:27:03.801662 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:27:20.586227 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:27:20.586185 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:27:28.683218 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:27:28.683178 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:28:02.181903 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:28:02.181816 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:28:10.984545 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:28:10.984510 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:28:19.482063 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:28:19.482030 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:28:27.387292 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:28:27.387252 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:28:29.956349 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:28:29.956316 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-sjdlv_c7a1e813-7c0b-4f31-8ba2-1204fefee3e3/console-operator/1.log" May 26 16:28:29.957684 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:28:29.957662 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-sjdlv_c7a1e813-7c0b-4f31-8ba2-1204fefee3e3/console-operator/1.log" May 26 16:28:36.189170 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:28:36.189118 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:28:53.086094 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:28:53.086048 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:29:04.781713 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:29:04.781670 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:29:50.592343 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:29:50.592300 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:29:55.383000 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:29:55.382963 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:30:00.144573 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:30:00.144540 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29663550-s2c7w"] May 26 16:30:00.146648 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:30:00.146630 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29663550-s2c7w" May 26 16:30:00.149074 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:30:00.149053 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-z88xr\"" May 26 16:30:00.164900 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:30:00.164870 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29663550-s2c7w"] May 26 16:30:00.227856 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:30:00.227819 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px488\" (UniqueName: \"kubernetes.io/projected/0ff2df63-739f-485e-8a06-ded8126411d7-kube-api-access-px488\") pod \"maas-api-key-cleanup-29663550-s2c7w\" (UID: \"0ff2df63-739f-485e-8a06-ded8126411d7\") " pod="opendatahub/maas-api-key-cleanup-29663550-s2c7w" May 26 16:30:00.329001 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:30:00.328945 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-px488\" (UniqueName: \"kubernetes.io/projected/0ff2df63-739f-485e-8a06-ded8126411d7-kube-api-access-px488\") pod \"maas-api-key-cleanup-29663550-s2c7w\" (UID: \"0ff2df63-739f-485e-8a06-ded8126411d7\") " pod="opendatahub/maas-api-key-cleanup-29663550-s2c7w" May 26 16:30:00.339741 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:30:00.339702 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-px488\" (UniqueName: \"kubernetes.io/projected/0ff2df63-739f-485e-8a06-ded8126411d7-kube-api-access-px488\") pod \"maas-api-key-cleanup-29663550-s2c7w\" (UID: \"0ff2df63-739f-485e-8a06-ded8126411d7\") " pod="opendatahub/maas-api-key-cleanup-29663550-s2c7w" May 26 16:30:00.456548 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:30:00.456513 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29663550-s2c7w" May 26 16:30:00.588692 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:30:00.588664 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29663550-s2c7w"] May 26 16:30:00.591954 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:30:00.591924 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ff2df63_739f_485e_8a06_ded8126411d7.slice/crio-652cbcfca5ac9e1fe93035080404b033294e0810d5c3f8470c908e6b35f510c4 WatchSource:0}: Error finding container 652cbcfca5ac9e1fe93035080404b033294e0810d5c3f8470c908e6b35f510c4: Status 404 returned error can't find the container with id 652cbcfca5ac9e1fe93035080404b033294e0810d5c3f8470c908e6b35f510c4 May 26 16:30:00.593786 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:30:00.593764 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 26 16:30:01.185331 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:30:01.185294 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29663550-s2c7w" event={"ID":"0ff2df63-739f-485e-8a06-ded8126411d7","Type":"ContainerStarted","Data":"652cbcfca5ac9e1fe93035080404b033294e0810d5c3f8470c908e6b35f510c4"} May 26 16:30:02.293484 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:30:02.293444 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:30:04.196122 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:30:04.196088 2560 generic.go:358] "Generic (PLEG): container finished" podID="0ff2df63-739f-485e-8a06-ded8126411d7" containerID="778e9049e586e17fbeef6022d5f35c8ff950553270da8d41983fcbd2403f239c" exitCode=0 May 26 16:30:04.196538 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:30:04.196179 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29663550-s2c7w" event={"ID":"0ff2df63-739f-485e-8a06-ded8126411d7","Type":"ContainerDied","Data":"778e9049e586e17fbeef6022d5f35c8ff950553270da8d41983fcbd2403f239c"} May 26 16:30:05.327449 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:30:05.327404 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29663550-s2c7w" May 26 16:30:05.475625 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:30:05.475539 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-px488\" (UniqueName: \"kubernetes.io/projected/0ff2df63-739f-485e-8a06-ded8126411d7-kube-api-access-px488\") pod \"0ff2df63-739f-485e-8a06-ded8126411d7\" (UID: \"0ff2df63-739f-485e-8a06-ded8126411d7\") " May 26 16:30:05.477682 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:30:05.477659 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ff2df63-739f-485e-8a06-ded8126411d7-kube-api-access-px488" (OuterVolumeSpecName: "kube-api-access-px488") pod "0ff2df63-739f-485e-8a06-ded8126411d7" (UID: "0ff2df63-739f-485e-8a06-ded8126411d7"). InnerVolumeSpecName "kube-api-access-px488". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 16:30:05.577089 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:30:05.577054 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-px488\" (UniqueName: \"kubernetes.io/projected/0ff2df63-739f-485e-8a06-ded8126411d7-kube-api-access-px488\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" May 26 16:30:06.204296 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:30:06.204258 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29663550-s2c7w" event={"ID":"0ff2df63-739f-485e-8a06-ded8126411d7","Type":"ContainerDied","Data":"652cbcfca5ac9e1fe93035080404b033294e0810d5c3f8470c908e6b35f510c4"} May 26 16:30:06.204296 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:30:06.204293 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="652cbcfca5ac9e1fe93035080404b033294e0810d5c3f8470c908e6b35f510c4" May 26 16:30:06.204296 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:30:06.204295 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29663550-s2c7w" May 26 16:30:10.290638 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:30:10.290600 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:30:20.983620 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:30:20.983585 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:30:28.884318 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:30:28.884281 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:30:37.984245 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:30:37.984202 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:30:46.089795 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:30:46.089757 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:30:56.882656 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:30:56.882618 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:31:04.407168 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:31:04.407132 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:31:13.285878 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:31:13.285839 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:31:21.793200 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:31:21.793158 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:31:31.189895 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:31:31.189857 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:31:39.583478 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:31:39.583417 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:31:48.186940 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:31:48.186902 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:31:56.885085 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:31:56.885044 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:32:06.601049 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:32:06.601010 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:32:14.987866 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:32:14.987819 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:33:29.979956 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:33:29.979922 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-sjdlv_c7a1e813-7c0b-4f31-8ba2-1204fefee3e3/console-operator/1.log" May 26 16:33:29.981640 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:33:29.981618 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-sjdlv_c7a1e813-7c0b-4f31-8ba2-1204fefee3e3/console-operator/1.log" May 26 16:34:33.588689 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:34:33.588653 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:34:38.286671 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:34:38.286633 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:35:02.894447 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:35:02.894401 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:35:10.088408 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:35:10.088372 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:35:19.201726 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:35:19.201687 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:35:29.598692 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:35:29.598651 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:35:38.389725 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:35:38.389687 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:35:49.084855 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:35:49.084820 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:35:59.190023 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:35:59.189984 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:36:08.290589 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:36:08.290547 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:36:16.897659 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:36:16.897619 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:36:28.479123 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:36:28.479081 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:36:39.643468 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:36:39.641603 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:37:13.888072 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:37:13.887984 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:37:57.687665 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:37:57.687626 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:38:05.690269 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:38:05.690231 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:38:15.085511 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:38:15.085468 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:38:23.485879 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:38:23.485837 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:38:30.002536 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:38:30.002505 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-sjdlv_c7a1e813-7c0b-4f31-8ba2-1204fefee3e3/console-operator/1.log" May 26 16:38:30.007852 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:38:30.007756 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-sjdlv_c7a1e813-7c0b-4f31-8ba2-1204fefee3e3/console-operator/1.log" May 26 16:38:31.591049 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:38:31.591009 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:38:44.483455 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:38:44.483408 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:38:53.594512 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:38:53.594470 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:39:01.685245 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:39:01.685205 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:39:09.683663 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:39:09.683627 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:39:17.689079 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:39:17.689037 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:39:26.381965 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:39:26.381920 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:39:37.284627 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:39:37.284594 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:39:54.191123 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:39:54.191040 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:40:03.584421 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:40:03.584387 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:40:11.188460 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:40:11.188404 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:40:20.381984 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:40:20.381948 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:40:37.296983 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:40:37.296948 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:40:45.680971 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:40:45.680929 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:40:54.799193 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:40:54.799150 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:41:02.776910 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:41:02.776867 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:41:11.483006 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:41:11.482966 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:41:21.089870 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:41:21.089782 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:41:30.597085 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:41:30.597042 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:41:40.985310 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:41:40.985270 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:41:50.096056 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:41:50.096020 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:42:03.083504 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:42:03.083455 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:42:12.886150 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:42:12.886110 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:42:21.185785 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:42:21.185744 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:42:29.383240 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:42:29.383202 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:42:37.398118 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:42:37.398076 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:42:54.085931 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:42:54.085847 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:43:02.788204 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:43:02.788164 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:43:10.896013 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:43:10.895979 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:43:19.180653 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:43:19.180616 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:43:30.035388 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:43:30.035360 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-sjdlv_c7a1e813-7c0b-4f31-8ba2-1204fefee3e3/console-operator/1.log" May 26 16:43:30.038933 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:43:30.038911 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-sjdlv_c7a1e813-7c0b-4f31-8ba2-1204fefee3e3/console-operator/1.log" May 26 16:43:44.080880 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:43:44.080842 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:43:55.780445 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:43:55.780397 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-889q2"] May 26 16:44:04.834911 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:04.834875 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29663550-s2c7w_0ff2df63-739f-485e-8a06-ded8126411d7/cleanup/0.log" May 26 16:44:05.200347 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:05.200317 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74889b64d-kphlf_8aad3b8b-c38c-465e-be8e-dd7a4008ac9b/manager/0.log" May 26 16:44:07.038392 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:07.038353 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-9lkj9_d5124bf7-d9cb-4f86-80b4-e8b6d84f6104/manager/0.log" May 26 16:44:07.393114 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:07.393037 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-vcvq9_ee89c22b-4665-4f23-81cb-ef38b3aef072/registry-server/0.log" May 26 16:44:07.630807 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:07.630773 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-889q2_af0c0b5e-2134-4bec-8472-5469f4c6501c/limitador/0.log" May 26 16:44:07.759606 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:07.759575 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-mrgkm_4893be95-dc64-442f-b3ff-71429354db30/manager/0.log" May 26 16:44:08.126016 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:08.125909 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t_1cb0eb4c-2958-49a9-a9a8-8889129d3381/istio-proxy/0.log" May 26 16:44:08.844355 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:08.844323 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6bbfbf574b-l5b7d_0248426a-06ce-4715-90e4-ceb857b98580/router/0.log" May 26 16:44:09.321301 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:09.321274 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-n7hbc_4b70c03b-41c4-4c6a-94a6-59b04ab62887/storage-initializer/0.log" May 26 16:44:09.329888 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:09.329857 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-n7hbc_4b70c03b-41c4-4c6a-94a6-59b04ab62887/main/0.log" May 26 16:44:14.182781 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:14.182748 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-cjkn8/must-gather-bv5vs"] May 26 16:44:14.183166 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:14.183092 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ff2df63-739f-485e-8a06-ded8126411d7" containerName="cleanup" May 26 16:44:14.183166 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:14.183105 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ff2df63-739f-485e-8a06-ded8126411d7" containerName="cleanup" May 26 16:44:14.183273 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:14.183175 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="0ff2df63-739f-485e-8a06-ded8126411d7" containerName="cleanup" May 26 16:44:14.186162 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:14.186144 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cjkn8/must-gather-bv5vs" May 26 16:44:14.188771 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:14.188744 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-cjkn8\"/\"default-dockercfg-tq4sb\"" May 26 16:44:14.188864 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:14.188754 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cjkn8\"/\"openshift-service-ca.crt\"" May 26 16:44:14.189839 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:14.189819 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cjkn8\"/\"kube-root-ca.crt\"" May 26 16:44:14.198493 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:14.198471 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cjkn8/must-gather-bv5vs"] May 26 16:44:14.287068 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:14.287024 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/abce17e2-c469-4107-83c3-3f22df15d9f9-must-gather-output\") pod \"must-gather-bv5vs\" (UID: \"abce17e2-c469-4107-83c3-3f22df15d9f9\") " pod="openshift-must-gather-cjkn8/must-gather-bv5vs" May 26 16:44:14.287233 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:14.287184 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8fk8\" (UniqueName: \"kubernetes.io/projected/abce17e2-c469-4107-83c3-3f22df15d9f9-kube-api-access-r8fk8\") pod \"must-gather-bv5vs\" (UID: \"abce17e2-c469-4107-83c3-3f22df15d9f9\") " pod="openshift-must-gather-cjkn8/must-gather-bv5vs" May 26 16:44:14.387751 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:14.387707 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r8fk8\" (UniqueName: \"kubernetes.io/projected/abce17e2-c469-4107-83c3-3f22df15d9f9-kube-api-access-r8fk8\") pod \"must-gather-bv5vs\" (UID: \"abce17e2-c469-4107-83c3-3f22df15d9f9\") " pod="openshift-must-gather-cjkn8/must-gather-bv5vs" May 26 16:44:14.387751 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:14.387760 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/abce17e2-c469-4107-83c3-3f22df15d9f9-must-gather-output\") pod \"must-gather-bv5vs\" (UID: \"abce17e2-c469-4107-83c3-3f22df15d9f9\") " pod="openshift-must-gather-cjkn8/must-gather-bv5vs" May 26 16:44:14.388065 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:14.388050 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/abce17e2-c469-4107-83c3-3f22df15d9f9-must-gather-output\") pod \"must-gather-bv5vs\" (UID: \"abce17e2-c469-4107-83c3-3f22df15d9f9\") " pod="openshift-must-gather-cjkn8/must-gather-bv5vs" May 26 16:44:14.396016 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:14.395986 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8fk8\" (UniqueName: \"kubernetes.io/projected/abce17e2-c469-4107-83c3-3f22df15d9f9-kube-api-access-r8fk8\") pod \"must-gather-bv5vs\" (UID: \"abce17e2-c469-4107-83c3-3f22df15d9f9\") " pod="openshift-must-gather-cjkn8/must-gather-bv5vs" May 26 16:44:14.508813 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:14.508754 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cjkn8/must-gather-bv5vs" May 26 16:44:14.638235 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:14.638208 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cjkn8/must-gather-bv5vs"] May 26 16:44:14.640990 ip-10-0-142-102 kubenswrapper[2560]: W0526 16:44:14.640957 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podabce17e2_c469_4107_83c3_3f22df15d9f9.slice/crio-a280911d1158ea443a4b6247d0b4e28d448e7a3de94fd2ef8465a8fa98a802f1 WatchSource:0}: Error finding container a280911d1158ea443a4b6247d0b4e28d448e7a3de94fd2ef8465a8fa98a802f1: Status 404 returned error can't find the container with id a280911d1158ea443a4b6247d0b4e28d448e7a3de94fd2ef8465a8fa98a802f1 May 26 16:44:14.642701 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:14.642685 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 26 16:44:15.093829 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:15.093787 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cjkn8/must-gather-bv5vs" event={"ID":"abce17e2-c469-4107-83c3-3f22df15d9f9","Type":"ContainerStarted","Data":"a280911d1158ea443a4b6247d0b4e28d448e7a3de94fd2ef8465a8fa98a802f1"} May 26 16:44:16.098864 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:16.098820 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cjkn8/must-gather-bv5vs" event={"ID":"abce17e2-c469-4107-83c3-3f22df15d9f9","Type":"ContainerStarted","Data":"facd66c5617617fa1928fb8995ee7849f022b271216eb53fcc69796878ecab52"} May 26 16:44:16.099239 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:16.098872 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cjkn8/must-gather-bv5vs" event={"ID":"abce17e2-c469-4107-83c3-3f22df15d9f9","Type":"ContainerStarted","Data":"ad9a35e69852489e102e43d5f2aa89144ce37940ec5d6f6996906c44032a1c05"} May 26 16:44:16.113771 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:16.113725 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-cjkn8/must-gather-bv5vs" podStartSLOduration=1.50309632 podStartE2EDuration="2.113708579s" podCreationTimestamp="2026-05-26 16:44:14 +0000 UTC" firstStartedPulling="2026-05-26 16:44:14.642810125 +0000 UTC m=+2145.173303711" lastFinishedPulling="2026-05-26 16:44:15.253422366 +0000 UTC m=+2145.783915970" observedRunningTime="2026-05-26 16:44:16.112845973 +0000 UTC m=+2146.643339584" watchObservedRunningTime="2026-05-26 16:44:16.113708579 +0000 UTC m=+2146.644202192" May 26 16:44:16.837414 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:16.837345 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6s4f7_abe6e974-b6ff-4fa6-93d5-8aa4be27b866/global-pull-secret-syncer/0.log" May 26 16:44:16.963835 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:16.963800 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6kkzr_45ada7c3-c4cd-423d-b8b9-a3ed76d9e56e/konnectivity-agent/0.log" May 26 16:44:17.105095 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:17.105020 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-102.ec2.internal_2e1cb75f0e94e5eb2d26b2c46dee4fa3/haproxy/0.log" May 26 16:44:21.615162 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:21.615082 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-9lkj9_d5124bf7-d9cb-4f86-80b4-e8b6d84f6104/manager/0.log" May 26 16:44:21.717382 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:21.717345 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-vcvq9_ee89c22b-4665-4f23-81cb-ef38b3aef072/registry-server/0.log" May 26 16:44:21.800298 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:21.800228 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-889q2_af0c0b5e-2134-4bec-8472-5469f4c6501c/limitador/0.log" May 26 16:44:21.883038 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:21.882956 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-mrgkm_4893be95-dc64-442f-b3ff-71429354db30/manager/0.log" May 26 16:44:23.561609 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:23.561516 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-dh5hg_ae0d6eb0-655f-464f-88f4-74ee7cf2a7af/cluster-monitoring-operator/0.log" May 26 16:44:23.717903 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:23.717871 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5d69dfd56b-b4qzs_e08e9d04-5a96-4ff5-9d58-cf8343d7bc03/metrics-server/0.log" May 26 16:44:23.762149 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:23.762113 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-5gslg_1a3001a7-1d76-412f-8d14-486d82e19883/monitoring-plugin/0.log" May 26 16:44:23.877863 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:23.877777 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nnhvz_92b6ff44-d505-4441-9dbd-d9a6090ab976/node-exporter/0.log" May 26 16:44:23.909112 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:23.909081 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nnhvz_92b6ff44-d505-4441-9dbd-d9a6090ab976/kube-rbac-proxy/0.log" May 26 16:44:23.939711 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:23.939675 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nnhvz_92b6ff44-d505-4441-9dbd-d9a6090ab976/init-textfile/0.log" May 26 16:44:24.184787 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:24.184714 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b82837e0-0463-44d8-8da8-78773446f17f/prometheus/0.log" May 26 16:44:24.236029 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:24.235981 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b82837e0-0463-44d8-8da8-78773446f17f/config-reloader/0.log" May 26 16:44:24.267472 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:24.267446 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b82837e0-0463-44d8-8da8-78773446f17f/thanos-sidecar/0.log" May 26 16:44:24.295369 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:24.295340 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b82837e0-0463-44d8-8da8-78773446f17f/kube-rbac-proxy-web/0.log" May 26 16:44:24.325401 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:24.325358 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b82837e0-0463-44d8-8da8-78773446f17f/kube-rbac-proxy/0.log" May 26 16:44:24.354849 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:24.354806 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b82837e0-0463-44d8-8da8-78773446f17f/kube-rbac-proxy-thanos/0.log" May 26 16:44:24.383880 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:24.383819 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b82837e0-0463-44d8-8da8-78773446f17f/init-config-reloader/0.log" May 26 16:44:24.602039 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:24.602002 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85d8bd4786-vtxp2_235bb816-f1b6-4818-8a19-c400d0011009/thanos-query/0.log" May 26 16:44:24.634633 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:24.634603 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85d8bd4786-vtxp2_235bb816-f1b6-4818-8a19-c400d0011009/kube-rbac-proxy-web/0.log" May 26 16:44:24.667291 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:24.667264 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85d8bd4786-vtxp2_235bb816-f1b6-4818-8a19-c400d0011009/kube-rbac-proxy/0.log" May 26 16:44:24.697378 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:24.697351 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85d8bd4786-vtxp2_235bb816-f1b6-4818-8a19-c400d0011009/prom-label-proxy/0.log" May 26 16:44:24.731515 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:24.731476 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85d8bd4786-vtxp2_235bb816-f1b6-4818-8a19-c400d0011009/kube-rbac-proxy-rules/0.log" May 26 16:44:24.761445 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:24.761406 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85d8bd4786-vtxp2_235bb816-f1b6-4818-8a19-c400d0011009/kube-rbac-proxy-metrics/0.log" May 26 16:44:25.742948 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:25.742900 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-cjkn8/perf-node-gather-daemonset-fv7ls"] May 26 16:44:25.751127 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:25.751098 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cjkn8/perf-node-gather-daemonset-fv7ls" May 26 16:44:25.755759 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:25.755729 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cjkn8/perf-node-gather-daemonset-fv7ls"] May 26 16:44:25.907581 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:25.907523 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1b2a9238-a76a-43f9-922f-20be2e0fd483-podres\") pod \"perf-node-gather-daemonset-fv7ls\" (UID: \"1b2a9238-a76a-43f9-922f-20be2e0fd483\") " pod="openshift-must-gather-cjkn8/perf-node-gather-daemonset-fv7ls" May 26 16:44:25.907776 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:25.907624 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1b2a9238-a76a-43f9-922f-20be2e0fd483-proc\") pod \"perf-node-gather-daemonset-fv7ls\" (UID: \"1b2a9238-a76a-43f9-922f-20be2e0fd483\") " pod="openshift-must-gather-cjkn8/perf-node-gather-daemonset-fv7ls" May 26 16:44:25.907776 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:25.907651 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsb7h\" (UniqueName: \"kubernetes.io/projected/1b2a9238-a76a-43f9-922f-20be2e0fd483-kube-api-access-bsb7h\") pod \"perf-node-gather-daemonset-fv7ls\" (UID: \"1b2a9238-a76a-43f9-922f-20be2e0fd483\") " pod="openshift-must-gather-cjkn8/perf-node-gather-daemonset-fv7ls" May 26 16:44:25.907776 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:25.907726 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b2a9238-a76a-43f9-922f-20be2e0fd483-sys\") pod \"perf-node-gather-daemonset-fv7ls\" (UID: \"1b2a9238-a76a-43f9-922f-20be2e0fd483\") " pod="openshift-must-gather-cjkn8/perf-node-gather-daemonset-fv7ls" May 26 16:44:25.907957 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:25.907789 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1b2a9238-a76a-43f9-922f-20be2e0fd483-lib-modules\") pod \"perf-node-gather-daemonset-fv7ls\" (UID: \"1b2a9238-a76a-43f9-922f-20be2e0fd483\") " pod="openshift-must-gather-cjkn8/perf-node-gather-daemonset-fv7ls" May 26 16:44:26.009879 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:26.008490 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1b2a9238-a76a-43f9-922f-20be2e0fd483-podres\") pod \"perf-node-gather-daemonset-fv7ls\" (UID: \"1b2a9238-a76a-43f9-922f-20be2e0fd483\") " pod="openshift-must-gather-cjkn8/perf-node-gather-daemonset-fv7ls" May 26 16:44:26.009879 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:26.008552 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1b2a9238-a76a-43f9-922f-20be2e0fd483-proc\") pod \"perf-node-gather-daemonset-fv7ls\" (UID: \"1b2a9238-a76a-43f9-922f-20be2e0fd483\") " pod="openshift-must-gather-cjkn8/perf-node-gather-daemonset-fv7ls" May 26 16:44:26.009879 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:26.008575 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bsb7h\" (UniqueName: \"kubernetes.io/projected/1b2a9238-a76a-43f9-922f-20be2e0fd483-kube-api-access-bsb7h\") pod \"perf-node-gather-daemonset-fv7ls\" (UID: \"1b2a9238-a76a-43f9-922f-20be2e0fd483\") " pod="openshift-must-gather-cjkn8/perf-node-gather-daemonset-fv7ls" May 26 16:44:26.009879 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:26.008610 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b2a9238-a76a-43f9-922f-20be2e0fd483-sys\") pod \"perf-node-gather-daemonset-fv7ls\" (UID: \"1b2a9238-a76a-43f9-922f-20be2e0fd483\") " pod="openshift-must-gather-cjkn8/perf-node-gather-daemonset-fv7ls" May 26 16:44:26.009879 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:26.008636 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1b2a9238-a76a-43f9-922f-20be2e0fd483-lib-modules\") pod \"perf-node-gather-daemonset-fv7ls\" (UID: \"1b2a9238-a76a-43f9-922f-20be2e0fd483\") " pod="openshift-must-gather-cjkn8/perf-node-gather-daemonset-fv7ls" May 26 16:44:26.009879 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:26.008756 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1b2a9238-a76a-43f9-922f-20be2e0fd483-podres\") pod \"perf-node-gather-daemonset-fv7ls\" (UID: \"1b2a9238-a76a-43f9-922f-20be2e0fd483\") " pod="openshift-must-gather-cjkn8/perf-node-gather-daemonset-fv7ls" May 26 16:44:26.009879 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:26.008841 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1b2a9238-a76a-43f9-922f-20be2e0fd483-lib-modules\") pod \"perf-node-gather-daemonset-fv7ls\" (UID: \"1b2a9238-a76a-43f9-922f-20be2e0fd483\") " pod="openshift-must-gather-cjkn8/perf-node-gather-daemonset-fv7ls" May 26 16:44:26.009879 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:26.008893 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b2a9238-a76a-43f9-922f-20be2e0fd483-sys\") pod \"perf-node-gather-daemonset-fv7ls\" (UID: \"1b2a9238-a76a-43f9-922f-20be2e0fd483\") " pod="openshift-must-gather-cjkn8/perf-node-gather-daemonset-fv7ls" May 26 16:44:26.009879 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:26.008941 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1b2a9238-a76a-43f9-922f-20be2e0fd483-proc\") pod \"perf-node-gather-daemonset-fv7ls\" (UID: \"1b2a9238-a76a-43f9-922f-20be2e0fd483\") " pod="openshift-must-gather-cjkn8/perf-node-gather-daemonset-fv7ls" May 26 16:44:26.020367 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:26.020294 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsb7h\" (UniqueName: \"kubernetes.io/projected/1b2a9238-a76a-43f9-922f-20be2e0fd483-kube-api-access-bsb7h\") pod \"perf-node-gather-daemonset-fv7ls\" (UID: \"1b2a9238-a76a-43f9-922f-20be2e0fd483\") " pod="openshift-must-gather-cjkn8/perf-node-gather-daemonset-fv7ls" May 26 16:44:26.063722 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:26.063685 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cjkn8/perf-node-gather-daemonset-fv7ls" May 26 16:44:26.239013 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:26.238393 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cjkn8/perf-node-gather-daemonset-fv7ls"] May 26 16:44:26.363610 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:26.363582 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-sjdlv_c7a1e813-7c0b-4f31-8ba2-1204fefee3e3/console-operator/1.log" May 26 16:44:26.366644 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:26.366617 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-sjdlv_c7a1e813-7c0b-4f31-8ba2-1204fefee3e3/console-operator/2.log" May 26 16:44:27.155181 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:27.155142 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cjkn8/perf-node-gather-daemonset-fv7ls" event={"ID":"1b2a9238-a76a-43f9-922f-20be2e0fd483","Type":"ContainerStarted","Data":"c2d2b0c4a0d131e6bd6fc61174599db965184a1fd96995d608bfea7011851d1a"} May 26 16:44:27.155654 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:27.155188 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cjkn8/perf-node-gather-daemonset-fv7ls" event={"ID":"1b2a9238-a76a-43f9-922f-20be2e0fd483","Type":"ContainerStarted","Data":"78089910ca71da4985f7f420940ef636ecf92c0fd84fa1b51c90a1250f0bc103"} May 26 16:44:27.155869 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:27.155844 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-cjkn8/perf-node-gather-daemonset-fv7ls" May 26 16:44:27.174197 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:27.174132 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-cjkn8/perf-node-gather-daemonset-fv7ls" podStartSLOduration=2.174109499 podStartE2EDuration="2.174109499s" podCreationTimestamp="2026-05-26 16:44:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 16:44:27.171464699 +0000 UTC m=+2157.701958306" watchObservedRunningTime="2026-05-26 16:44:27.174109499 +0000 UTC m=+2157.704603108" May 26 16:44:28.292346 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:28.292319 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rk9bl_198e0563-480e-4643-8cc7-ffbcdd9d6096/dns/0.log" May 26 16:44:28.315093 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:28.315061 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rk9bl_198e0563-480e-4643-8cc7-ffbcdd9d6096/kube-rbac-proxy/0.log" May 26 16:44:28.367744 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:28.367716 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nqcwn_2d3a8f3a-02fd-4849-a169-2b72451d600a/dns-node-resolver/0.log" May 26 16:44:28.856866 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:28.856839 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-b64fdffcf-5gf69_4182d435-42d4-46cf-be5b-ed67334ea3ff/registry/0.log" May 26 16:44:28.877502 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:28.877474 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5rp4s_ce8f2e7d-5806-41f9-aed0-49e4edec1092/node-ca/0.log" May 26 16:44:29.812540 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:29.812506 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bj2g9t_1cb0eb4c-2958-49a9-a9a8-8889129d3381/istio-proxy/0.log" May 26 16:44:30.121089 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:30.121018 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6bbfbf574b-l5b7d_0248426a-06ce-4715-90e4-ceb857b98580/router/0.log" May 26 16:44:30.680438 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:30.680403 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rqtzd_074a7bdb-b46a-4d92-93be-4934b7e5c55b/serve-healthcheck-canary/0.log" May 26 16:44:31.235231 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:31.235197 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mrvlm_2e558e02-9fbc-4145-9d3e-33f91a7197a2/kube-rbac-proxy/0.log" May 26 16:44:31.256503 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:31.256470 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mrvlm_2e558e02-9fbc-4145-9d3e-33f91a7197a2/exporter/0.log" May 26 16:44:31.278294 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:31.278260 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mrvlm_2e558e02-9fbc-4145-9d3e-33f91a7197a2/extractor/0.log" May 26 16:44:33.168518 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:33.168490 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-cjkn8/perf-node-gather-daemonset-fv7ls" May 26 16:44:33.329571 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:33.329540 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29663550-s2c7w_0ff2df63-739f-485e-8a06-ded8126411d7/cleanup/0.log" May 26 16:44:33.462826 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:33.462783 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74889b64d-kphlf_8aad3b8b-c38c-465e-be8e-dd7a4008ac9b/manager/0.log" May 26 16:44:34.875109 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:34.874992 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-575f8499b5-5xnh6_2f813d63-518c-4f79-8a4b-3f055b8ff841/manager/0.log" May 26 16:44:39.175254 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:39.175227 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-9q7hf_73f03199-74ec-4981-9eef-34c97b2fc8ea/migrator/0.log" May 26 16:44:39.197254 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:39.197226 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-9q7hf_73f03199-74ec-4981-9eef-34c97b2fc8ea/graceful-termination/0.log" May 26 16:44:40.550727 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:40.550698 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2r6kq_eae253a8-1f39-46f2-abe6-b677fff8aa74/kube-multus-additional-cni-plugins/0.log" May 26 16:44:40.573789 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:40.573763 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2r6kq_eae253a8-1f39-46f2-abe6-b677fff8aa74/egress-router-binary-copy/0.log" May 26 16:44:40.601176 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:40.601148 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2r6kq_eae253a8-1f39-46f2-abe6-b677fff8aa74/cni-plugins/0.log" May 26 16:44:40.625691 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:40.625666 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2r6kq_eae253a8-1f39-46f2-abe6-b677fff8aa74/bond-cni-plugin/0.log" May 26 16:44:40.665691 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:40.665662 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2r6kq_eae253a8-1f39-46f2-abe6-b677fff8aa74/routeoverride-cni/0.log" May 26 16:44:40.687557 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:40.687526 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2r6kq_eae253a8-1f39-46f2-abe6-b677fff8aa74/whereabouts-cni-bincopy/0.log" May 26 16:44:40.710590 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:40.710560 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2r6kq_eae253a8-1f39-46f2-abe6-b677fff8aa74/whereabouts-cni/0.log" May 26 16:44:41.067954 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:41.067925 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-bqsfl_7848e219-3fad-4749-80de-651dc7faace5/kube-multus/0.log" May 26 16:44:41.232483 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:41.232452 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ws4lv_eec5f0e1-7fd2-4597-a1a0-3b5b10517934/network-metrics-daemon/0.log" May 26 16:44:41.252921 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:41.252893 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ws4lv_eec5f0e1-7fd2-4597-a1a0-3b5b10517934/kube-rbac-proxy/0.log" May 26 16:44:42.371153 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:42.371067 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7xvh4_e88baa86-d2fb-4052-9453-0fb254a02aa1/ovn-controller/0.log" May 26 16:44:42.400783 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:42.400753 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7xvh4_e88baa86-d2fb-4052-9453-0fb254a02aa1/ovn-acl-logging/0.log" May 26 16:44:42.422034 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:42.422001 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7xvh4_e88baa86-d2fb-4052-9453-0fb254a02aa1/kube-rbac-proxy-node/0.log" May 26 16:44:42.447363 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:42.447328 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7xvh4_e88baa86-d2fb-4052-9453-0fb254a02aa1/kube-rbac-proxy-ovn-metrics/0.log" May 26 16:44:42.466655 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:42.466626 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7xvh4_e88baa86-d2fb-4052-9453-0fb254a02aa1/northd/0.log" May 26 16:44:42.488906 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:42.488870 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7xvh4_e88baa86-d2fb-4052-9453-0fb254a02aa1/nbdb/0.log" May 26 16:44:42.512063 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:42.512033 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7xvh4_e88baa86-d2fb-4052-9453-0fb254a02aa1/sbdb/0.log" May 26 16:44:42.647177 ip-10-0-142-102 kubenswrapper[2560]: I0526 16:44:42.647095 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7xvh4_e88baa86-d2fb-4052-9453-0fb254a02aa1/ovnkube-controller/0.log"