May 27 23:38:26.815099 ip-10-0-128-22 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 27 23:38:26.815107 ip-10-0-128-22 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 27 23:38:26.815114 ip-10-0-128-22 systemd[1]: kubelet.service: Failed with result 'resources'. May 27 23:38:26.815349 ip-10-0-128-22 systemd[1]: Failed to start Kubernetes Kubelet. May 27 23:38:36.820573 ip-10-0-128-22 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 27 23:38:36.820592 ip-10-0-128-22 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 220316e7411946d89424dc810866e80a -- May 27 23:40:56.961940 ip-10-0-128-22 systemd[1]: Starting Kubernetes Kubelet... May 27 23:40:57.381859 ip-10-0-128-22 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 27 23:40:57.381859 ip-10-0-128-22 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 27 23:40:57.381859 ip-10-0-128-22 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 27 23:40:57.381859 ip-10-0-128-22 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 27 23:40:57.381859 ip-10-0-128-22 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 27 23:40:57.384431 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.384341 2556 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 27 23:40:57.387607 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387593 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 23:40:57.387655 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387609 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 23:40:57.387655 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387613 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 23:40:57.387655 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387616 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 23:40:57.387655 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387618 2556 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 23:40:57.387655 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387621 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 23:40:57.387655 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387624 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 23:40:57.387655 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387627 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 23:40:57.387655 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387629 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 23:40:57.387655 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387632 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 23:40:57.387655 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387646 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 23:40:57.387655 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387649 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 23:40:57.387655 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387651 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 23:40:57.387655 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387654 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 23:40:57.387655 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387657 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 23:40:57.387655 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387660 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 23:40:57.387655 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387664 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 23:40:57.388068 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387667 2556 feature_gate.go:328] unrecognized feature gate: Example May 27 23:40:57.388068 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387669 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 23:40:57.388068 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387672 2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 23:40:57.388068 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387675 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 23:40:57.388068 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387679 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 23:40:57.388068 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387682 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 23:40:57.388068 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387685 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 23:40:57.388068 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387687 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 23:40:57.388068 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387690 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 23:40:57.388068 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387692 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 23:40:57.388068 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387695 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 23:40:57.388068 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387697 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 23:40:57.388068 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387700 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 23:40:57.388068 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387703 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 23:40:57.388068 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387706 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 23:40:57.388068 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387708 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 23:40:57.388068 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387711 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 23:40:57.388068 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387713 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 23:40:57.388068 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387716 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 23:40:57.388519 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387718 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 23:40:57.388519 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387721 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 23:40:57.388519 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387723 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 23:40:57.388519 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387726 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 23:40:57.388519 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387728 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 23:40:57.388519 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387731 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 23:40:57.388519 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387733 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 23:40:57.388519 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387736 2556 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 23:40:57.388519 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387738 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 23:40:57.388519 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387741 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 23:40:57.388519 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387743 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 23:40:57.388519 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387746 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 23:40:57.388519 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387748 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 23:40:57.388519 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387752 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 23:40:57.388519 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387757 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 23:40:57.388519 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387760 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 23:40:57.388519 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387763 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 23:40:57.388519 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387767 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 23:40:57.388519 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387770 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 23:40:57.389080 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387772 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 23:40:57.389080 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387774 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 23:40:57.389080 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387777 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 23:40:57.389080 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387780 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 23:40:57.389080 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387783 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 23:40:57.389080 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387786 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 23:40:57.389080 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387790 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 23:40:57.389080 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387793 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 23:40:57.389080 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387796 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 23:40:57.389080 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387800 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 23:40:57.389080 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387803 2556 feature_gate.go:328] unrecognized feature gate: Example2 May 27 23:40:57.389080 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387806 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 23:40:57.389080 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387809 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 23:40:57.389080 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387812 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 23:40:57.389080 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387814 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 23:40:57.389080 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387817 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 23:40:57.389080 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387819 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 23:40:57.389080 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387822 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 23:40:57.389080 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387824 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 23:40:57.389534 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387827 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 23:40:57.389534 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387829 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 23:40:57.389534 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387832 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 23:40:57.389534 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387834 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 23:40:57.389534 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387837 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 23:40:57.389534 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387839 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 23:40:57.389534 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387842 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 23:40:57.389534 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387845 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 23:40:57.389534 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387848 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 23:40:57.389534 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387851 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 23:40:57.389534 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387853 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 23:40:57.389534 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.387856 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 23:40:57.389534 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388245 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 23:40:57.389534 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388250 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 23:40:57.389534 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388253 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 23:40:57.389534 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388255 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 23:40:57.389534 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388258 2556 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 23:40:57.389534 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388261 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 23:40:57.389534 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388264 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 23:40:57.389534 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388267 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 23:40:57.390040 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388269 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 23:40:57.390040 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388272 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 23:40:57.390040 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388274 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 23:40:57.390040 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388277 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 23:40:57.390040 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388279 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 23:40:57.390040 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388283 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 23:40:57.390040 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388285 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 23:40:57.390040 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388289 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 23:40:57.390040 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388292 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 23:40:57.390040 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388295 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 23:40:57.390040 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388297 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 23:40:57.390040 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388300 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 23:40:57.390040 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388302 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 23:40:57.390040 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388305 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 23:40:57.390040 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388307 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 23:40:57.390040 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388310 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 23:40:57.390040 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388312 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 23:40:57.390040 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388315 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 23:40:57.390040 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388318 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 23:40:57.390503 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388322 2556 feature_gate.go:328] unrecognized feature gate: Example2 May 27 23:40:57.390503 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388325 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 23:40:57.390503 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388328 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 23:40:57.390503 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388331 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 23:40:57.390503 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388334 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 23:40:57.390503 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388336 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 23:40:57.390503 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388339 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 23:40:57.390503 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388342 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 23:40:57.390503 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388344 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 23:40:57.390503 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388347 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 23:40:57.390503 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388350 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 23:40:57.390503 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388353 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 23:40:57.390503 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388355 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 23:40:57.390503 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388358 2556 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 23:40:57.390503 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388360 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 23:40:57.390503 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388363 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 23:40:57.390503 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388365 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 23:40:57.390503 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388368 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 23:40:57.390503 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388370 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 23:40:57.390503 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388373 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 23:40:57.391000 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388375 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 23:40:57.391000 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388378 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 23:40:57.391000 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388380 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 23:40:57.391000 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388383 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 23:40:57.391000 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388385 2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 23:40:57.391000 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388387 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 23:40:57.391000 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388390 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 23:40:57.391000 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388392 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 23:40:57.391000 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388395 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 23:40:57.391000 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388397 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 23:40:57.391000 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388401 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 23:40:57.391000 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388405 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 23:40:57.391000 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388409 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 23:40:57.391000 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388412 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 23:40:57.391000 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388415 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 23:40:57.391000 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388418 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 23:40:57.391000 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388421 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 23:40:57.391000 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388424 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 23:40:57.391000 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388427 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 23:40:57.391464 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388430 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 23:40:57.391464 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388433 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 23:40:57.391464 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388436 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 23:40:57.391464 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388439 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 23:40:57.391464 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388442 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 23:40:57.391464 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388445 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 23:40:57.391464 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388448 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 23:40:57.391464 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388450 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 23:40:57.391464 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388453 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 23:40:57.391464 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388455 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 23:40:57.391464 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388459 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 23:40:57.391464 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388461 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 23:40:57.391464 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388464 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 23:40:57.391464 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388466 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 23:40:57.391464 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388468 2556 feature_gate.go:328] unrecognized feature gate: Example May 27 23:40:57.391464 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388471 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 23:40:57.391464 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388473 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 23:40:57.391464 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388476 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 23:40:57.391464 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388478 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 23:40:57.391464 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.388481 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 23:40:57.391973 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388567 2556 flags.go:64] FLAG: --address="0.0.0.0" May 27 23:40:57.391973 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388578 2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 27 23:40:57.391973 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388587 2556 flags.go:64] FLAG: --anonymous-auth="true" May 27 23:40:57.391973 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388591 2556 flags.go:64] FLAG: --application-metrics-count-limit="100" May 27 23:40:57.391973 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388596 2556 flags.go:64] FLAG: --authentication-token-webhook="false" May 27 23:40:57.391973 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388599 2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 27 23:40:57.391973 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388604 2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 27 23:40:57.391973 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388608 2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 27 23:40:57.391973 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388612 2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 27 23:40:57.391973 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388615 2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 27 23:40:57.391973 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388619 2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 27 23:40:57.391973 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388622 2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 27 23:40:57.391973 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388625 2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 27 23:40:57.391973 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388629 2556 flags.go:64] FLAG: --cgroup-root="" May 27 23:40:57.391973 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388632 2556 flags.go:64] FLAG: --cgroups-per-qos="true" May 27 23:40:57.391973 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388646 2556 flags.go:64] FLAG: --client-ca-file="" May 27 23:40:57.391973 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388649 2556 flags.go:64] FLAG: --cloud-config="" May 27 23:40:57.391973 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388652 2556 flags.go:64] FLAG: --cloud-provider="external" May 27 23:40:57.391973 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388656 2556 flags.go:64] FLAG: --cluster-dns="[]" May 27 23:40:57.391973 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388660 2556 flags.go:64] FLAG: --cluster-domain="" May 27 23:40:57.391973 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388663 2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 27 23:40:57.391973 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388666 2556 flags.go:64] FLAG: --config-dir="" May 27 23:40:57.391973 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388669 2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 27 23:40:57.391973 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388673 2556 flags.go:64] FLAG: --container-log-max-files="5" May 27 23:40:57.391973 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388677 2556 flags.go:64] FLAG: --container-log-max-size="10Mi" May 27 23:40:57.392575 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388680 2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 27 23:40:57.392575 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388683 2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 27 23:40:57.392575 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388686 2556 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 27 23:40:57.392575 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388689 2556 flags.go:64] FLAG: --contention-profiling="false" May 27 23:40:57.392575 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388693 2556 flags.go:64] FLAG: --cpu-cfs-quota="true" May 27 23:40:57.392575 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388696 2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 27 23:40:57.392575 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388699 2556 flags.go:64] FLAG: --cpu-manager-policy="none" May 27 23:40:57.392575 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388702 2556 flags.go:64] FLAG: --cpu-manager-policy-options="" May 27 23:40:57.392575 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388706 2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 27 23:40:57.392575 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388709 2556 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 27 23:40:57.392575 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388712 2556 flags.go:64] FLAG: --enable-debugging-handlers="true" May 27 23:40:57.392575 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388715 2556 flags.go:64] FLAG: --enable-load-reader="false" May 27 23:40:57.392575 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388718 2556 flags.go:64] FLAG: --enable-server="true" May 27 23:40:57.392575 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388722 2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 27 23:40:57.392575 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388727 2556 flags.go:64] FLAG: --event-burst="100" May 27 23:40:57.392575 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388730 2556 flags.go:64] FLAG: --event-qps="50" May 27 23:40:57.392575 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388733 2556 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 27 23:40:57.392575 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388736 2556 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 27 23:40:57.392575 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388739 2556 flags.go:64] FLAG: --eviction-hard="" May 27 23:40:57.392575 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388743 2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 27 23:40:57.392575 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388746 2556 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 27 23:40:57.392575 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388750 2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 27 23:40:57.392575 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388753 2556 flags.go:64] FLAG: --eviction-soft="" May 27 23:40:57.392575 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388756 2556 flags.go:64] FLAG: --eviction-soft-grace-period="" May 27 23:40:57.392575 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388759 2556 flags.go:64] FLAG: --exit-on-lock-contention="false" May 27 23:40:57.393186 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388762 2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 27 23:40:57.393186 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388765 2556 flags.go:64] FLAG: --experimental-mounter-path="" May 27 23:40:57.393186 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388768 2556 flags.go:64] FLAG: --fail-cgroupv1="false" May 27 23:40:57.393186 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388771 2556 flags.go:64] FLAG: --fail-swap-on="true" May 27 23:40:57.393186 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388774 2556 flags.go:64] FLAG: --feature-gates="" May 27 23:40:57.393186 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388777 2556 flags.go:64] FLAG: --file-check-frequency="20s" May 27 23:40:57.393186 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388780 2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 27 23:40:57.393186 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388784 2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 27 23:40:57.393186 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388788 2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 27 23:40:57.393186 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388791 2556 flags.go:64] FLAG: --healthz-port="10248" May 27 23:40:57.393186 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388793 2556 flags.go:64] FLAG: --help="false" May 27 23:40:57.393186 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388796 2556 flags.go:64] FLAG: --hostname-override="ip-10-0-128-22.ec2.internal" May 27 23:40:57.393186 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388802 2556 flags.go:64] FLAG: --housekeeping-interval="10s" May 27 23:40:57.393186 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388805 2556 flags.go:64] FLAG: --http-check-frequency="20s" May 27 23:40:57.393186 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388808 2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 27 23:40:57.393186 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388811 2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 27 23:40:57.393186 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388814 2556 flags.go:64] FLAG: --image-gc-high-threshold="85" May 27 23:40:57.393186 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388817 2556 flags.go:64] FLAG: --image-gc-low-threshold="80" May 27 23:40:57.393186 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388822 2556 flags.go:64] FLAG: --image-service-endpoint="" May 27 23:40:57.393186 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388825 2556 flags.go:64] FLAG: --kernel-memcg-notification="false" May 27 23:40:57.393186 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388828 2556 flags.go:64] FLAG: --kube-api-burst="100" May 27 23:40:57.393186 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388831 2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 27 23:40:57.393186 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388834 2556 flags.go:64] FLAG: --kube-api-qps="50" May 27 23:40:57.393186 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388837 2556 flags.go:64] FLAG: --kube-reserved="" May 27 23:40:57.393821 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388840 2556 flags.go:64] FLAG: --kube-reserved-cgroup="" May 27 23:40:57.393821 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388843 2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 27 23:40:57.393821 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388846 2556 flags.go:64] FLAG: --kubelet-cgroups="" May 27 23:40:57.393821 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388849 2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 27 23:40:57.393821 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388852 2556 flags.go:64] FLAG: --lock-file="" May 27 23:40:57.393821 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388855 2556 flags.go:64] FLAG: --log-cadvisor-usage="false" May 27 23:40:57.393821 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388858 2556 flags.go:64] FLAG: --log-flush-frequency="5s" May 27 23:40:57.393821 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388861 2556 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 27 23:40:57.393821 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388867 2556 flags.go:64] FLAG: --log-json-split-stream="false" May 27 23:40:57.393821 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388869 2556 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 27 23:40:57.393821 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388872 2556 flags.go:64] FLAG: --log-text-split-stream="false" May 27 23:40:57.393821 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388875 2556 flags.go:64] FLAG: --logging-format="text" May 27 23:40:57.393821 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388878 2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 27 23:40:57.393821 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388881 2556 flags.go:64] FLAG: --make-iptables-util-chains="true" May 27 23:40:57.393821 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388884 2556 flags.go:64] FLAG: --manifest-url="" May 27 23:40:57.393821 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388887 2556 flags.go:64] FLAG: --manifest-url-header="" May 27 23:40:57.393821 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388891 2556 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 27 23:40:57.393821 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388894 2556 flags.go:64] FLAG: --max-open-files="1000000" May 27 23:40:57.393821 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388898 2556 flags.go:64] FLAG: --max-pods="110" May 27 23:40:57.393821 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388901 2556 flags.go:64] FLAG: --maximum-dead-containers="-1" May 27 23:40:57.393821 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388906 2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 27 23:40:57.393821 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388909 2556 flags.go:64] FLAG: --memory-manager-policy="None" May 27 23:40:57.393821 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388912 2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 27 23:40:57.393821 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388915 2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 27 23:40:57.393821 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388918 2556 flags.go:64] FLAG: --node-ip="0.0.0.0" May 27 23:40:57.394418 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388921 2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 27 23:40:57.394418 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388930 2556 flags.go:64] FLAG: --node-status-max-images="50" May 27 23:40:57.394418 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388933 2556 flags.go:64] FLAG: --node-status-update-frequency="10s" May 27 23:40:57.394418 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388935 2556 flags.go:64] FLAG: --oom-score-adj="-999" May 27 23:40:57.394418 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388938 2556 flags.go:64] FLAG: --pod-cidr="" May 27 23:40:57.394418 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388941 2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 27 23:40:57.394418 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388947 2556 flags.go:64] FLAG: --pod-manifest-path="" May 27 23:40:57.394418 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388950 2556 flags.go:64] FLAG: --pod-max-pids="-1" May 27 23:40:57.394418 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388953 2556 flags.go:64] FLAG: --pods-per-core="0" May 27 23:40:57.394418 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388956 2556 flags.go:64] FLAG: --port="10250" May 27 23:40:57.394418 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388959 2556 flags.go:64] FLAG: --protect-kernel-defaults="false" May 27 23:40:57.394418 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388962 2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-032dcb85e130aa053" May 27 23:40:57.394418 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388965 2556 flags.go:64] FLAG: --qos-reserved="" May 27 23:40:57.394418 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388969 2556 flags.go:64] FLAG: --read-only-port="10255" May 27 23:40:57.394418 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388972 2556 flags.go:64] FLAG: --register-node="true" May 27 23:40:57.394418 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388975 2556 flags.go:64] FLAG: --register-schedulable="true" May 27 23:40:57.394418 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388978 2556 flags.go:64] FLAG: --register-with-taints="" May 27 23:40:57.394418 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388981 2556 flags.go:64] FLAG: --registry-burst="10" May 27 23:40:57.394418 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388984 2556 flags.go:64] FLAG: --registry-qps="5" May 27 23:40:57.394418 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388987 2556 flags.go:64] FLAG: --reserved-cpus="" May 27 23:40:57.394418 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388990 2556 flags.go:64] FLAG: --reserved-memory="" May 27 23:40:57.394418 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388994 2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 27 23:40:57.394418 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.388997 2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 27 23:40:57.394418 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.389001 2556 flags.go:64] FLAG: --rotate-certificates="false" May 27 23:40:57.394418 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.389003 2556 flags.go:64] FLAG: --rotate-server-certificates="false" May 27 23:40:57.395080 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.389006 2556 flags.go:64] FLAG: --runonce="false" May 27 23:40:57.395080 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.389009 2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 27 23:40:57.395080 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.389014 2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 27 23:40:57.395080 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.389017 2556 flags.go:64] FLAG: --seccomp-default="false" May 27 23:40:57.395080 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.389020 2556 flags.go:64] FLAG: --serialize-image-pulls="true" May 27 23:40:57.395080 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.389023 2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 27 23:40:57.395080 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.389026 2556 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 27 23:40:57.395080 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.389029 2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 27 23:40:57.395080 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.389032 2556 flags.go:64] FLAG: --storage-driver-password="root" May 27 23:40:57.395080 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.389036 2556 flags.go:64] FLAG: --storage-driver-secure="false" May 27 23:40:57.395080 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.389039 2556 flags.go:64] FLAG: --storage-driver-table="stats" May 27 23:40:57.395080 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.389041 2556 flags.go:64] FLAG: --storage-driver-user="root" May 27 23:40:57.395080 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.389044 2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 27 23:40:57.395080 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.389047 2556 flags.go:64] FLAG: --sync-frequency="1m0s" May 27 23:40:57.395080 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.389050 2556 flags.go:64] FLAG: --system-cgroups="" May 27 23:40:57.395080 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.389053 2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 27 23:40:57.395080 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.389058 2556 flags.go:64] FLAG: --system-reserved-cgroup="" May 27 23:40:57.395080 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.389061 2556 flags.go:64] FLAG: --tls-cert-file="" May 27 23:40:57.395080 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.389064 2556 flags.go:64] FLAG: --tls-cipher-suites="[]" May 27 23:40:57.395080 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.389068 2556 flags.go:64] FLAG: --tls-min-version="" May 27 23:40:57.395080 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.389071 2556 flags.go:64] FLAG: --tls-private-key-file="" May 27 23:40:57.395080 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.389075 2556 flags.go:64] FLAG: --topology-manager-policy="none" May 27 23:40:57.395080 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.389078 2556 flags.go:64] FLAG: --topology-manager-policy-options="" May 27 23:40:57.395080 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.389081 2556 flags.go:64] FLAG: --topology-manager-scope="container" May 27 23:40:57.395080 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.389084 2556 flags.go:64] FLAG: --v="2" May 27 23:40:57.395681 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.389088 2556 flags.go:64] FLAG: --version="false" May 27 23:40:57.395681 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.389092 2556 flags.go:64] FLAG: --vmodule="" May 27 23:40:57.395681 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.389097 2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 27 23:40:57.395681 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.389100 2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 27 23:40:57.395681 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389190 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 23:40:57.395681 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389193 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 23:40:57.395681 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389196 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 23:40:57.395681 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389199 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 23:40:57.395681 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389202 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 23:40:57.395681 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389206 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 23:40:57.395681 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389209 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 23:40:57.395681 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389212 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 23:40:57.395681 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389215 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 23:40:57.395681 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389218 2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 23:40:57.395681 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389221 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 23:40:57.395681 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389224 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 23:40:57.395681 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389228 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 23:40:57.395681 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389231 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 23:40:57.395681 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389234 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 23:40:57.395681 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389236 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 23:40:57.395681 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389239 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 23:40:57.396507 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389241 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 23:40:57.396507 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389244 2556 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 23:40:57.396507 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389246 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 23:40:57.396507 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389249 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 23:40:57.396507 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389252 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 23:40:57.396507 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389254 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 23:40:57.396507 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389257 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 23:40:57.396507 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389259 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 23:40:57.396507 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389263 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 23:40:57.396507 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389265 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 23:40:57.396507 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389268 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 23:40:57.396507 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389271 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 23:40:57.396507 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389273 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 23:40:57.396507 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389276 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 23:40:57.396507 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389278 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 23:40:57.396507 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389280 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 23:40:57.396507 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389283 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 23:40:57.396507 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389285 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 23:40:57.396507 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389288 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 23:40:57.396507 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389291 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 23:40:57.397093 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389298 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 23:40:57.397093 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389300 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 23:40:57.397093 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389303 2556 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 23:40:57.397093 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389305 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 23:40:57.397093 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389308 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 23:40:57.397093 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389310 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 23:40:57.397093 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389313 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 23:40:57.397093 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389317 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 23:40:57.397093 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389320 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 23:40:57.397093 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389322 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 23:40:57.397093 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389325 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 23:40:57.397093 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389327 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 23:40:57.397093 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389330 2556 feature_gate.go:328] unrecognized feature gate: Example May 27 23:40:57.397093 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389334 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 23:40:57.397093 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389338 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 23:40:57.397093 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389341 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 23:40:57.397093 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389344 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 23:40:57.397093 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389346 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 23:40:57.397093 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389349 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 23:40:57.397093 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389351 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 23:40:57.397585 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389354 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 23:40:57.397585 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389357 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 23:40:57.397585 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389360 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 23:40:57.397585 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389363 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 23:40:57.397585 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389365 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 23:40:57.397585 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389368 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 23:40:57.397585 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389370 2556 feature_gate.go:328] unrecognized feature gate: Example2 May 27 23:40:57.397585 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389373 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 23:40:57.397585 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389375 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 23:40:57.397585 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389378 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 23:40:57.397585 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389380 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 23:40:57.397585 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389383 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 23:40:57.397585 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389387 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 23:40:57.397585 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389389 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 23:40:57.397585 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389392 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 23:40:57.397585 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389394 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 23:40:57.397585 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389397 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 23:40:57.397585 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389399 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 23:40:57.397585 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389402 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 23:40:57.397585 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389406 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 23:40:57.398106 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389408 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 23:40:57.398106 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389412 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 23:40:57.398106 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389424 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 23:40:57.398106 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389427 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 23:40:57.398106 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389430 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 23:40:57.398106 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389433 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 23:40:57.398106 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389436 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 23:40:57.398106 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389439 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 23:40:57.398106 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.389442 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 23:40:57.398106 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.390326 2556 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 27 23:40:57.398358 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.398323 2556 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 27 23:40:57.398358 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.398339 2556 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 27 23:40:57.398435 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398424 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 23:40:57.398435 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398435 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 23:40:57.398494 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398442 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 23:40:57.398494 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398445 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 23:40:57.398494 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398448 2556 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 23:40:57.398494 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398452 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 23:40:57.398494 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398454 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 23:40:57.398494 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398457 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 23:40:57.398494 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398460 2556 feature_gate.go:328] unrecognized feature gate: Example2 May 27 23:40:57.398494 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398463 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 23:40:57.398494 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398466 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 23:40:57.398494 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398468 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 23:40:57.398494 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398471 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 23:40:57.398494 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398474 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 23:40:57.398494 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398480 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 23:40:57.398494 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398483 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 23:40:57.398494 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398486 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 23:40:57.398494 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398488 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 23:40:57.398494 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398491 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 23:40:57.398494 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398494 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 23:40:57.398494 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398497 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 23:40:57.398494 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398500 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 23:40:57.399018 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398503 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 23:40:57.399018 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398506 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 23:40:57.399018 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398509 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 23:40:57.399018 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398512 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 23:40:57.399018 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398514 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 23:40:57.399018 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398520 2556 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 23:40:57.399018 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398522 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 23:40:57.399018 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398525 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 23:40:57.399018 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398527 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 23:40:57.399018 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398530 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 23:40:57.399018 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398533 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 23:40:57.399018 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398535 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 23:40:57.399018 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398539 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 23:40:57.399018 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398542 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 23:40:57.399018 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398544 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 23:40:57.399018 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398547 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 23:40:57.399018 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398550 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 23:40:57.399018 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398552 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 23:40:57.399018 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398557 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 23:40:57.399018 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398560 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 23:40:57.399493 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398563 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 23:40:57.399493 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398565 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 23:40:57.399493 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398568 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 23:40:57.399493 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398570 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 23:40:57.399493 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398573 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 23:40:57.399493 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398576 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 23:40:57.399493 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398578 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 23:40:57.399493 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398582 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 23:40:57.399493 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398585 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 23:40:57.399493 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398588 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 23:40:57.399493 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398591 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 23:40:57.399493 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398596 2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 23:40:57.399493 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398599 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 23:40:57.399493 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398602 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 23:40:57.399493 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398605 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 23:40:57.399493 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398608 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 23:40:57.399493 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398611 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 23:40:57.399493 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398613 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 23:40:57.399493 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398616 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 23:40:57.399493 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398619 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 23:40:57.400004 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398622 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 23:40:57.400004 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398624 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 23:40:57.400004 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398627 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 23:40:57.400004 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398632 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 23:40:57.400004 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398650 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 23:40:57.400004 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398655 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 23:40:57.400004 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398657 2556 feature_gate.go:328] unrecognized feature gate: Example May 27 23:40:57.400004 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398660 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 23:40:57.400004 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398663 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 23:40:57.400004 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398666 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 23:40:57.400004 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398668 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 23:40:57.400004 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398671 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 23:40:57.400004 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398674 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 23:40:57.400004 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398676 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 23:40:57.400004 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398680 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 23:40:57.400004 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398688 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 23:40:57.400004 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398691 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 23:40:57.400004 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398693 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 23:40:57.400004 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398696 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 23:40:57.400461 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398699 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 23:40:57.400461 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398701 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 23:40:57.400461 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398704 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 23:40:57.400461 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398706 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 23:40:57.400461 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398709 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 23:40:57.400461 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.398714 2556 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 27 23:40:57.400461 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398903 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 23:40:57.400461 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398911 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 23:40:57.400461 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398914 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 23:40:57.400461 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398917 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 23:40:57.400461 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398920 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 23:40:57.400461 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398923 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 23:40:57.400461 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398926 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 23:40:57.400461 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398929 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 23:40:57.400461 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398932 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 23:40:57.400857 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398935 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 23:40:57.400857 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398937 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 23:40:57.400857 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398940 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 23:40:57.400857 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398943 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 23:40:57.400857 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398949 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 23:40:57.400857 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398952 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 23:40:57.400857 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398955 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 23:40:57.400857 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398957 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 23:40:57.400857 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398960 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 23:40:57.400857 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398963 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 23:40:57.400857 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398965 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 23:40:57.400857 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398968 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 23:40:57.400857 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398971 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 23:40:57.400857 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398973 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 23:40:57.400857 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398976 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 23:40:57.400857 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398978 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 23:40:57.400857 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398981 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 23:40:57.400857 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398986 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 23:40:57.400857 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398989 2556 feature_gate.go:328] unrecognized feature gate: Example May 27 23:40:57.400857 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398992 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 23:40:57.401344 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398994 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 23:40:57.401344 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.398997 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 23:40:57.401344 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399000 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 23:40:57.401344 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399003 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 23:40:57.401344 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399006 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 23:40:57.401344 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399008 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 23:40:57.401344 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399011 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 23:40:57.401344 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399014 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 23:40:57.401344 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399017 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 23:40:57.401344 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399024 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 23:40:57.401344 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399027 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 23:40:57.401344 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399030 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 23:40:57.401344 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399033 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 23:40:57.401344 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399036 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 23:40:57.401344 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399039 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 23:40:57.401344 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399042 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 23:40:57.401344 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399044 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 23:40:57.401344 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399047 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 23:40:57.401344 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399050 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 23:40:57.401344 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399053 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 23:40:57.401860 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399055 2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 23:40:57.401860 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399058 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 23:40:57.401860 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399063 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 23:40:57.401860 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399066 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 23:40:57.401860 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399068 2556 feature_gate.go:328] unrecognized feature gate: Example2 May 27 23:40:57.401860 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399071 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 23:40:57.401860 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399073 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 23:40:57.401860 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399077 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 23:40:57.401860 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399079 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 23:40:57.401860 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399082 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 23:40:57.401860 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399085 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 23:40:57.401860 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399087 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 23:40:57.401860 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399090 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 23:40:57.401860 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399093 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 23:40:57.401860 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399099 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 23:40:57.401860 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399103 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 23:40:57.401860 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399106 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 23:40:57.401860 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399109 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 23:40:57.401860 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399111 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 23:40:57.402336 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399114 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 23:40:57.402336 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399116 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 23:40:57.402336 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399119 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 23:40:57.402336 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399122 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 23:40:57.402336 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399124 2556 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 23:40:57.402336 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399127 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 23:40:57.402336 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399130 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 23:40:57.402336 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399135 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 23:40:57.402336 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399137 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 23:40:57.402336 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399140 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 23:40:57.402336 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399143 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 23:40:57.402336 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399146 2556 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 23:40:57.402336 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399148 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 23:40:57.402336 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399151 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 23:40:57.402336 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399154 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 23:40:57.402336 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399156 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 23:40:57.402336 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399159 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 23:40:57.402336 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:57.399161 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 23:40:57.402845 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.399166 2556 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 27 23:40:57.402845 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.399818 2556 server.go:962] "Client rotation is on, will bootstrap in background" May 27 23:40:57.402845 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.402075 2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 27 23:40:57.403335 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.403320 2556 server.go:1019] "Starting client certificate rotation" May 27 23:40:57.403441 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.403424 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 27 23:40:57.403476 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.403464 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 27 23:40:57.429797 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.429777 2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 27 23:40:57.431495 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.431479 2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 27 23:40:57.449679 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.449658 2556 log.go:25] "Validated CRI v1 runtime API" May 27 23:40:57.454767 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.454751 2556 log.go:25] "Validated CRI v1 image API" May 27 23:40:57.457108 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.457093 2556 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 27 23:40:57.460499 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.460473 2556 fs.go:135] Filesystem UUIDs: map[6074a8f9-41c1-44dc-af1e-d41b7c4317ae:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 e8527ea8-fea5-4272-a08a-35ae535d0c19:/dev/nvme0n1p3] May 27 23:40:57.460568 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.460497 2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 27 23:40:57.465079 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.465060 2556 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 27 23:40:57.465340 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.465228 2556 manager.go:217] Machine: {Timestamp:2026-05-27 23:40:57.464687085 +0000 UTC m=+0.391588667 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3150513 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22163de32b761238903ad0b28fac6a SystemUUID:ec22163d-e32b-7612-3890-3ad0b28fac6a BootID:220316e7-4119-46d8-9424-dc810866e80a Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d1:ab:d3:ff:71 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d1:ab:d3:ff:71 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ca:32:70:af:00:f6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 27 23:40:57.466142 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.466132 2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 27 23:40:57.466228 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.466214 2556 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 27 23:40:57.470360 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.470338 2556 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 27 23:40:57.470495 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.470362 2556 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-22.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 27 23:40:57.470537 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.470506 2556 topology_manager.go:138] "Creating topology manager with none policy" May 27 23:40:57.470537 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.470515 2556 container_manager_linux.go:306] "Creating device plugin manager" May 27 23:40:57.470537 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.470521 2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 27 23:40:57.471339 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.471329 2556 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 27 23:40:57.473055 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.473045 2556 state_mem.go:36] "Initialized new in-memory state store" May 27 23:40:57.473161 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.473152 2556 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 27 23:40:57.475882 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.475870 2556 kubelet.go:491] "Attempting to sync node with API server" May 27 23:40:57.475914 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.475890 2556 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 27 23:40:57.475914 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.475903 2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 27 23:40:57.475914 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.475911 2556 kubelet.go:397] "Adding apiserver pod source" May 27 23:40:57.476026 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.475920 2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 27 23:40:57.477840 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.477797 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 27 23:40:57.477928 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.477861 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 27 23:40:57.483482 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.483460 2556 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 27 23:40:57.485706 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.485685 2556 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 27 23:40:57.487839 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.487819 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 27 23:40:57.487839 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.487842 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 27 23:40:57.487945 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.487852 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 27 23:40:57.487945 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.487864 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 27 23:40:57.487945 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.487873 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 27 23:40:57.487945 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.487879 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 27 23:40:57.487945 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.487885 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 27 23:40:57.487945 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.487890 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 27 23:40:57.487945 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.487897 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 27 23:40:57.487945 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.487902 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 27 23:40:57.487945 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.487911 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 27 23:40:57.487945 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.487916 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 27 23:40:57.488895 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.488884 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 27 23:40:57.488895 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.488894 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 27 23:40:57.489084 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:40:57.489047 2556 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-22.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 27 23:40:57.489142 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:40:57.489122 2556 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 27 23:40:57.490546 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.490528 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lk2jz" May 27 23:40:57.492015 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.492001 2556 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 27 23:40:57.492076 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.492038 2556 server.go:1295] "Started kubelet" May 27 23:40:57.492140 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.492091 2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 27 23:40:57.492192 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.492122 2556 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 27 23:40:57.492192 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.492177 2556 server_v1.go:47] "podresources" method="list" useActivePods=true May 27 23:40:57.492855 ip-10-0-128-22 systemd[1]: Started Kubernetes Kubelet. May 27 23:40:57.493723 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.493596 2556 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 27 23:40:57.495163 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.495149 2556 server.go:317] "Adding debug handlers to kubelet server" May 27 23:40:57.499887 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.499872 2556 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-22.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 27 23:40:57.500792 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:40:57.499579 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-22.ec2.internal.18b390975b8ea875 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-22.ec2.internal,UID:ip-10-0-128-22.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-22.ec2.internal,},FirstTimestamp:2026-05-27 23:40:57.492015221 +0000 UTC m=+0.418916801,LastTimestamp:2026-05-27 23:40:57.492015221 +0000 UTC m=+0.418916801,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-22.ec2.internal,}" May 27 23:40:57.501402 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:40:57.501384 2556 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 27 23:40:57.502391 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.502377 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 27 23:40:57.503113 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.503097 2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 27 23:40:57.503202 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.503190 2556 volume_manager.go:295] "The desired_state_of_world populator starts" May 27 23:40:57.503202 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.503202 2556 volume_manager.go:297] "Starting Kubelet Volume Manager" May 27 23:40:57.503350 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.503329 2556 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 27 23:40:57.503422 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.503375 2556 reconstruct.go:97] "Volume reconstruction finished" May 27 23:40:57.503422 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.503388 2556 reconciler.go:26] "Reconciler: start to sync state" May 27 23:40:57.503771 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.503756 2556 factory.go:55] Registering systemd factory May 27 23:40:57.503842 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.503815 2556 factory.go:223] Registration of the systemd container factory successfully May 27 23:40:57.503969 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.503951 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lk2jz" May 27 23:40:57.504073 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.504057 2556 factory.go:153] Registering CRI-O factory May 27 23:40:57.504073 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:40:57.504066 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-22.ec2.internal\" not found" May 27 23:40:57.504159 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.504075 2556 factory.go:223] Registration of the crio container factory successfully May 27 23:40:57.504159 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.504130 2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 27 23:40:57.504159 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.504146 2556 factory.go:103] Registering Raw factory May 27 23:40:57.504263 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.504166 2556 manager.go:1196] Started watching for new ooms in manager May 27 23:40:57.504775 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.504763 2556 manager.go:319] Starting recovery of all containers May 27 23:40:57.506323 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:40:57.506299 2556 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 27 23:40:57.506323 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:40:57.506300 2556 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-22.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" May 27 23:40:57.515813 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.515610 2556 manager.go:324] Recovery completed May 27 23:40:57.520068 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.520054 2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 23:40:57.521692 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.521680 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-22.ec2.internal" event="NodeHasSufficientMemory" May 27 23:40:57.521775 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.521705 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-22.ec2.internal" event="NodeHasNoDiskPressure" May 27 23:40:57.521775 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.521715 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-22.ec2.internal" event="NodeHasSufficientPID" May 27 23:40:57.522214 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.522197 2556 cpu_manager.go:222] "Starting CPU manager" policy="none" May 27 23:40:57.522214 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.522212 2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 27 23:40:57.522297 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.522227 2556 state_mem.go:36] "Initialized new in-memory state store" May 27 23:40:57.525909 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.525897 2556 policy_none.go:49] "None policy: Start" May 27 23:40:57.525961 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.525914 2556 memory_manager.go:186] "Starting memorymanager" policy="None" May 27 23:40:57.525961 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.525924 2556 state_mem.go:35] "Initializing new in-memory state store" May 27 23:40:57.589630 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.575926 2556 manager.go:341] "Starting Device Plugin manager" May 27 23:40:57.589630 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:40:57.575951 2556 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 27 23:40:57.589630 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.575961 2556 server.go:85] "Starting device plugin registration server" May 27 23:40:57.589630 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.576198 2556 eviction_manager.go:189] "Eviction manager: starting control loop" May 27 23:40:57.589630 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.576214 2556 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 27 23:40:57.589630 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.576320 2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 27 23:40:57.589630 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.576428 2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 27 23:40:57.589630 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.576436 2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 27 23:40:57.589630 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:40:57.576883 2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 27 23:40:57.589630 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:40:57.576924 2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-22.ec2.internal\" not found" May 27 23:40:57.645334 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.645275 2556 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 27 23:40:57.646480 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.646465 2556 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 27 23:40:57.646572 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.646497 2556 status_manager.go:230] "Starting to sync pod status with apiserver" May 27 23:40:57.646572 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.646530 2556 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 27 23:40:57.646572 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.646540 2556 kubelet.go:2451] "Starting kubelet main sync loop" May 27 23:40:57.646729 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:40:57.646583 2556 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 27 23:40:57.648753 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.648735 2556 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 27 23:40:57.676686 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.676667 2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 23:40:57.677487 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.677471 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-22.ec2.internal" event="NodeHasSufficientMemory" May 27 23:40:57.677561 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.677499 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-22.ec2.internal" event="NodeHasNoDiskPressure" May 27 23:40:57.677561 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.677511 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-22.ec2.internal" event="NodeHasSufficientPID" May 27 23:40:57.677561 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.677539 2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-22.ec2.internal" May 27 23:40:57.688067 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.688049 2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-22.ec2.internal" May 27 23:40:57.688137 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:40:57.688071 2556 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-22.ec2.internal\": node \"ip-10-0-128-22.ec2.internal\" not found" May 27 23:40:57.728607 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:40:57.728580 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-22.ec2.internal\" not found" May 27 23:40:57.747183 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.747159 2556 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-22.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-22.ec2.internal"] May 27 23:40:57.747278 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.747230 2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 23:40:57.748854 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.748840 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-22.ec2.internal" event="NodeHasSufficientMemory" May 27 23:40:57.748925 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.748867 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-22.ec2.internal" event="NodeHasNoDiskPressure" May 27 23:40:57.748925 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.748878 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-22.ec2.internal" event="NodeHasSufficientPID" May 27 23:40:57.749975 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.749961 2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 23:40:57.750163 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.750148 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-22.ec2.internal" May 27 23:40:57.750230 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.750200 2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 23:40:57.750670 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.750653 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-22.ec2.internal" event="NodeHasSufficientMemory" May 27 23:40:57.750767 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.750658 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-22.ec2.internal" event="NodeHasSufficientMemory" May 27 23:40:57.750767 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.750709 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-22.ec2.internal" event="NodeHasNoDiskPressure" May 27 23:40:57.750767 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.750721 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-22.ec2.internal" event="NodeHasSufficientPID" May 27 23:40:57.750767 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.750687 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-22.ec2.internal" event="NodeHasNoDiskPressure" May 27 23:40:57.750767 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.750752 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-22.ec2.internal" event="NodeHasSufficientPID" May 27 23:40:57.751714 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.751702 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-22.ec2.internal" May 27 23:40:57.751762 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.751726 2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 23:40:57.752353 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.752337 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-22.ec2.internal" event="NodeHasSufficientMemory" May 27 23:40:57.752425 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.752367 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-22.ec2.internal" event="NodeHasNoDiskPressure" May 27 23:40:57.752425 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.752377 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-22.ec2.internal" event="NodeHasSufficientPID" May 27 23:40:57.775215 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:40:57.775194 2556 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-22.ec2.internal\" not found" node="ip-10-0-128-22.ec2.internal" May 27 23:40:57.779380 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:40:57.779364 2556 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-22.ec2.internal\" not found" node="ip-10-0-128-22.ec2.internal" May 27 23:40:57.804608 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.804587 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7399066287f38f7ad76a60ae70377aa4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-22.ec2.internal\" (UID: \"7399066287f38f7ad76a60ae70377aa4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-22.ec2.internal" May 27 23:40:57.804727 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.804611 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7399066287f38f7ad76a60ae70377aa4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-22.ec2.internal\" (UID: \"7399066287f38f7ad76a60ae70377aa4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-22.ec2.internal" May 27 23:40:57.804727 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.804630 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ff79473a562eff3ccf42c987addd6ef4-config\") pod \"kube-apiserver-proxy-ip-10-0-128-22.ec2.internal\" (UID: \"ff79473a562eff3ccf42c987addd6ef4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-22.ec2.internal" May 27 23:40:57.829203 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:40:57.829184 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-22.ec2.internal\" not found" May 27 23:40:57.905037 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.904968 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7399066287f38f7ad76a60ae70377aa4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-22.ec2.internal\" (UID: \"7399066287f38f7ad76a60ae70377aa4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-22.ec2.internal" May 27 23:40:57.905037 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.904997 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7399066287f38f7ad76a60ae70377aa4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-22.ec2.internal\" (UID: \"7399066287f38f7ad76a60ae70377aa4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-22.ec2.internal" May 27 23:40:57.905037 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.905014 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ff79473a562eff3ccf42c987addd6ef4-config\") pod \"kube-apiserver-proxy-ip-10-0-128-22.ec2.internal\" (UID: \"ff79473a562eff3ccf42c987addd6ef4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-22.ec2.internal" May 27 23:40:57.905192 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.905040 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ff79473a562eff3ccf42c987addd6ef4-config\") pod \"kube-apiserver-proxy-ip-10-0-128-22.ec2.internal\" (UID: \"ff79473a562eff3ccf42c987addd6ef4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-22.ec2.internal" May 27 23:40:57.905192 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.905071 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7399066287f38f7ad76a60ae70377aa4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-22.ec2.internal\" (UID: \"7399066287f38f7ad76a60ae70377aa4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-22.ec2.internal" May 27 23:40:57.905192 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:57.905071 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7399066287f38f7ad76a60ae70377aa4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-22.ec2.internal\" (UID: \"7399066287f38f7ad76a60ae70377aa4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-22.ec2.internal" May 27 23:40:57.930101 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:40:57.930057 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-22.ec2.internal\" not found" May 27 23:40:58.030736 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:40:58.030689 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-22.ec2.internal\" not found" May 27 23:40:58.077910 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:58.077878 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-22.ec2.internal" May 27 23:40:58.081666 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:58.081650 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-22.ec2.internal" May 27 23:40:58.131509 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:40:58.131484 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-22.ec2.internal\" not found" May 27 23:40:58.231973 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:40:58.231948 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-22.ec2.internal\" not found" May 27 23:40:58.332412 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:40:58.332386 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-22.ec2.internal\" not found" May 27 23:40:58.353945 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:58.353922 2556 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 27 23:40:58.372766 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:58.372747 2556 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 27 23:40:58.403726 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:58.403707 2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 27 23:40:58.404218 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:58.403808 2556 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 27 23:40:58.404218 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:58.403841 2556 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 27 23:40:58.404218 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:58.403854 2556 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 27 23:40:58.433138 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:40:58.433118 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-22.ec2.internal\" not found" May 27 23:40:58.503261 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:58.503206 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 27 23:40:58.507421 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:58.507387 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-26 23:35:57 +0000 UTC" deadline="2028-01-08 08:46:25.150208797 +0000 UTC" May 27 23:40:58.507421 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:58.507419 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14169h5m26.642797633s" May 27 23:40:58.517354 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:58.517338 2556 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 27 23:40:58.533779 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:40:58.533754 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-22.ec2.internal\" not found" May 27 23:40:58.544733 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:58.544708 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-45kdf" May 27 23:40:58.551061 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:58.551038 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-45kdf" May 27 23:40:58.634684 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:40:58.634650 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-22.ec2.internal\" not found" May 27 23:40:58.691632 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:58.691582 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff79473a562eff3ccf42c987addd6ef4.slice/crio-31b9904159cdfe184f7ee7bbb662685079730491a7ba3576a78d10d24fad20a8 WatchSource:0}: Error finding container 31b9904159cdfe184f7ee7bbb662685079730491a7ba3576a78d10d24fad20a8: Status 404 returned error can't find the container with id 31b9904159cdfe184f7ee7bbb662685079730491a7ba3576a78d10d24fad20a8 May 27 23:40:58.691835 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:40:58.691818 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7399066287f38f7ad76a60ae70377aa4.slice/crio-46473366dc2d18364687ca593bdec693fc6272da42dbb8f4537021d981e55a46 WatchSource:0}: Error finding container 46473366dc2d18364687ca593bdec693fc6272da42dbb8f4537021d981e55a46: Status 404 returned error can't find the container with id 46473366dc2d18364687ca593bdec693fc6272da42dbb8f4537021d981e55a46 May 27 23:40:58.695752 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:58.695735 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 23:40:58.735033 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:40:58.734998 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-22.ec2.internal\" not found" May 27 23:40:58.765125 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:58.765070 2556 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 27 23:40:58.804040 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:58.804018 2556 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-22.ec2.internal" May 27 23:40:58.817171 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:58.817154 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 27 23:40:58.818295 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:58.818283 2556 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-22.ec2.internal" May 27 23:40:58.831404 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:58.831389 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 27 23:40:59.477871 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.477840 2556 apiserver.go:52] "Watching apiserver" May 27 23:40:59.486980 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.486958 2556 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 27 23:40:59.488942 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.488889 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-tbcdd","kube-system/konnectivity-agent-dv6s4","kube-system/kube-apiserver-proxy-ip-10-0-128-22.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6m78w","openshift-dns/node-resolver-8hfsr","openshift-image-registry/node-ca-k2k6s","openshift-multus/multus-6qfrg","openshift-multus/multus-additional-cni-plugins-c4dx6","openshift-multus/network-metrics-daemon-t87h5","openshift-cluster-node-tuning-operator/tuned-48nz8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-22.ec2.internal","openshift-network-diagnostics/network-check-target-cwkwk","openshift-network-operator/iptables-alerter-7tr5v"] May 27 23:40:59.493203 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.493180 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6qfrg" May 27 23:40:59.493339 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.493315 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dv6s4" May 27 23:40:59.495838 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.495809 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 27 23:40:59.495946 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.495897 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 27 23:40:59.495946 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.495907 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 27 23:40:59.496489 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.496442 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 27 23:40:59.496608 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.496496 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 27 23:40:59.496608 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.496506 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 27 23:40:59.496608 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.496466 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vr4bc\"" May 27 23:40:59.496777 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.496702 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-w8dls\"" May 27 23:40:59.498098 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.497856 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6m78w" May 27 23:40:59.498098 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.497943 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8hfsr" May 27 23:40:59.499775 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.499754 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 27 23:40:59.499937 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.499920 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k2k6s" May 27 23:40:59.500137 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.500122 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4nqp6\"" May 27 23:40:59.500304 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.500290 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 27 23:40:59.500549 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.500533 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 27 23:40:59.500725 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.500710 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 27 23:40:59.500802 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.500785 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 27 23:40:59.500840 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.500807 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-m8ppk\"" May 27 23:40:59.501972 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.501931 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 27 23:40:59.502216 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.502199 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 27 23:40:59.502433 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.502416 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5wh5j\"" May 27 23:40:59.503495 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.502799 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 27 23:40:59.503495 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.503157 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.505198 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.505175 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 27 23:40:59.505415 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.505394 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 27 23:40:59.505717 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.505627 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 27 23:40:59.506202 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.506180 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bbs7k\"" May 27 23:40:59.506688 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.506558 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 27 23:40:59.506688 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.506595 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 27 23:40:59.510807 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.510469 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t87h5" May 27 23:40:59.510807 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.510498 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-c4dx6" May 27 23:40:59.510807 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:40:59.510553 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t87h5" podUID="b407d9da-589e-4803-abad-d70c5a21a11a" May 27 23:40:59.510807 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.510571 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 27 23:40:59.512820 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.512779 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c82e3b33-c73d-4543-9baf-2784cc72d33e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.512820 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.512818 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c82e3b33-c73d-4543-9baf-2784cc72d33e-ovnkube-config\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.512975 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.512844 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/95ce23f5-a9ec-4203-9875-1f8bd5254019-cni-binary-copy\") pod \"multus-6qfrg\" (UID: \"95ce23f5-a9ec-4203-9875-1f8bd5254019\") " pod="openshift-multus/multus-6qfrg" May 27 23:40:59.512975 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.512869 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c82e3b33-c73d-4543-9baf-2784cc72d33e-env-overrides\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.512975 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.512894 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc798\" (UniqueName: \"kubernetes.io/projected/cd79991b-47fe-457f-b415-c8ecd5c442c9-kube-api-access-kc798\") pod \"node-resolver-8hfsr\" (UID: \"cd79991b-47fe-457f-b415-c8ecd5c442c9\") " pod="openshift-dns/node-resolver-8hfsr" May 27 23:40:59.512975 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.512917 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c82e3b33-c73d-4543-9baf-2784cc72d33e-host-kubelet\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.512975 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.512939 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c82e3b33-c73d-4543-9baf-2784cc72d33e-host-slash\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.512975 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.512954 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0c0f7a5c-3e27-4d16-8d4f-f646b819f865-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6m78w\" (UID: \"0c0f7a5c-3e27-4d16-8d4f-f646b819f865\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6m78w" May 27 23:40:59.513255 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.512996 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0c0f7a5c-3e27-4d16-8d4f-f646b819f865-device-dir\") pod \"aws-ebs-csi-driver-node-6m78w\" (UID: \"0c0f7a5c-3e27-4d16-8d4f-f646b819f865\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6m78w" May 27 23:40:59.513255 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.513023 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0c0f7a5c-3e27-4d16-8d4f-f646b819f865-socket-dir\") pod \"aws-ebs-csi-driver-node-6m78w\" (UID: \"0c0f7a5c-3e27-4d16-8d4f-f646b819f865\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6m78w" May 27 23:40:59.513255 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.513054 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/95ce23f5-a9ec-4203-9875-1f8bd5254019-host-run-k8s-cni-cncf-io\") pod \"multus-6qfrg\" (UID: \"95ce23f5-a9ec-4203-9875-1f8bd5254019\") " pod="openshift-multus/multus-6qfrg" May 27 23:40:59.513255 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.513077 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c82e3b33-c73d-4543-9baf-2784cc72d33e-var-lib-openvswitch\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.513255 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.513100 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ff3537f7-1ece-4ffa-a8c8-b42b200cee3a-cnibin\") pod \"multus-additional-cni-plugins-c4dx6\" (UID: \"ff3537f7-1ece-4ffa-a8c8-b42b200cee3a\") " pod="openshift-multus/multus-additional-cni-plugins-c4dx6" May 27 23:40:59.513255 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.513121 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ff3537f7-1ece-4ffa-a8c8-b42b200cee3a-os-release\") pod \"multus-additional-cni-plugins-c4dx6\" (UID: \"ff3537f7-1ece-4ffa-a8c8-b42b200cee3a\") " pod="openshift-multus/multus-additional-cni-plugins-c4dx6" May 27 23:40:59.513255 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.513147 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7w82\" (UniqueName: \"kubernetes.io/projected/ff3537f7-1ece-4ffa-a8c8-b42b200cee3a-kube-api-access-w7w82\") pod \"multus-additional-cni-plugins-c4dx6\" (UID: \"ff3537f7-1ece-4ffa-a8c8-b42b200cee3a\") " pod="openshift-multus/multus-additional-cni-plugins-c4dx6" May 27 23:40:59.513255 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.513204 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8wzl\" (UniqueName: \"kubernetes.io/projected/0c0f7a5c-3e27-4d16-8d4f-f646b819f865-kube-api-access-z8wzl\") pod \"aws-ebs-csi-driver-node-6m78w\" (UID: \"0c0f7a5c-3e27-4d16-8d4f-f646b819f865\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6m78w" May 27 23:40:59.513255 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.513240 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e682bdbf-0081-4b2e-b8fc-bf23a7a18612-host\") pod \"node-ca-k2k6s\" (UID: \"e682bdbf-0081-4b2e-b8fc-bf23a7a18612\") " pod="openshift-image-registry/node-ca-k2k6s" May 27 23:40:59.513724 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.513266 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c82e3b33-c73d-4543-9baf-2784cc72d33e-ovn-node-metrics-cert\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.513724 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.513292 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ff3537f7-1ece-4ffa-a8c8-b42b200cee3a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c4dx6\" (UID: \"ff3537f7-1ece-4ffa-a8c8-b42b200cee3a\") " pod="openshift-multus/multus-additional-cni-plugins-c4dx6" May 27 23:40:59.513724 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.513333 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ff3537f7-1ece-4ffa-a8c8-b42b200cee3a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c4dx6\" (UID: \"ff3537f7-1ece-4ffa-a8c8-b42b200cee3a\") " pod="openshift-multus/multus-additional-cni-plugins-c4dx6" May 27 23:40:59.513724 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.513381 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fc83aa1e-cc07-4d4a-91d1-df90c691f148-konnectivity-ca\") pod \"konnectivity-agent-dv6s4\" (UID: \"fc83aa1e-cc07-4d4a-91d1-df90c691f148\") " pod="kube-system/konnectivity-agent-dv6s4" May 27 23:40:59.513724 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.513425 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c82e3b33-c73d-4543-9baf-2784cc72d33e-etc-openvswitch\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.513724 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.513469 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c82e3b33-c73d-4543-9baf-2784cc72d33e-host-cni-bin\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.513724 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.513496 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c82e3b33-c73d-4543-9baf-2784cc72d33e-host-cni-netd\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.513724 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.513521 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd79991b-47fe-457f-b415-c8ecd5c442c9-tmp-dir\") pod \"node-resolver-8hfsr\" (UID: \"cd79991b-47fe-457f-b415-c8ecd5c442c9\") " pod="openshift-dns/node-resolver-8hfsr" May 27 23:40:59.513724 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.513548 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/95ce23f5-a9ec-4203-9875-1f8bd5254019-multus-daemon-config\") pod \"multus-6qfrg\" (UID: \"95ce23f5-a9ec-4203-9875-1f8bd5254019\") " pod="openshift-multus/multus-6qfrg" May 27 23:40:59.513724 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.513589 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c82e3b33-c73d-4543-9baf-2784cc72d33e-run-systemd\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.513724 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.513631 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c82e3b33-c73d-4543-9baf-2784cc72d33e-run-openvswitch\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.513724 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.513685 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/95ce23f5-a9ec-4203-9875-1f8bd5254019-host-var-lib-cni-bin\") pod \"multus-6qfrg\" (UID: \"95ce23f5-a9ec-4203-9875-1f8bd5254019\") " pod="openshift-multus/multus-6qfrg" May 27 23:40:59.514322 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.513735 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c82e3b33-c73d-4543-9baf-2784cc72d33e-ovnkube-script-lib\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.514322 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.513772 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ff3537f7-1ece-4ffa-a8c8-b42b200cee3a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c4dx6\" (UID: \"ff3537f7-1ece-4ffa-a8c8-b42b200cee3a\") " pod="openshift-multus/multus-additional-cni-plugins-c4dx6" May 27 23:40:59.514322 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.513800 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95ce23f5-a9ec-4203-9875-1f8bd5254019-system-cni-dir\") pod \"multus-6qfrg\" (UID: \"95ce23f5-a9ec-4203-9875-1f8bd5254019\") " pod="openshift-multus/multus-6qfrg" May 27 23:40:59.514322 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.513822 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/95ce23f5-a9ec-4203-9875-1f8bd5254019-cnibin\") pod \"multus-6qfrg\" (UID: \"95ce23f5-a9ec-4203-9875-1f8bd5254019\") " pod="openshift-multus/multus-6qfrg" May 27 23:40:59.514322 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.513844 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/95ce23f5-a9ec-4203-9875-1f8bd5254019-os-release\") pod \"multus-6qfrg\" (UID: \"95ce23f5-a9ec-4203-9875-1f8bd5254019\") " pod="openshift-multus/multus-6qfrg" May 27 23:40:59.514322 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.513881 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b47hh\" (UniqueName: \"kubernetes.io/projected/95ce23f5-a9ec-4203-9875-1f8bd5254019-kube-api-access-b47hh\") pod \"multus-6qfrg\" (UID: \"95ce23f5-a9ec-4203-9875-1f8bd5254019\") " pod="openshift-multus/multus-6qfrg" May 27 23:40:59.514322 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.513916 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brrcr\" (UniqueName: \"kubernetes.io/projected/e682bdbf-0081-4b2e-b8fc-bf23a7a18612-kube-api-access-brrcr\") pod \"node-ca-k2k6s\" (UID: \"e682bdbf-0081-4b2e-b8fc-bf23a7a18612\") " pod="openshift-image-registry/node-ca-k2k6s" May 27 23:40:59.514322 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.513965 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c82e3b33-c73d-4543-9baf-2784cc72d33e-run-ovn\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.514322 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.513973 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-m9bc8\"" May 27 23:40:59.514322 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.513993 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c82e3b33-c73d-4543-9baf-2784cc72d33e-host-run-ovn-kubernetes\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.514322 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.514023 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/95ce23f5-a9ec-4203-9875-1f8bd5254019-host-run-netns\") pod \"multus-6qfrg\" (UID: \"95ce23f5-a9ec-4203-9875-1f8bd5254019\") " pod="openshift-multus/multus-6qfrg" May 27 23:40:59.514322 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.514032 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 27 23:40:59.514322 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.514061 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/95ce23f5-a9ec-4203-9875-1f8bd5254019-host-run-multus-certs\") pod \"multus-6qfrg\" (UID: \"95ce23f5-a9ec-4203-9875-1f8bd5254019\") " pod="openshift-multus/multus-6qfrg" May 27 23:40:59.514322 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.514087 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fc83aa1e-cc07-4d4a-91d1-df90c691f148-agent-certs\") pod \"konnectivity-agent-dv6s4\" (UID: \"fc83aa1e-cc07-4d4a-91d1-df90c691f148\") " pod="kube-system/konnectivity-agent-dv6s4" May 27 23:40:59.514322 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.514113 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c82e3b33-c73d-4543-9baf-2784cc72d33e-node-log\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.514322 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.514138 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/95ce23f5-a9ec-4203-9875-1f8bd5254019-multus-conf-dir\") pod \"multus-6qfrg\" (UID: \"95ce23f5-a9ec-4203-9875-1f8bd5254019\") " pod="openshift-multus/multus-6qfrg" May 27 23:40:59.514322 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.514187 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95ce23f5-a9ec-4203-9875-1f8bd5254019-etc-kubernetes\") pod \"multus-6qfrg\" (UID: \"95ce23f5-a9ec-4203-9875-1f8bd5254019\") " pod="openshift-multus/multus-6qfrg" May 27 23:40:59.514322 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.514222 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j98mz\" (UniqueName: \"kubernetes.io/projected/c82e3b33-c73d-4543-9baf-2784cc72d33e-kube-api-access-j98mz\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.515059 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.514229 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 27 23:40:59.515059 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.514250 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95ce23f5-a9ec-4203-9875-1f8bd5254019-multus-cni-dir\") pod \"multus-6qfrg\" (UID: \"95ce23f5-a9ec-4203-9875-1f8bd5254019\") " pod="openshift-multus/multus-6qfrg" May 27 23:40:59.515059 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.514392 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/95ce23f5-a9ec-4203-9875-1f8bd5254019-hostroot\") pod \"multus-6qfrg\" (UID: \"95ce23f5-a9ec-4203-9875-1f8bd5254019\") " pod="openshift-multus/multus-6qfrg" May 27 23:40:59.515059 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.514449 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0c0f7a5c-3e27-4d16-8d4f-f646b819f865-registration-dir\") pod \"aws-ebs-csi-driver-node-6m78w\" (UID: \"0c0f7a5c-3e27-4d16-8d4f-f646b819f865\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6m78w" May 27 23:40:59.515059 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.514475 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0c0f7a5c-3e27-4d16-8d4f-f646b819f865-etc-selinux\") pod \"aws-ebs-csi-driver-node-6m78w\" (UID: \"0c0f7a5c-3e27-4d16-8d4f-f646b819f865\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6m78w" May 27 23:40:59.515059 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.514515 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0c0f7a5c-3e27-4d16-8d4f-f646b819f865-sys-fs\") pod \"aws-ebs-csi-driver-node-6m78w\" (UID: \"0c0f7a5c-3e27-4d16-8d4f-f646b819f865\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6m78w" May 27 23:40:59.515059 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.514556 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e682bdbf-0081-4b2e-b8fc-bf23a7a18612-serviceca\") pod \"node-ca-k2k6s\" (UID: \"e682bdbf-0081-4b2e-b8fc-bf23a7a18612\") " pod="openshift-image-registry/node-ca-k2k6s" May 27 23:40:59.515059 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.514595 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c82e3b33-c73d-4543-9baf-2784cc72d33e-log-socket\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.515059 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.514666 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cd79991b-47fe-457f-b415-c8ecd5c442c9-hosts-file\") pod \"node-resolver-8hfsr\" (UID: \"cd79991b-47fe-457f-b415-c8ecd5c442c9\") " pod="openshift-dns/node-resolver-8hfsr" May 27 23:40:59.515059 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.514694 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff3537f7-1ece-4ffa-a8c8-b42b200cee3a-system-cni-dir\") pod \"multus-additional-cni-plugins-c4dx6\" (UID: \"ff3537f7-1ece-4ffa-a8c8-b42b200cee3a\") " pod="openshift-multus/multus-additional-cni-plugins-c4dx6" May 27 23:40:59.515059 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.514721 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ff3537f7-1ece-4ffa-a8c8-b42b200cee3a-cni-binary-copy\") pod \"multus-additional-cni-plugins-c4dx6\" (UID: \"ff3537f7-1ece-4ffa-a8c8-b42b200cee3a\") " pod="openshift-multus/multus-additional-cni-plugins-c4dx6" May 27 23:40:59.515059 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.514747 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/95ce23f5-a9ec-4203-9875-1f8bd5254019-multus-socket-dir-parent\") pod \"multus-6qfrg\" (UID: \"95ce23f5-a9ec-4203-9875-1f8bd5254019\") " pod="openshift-multus/multus-6qfrg" May 27 23:40:59.515059 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.514801 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/95ce23f5-a9ec-4203-9875-1f8bd5254019-host-var-lib-cni-multus\") pod \"multus-6qfrg\" (UID: \"95ce23f5-a9ec-4203-9875-1f8bd5254019\") " pod="openshift-multus/multus-6qfrg" May 27 23:40:59.515059 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.514869 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/95ce23f5-a9ec-4203-9875-1f8bd5254019-host-var-lib-kubelet\") pod \"multus-6qfrg\" (UID: \"95ce23f5-a9ec-4203-9875-1f8bd5254019\") " pod="openshift-multus/multus-6qfrg" May 27 23:40:59.515059 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.514893 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c82e3b33-c73d-4543-9baf-2784cc72d33e-systemd-units\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.515059 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.514913 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c82e3b33-c73d-4543-9baf-2784cc72d33e-host-run-netns\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.516518 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.516501 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-48nz8" May 27 23:40:59.516703 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.516677 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cwkwk" May 27 23:40:59.516802 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:40:59.516759 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cwkwk" podUID="6a6ef6f8-506a-4fd5-886a-17d7e66340f8" May 27 23:40:59.518863 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.518842 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7tr5v" May 27 23:40:59.519153 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.519130 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 27 23:40:59.519408 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.519365 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 27 23:40:59.519503 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.519420 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-62cjm\"" May 27 23:40:59.520927 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.520911 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 27 23:40:59.521402 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.521278 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 27 23:40:59.521567 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.521551 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-njjfs\"" May 27 23:40:59.521794 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.521698 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 27 23:40:59.551648 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.551613 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-26 23:35:58 +0000 UTC" deadline="2027-11-15 20:10:01.97961483 +0000 UTC" May 27 23:40:59.551743 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.551632 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12884h29m2.427984349s" May 27 23:40:59.605284 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.605248 2556 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 27 23:40:59.615567 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.615540 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/95ce23f5-a9ec-4203-9875-1f8bd5254019-multus-daemon-config\") pod \"multus-6qfrg\" (UID: \"95ce23f5-a9ec-4203-9875-1f8bd5254019\") " pod="openshift-multus/multus-6qfrg" May 27 23:40:59.615684 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.615579 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c82e3b33-c73d-4543-9baf-2784cc72d33e-run-systemd\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.615684 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.615599 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c82e3b33-c73d-4543-9baf-2784cc72d33e-run-openvswitch\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.615790 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.615681 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c82e3b33-c73d-4543-9baf-2784cc72d33e-run-systemd\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.616413 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.616339 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/95ce23f5-a9ec-4203-9875-1f8bd5254019-multus-daemon-config\") pod \"multus-6qfrg\" (UID: \"95ce23f5-a9ec-4203-9875-1f8bd5254019\") " pod="openshift-multus/multus-6qfrg" May 27 23:40:59.616516 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.616361 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/95ce23f5-a9ec-4203-9875-1f8bd5254019-host-var-lib-cni-bin\") pod \"multus-6qfrg\" (UID: \"95ce23f5-a9ec-4203-9875-1f8bd5254019\") " pod="openshift-multus/multus-6qfrg" May 27 23:40:59.616516 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.616475 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c82e3b33-c73d-4543-9baf-2784cc72d33e-ovnkube-script-lib\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.616612 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.616503 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/95ce23f5-a9ec-4203-9875-1f8bd5254019-host-var-lib-cni-bin\") pod \"multus-6qfrg\" (UID: \"95ce23f5-a9ec-4203-9875-1f8bd5254019\") " pod="openshift-multus/multus-6qfrg" May 27 23:40:59.616612 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.616525 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c82e3b33-c73d-4543-9baf-2784cc72d33e-run-openvswitch\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.616612 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.616512 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ff3537f7-1ece-4ffa-a8c8-b42b200cee3a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c4dx6\" (UID: \"ff3537f7-1ece-4ffa-a8c8-b42b200cee3a\") " pod="openshift-multus/multus-additional-cni-plugins-c4dx6" May 27 23:40:59.616612 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.616590 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f829d62-45c3-4fae-bc63-1227501d75e2-etc-kubernetes\") pod \"tuned-48nz8\" (UID: \"3f829d62-45c3-4fae-bc63-1227501d75e2\") " pod="openshift-cluster-node-tuning-operator/tuned-48nz8" May 27 23:40:59.616822 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.616623 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95ce23f5-a9ec-4203-9875-1f8bd5254019-system-cni-dir\") pod \"multus-6qfrg\" (UID: \"95ce23f5-a9ec-4203-9875-1f8bd5254019\") " pod="openshift-multus/multus-6qfrg" May 27 23:40:59.616822 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.616673 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/95ce23f5-a9ec-4203-9875-1f8bd5254019-cnibin\") pod \"multus-6qfrg\" (UID: \"95ce23f5-a9ec-4203-9875-1f8bd5254019\") " pod="openshift-multus/multus-6qfrg" May 27 23:40:59.616822 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.616706 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95ce23f5-a9ec-4203-9875-1f8bd5254019-system-cni-dir\") pod \"multus-6qfrg\" (UID: \"95ce23f5-a9ec-4203-9875-1f8bd5254019\") " pod="openshift-multus/multus-6qfrg" May 27 23:40:59.616822 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.616706 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/95ce23f5-a9ec-4203-9875-1f8bd5254019-os-release\") pod \"multus-6qfrg\" (UID: \"95ce23f5-a9ec-4203-9875-1f8bd5254019\") " pod="openshift-multus/multus-6qfrg" May 27 23:40:59.616822 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.616791 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/95ce23f5-a9ec-4203-9875-1f8bd5254019-os-release\") pod \"multus-6qfrg\" (UID: \"95ce23f5-a9ec-4203-9875-1f8bd5254019\") " pod="openshift-multus/multus-6qfrg" May 27 23:40:59.616822 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.616791 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/95ce23f5-a9ec-4203-9875-1f8bd5254019-cnibin\") pod \"multus-6qfrg\" (UID: \"95ce23f5-a9ec-4203-9875-1f8bd5254019\") " pod="openshift-multus/multus-6qfrg" May 27 23:40:59.617108 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.616840 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b47hh\" (UniqueName: \"kubernetes.io/projected/95ce23f5-a9ec-4203-9875-1f8bd5254019-kube-api-access-b47hh\") pod \"multus-6qfrg\" (UID: \"95ce23f5-a9ec-4203-9875-1f8bd5254019\") " pod="openshift-multus/multus-6qfrg" May 27 23:40:59.617159 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.617127 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c82e3b33-c73d-4543-9baf-2784cc72d33e-ovnkube-script-lib\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.617206 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.617187 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-brrcr\" (UniqueName: \"kubernetes.io/projected/e682bdbf-0081-4b2e-b8fc-bf23a7a18612-kube-api-access-brrcr\") pod \"node-ca-k2k6s\" (UID: \"e682bdbf-0081-4b2e-b8fc-bf23a7a18612\") " pod="openshift-image-registry/node-ca-k2k6s" May 27 23:40:59.617261 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.617226 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c82e3b33-c73d-4543-9baf-2784cc72d33e-run-ovn\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.617307 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.617257 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c82e3b33-c73d-4543-9baf-2784cc72d33e-host-run-ovn-kubernetes\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.617307 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.617296 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3f829d62-45c3-4fae-bc63-1227501d75e2-etc-modprobe-d\") pod \"tuned-48nz8\" (UID: \"3f829d62-45c3-4fae-bc63-1227501d75e2\") " pod="openshift-cluster-node-tuning-operator/tuned-48nz8" May 27 23:40:59.617400 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.617332 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/95ce23f5-a9ec-4203-9875-1f8bd5254019-host-run-netns\") pod \"multus-6qfrg\" (UID: \"95ce23f5-a9ec-4203-9875-1f8bd5254019\") " pod="openshift-multus/multus-6qfrg" May 27 23:40:59.617400 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.617366 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/95ce23f5-a9ec-4203-9875-1f8bd5254019-host-run-multus-certs\") pod \"multus-6qfrg\" (UID: \"95ce23f5-a9ec-4203-9875-1f8bd5254019\") " pod="openshift-multus/multus-6qfrg" May 27 23:40:59.617494 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.617401 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fc83aa1e-cc07-4d4a-91d1-df90c691f148-agent-certs\") pod \"konnectivity-agent-dv6s4\" (UID: \"fc83aa1e-cc07-4d4a-91d1-df90c691f148\") " pod="kube-system/konnectivity-agent-dv6s4" May 27 23:40:59.617494 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.617429 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c82e3b33-c73d-4543-9baf-2784cc72d33e-node-log\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.617494 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.617465 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3f829d62-45c3-4fae-bc63-1227501d75e2-etc-systemd\") pod \"tuned-48nz8\" (UID: \"3f829d62-45c3-4fae-bc63-1227501d75e2\") " pod="openshift-cluster-node-tuning-operator/tuned-48nz8" May 27 23:40:59.617629 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.617499 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3f829d62-45c3-4fae-bc63-1227501d75e2-sys\") pod \"tuned-48nz8\" (UID: \"3f829d62-45c3-4fae-bc63-1227501d75e2\") " pod="openshift-cluster-node-tuning-operator/tuned-48nz8" May 27 23:40:59.617629 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.617497 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ff3537f7-1ece-4ffa-a8c8-b42b200cee3a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c4dx6\" (UID: \"ff3537f7-1ece-4ffa-a8c8-b42b200cee3a\") " pod="openshift-multus/multus-additional-cni-plugins-c4dx6" May 27 23:40:59.617629 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.617532 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3f829d62-45c3-4fae-bc63-1227501d75e2-host\") pod \"tuned-48nz8\" (UID: \"3f829d62-45c3-4fae-bc63-1227501d75e2\") " pod="openshift-cluster-node-tuning-operator/tuned-48nz8" May 27 23:40:59.617629 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.617588 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/95ce23f5-a9ec-4203-9875-1f8bd5254019-host-run-netns\") pod \"multus-6qfrg\" (UID: \"95ce23f5-a9ec-4203-9875-1f8bd5254019\") " pod="openshift-multus/multus-6qfrg" May 27 23:40:59.617629 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.617608 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/95ce23f5-a9ec-4203-9875-1f8bd5254019-host-run-multus-certs\") pod \"multus-6qfrg\" (UID: \"95ce23f5-a9ec-4203-9875-1f8bd5254019\") " pod="openshift-multus/multus-6qfrg" May 27 23:40:59.617891 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.617854 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c82e3b33-c73d-4543-9baf-2784cc72d33e-host-run-ovn-kubernetes\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.617946 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.617933 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c82e3b33-c73d-4543-9baf-2784cc72d33e-node-log\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.617996 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.617933 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8mzn\" (UniqueName: \"kubernetes.io/projected/3f829d62-45c3-4fae-bc63-1227501d75e2-kube-api-access-t8mzn\") pod \"tuned-48nz8\" (UID: \"3f829d62-45c3-4fae-bc63-1227501d75e2\") " pod="openshift-cluster-node-tuning-operator/tuned-48nz8" May 27 23:40:59.618047 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.617994 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c82e3b33-c73d-4543-9baf-2784cc72d33e-run-ovn\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.618092 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.618055 2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 27 23:40:59.618092 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.618082 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/95ce23f5-a9ec-4203-9875-1f8bd5254019-multus-conf-dir\") pod \"multus-6qfrg\" (UID: \"95ce23f5-a9ec-4203-9875-1f8bd5254019\") " pod="openshift-multus/multus-6qfrg" May 27 23:40:59.618177 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.618124 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95ce23f5-a9ec-4203-9875-1f8bd5254019-etc-kubernetes\") pod \"multus-6qfrg\" (UID: \"95ce23f5-a9ec-4203-9875-1f8bd5254019\") " pod="openshift-multus/multus-6qfrg" May 27 23:40:59.618221 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.618173 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j98mz\" (UniqueName: \"kubernetes.io/projected/c82e3b33-c73d-4543-9baf-2784cc72d33e-kube-api-access-j98mz\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.618271 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.618223 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b407d9da-589e-4803-abad-d70c5a21a11a-metrics-certs\") pod \"network-metrics-daemon-t87h5\" (UID: \"b407d9da-589e-4803-abad-d70c5a21a11a\") " pod="openshift-multus/network-metrics-daemon-t87h5" May 27 23:40:59.618318 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.618257 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95ce23f5-a9ec-4203-9875-1f8bd5254019-multus-cni-dir\") pod \"multus-6qfrg\" (UID: \"95ce23f5-a9ec-4203-9875-1f8bd5254019\") " pod="openshift-multus/multus-6qfrg" May 27 23:40:59.618318 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.618300 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/95ce23f5-a9ec-4203-9875-1f8bd5254019-hostroot\") pod \"multus-6qfrg\" (UID: \"95ce23f5-a9ec-4203-9875-1f8bd5254019\") " pod="openshift-multus/multus-6qfrg" May 27 23:40:59.618421 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.618391 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0c0f7a5c-3e27-4d16-8d4f-f646b819f865-registration-dir\") pod \"aws-ebs-csi-driver-node-6m78w\" (UID: \"0c0f7a5c-3e27-4d16-8d4f-f646b819f865\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6m78w" May 27 23:40:59.618467 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.618437 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0c0f7a5c-3e27-4d16-8d4f-f646b819f865-etc-selinux\") pod \"aws-ebs-csi-driver-node-6m78w\" (UID: \"0c0f7a5c-3e27-4d16-8d4f-f646b819f865\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6m78w" May 27 23:40:59.618516 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.618466 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0c0f7a5c-3e27-4d16-8d4f-f646b819f865-sys-fs\") pod \"aws-ebs-csi-driver-node-6m78w\" (UID: \"0c0f7a5c-3e27-4d16-8d4f-f646b819f865\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6m78w" May 27 23:40:59.618516 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.618509 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e682bdbf-0081-4b2e-b8fc-bf23a7a18612-serviceca\") pod \"node-ca-k2k6s\" (UID: \"e682bdbf-0081-4b2e-b8fc-bf23a7a18612\") " pod="openshift-image-registry/node-ca-k2k6s" May 27 23:40:59.618592 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.618538 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c82e3b33-c73d-4543-9baf-2784cc72d33e-log-socket\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.618592 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.618586 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cd79991b-47fe-457f-b415-c8ecd5c442c9-hosts-file\") pod \"node-resolver-8hfsr\" (UID: \"cd79991b-47fe-457f-b415-c8ecd5c442c9\") " pod="openshift-dns/node-resolver-8hfsr" May 27 23:40:59.618688 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.618617 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff3537f7-1ece-4ffa-a8c8-b42b200cee3a-system-cni-dir\") pod \"multus-additional-cni-plugins-c4dx6\" (UID: \"ff3537f7-1ece-4ffa-a8c8-b42b200cee3a\") " pod="openshift-multus/multus-additional-cni-plugins-c4dx6" May 27 23:40:59.618732 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.618698 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ff3537f7-1ece-4ffa-a8c8-b42b200cee3a-cni-binary-copy\") pod \"multus-additional-cni-plugins-c4dx6\" (UID: \"ff3537f7-1ece-4ffa-a8c8-b42b200cee3a\") " pod="openshift-multus/multus-additional-cni-plugins-c4dx6" May 27 23:40:59.618827 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.618809 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/95ce23f5-a9ec-4203-9875-1f8bd5254019-multus-socket-dir-parent\") pod \"multus-6qfrg\" (UID: \"95ce23f5-a9ec-4203-9875-1f8bd5254019\") " pod="openshift-multus/multus-6qfrg" May 27 23:40:59.618908 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.618883 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0c0f7a5c-3e27-4d16-8d4f-f646b819f865-registration-dir\") pod \"aws-ebs-csi-driver-node-6m78w\" (UID: \"0c0f7a5c-3e27-4d16-8d4f-f646b819f865\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6m78w" May 27 23:40:59.618908 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.618829 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95ce23f5-a9ec-4203-9875-1f8bd5254019-multus-cni-dir\") pod \"multus-6qfrg\" (UID: \"95ce23f5-a9ec-4203-9875-1f8bd5254019\") " pod="openshift-multus/multus-6qfrg" May 27 23:40:59.618908 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.618834 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cd79991b-47fe-457f-b415-c8ecd5c442c9-hosts-file\") pod \"node-resolver-8hfsr\" (UID: \"cd79991b-47fe-457f-b415-c8ecd5c442c9\") " pod="openshift-dns/node-resolver-8hfsr" May 27 23:40:59.619132 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.618889 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95ce23f5-a9ec-4203-9875-1f8bd5254019-etc-kubernetes\") pod \"multus-6qfrg\" (UID: \"95ce23f5-a9ec-4203-9875-1f8bd5254019\") " pod="openshift-multus/multus-6qfrg" May 27 23:40:59.619132 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.618901 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff3537f7-1ece-4ffa-a8c8-b42b200cee3a-system-cni-dir\") pod \"multus-additional-cni-plugins-c4dx6\" (UID: \"ff3537f7-1ece-4ffa-a8c8-b42b200cee3a\") " pod="openshift-multus/multus-additional-cni-plugins-c4dx6" May 27 23:40:59.619132 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.618935 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0c0f7a5c-3e27-4d16-8d4f-f646b819f865-etc-selinux\") pod \"aws-ebs-csi-driver-node-6m78w\" (UID: \"0c0f7a5c-3e27-4d16-8d4f-f646b819f865\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6m78w" May 27 23:40:59.619132 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.618951 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/95ce23f5-a9ec-4203-9875-1f8bd5254019-multus-conf-dir\") pod \"multus-6qfrg\" (UID: \"95ce23f5-a9ec-4203-9875-1f8bd5254019\") " pod="openshift-multus/multus-6qfrg" May 27 23:40:59.619132 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.618866 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c82e3b33-c73d-4543-9baf-2784cc72d33e-log-socket\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.619132 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.619012 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/95ce23f5-a9ec-4203-9875-1f8bd5254019-hostroot\") pod \"multus-6qfrg\" (UID: \"95ce23f5-a9ec-4203-9875-1f8bd5254019\") " pod="openshift-multus/multus-6qfrg" May 27 23:40:59.619132 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.619069 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/95ce23f5-a9ec-4203-9875-1f8bd5254019-host-var-lib-cni-multus\") pod \"multus-6qfrg\" (UID: \"95ce23f5-a9ec-4203-9875-1f8bd5254019\") " pod="openshift-multus/multus-6qfrg" May 27 23:40:59.619510 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.619200 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0c0f7a5c-3e27-4d16-8d4f-f646b819f865-sys-fs\") pod \"aws-ebs-csi-driver-node-6m78w\" (UID: \"0c0f7a5c-3e27-4d16-8d4f-f646b819f865\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6m78w" May 27 23:40:59.619510 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.619289 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e682bdbf-0081-4b2e-b8fc-bf23a7a18612-serviceca\") pod \"node-ca-k2k6s\" (UID: \"e682bdbf-0081-4b2e-b8fc-bf23a7a18612\") " pod="openshift-image-registry/node-ca-k2k6s" May 27 23:40:59.619510 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.619441 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/95ce23f5-a9ec-4203-9875-1f8bd5254019-host-var-lib-kubelet\") pod \"multus-6qfrg\" (UID: \"95ce23f5-a9ec-4203-9875-1f8bd5254019\") " pod="openshift-multus/multus-6qfrg" May 27 23:40:59.619510 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.619471 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c82e3b33-c73d-4543-9baf-2784cc72d33e-systemd-units\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.619510 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.619473 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ff3537f7-1ece-4ffa-a8c8-b42b200cee3a-cni-binary-copy\") pod \"multus-additional-cni-plugins-c4dx6\" (UID: \"ff3537f7-1ece-4ffa-a8c8-b42b200cee3a\") " pod="openshift-multus/multus-additional-cni-plugins-c4dx6" May 27 23:40:59.619510 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.619506 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c82e3b33-c73d-4543-9baf-2784cc72d33e-host-run-netns\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.619816 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.619529 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3f829d62-45c3-4fae-bc63-1227501d75e2-etc-sysconfig\") pod \"tuned-48nz8\" (UID: \"3f829d62-45c3-4fae-bc63-1227501d75e2\") " pod="openshift-cluster-node-tuning-operator/tuned-48nz8" May 27 23:40:59.619816 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.619541 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/95ce23f5-a9ec-4203-9875-1f8bd5254019-multus-socket-dir-parent\") pod \"multus-6qfrg\" (UID: \"95ce23f5-a9ec-4203-9875-1f8bd5254019\") " pod="openshift-multus/multus-6qfrg" May 27 23:40:59.619816 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.619559 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c82e3b33-c73d-4543-9baf-2784cc72d33e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.619816 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.619624 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c82e3b33-c73d-4543-9baf-2784cc72d33e-systemd-units\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.619816 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.619686 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c82e3b33-c73d-4543-9baf-2784cc72d33e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.619816 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.619726 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/95ce23f5-a9ec-4203-9875-1f8bd5254019-host-var-lib-kubelet\") pod \"multus-6qfrg\" (UID: \"95ce23f5-a9ec-4203-9875-1f8bd5254019\") " pod="openshift-multus/multus-6qfrg" May 27 23:40:59.619816 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.619770 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/95ce23f5-a9ec-4203-9875-1f8bd5254019-host-var-lib-cni-multus\") pod \"multus-6qfrg\" (UID: \"95ce23f5-a9ec-4203-9875-1f8bd5254019\") " pod="openshift-multus/multus-6qfrg" May 27 23:40:59.619816 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.619808 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c82e3b33-c73d-4543-9baf-2784cc72d33e-host-run-netns\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.620155 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.619847 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c82e3b33-c73d-4543-9baf-2784cc72d33e-ovnkube-config\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.620155 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.619902 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3f829d62-45c3-4fae-bc63-1227501d75e2-run\") pod \"tuned-48nz8\" (UID: \"3f829d62-45c3-4fae-bc63-1227501d75e2\") " pod="openshift-cluster-node-tuning-operator/tuned-48nz8" May 27 23:40:59.620155 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.619927 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f829d62-45c3-4fae-bc63-1227501d75e2-tmp\") pod \"tuned-48nz8\" (UID: \"3f829d62-45c3-4fae-bc63-1227501d75e2\") " pod="openshift-cluster-node-tuning-operator/tuned-48nz8" May 27 23:40:59.620155 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.619972 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/340c3057-5db9-47aa-9894-64c7f8db149f-iptables-alerter-script\") pod \"iptables-alerter-7tr5v\" (UID: \"340c3057-5db9-47aa-9894-64c7f8db149f\") " pod="openshift-network-operator/iptables-alerter-7tr5v" May 27 23:40:59.620155 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.620006 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/95ce23f5-a9ec-4203-9875-1f8bd5254019-cni-binary-copy\") pod \"multus-6qfrg\" (UID: \"95ce23f5-a9ec-4203-9875-1f8bd5254019\") " pod="openshift-multus/multus-6qfrg" May 27 23:40:59.620155 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.620032 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3f829d62-45c3-4fae-bc63-1227501d75e2-etc-tuned\") pod \"tuned-48nz8\" (UID: \"3f829d62-45c3-4fae-bc63-1227501d75e2\") " pod="openshift-cluster-node-tuning-operator/tuned-48nz8" May 27 23:40:59.620155 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.620092 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c82e3b33-c73d-4543-9baf-2784cc72d33e-env-overrides\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.620155 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.620119 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kc798\" (UniqueName: \"kubernetes.io/projected/cd79991b-47fe-457f-b415-c8ecd5c442c9-kube-api-access-kc798\") pod \"node-resolver-8hfsr\" (UID: \"cd79991b-47fe-457f-b415-c8ecd5c442c9\") " pod="openshift-dns/node-resolver-8hfsr" May 27 23:40:59.620155 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.620148 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c82e3b33-c73d-4543-9baf-2784cc72d33e-host-kubelet\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.620526 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.620176 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c82e3b33-c73d-4543-9baf-2784cc72d33e-host-slash\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.620526 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.620206 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0c0f7a5c-3e27-4d16-8d4f-f646b819f865-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6m78w\" (UID: \"0c0f7a5c-3e27-4d16-8d4f-f646b819f865\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6m78w" May 27 23:40:59.620526 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.620236 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0c0f7a5c-3e27-4d16-8d4f-f646b819f865-device-dir\") pod \"aws-ebs-csi-driver-node-6m78w\" (UID: \"0c0f7a5c-3e27-4d16-8d4f-f646b819f865\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6m78w" May 27 23:40:59.620526 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.620260 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0c0f7a5c-3e27-4d16-8d4f-f646b819f865-socket-dir\") pod \"aws-ebs-csi-driver-node-6m78w\" (UID: \"0c0f7a5c-3e27-4d16-8d4f-f646b819f865\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6m78w" May 27 23:40:59.620526 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.620340 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/95ce23f5-a9ec-4203-9875-1f8bd5254019-host-run-k8s-cni-cncf-io\") pod \"multus-6qfrg\" (UID: \"95ce23f5-a9ec-4203-9875-1f8bd5254019\") " pod="openshift-multus/multus-6qfrg" May 27 23:40:59.620526 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.620367 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c82e3b33-c73d-4543-9baf-2784cc72d33e-var-lib-openvswitch\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.620526 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.620395 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ff3537f7-1ece-4ffa-a8c8-b42b200cee3a-cnibin\") pod \"multus-additional-cni-plugins-c4dx6\" (UID: \"ff3537f7-1ece-4ffa-a8c8-b42b200cee3a\") " pod="openshift-multus/multus-additional-cni-plugins-c4dx6" May 27 23:40:59.620526 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.620423 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ff3537f7-1ece-4ffa-a8c8-b42b200cee3a-os-release\") pod \"multus-additional-cni-plugins-c4dx6\" (UID: \"ff3537f7-1ece-4ffa-a8c8-b42b200cee3a\") " pod="openshift-multus/multus-additional-cni-plugins-c4dx6" May 27 23:40:59.620526 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.620497 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c82e3b33-c73d-4543-9baf-2784cc72d33e-host-slash\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.620982 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.620528 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ff3537f7-1ece-4ffa-a8c8-b42b200cee3a-cnibin\") pod \"multus-additional-cni-plugins-c4dx6\" (UID: \"ff3537f7-1ece-4ffa-a8c8-b42b200cee3a\") " pod="openshift-multus/multus-additional-cni-plugins-c4dx6" May 27 23:40:59.620982 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.620565 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c82e3b33-c73d-4543-9baf-2784cc72d33e-var-lib-openvswitch\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.620982 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.620703 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c82e3b33-c73d-4543-9baf-2784cc72d33e-host-kubelet\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.620982 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.620754 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/95ce23f5-a9ec-4203-9875-1f8bd5254019-host-run-k8s-cni-cncf-io\") pod \"multus-6qfrg\" (UID: \"95ce23f5-a9ec-4203-9875-1f8bd5254019\") " pod="openshift-multus/multus-6qfrg" May 27 23:40:59.620982 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.620764 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0c0f7a5c-3e27-4d16-8d4f-f646b819f865-socket-dir\") pod \"aws-ebs-csi-driver-node-6m78w\" (UID: \"0c0f7a5c-3e27-4d16-8d4f-f646b819f865\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6m78w" May 27 23:40:59.620982 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.620834 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ff3537f7-1ece-4ffa-a8c8-b42b200cee3a-os-release\") pod \"multus-additional-cni-plugins-c4dx6\" (UID: \"ff3537f7-1ece-4ffa-a8c8-b42b200cee3a\") " pod="openshift-multus/multus-additional-cni-plugins-c4dx6" May 27 23:40:59.620982 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.620893 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c82e3b33-c73d-4543-9baf-2784cc72d33e-env-overrides\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.620982 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.620513 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w7w82\" (UniqueName: \"kubernetes.io/projected/ff3537f7-1ece-4ffa-a8c8-b42b200cee3a-kube-api-access-w7w82\") pod \"multus-additional-cni-plugins-c4dx6\" (UID: \"ff3537f7-1ece-4ffa-a8c8-b42b200cee3a\") " pod="openshift-multus/multus-additional-cni-plugins-c4dx6" May 27 23:40:59.620982 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.620970 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0c0f7a5c-3e27-4d16-8d4f-f646b819f865-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6m78w\" (UID: \"0c0f7a5c-3e27-4d16-8d4f-f646b819f865\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6m78w" May 27 23:40:59.620982 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.620976 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z8wzl\" (UniqueName: \"kubernetes.io/projected/0c0f7a5c-3e27-4d16-8d4f-f646b819f865-kube-api-access-z8wzl\") pod \"aws-ebs-csi-driver-node-6m78w\" (UID: \"0c0f7a5c-3e27-4d16-8d4f-f646b819f865\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6m78w" May 27 23:40:59.621464 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.621149 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wml5g\" (UniqueName: \"kubernetes.io/projected/6a6ef6f8-506a-4fd5-886a-17d7e66340f8-kube-api-access-wml5g\") pod \"network-check-target-cwkwk\" (UID: \"6a6ef6f8-506a-4fd5-886a-17d7e66340f8\") " pod="openshift-network-diagnostics/network-check-target-cwkwk" May 27 23:40:59.621464 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.621311 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3f829d62-45c3-4fae-bc63-1227501d75e2-etc-sysctl-conf\") pod \"tuned-48nz8\" (UID: \"3f829d62-45c3-4fae-bc63-1227501d75e2\") " pod="openshift-cluster-node-tuning-operator/tuned-48nz8" May 27 23:40:59.621464 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.621340 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e682bdbf-0081-4b2e-b8fc-bf23a7a18612-host\") pod \"node-ca-k2k6s\" (UID: \"e682bdbf-0081-4b2e-b8fc-bf23a7a18612\") " pod="openshift-image-registry/node-ca-k2k6s" May 27 23:40:59.621464 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.621159 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c82e3b33-c73d-4543-9baf-2784cc72d33e-ovnkube-config\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.621464 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.621234 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0c0f7a5c-3e27-4d16-8d4f-f646b819f865-device-dir\") pod \"aws-ebs-csi-driver-node-6m78w\" (UID: \"0c0f7a5c-3e27-4d16-8d4f-f646b819f865\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6m78w" May 27 23:40:59.621464 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.621439 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e682bdbf-0081-4b2e-b8fc-bf23a7a18612-host\") pod \"node-ca-k2k6s\" (UID: \"e682bdbf-0081-4b2e-b8fc-bf23a7a18612\") " pod="openshift-image-registry/node-ca-k2k6s" May 27 23:40:59.621464 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.621373 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c82e3b33-c73d-4543-9baf-2784cc72d33e-ovn-node-metrics-cert\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.621820 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.621491 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ff3537f7-1ece-4ffa-a8c8-b42b200cee3a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c4dx6\" (UID: \"ff3537f7-1ece-4ffa-a8c8-b42b200cee3a\") " pod="openshift-multus/multus-additional-cni-plugins-c4dx6" May 27 23:40:59.621820 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.621530 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ff3537f7-1ece-4ffa-a8c8-b42b200cee3a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c4dx6\" (UID: \"ff3537f7-1ece-4ffa-a8c8-b42b200cee3a\") " pod="openshift-multus/multus-additional-cni-plugins-c4dx6" May 27 23:40:59.621820 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.621570 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3f829d62-45c3-4fae-bc63-1227501d75e2-etc-sysctl-d\") pod \"tuned-48nz8\" (UID: \"3f829d62-45c3-4fae-bc63-1227501d75e2\") " pod="openshift-cluster-node-tuning-operator/tuned-48nz8" May 27 23:40:59.621820 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.621601 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3f829d62-45c3-4fae-bc63-1227501d75e2-lib-modules\") pod \"tuned-48nz8\" (UID: \"3f829d62-45c3-4fae-bc63-1227501d75e2\") " pod="openshift-cluster-node-tuning-operator/tuned-48nz8" May 27 23:40:59.621820 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.621626 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vktmr\" (UniqueName: \"kubernetes.io/projected/340c3057-5db9-47aa-9894-64c7f8db149f-kube-api-access-vktmr\") pod \"iptables-alerter-7tr5v\" (UID: \"340c3057-5db9-47aa-9894-64c7f8db149f\") " pod="openshift-network-operator/iptables-alerter-7tr5v" May 27 23:40:59.621820 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.621669 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjjqx\" (UniqueName: \"kubernetes.io/projected/b407d9da-589e-4803-abad-d70c5a21a11a-kube-api-access-bjjqx\") pod \"network-metrics-daemon-t87h5\" (UID: \"b407d9da-589e-4803-abad-d70c5a21a11a\") " pod="openshift-multus/network-metrics-daemon-t87h5" May 27 23:40:59.621820 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.621717 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fc83aa1e-cc07-4d4a-91d1-df90c691f148-konnectivity-ca\") pod \"konnectivity-agent-dv6s4\" (UID: \"fc83aa1e-cc07-4d4a-91d1-df90c691f148\") " pod="kube-system/konnectivity-agent-dv6s4" May 27 23:40:59.621820 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.621753 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c82e3b33-c73d-4543-9baf-2784cc72d33e-etc-openvswitch\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.621820 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.621786 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c82e3b33-c73d-4543-9baf-2784cc72d33e-host-cni-bin\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.621820 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.621792 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ff3537f7-1ece-4ffa-a8c8-b42b200cee3a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c4dx6\" (UID: \"ff3537f7-1ece-4ffa-a8c8-b42b200cee3a\") " pod="openshift-multus/multus-additional-cni-plugins-c4dx6" May 27 23:40:59.621820 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.621820 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c82e3b33-c73d-4543-9baf-2784cc72d33e-host-cni-netd\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.622272 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.621853 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd79991b-47fe-457f-b415-c8ecd5c442c9-tmp-dir\") pod \"node-resolver-8hfsr\" (UID: \"cd79991b-47fe-457f-b415-c8ecd5c442c9\") " pod="openshift-dns/node-resolver-8hfsr" May 27 23:40:59.622272 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.621884 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f829d62-45c3-4fae-bc63-1227501d75e2-var-lib-kubelet\") pod \"tuned-48nz8\" (UID: \"3f829d62-45c3-4fae-bc63-1227501d75e2\") " pod="openshift-cluster-node-tuning-operator/tuned-48nz8" May 27 23:40:59.622272 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.621913 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/340c3057-5db9-47aa-9894-64c7f8db149f-host-slash\") pod \"iptables-alerter-7tr5v\" (UID: \"340c3057-5db9-47aa-9894-64c7f8db149f\") " pod="openshift-network-operator/iptables-alerter-7tr5v" May 27 23:40:59.622272 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.622021 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c82e3b33-c73d-4543-9baf-2784cc72d33e-host-cni-bin\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.622272 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.622080 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c82e3b33-c73d-4543-9baf-2784cc72d33e-host-cni-netd\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.622272 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.622073 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ff3537f7-1ece-4ffa-a8c8-b42b200cee3a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c4dx6\" (UID: \"ff3537f7-1ece-4ffa-a8c8-b42b200cee3a\") " pod="openshift-multus/multus-additional-cni-plugins-c4dx6" May 27 23:40:59.622272 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.621885 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c82e3b33-c73d-4543-9baf-2784cc72d33e-etc-openvswitch\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.622503 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.622350 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd79991b-47fe-457f-b415-c8ecd5c442c9-tmp-dir\") pod \"node-resolver-8hfsr\" (UID: \"cd79991b-47fe-457f-b415-c8ecd5c442c9\") " pod="openshift-dns/node-resolver-8hfsr" May 27 23:40:59.622870 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.622813 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fc83aa1e-cc07-4d4a-91d1-df90c691f148-konnectivity-ca\") pod \"konnectivity-agent-dv6s4\" (UID: \"fc83aa1e-cc07-4d4a-91d1-df90c691f148\") " pod="kube-system/konnectivity-agent-dv6s4" May 27 23:40:59.622971 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.622864 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fc83aa1e-cc07-4d4a-91d1-df90c691f148-agent-certs\") pod \"konnectivity-agent-dv6s4\" (UID: \"fc83aa1e-cc07-4d4a-91d1-df90c691f148\") " pod="kube-system/konnectivity-agent-dv6s4" May 27 23:40:59.623831 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.623809 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c82e3b33-c73d-4543-9baf-2784cc72d33e-ovn-node-metrics-cert\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.625013 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.624991 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/95ce23f5-a9ec-4203-9875-1f8bd5254019-cni-binary-copy\") pod \"multus-6qfrg\" (UID: \"95ce23f5-a9ec-4203-9875-1f8bd5254019\") " pod="openshift-multus/multus-6qfrg" May 27 23:40:59.626552 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.626528 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brrcr\" (UniqueName: \"kubernetes.io/projected/e682bdbf-0081-4b2e-b8fc-bf23a7a18612-kube-api-access-brrcr\") pod \"node-ca-k2k6s\" (UID: \"e682bdbf-0081-4b2e-b8fc-bf23a7a18612\") " pod="openshift-image-registry/node-ca-k2k6s" May 27 23:40:59.626853 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.626830 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b47hh\" (UniqueName: \"kubernetes.io/projected/95ce23f5-a9ec-4203-9875-1f8bd5254019-kube-api-access-b47hh\") pod \"multus-6qfrg\" (UID: \"95ce23f5-a9ec-4203-9875-1f8bd5254019\") " pod="openshift-multus/multus-6qfrg" May 27 23:40:59.627384 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.627366 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j98mz\" (UniqueName: \"kubernetes.io/projected/c82e3b33-c73d-4543-9baf-2784cc72d33e-kube-api-access-j98mz\") pod \"ovnkube-node-tbcdd\" (UID: \"c82e3b33-c73d-4543-9baf-2784cc72d33e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.628088 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.628069 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc798\" (UniqueName: \"kubernetes.io/projected/cd79991b-47fe-457f-b415-c8ecd5c442c9-kube-api-access-kc798\") pod \"node-resolver-8hfsr\" (UID: \"cd79991b-47fe-457f-b415-c8ecd5c442c9\") " pod="openshift-dns/node-resolver-8hfsr" May 27 23:40:59.630389 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.630371 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7w82\" (UniqueName: \"kubernetes.io/projected/ff3537f7-1ece-4ffa-a8c8-b42b200cee3a-kube-api-access-w7w82\") pod \"multus-additional-cni-plugins-c4dx6\" (UID: \"ff3537f7-1ece-4ffa-a8c8-b42b200cee3a\") " pod="openshift-multus/multus-additional-cni-plugins-c4dx6" May 27 23:40:59.630579 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.630563 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8wzl\" (UniqueName: \"kubernetes.io/projected/0c0f7a5c-3e27-4d16-8d4f-f646b819f865-kube-api-access-z8wzl\") pod \"aws-ebs-csi-driver-node-6m78w\" (UID: \"0c0f7a5c-3e27-4d16-8d4f-f646b819f865\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6m78w" May 27 23:40:59.650731 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.650675 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-22.ec2.internal" event={"ID":"ff79473a562eff3ccf42c987addd6ef4","Type":"ContainerStarted","Data":"31b9904159cdfe184f7ee7bbb662685079730491a7ba3576a78d10d24fad20a8"} May 27 23:40:59.651708 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.651689 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-22.ec2.internal" event={"ID":"7399066287f38f7ad76a60ae70377aa4","Type":"ContainerStarted","Data":"46473366dc2d18364687ca593bdec693fc6272da42dbb8f4537021d981e55a46"} May 27 23:40:59.689679 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.689655 2556 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 27 23:40:59.722619 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.722590 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wml5g\" (UniqueName: \"kubernetes.io/projected/6a6ef6f8-506a-4fd5-886a-17d7e66340f8-kube-api-access-wml5g\") pod \"network-check-target-cwkwk\" (UID: \"6a6ef6f8-506a-4fd5-886a-17d7e66340f8\") " pod="openshift-network-diagnostics/network-check-target-cwkwk" May 27 23:40:59.722737 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.722631 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3f829d62-45c3-4fae-bc63-1227501d75e2-etc-sysctl-conf\") pod \"tuned-48nz8\" (UID: \"3f829d62-45c3-4fae-bc63-1227501d75e2\") " pod="openshift-cluster-node-tuning-operator/tuned-48nz8" May 27 23:40:59.722737 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.722675 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3f829d62-45c3-4fae-bc63-1227501d75e2-etc-sysctl-d\") pod \"tuned-48nz8\" (UID: \"3f829d62-45c3-4fae-bc63-1227501d75e2\") " pod="openshift-cluster-node-tuning-operator/tuned-48nz8" May 27 23:40:59.722737 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.722699 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3f829d62-45c3-4fae-bc63-1227501d75e2-lib-modules\") pod \"tuned-48nz8\" (UID: \"3f829d62-45c3-4fae-bc63-1227501d75e2\") " pod="openshift-cluster-node-tuning-operator/tuned-48nz8" May 27 23:40:59.722737 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.722723 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vktmr\" (UniqueName: \"kubernetes.io/projected/340c3057-5db9-47aa-9894-64c7f8db149f-kube-api-access-vktmr\") pod \"iptables-alerter-7tr5v\" (UID: \"340c3057-5db9-47aa-9894-64c7f8db149f\") " pod="openshift-network-operator/iptables-alerter-7tr5v" May 27 23:40:59.722916 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.722770 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bjjqx\" (UniqueName: \"kubernetes.io/projected/b407d9da-589e-4803-abad-d70c5a21a11a-kube-api-access-bjjqx\") pod \"network-metrics-daemon-t87h5\" (UID: \"b407d9da-589e-4803-abad-d70c5a21a11a\") " pod="openshift-multus/network-metrics-daemon-t87h5" May 27 23:40:59.722916 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.722800 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f829d62-45c3-4fae-bc63-1227501d75e2-var-lib-kubelet\") pod \"tuned-48nz8\" (UID: \"3f829d62-45c3-4fae-bc63-1227501d75e2\") " pod="openshift-cluster-node-tuning-operator/tuned-48nz8" May 27 23:40:59.722916 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.722824 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/340c3057-5db9-47aa-9894-64c7f8db149f-host-slash\") pod \"iptables-alerter-7tr5v\" (UID: \"340c3057-5db9-47aa-9894-64c7f8db149f\") " pod="openshift-network-operator/iptables-alerter-7tr5v" May 27 23:40:59.722916 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.722852 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f829d62-45c3-4fae-bc63-1227501d75e2-etc-kubernetes\") pod \"tuned-48nz8\" (UID: \"3f829d62-45c3-4fae-bc63-1227501d75e2\") " pod="openshift-cluster-node-tuning-operator/tuned-48nz8" May 27 23:40:59.722916 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.722863 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3f829d62-45c3-4fae-bc63-1227501d75e2-etc-sysctl-d\") pod \"tuned-48nz8\" (UID: \"3f829d62-45c3-4fae-bc63-1227501d75e2\") " pod="openshift-cluster-node-tuning-operator/tuned-48nz8" May 27 23:40:59.722916 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.722875 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3f829d62-45c3-4fae-bc63-1227501d75e2-etc-sysctl-conf\") pod \"tuned-48nz8\" (UID: \"3f829d62-45c3-4fae-bc63-1227501d75e2\") " pod="openshift-cluster-node-tuning-operator/tuned-48nz8" May 27 23:40:59.722916 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.722885 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3f829d62-45c3-4fae-bc63-1227501d75e2-etc-modprobe-d\") pod \"tuned-48nz8\" (UID: \"3f829d62-45c3-4fae-bc63-1227501d75e2\") " pod="openshift-cluster-node-tuning-operator/tuned-48nz8" May 27 23:40:59.722916 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.722891 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f829d62-45c3-4fae-bc63-1227501d75e2-var-lib-kubelet\") pod \"tuned-48nz8\" (UID: \"3f829d62-45c3-4fae-bc63-1227501d75e2\") " pod="openshift-cluster-node-tuning-operator/tuned-48nz8" May 27 23:40:59.722916 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.722915 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3f829d62-45c3-4fae-bc63-1227501d75e2-etc-systemd\") pod \"tuned-48nz8\" (UID: \"3f829d62-45c3-4fae-bc63-1227501d75e2\") " pod="openshift-cluster-node-tuning-operator/tuned-48nz8" May 27 23:40:59.723272 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.722928 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f829d62-45c3-4fae-bc63-1227501d75e2-etc-kubernetes\") pod \"tuned-48nz8\" (UID: \"3f829d62-45c3-4fae-bc63-1227501d75e2\") " pod="openshift-cluster-node-tuning-operator/tuned-48nz8" May 27 23:40:59.723272 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.722928 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/340c3057-5db9-47aa-9894-64c7f8db149f-host-slash\") pod \"iptables-alerter-7tr5v\" (UID: \"340c3057-5db9-47aa-9894-64c7f8db149f\") " pod="openshift-network-operator/iptables-alerter-7tr5v" May 27 23:40:59.723272 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.722863 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3f829d62-45c3-4fae-bc63-1227501d75e2-lib-modules\") pod \"tuned-48nz8\" (UID: \"3f829d62-45c3-4fae-bc63-1227501d75e2\") " pod="openshift-cluster-node-tuning-operator/tuned-48nz8" May 27 23:40:59.723272 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.722940 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3f829d62-45c3-4fae-bc63-1227501d75e2-sys\") pod \"tuned-48nz8\" (UID: \"3f829d62-45c3-4fae-bc63-1227501d75e2\") " pod="openshift-cluster-node-tuning-operator/tuned-48nz8" May 27 23:40:59.723272 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.722971 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3f829d62-45c3-4fae-bc63-1227501d75e2-etc-systemd\") pod \"tuned-48nz8\" (UID: \"3f829d62-45c3-4fae-bc63-1227501d75e2\") " pod="openshift-cluster-node-tuning-operator/tuned-48nz8" May 27 23:40:59.723272 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.722977 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3f829d62-45c3-4fae-bc63-1227501d75e2-etc-modprobe-d\") pod \"tuned-48nz8\" (UID: \"3f829d62-45c3-4fae-bc63-1227501d75e2\") " pod="openshift-cluster-node-tuning-operator/tuned-48nz8" May 27 23:40:59.723272 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.722982 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3f829d62-45c3-4fae-bc63-1227501d75e2-host\") pod \"tuned-48nz8\" (UID: \"3f829d62-45c3-4fae-bc63-1227501d75e2\") " pod="openshift-cluster-node-tuning-operator/tuned-48nz8" May 27 23:40:59.723272 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.722993 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3f829d62-45c3-4fae-bc63-1227501d75e2-sys\") pod \"tuned-48nz8\" (UID: \"3f829d62-45c3-4fae-bc63-1227501d75e2\") " pod="openshift-cluster-node-tuning-operator/tuned-48nz8" May 27 23:40:59.723272 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.723017 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t8mzn\" (UniqueName: \"kubernetes.io/projected/3f829d62-45c3-4fae-bc63-1227501d75e2-kube-api-access-t8mzn\") pod \"tuned-48nz8\" (UID: \"3f829d62-45c3-4fae-bc63-1227501d75e2\") " pod="openshift-cluster-node-tuning-operator/tuned-48nz8" May 27 23:40:59.723272 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.723021 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3f829d62-45c3-4fae-bc63-1227501d75e2-host\") pod \"tuned-48nz8\" (UID: \"3f829d62-45c3-4fae-bc63-1227501d75e2\") " pod="openshift-cluster-node-tuning-operator/tuned-48nz8" May 27 23:40:59.723272 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.723044 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b407d9da-589e-4803-abad-d70c5a21a11a-metrics-certs\") pod \"network-metrics-daemon-t87h5\" (UID: \"b407d9da-589e-4803-abad-d70c5a21a11a\") " pod="openshift-multus/network-metrics-daemon-t87h5" May 27 23:40:59.723272 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.723106 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3f829d62-45c3-4fae-bc63-1227501d75e2-etc-sysconfig\") pod \"tuned-48nz8\" (UID: \"3f829d62-45c3-4fae-bc63-1227501d75e2\") " pod="openshift-cluster-node-tuning-operator/tuned-48nz8" May 27 23:40:59.723272 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:40:59.723118 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 23:40:59.723272 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.723133 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3f829d62-45c3-4fae-bc63-1227501d75e2-run\") pod \"tuned-48nz8\" (UID: \"3f829d62-45c3-4fae-bc63-1227501d75e2\") " pod="openshift-cluster-node-tuning-operator/tuned-48nz8" May 27 23:40:59.723272 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.723154 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f829d62-45c3-4fae-bc63-1227501d75e2-tmp\") pod \"tuned-48nz8\" (UID: \"3f829d62-45c3-4fae-bc63-1227501d75e2\") " pod="openshift-cluster-node-tuning-operator/tuned-48nz8" May 27 23:40:59.723272 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:40:59.723193 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b407d9da-589e-4803-abad-d70c5a21a11a-metrics-certs podName:b407d9da-589e-4803-abad-d70c5a21a11a nodeName:}" failed. No retries permitted until 2026-05-27 23:41:00.223160549 +0000 UTC m=+3.150062133 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b407d9da-589e-4803-abad-d70c5a21a11a-metrics-certs") pod "network-metrics-daemon-t87h5" (UID: "b407d9da-589e-4803-abad-d70c5a21a11a") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 23:40:59.723272 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.723210 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3f829d62-45c3-4fae-bc63-1227501d75e2-etc-sysconfig\") pod \"tuned-48nz8\" (UID: \"3f829d62-45c3-4fae-bc63-1227501d75e2\") " pod="openshift-cluster-node-tuning-operator/tuned-48nz8" May 27 23:40:59.724028 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.723221 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/340c3057-5db9-47aa-9894-64c7f8db149f-iptables-alerter-script\") pod \"iptables-alerter-7tr5v\" (UID: \"340c3057-5db9-47aa-9894-64c7f8db149f\") " pod="openshift-network-operator/iptables-alerter-7tr5v" May 27 23:40:59.724028 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.723238 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3f829d62-45c3-4fae-bc63-1227501d75e2-run\") pod \"tuned-48nz8\" (UID: \"3f829d62-45c3-4fae-bc63-1227501d75e2\") " pod="openshift-cluster-node-tuning-operator/tuned-48nz8" May 27 23:40:59.724028 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.723245 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3f829d62-45c3-4fae-bc63-1227501d75e2-etc-tuned\") pod \"tuned-48nz8\" (UID: \"3f829d62-45c3-4fae-bc63-1227501d75e2\") " pod="openshift-cluster-node-tuning-operator/tuned-48nz8" May 27 23:40:59.724028 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.723725 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/340c3057-5db9-47aa-9894-64c7f8db149f-iptables-alerter-script\") pod \"iptables-alerter-7tr5v\" (UID: \"340c3057-5db9-47aa-9894-64c7f8db149f\") " pod="openshift-network-operator/iptables-alerter-7tr5v" May 27 23:40:59.725422 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.725393 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f829d62-45c3-4fae-bc63-1227501d75e2-tmp\") pod \"tuned-48nz8\" (UID: \"3f829d62-45c3-4fae-bc63-1227501d75e2\") " pod="openshift-cluster-node-tuning-operator/tuned-48nz8" May 27 23:40:59.725514 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.725442 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3f829d62-45c3-4fae-bc63-1227501d75e2-etc-tuned\") pod \"tuned-48nz8\" (UID: \"3f829d62-45c3-4fae-bc63-1227501d75e2\") " pod="openshift-cluster-node-tuning-operator/tuned-48nz8" May 27 23:40:59.732398 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:40:59.732336 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 23:40:59.732398 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:40:59.732357 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 23:40:59.732398 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:40:59.732369 2556 projected.go:194] Error preparing data for projected volume kube-api-access-wml5g for pod openshift-network-diagnostics/network-check-target-cwkwk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 23:40:59.732600 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:40:59.732426 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a6ef6f8-506a-4fd5-886a-17d7e66340f8-kube-api-access-wml5g podName:6a6ef6f8-506a-4fd5-886a-17d7e66340f8 nodeName:}" failed. No retries permitted until 2026-05-27 23:41:00.232412627 +0000 UTC m=+3.159314194 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wml5g" (UniqueName: "kubernetes.io/projected/6a6ef6f8-506a-4fd5-886a-17d7e66340f8-kube-api-access-wml5g") pod "network-check-target-cwkwk" (UID: "6a6ef6f8-506a-4fd5-886a-17d7e66340f8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 23:40:59.734093 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.734070 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjjqx\" (UniqueName: \"kubernetes.io/projected/b407d9da-589e-4803-abad-d70c5a21a11a-kube-api-access-bjjqx\") pod \"network-metrics-daemon-t87h5\" (UID: \"b407d9da-589e-4803-abad-d70c5a21a11a\") " pod="openshift-multus/network-metrics-daemon-t87h5" May 27 23:40:59.734214 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.734191 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vktmr\" (UniqueName: \"kubernetes.io/projected/340c3057-5db9-47aa-9894-64c7f8db149f-kube-api-access-vktmr\") pod \"iptables-alerter-7tr5v\" (UID: \"340c3057-5db9-47aa-9894-64c7f8db149f\") " pod="openshift-network-operator/iptables-alerter-7tr5v" May 27 23:40:59.735460 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.735442 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8mzn\" (UniqueName: \"kubernetes.io/projected/3f829d62-45c3-4fae-bc63-1227501d75e2-kube-api-access-t8mzn\") pod \"tuned-48nz8\" (UID: \"3f829d62-45c3-4fae-bc63-1227501d75e2\") " pod="openshift-cluster-node-tuning-operator/tuned-48nz8" May 27 23:40:59.804820 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.804782 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6qfrg" May 27 23:40:59.813914 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.813885 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dv6s4" May 27 23:40:59.823605 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.823583 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6m78w" May 27 23:40:59.829171 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.829152 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8hfsr" May 27 23:40:59.835651 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.835609 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k2k6s" May 27 23:40:59.843736 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.843719 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:40:59.849357 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.849339 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-c4dx6" May 27 23:40:59.855419 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.855397 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-48nz8" May 27 23:40:59.861928 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:40:59.861910 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7tr5v" May 27 23:41:00.226151 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:00.226105 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b407d9da-589e-4803-abad-d70c5a21a11a-metrics-certs\") pod \"network-metrics-daemon-t87h5\" (UID: \"b407d9da-589e-4803-abad-d70c5a21a11a\") " pod="openshift-multus/network-metrics-daemon-t87h5" May 27 23:41:00.226324 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:00.226238 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 23:41:00.226324 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:00.226316 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b407d9da-589e-4803-abad-d70c5a21a11a-metrics-certs podName:b407d9da-589e-4803-abad-d70c5a21a11a nodeName:}" failed. No retries permitted until 2026-05-27 23:41:01.226290811 +0000 UTC m=+4.153192422 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b407d9da-589e-4803-abad-d70c5a21a11a-metrics-certs") pod "network-metrics-daemon-t87h5" (UID: "b407d9da-589e-4803-abad-d70c5a21a11a") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 23:41:00.315223 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:41:00.315187 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc83aa1e_cc07_4d4a_91d1_df90c691f148.slice/crio-fa6b502d476aeb41715d958997ff4077c6225a2cfa84287b616e5684f426fcdc WatchSource:0}: Error finding container fa6b502d476aeb41715d958997ff4077c6225a2cfa84287b616e5684f426fcdc: Status 404 returned error can't find the container with id fa6b502d476aeb41715d958997ff4077c6225a2cfa84287b616e5684f426fcdc May 27 23:41:00.321972 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:41:00.321944 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c0f7a5c_3e27_4d16_8d4f_f646b819f865.slice/crio-26702d822ac8315f3a77cf2299c4839559d2cb63ea9b178389c88dbb4cffda85 WatchSource:0}: Error finding container 26702d822ac8315f3a77cf2299c4839559d2cb63ea9b178389c88dbb4cffda85: Status 404 returned error can't find the container with id 26702d822ac8315f3a77cf2299c4839559d2cb63ea9b178389c88dbb4cffda85 May 27 23:41:00.322366 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:41:00.322344 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f829d62_45c3_4fae_bc63_1227501d75e2.slice/crio-b309d0a7dfc807f51e7c26a9a6c4a9eb490808d1d9f3c5259ae85e804cdc9b54 WatchSource:0}: Error finding container b309d0a7dfc807f51e7c26a9a6c4a9eb490808d1d9f3c5259ae85e804cdc9b54: Status 404 returned error can't find the container with id b309d0a7dfc807f51e7c26a9a6c4a9eb490808d1d9f3c5259ae85e804cdc9b54 May 27 23:41:00.323207 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:41:00.323185 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95ce23f5_a9ec_4203_9875_1f8bd5254019.slice/crio-2d5bae77d2b8473cec43c011aefa10b5861a13e939ff86dffb8956e595c62705 WatchSource:0}: Error finding container 2d5bae77d2b8473cec43c011aefa10b5861a13e939ff86dffb8956e595c62705: Status 404 returned error can't find the container with id 2d5bae77d2b8473cec43c011aefa10b5861a13e939ff86dffb8956e595c62705 May 27 23:41:00.324850 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:41:00.324804 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff3537f7_1ece_4ffa_a8c8_b42b200cee3a.slice/crio-67ef3fddba814424a5857baed5e527f48a66ba7682d7246403fd2fe0ef18b3c5 WatchSource:0}: Error finding container 67ef3fddba814424a5857baed5e527f48a66ba7682d7246403fd2fe0ef18b3c5: Status 404 returned error can't find the container with id 67ef3fddba814424a5857baed5e527f48a66ba7682d7246403fd2fe0ef18b3c5 May 27 23:41:00.325822 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:41:00.325803 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd79991b_47fe_457f_b415_c8ecd5c442c9.slice/crio-f4aafb71468f2e4b13c7df0f74ae094a74f7f2cd8361e5bf0449a9e4106e399e WatchSource:0}: Error finding container f4aafb71468f2e4b13c7df0f74ae094a74f7f2cd8361e5bf0449a9e4106e399e: Status 404 returned error can't find the container with id f4aafb71468f2e4b13c7df0f74ae094a74f7f2cd8361e5bf0449a9e4106e399e May 27 23:41:00.326691 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:00.326594 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wml5g\" (UniqueName: \"kubernetes.io/projected/6a6ef6f8-506a-4fd5-886a-17d7e66340f8-kube-api-access-wml5g\") pod \"network-check-target-cwkwk\" (UID: \"6a6ef6f8-506a-4fd5-886a-17d7e66340f8\") " pod="openshift-network-diagnostics/network-check-target-cwkwk" May 27 23:41:00.326823 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:00.326794 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 23:41:00.326823 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:00.326817 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 23:41:00.326962 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:00.326833 2556 projected.go:194] Error preparing data for projected volume kube-api-access-wml5g for pod openshift-network-diagnostics/network-check-target-cwkwk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 23:41:00.326962 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:00.326895 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a6ef6f8-506a-4fd5-886a-17d7e66340f8-kube-api-access-wml5g podName:6a6ef6f8-506a-4fd5-886a-17d7e66340f8 nodeName:}" failed. No retries permitted until 2026-05-27 23:41:01.326876574 +0000 UTC m=+4.253778146 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wml5g" (UniqueName: "kubernetes.io/projected/6a6ef6f8-506a-4fd5-886a-17d7e66340f8-kube-api-access-wml5g") pod "network-check-target-cwkwk" (UID: "6a6ef6f8-506a-4fd5-886a-17d7e66340f8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 23:41:00.327508 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:41:00.327488 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod340c3057_5db9_47aa_9894_64c7f8db149f.slice/crio-1ec40c6feaaf9b69112131969b0a763a0f0a9ed1c50e60c8ab3ead1876a5142f WatchSource:0}: Error finding container 1ec40c6feaaf9b69112131969b0a763a0f0a9ed1c50e60c8ab3ead1876a5142f: Status 404 returned error can't find the container with id 1ec40c6feaaf9b69112131969b0a763a0f0a9ed1c50e60c8ab3ead1876a5142f May 27 23:41:00.328440 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:41:00.328412 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc82e3b33_c73d_4543_9baf_2784cc72d33e.slice/crio-63dc5329670fb69996e01339f96010b293e4a4a8ecc9cf20d87f64cd6f94bdf5 WatchSource:0}: Error finding container 63dc5329670fb69996e01339f96010b293e4a4a8ecc9cf20d87f64cd6f94bdf5: Status 404 returned error can't find the container with id 63dc5329670fb69996e01339f96010b293e4a4a8ecc9cf20d87f64cd6f94bdf5 May 27 23:41:00.329212 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:41:00.329183 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode682bdbf_0081_4b2e_b8fc_bf23a7a18612.slice/crio-c2a2897ef46abb10cc626532d2b72f965d79bef4a772d8bfcc74db12a6aa391f WatchSource:0}: Error finding container c2a2897ef46abb10cc626532d2b72f965d79bef4a772d8bfcc74db12a6aa391f: Status 404 returned error can't find the container with id c2a2897ef46abb10cc626532d2b72f965d79bef4a772d8bfcc74db12a6aa391f May 27 23:41:00.433619 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:00.433490 2556 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 27 23:41:00.552284 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:00.552188 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-26 23:35:58 +0000 UTC" deadline="2027-11-01 10:25:34.525334462 +0000 UTC" May 27 23:41:00.552284 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:00.552220 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12538h44m33.973116356s" May 27 23:41:00.654386 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:00.654359 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k2k6s" event={"ID":"e682bdbf-0081-4b2e-b8fc-bf23a7a18612","Type":"ContainerStarted","Data":"c2a2897ef46abb10cc626532d2b72f965d79bef4a772d8bfcc74db12a6aa391f"} May 27 23:41:00.655375 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:00.655348 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" event={"ID":"c82e3b33-c73d-4543-9baf-2784cc72d33e","Type":"ContainerStarted","Data":"63dc5329670fb69996e01339f96010b293e4a4a8ecc9cf20d87f64cd6f94bdf5"} May 27 23:41:00.656237 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:00.656212 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7tr5v" event={"ID":"340c3057-5db9-47aa-9894-64c7f8db149f","Type":"ContainerStarted","Data":"1ec40c6feaaf9b69112131969b0a763a0f0a9ed1c50e60c8ab3ead1876a5142f"} May 27 23:41:00.657163 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:00.657134 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c4dx6" event={"ID":"ff3537f7-1ece-4ffa-a8c8-b42b200cee3a","Type":"ContainerStarted","Data":"67ef3fddba814424a5857baed5e527f48a66ba7682d7246403fd2fe0ef18b3c5"} May 27 23:41:00.658099 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:00.658073 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6qfrg" event={"ID":"95ce23f5-a9ec-4203-9875-1f8bd5254019","Type":"ContainerStarted","Data":"2d5bae77d2b8473cec43c011aefa10b5861a13e939ff86dffb8956e595c62705"} May 27 23:41:00.659053 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:00.659025 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-48nz8" event={"ID":"3f829d62-45c3-4fae-bc63-1227501d75e2","Type":"ContainerStarted","Data":"b309d0a7dfc807f51e7c26a9a6c4a9eb490808d1d9f3c5259ae85e804cdc9b54"} May 27 23:41:00.660456 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:00.660434 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-22.ec2.internal" event={"ID":"7399066287f38f7ad76a60ae70377aa4","Type":"ContainerStarted","Data":"49a8ec34e17fb8e0f3ab7f0db06fcadbeca97f9932cbf49e02baa1547dc4971a"} May 27 23:41:00.661367 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:00.661346 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8hfsr" event={"ID":"cd79991b-47fe-457f-b415-c8ecd5c442c9","Type":"ContainerStarted","Data":"f4aafb71468f2e4b13c7df0f74ae094a74f7f2cd8361e5bf0449a9e4106e399e"} May 27 23:41:00.662226 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:00.662207 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6m78w" event={"ID":"0c0f7a5c-3e27-4d16-8d4f-f646b819f865","Type":"ContainerStarted","Data":"26702d822ac8315f3a77cf2299c4839559d2cb63ea9b178389c88dbb4cffda85"} May 27 23:41:00.663096 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:00.663077 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dv6s4" event={"ID":"fc83aa1e-cc07-4d4a-91d1-df90c691f148","Type":"ContainerStarted","Data":"fa6b502d476aeb41715d958997ff4077c6225a2cfa84287b616e5684f426fcdc"} May 27 23:41:00.664192 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:00.664173 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-22.ec2.internal" event={"ID":"ff79473a562eff3ccf42c987addd6ef4","Type":"ContainerStarted","Data":"20e0550e4adc21973971063ac7e832855883b1e3350d3d1182d27d4e865c4813"} May 27 23:41:01.234435 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:01.233802 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b407d9da-589e-4803-abad-d70c5a21a11a-metrics-certs\") pod \"network-metrics-daemon-t87h5\" (UID: \"b407d9da-589e-4803-abad-d70c5a21a11a\") " pod="openshift-multus/network-metrics-daemon-t87h5" May 27 23:41:01.234435 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:01.233986 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 23:41:01.234435 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:01.234052 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b407d9da-589e-4803-abad-d70c5a21a11a-metrics-certs podName:b407d9da-589e-4803-abad-d70c5a21a11a nodeName:}" failed. No retries permitted until 2026-05-27 23:41:03.234032437 +0000 UTC m=+6.160934008 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b407d9da-589e-4803-abad-d70c5a21a11a-metrics-certs") pod "network-metrics-daemon-t87h5" (UID: "b407d9da-589e-4803-abad-d70c5a21a11a") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 23:41:01.306883 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:01.306854 2556 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 27 23:41:01.334422 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:01.334388 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wml5g\" (UniqueName: \"kubernetes.io/projected/6a6ef6f8-506a-4fd5-886a-17d7e66340f8-kube-api-access-wml5g\") pod \"network-check-target-cwkwk\" (UID: \"6a6ef6f8-506a-4fd5-886a-17d7e66340f8\") " pod="openshift-network-diagnostics/network-check-target-cwkwk" May 27 23:41:01.334582 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:01.334546 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 23:41:01.334582 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:01.334568 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 23:41:01.334582 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:01.334581 2556 projected.go:194] Error preparing data for projected volume kube-api-access-wml5g for pod openshift-network-diagnostics/network-check-target-cwkwk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 23:41:01.334771 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:01.334649 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a6ef6f8-506a-4fd5-886a-17d7e66340f8-kube-api-access-wml5g podName:6a6ef6f8-506a-4fd5-886a-17d7e66340f8 nodeName:}" failed. No retries permitted until 2026-05-27 23:41:03.334617081 +0000 UTC m=+6.261518665 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wml5g" (UniqueName: "kubernetes.io/projected/6a6ef6f8-506a-4fd5-886a-17d7e66340f8-kube-api-access-wml5g") pod "network-check-target-cwkwk" (UID: "6a6ef6f8-506a-4fd5-886a-17d7e66340f8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 23:41:01.647731 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:01.647156 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cwkwk" May 27 23:41:01.647731 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:01.647287 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cwkwk" podUID="6a6ef6f8-506a-4fd5-886a-17d7e66340f8" May 27 23:41:01.647731 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:01.647612 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t87h5" May 27 23:41:01.648478 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:01.648432 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t87h5" podUID="b407d9da-589e-4803-abad-d70c5a21a11a" May 27 23:41:01.680980 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:01.680950 2556 generic.go:358] "Generic (PLEG): container finished" podID="7399066287f38f7ad76a60ae70377aa4" containerID="49a8ec34e17fb8e0f3ab7f0db06fcadbeca97f9932cbf49e02baa1547dc4971a" exitCode=0 May 27 23:41:01.682019 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:01.681908 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-22.ec2.internal" event={"ID":"7399066287f38f7ad76a60ae70377aa4","Type":"ContainerDied","Data":"49a8ec34e17fb8e0f3ab7f0db06fcadbeca97f9932cbf49e02baa1547dc4971a"} May 27 23:41:01.682019 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:01.681942 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-22.ec2.internal" event={"ID":"7399066287f38f7ad76a60ae70377aa4","Type":"ContainerStarted","Data":"db16adebda908bdda853d9914a6fde2469434d016a4df95cf372a2a69ca7be5c"} May 27 23:41:01.697998 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:01.697826 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-22.ec2.internal" podStartSLOduration=3.697810081 podStartE2EDuration="3.697810081s" podCreationTimestamp="2026-05-27 23:40:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 23:41:00.690341487 +0000 UTC m=+3.617243079" watchObservedRunningTime="2026-05-27 23:41:01.697810081 +0000 UTC m=+4.624711673" May 27 23:41:03.255183 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:03.255142 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b407d9da-589e-4803-abad-d70c5a21a11a-metrics-certs\") pod \"network-metrics-daemon-t87h5\" (UID: \"b407d9da-589e-4803-abad-d70c5a21a11a\") " pod="openshift-multus/network-metrics-daemon-t87h5" May 27 23:41:03.255661 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:03.255294 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 23:41:03.255661 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:03.255357 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b407d9da-589e-4803-abad-d70c5a21a11a-metrics-certs podName:b407d9da-589e-4803-abad-d70c5a21a11a nodeName:}" failed. No retries permitted until 2026-05-27 23:41:07.255338263 +0000 UTC m=+10.182239834 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b407d9da-589e-4803-abad-d70c5a21a11a-metrics-certs") pod "network-metrics-daemon-t87h5" (UID: "b407d9da-589e-4803-abad-d70c5a21a11a") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 23:41:03.356106 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:03.356070 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wml5g\" (UniqueName: \"kubernetes.io/projected/6a6ef6f8-506a-4fd5-886a-17d7e66340f8-kube-api-access-wml5g\") pod \"network-check-target-cwkwk\" (UID: \"6a6ef6f8-506a-4fd5-886a-17d7e66340f8\") " pod="openshift-network-diagnostics/network-check-target-cwkwk" May 27 23:41:03.356306 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:03.356270 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 23:41:03.356306 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:03.356294 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 23:41:03.356306 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:03.356307 2556 projected.go:194] Error preparing data for projected volume kube-api-access-wml5g for pod openshift-network-diagnostics/network-check-target-cwkwk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 23:41:03.356488 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:03.356370 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a6ef6f8-506a-4fd5-886a-17d7e66340f8-kube-api-access-wml5g podName:6a6ef6f8-506a-4fd5-886a-17d7e66340f8 nodeName:}" failed. No retries permitted until 2026-05-27 23:41:07.356349551 +0000 UTC m=+10.283251120 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wml5g" (UniqueName: "kubernetes.io/projected/6a6ef6f8-506a-4fd5-886a-17d7e66340f8-kube-api-access-wml5g") pod "network-check-target-cwkwk" (UID: "6a6ef6f8-506a-4fd5-886a-17d7e66340f8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 23:41:03.647317 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:03.647136 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t87h5" May 27 23:41:03.647317 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:03.647272 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t87h5" podUID="b407d9da-589e-4803-abad-d70c5a21a11a" May 27 23:41:03.647317 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:03.647322 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cwkwk" May 27 23:41:03.647580 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:03.647398 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cwkwk" podUID="6a6ef6f8-506a-4fd5-886a-17d7e66340f8" May 27 23:41:05.647497 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:05.647462 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t87h5" May 27 23:41:05.647964 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:05.647467 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cwkwk" May 27 23:41:05.647964 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:05.647611 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t87h5" podUID="b407d9da-589e-4803-abad-d70c5a21a11a" May 27 23:41:05.647964 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:05.647702 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cwkwk" podUID="6a6ef6f8-506a-4fd5-886a-17d7e66340f8" May 27 23:41:07.289185 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:07.289147 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b407d9da-589e-4803-abad-d70c5a21a11a-metrics-certs\") pod \"network-metrics-daemon-t87h5\" (UID: \"b407d9da-589e-4803-abad-d70c5a21a11a\") " pod="openshift-multus/network-metrics-daemon-t87h5" May 27 23:41:07.289701 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:07.289283 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 23:41:07.289701 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:07.289364 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b407d9da-589e-4803-abad-d70c5a21a11a-metrics-certs podName:b407d9da-589e-4803-abad-d70c5a21a11a nodeName:}" failed. No retries permitted until 2026-05-27 23:41:15.289338878 +0000 UTC m=+18.216240449 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b407d9da-589e-4803-abad-d70c5a21a11a-metrics-certs") pod "network-metrics-daemon-t87h5" (UID: "b407d9da-589e-4803-abad-d70c5a21a11a") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 23:41:07.389851 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:07.389732 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wml5g\" (UniqueName: \"kubernetes.io/projected/6a6ef6f8-506a-4fd5-886a-17d7e66340f8-kube-api-access-wml5g\") pod \"network-check-target-cwkwk\" (UID: \"6a6ef6f8-506a-4fd5-886a-17d7e66340f8\") " pod="openshift-network-diagnostics/network-check-target-cwkwk" May 27 23:41:07.390010 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:07.389934 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 23:41:07.390010 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:07.389960 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 23:41:07.390010 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:07.389974 2556 projected.go:194] Error preparing data for projected volume kube-api-access-wml5g for pod openshift-network-diagnostics/network-check-target-cwkwk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 23:41:07.390127 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:07.390041 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a6ef6f8-506a-4fd5-886a-17d7e66340f8-kube-api-access-wml5g podName:6a6ef6f8-506a-4fd5-886a-17d7e66340f8 nodeName:}" failed. No retries permitted until 2026-05-27 23:41:15.390023162 +0000 UTC m=+18.316924743 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wml5g" (UniqueName: "kubernetes.io/projected/6a6ef6f8-506a-4fd5-886a-17d7e66340f8-kube-api-access-wml5g") pod "network-check-target-cwkwk" (UID: "6a6ef6f8-506a-4fd5-886a-17d7e66340f8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 23:41:07.648742 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:07.648662 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t87h5" May 27 23:41:07.648742 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:07.648708 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cwkwk" May 27 23:41:07.648952 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:07.648796 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t87h5" podUID="b407d9da-589e-4803-abad-d70c5a21a11a" May 27 23:41:07.648952 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:07.648917 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cwkwk" podUID="6a6ef6f8-506a-4fd5-886a-17d7e66340f8" May 27 23:41:09.647102 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:09.647066 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t87h5" May 27 23:41:09.647563 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:09.647077 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cwkwk" May 27 23:41:09.647563 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:09.647194 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t87h5" podUID="b407d9da-589e-4803-abad-d70c5a21a11a" May 27 23:41:09.647563 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:09.647243 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cwkwk" podUID="6a6ef6f8-506a-4fd5-886a-17d7e66340f8" May 27 23:41:11.647727 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:11.647686 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t87h5" May 27 23:41:11.648157 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:11.647838 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t87h5" podUID="b407d9da-589e-4803-abad-d70c5a21a11a" May 27 23:41:11.648157 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:11.647904 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cwkwk" May 27 23:41:11.648157 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:11.648038 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cwkwk" podUID="6a6ef6f8-506a-4fd5-886a-17d7e66340f8" May 27 23:41:13.647148 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:13.647107 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t87h5" May 27 23:41:13.647666 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:13.647151 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cwkwk" May 27 23:41:13.647666 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:13.647238 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t87h5" podUID="b407d9da-589e-4803-abad-d70c5a21a11a" May 27 23:41:13.647666 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:13.647348 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cwkwk" podUID="6a6ef6f8-506a-4fd5-886a-17d7e66340f8" May 27 23:41:15.347302 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:15.347268 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b407d9da-589e-4803-abad-d70c5a21a11a-metrics-certs\") pod \"network-metrics-daemon-t87h5\" (UID: \"b407d9da-589e-4803-abad-d70c5a21a11a\") " pod="openshift-multus/network-metrics-daemon-t87h5" May 27 23:41:15.347761 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:15.347429 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 23:41:15.347761 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:15.347500 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b407d9da-589e-4803-abad-d70c5a21a11a-metrics-certs podName:b407d9da-589e-4803-abad-d70c5a21a11a nodeName:}" failed. No retries permitted until 2026-05-27 23:41:31.347483123 +0000 UTC m=+34.274384691 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b407d9da-589e-4803-abad-d70c5a21a11a-metrics-certs") pod "network-metrics-daemon-t87h5" (UID: "b407d9da-589e-4803-abad-d70c5a21a11a") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 23:41:15.448050 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:15.448010 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wml5g\" (UniqueName: \"kubernetes.io/projected/6a6ef6f8-506a-4fd5-886a-17d7e66340f8-kube-api-access-wml5g\") pod \"network-check-target-cwkwk\" (UID: \"6a6ef6f8-506a-4fd5-886a-17d7e66340f8\") " pod="openshift-network-diagnostics/network-check-target-cwkwk" May 27 23:41:15.448221 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:15.448185 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 23:41:15.448221 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:15.448213 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 23:41:15.448350 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:15.448227 2556 projected.go:194] Error preparing data for projected volume kube-api-access-wml5g for pod openshift-network-diagnostics/network-check-target-cwkwk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 23:41:15.448350 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:15.448293 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a6ef6f8-506a-4fd5-886a-17d7e66340f8-kube-api-access-wml5g podName:6a6ef6f8-506a-4fd5-886a-17d7e66340f8 nodeName:}" failed. No retries permitted until 2026-05-27 23:41:31.448278958 +0000 UTC m=+34.375180533 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wml5g" (UniqueName: "kubernetes.io/projected/6a6ef6f8-506a-4fd5-886a-17d7e66340f8-kube-api-access-wml5g") pod "network-check-target-cwkwk" (UID: "6a6ef6f8-506a-4fd5-886a-17d7e66340f8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 23:41:15.646881 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:15.646804 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t87h5" May 27 23:41:15.647043 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:15.646806 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cwkwk" May 27 23:41:15.647043 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:15.646935 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t87h5" podUID="b407d9da-589e-4803-abad-d70c5a21a11a" May 27 23:41:15.647043 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:15.646997 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cwkwk" podUID="6a6ef6f8-506a-4fd5-886a-17d7e66340f8" May 27 23:41:17.648192 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:17.648152 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cwkwk" May 27 23:41:17.648672 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:17.648269 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cwkwk" podUID="6a6ef6f8-506a-4fd5-886a-17d7e66340f8" May 27 23:41:17.648672 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:17.648333 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t87h5" May 27 23:41:17.648672 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:17.648479 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t87h5" podUID="b407d9da-589e-4803-abad-d70c5a21a11a" May 27 23:41:19.647622 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:19.647225 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t87h5" May 27 23:41:19.648512 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:19.647254 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cwkwk" May 27 23:41:19.648512 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:19.647696 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t87h5" podUID="b407d9da-589e-4803-abad-d70c5a21a11a" May 27 23:41:19.648512 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:19.647771 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cwkwk" podUID="6a6ef6f8-506a-4fd5-886a-17d7e66340f8" May 27 23:41:19.721709 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:19.721655 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-48nz8" event={"ID":"3f829d62-45c3-4fae-bc63-1227501d75e2","Type":"ContainerStarted","Data":"47691ceed9b3f9068c2db733e0f21aa5b42a9cd91554c97e2e56a7348d07a175"} May 27 23:41:19.723230 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:19.723204 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8hfsr" event={"ID":"cd79991b-47fe-457f-b415-c8ecd5c442c9","Type":"ContainerStarted","Data":"36ff8888709faa4d645ef1f3e5ca7550ea82721841440c70ae09644bc994740e"} May 27 23:41:19.724627 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:19.724602 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6m78w" event={"ID":"0c0f7a5c-3e27-4d16-8d4f-f646b819f865","Type":"ContainerStarted","Data":"81d1477105d976afd7e00c575457d71298ccce17e00b3f7ae0ebf8644bc075d7"} May 27 23:41:19.726523 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:19.726500 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dv6s4" event={"ID":"fc83aa1e-cc07-4d4a-91d1-df90c691f148","Type":"ContainerStarted","Data":"68db87098a4aeb02aa7cdca1e0d97c5bb572469f90fe5798098161ab40169415"} May 27 23:41:19.727884 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:19.727858 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k2k6s" event={"ID":"e682bdbf-0081-4b2e-b8fc-bf23a7a18612","Type":"ContainerStarted","Data":"f530d84319f7e621c49686e18cb3378b2d41f65860fd0e43a87359ec61c3d4de"} May 27 23:41:19.730581 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:19.730560 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" event={"ID":"c82e3b33-c73d-4543-9baf-2784cc72d33e","Type":"ContainerStarted","Data":"2f62224851e0ad96fdcaeb42fc1407c4a611289d22d9e951c93d6c28b362f382"} May 27 23:41:19.730678 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:19.730588 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" event={"ID":"c82e3b33-c73d-4543-9baf-2784cc72d33e","Type":"ContainerStarted","Data":"d14bbf9c55c2db8e3f5ac1ab19ee8776d1e1f07913aa895357d59c2aacfc5dd8"} May 27 23:41:19.730678 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:19.730602 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" event={"ID":"c82e3b33-c73d-4543-9baf-2784cc72d33e","Type":"ContainerStarted","Data":"f7f4884120ce97b75c1b8cf1e330077801135049a5fcf87678f6cc65587752aa"} May 27 23:41:19.730678 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:19.730616 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" event={"ID":"c82e3b33-c73d-4543-9baf-2784cc72d33e","Type":"ContainerStarted","Data":"4aecfcf6ed1cea96cd1062fb84b57e17014cabce8e5d69f48f547cd46f70c951"} May 27 23:41:19.730678 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:19.730628 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" event={"ID":"c82e3b33-c73d-4543-9baf-2784cc72d33e","Type":"ContainerStarted","Data":"a5cefc46f0b9c3c20aa6ac5eb91903cedfedc6231c73996bccb9ba5ab9538e72"} May 27 23:41:19.730678 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:19.730657 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" event={"ID":"c82e3b33-c73d-4543-9baf-2784cc72d33e","Type":"ContainerStarted","Data":"c9cb04512c7d9d90cba401b70af54f6d8d3b00d125a57112b7f464900ab1da0e"} May 27 23:41:19.732269 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:19.732070 2556 generic.go:358] "Generic (PLEG): container finished" podID="ff3537f7-1ece-4ffa-a8c8-b42b200cee3a" containerID="0e7d2545ea32c07a615323a1e922402a4e61ff3e18568262e9b1d67d61314fe2" exitCode=0 May 27 23:41:19.732269 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:19.732140 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c4dx6" event={"ID":"ff3537f7-1ece-4ffa-a8c8-b42b200cee3a","Type":"ContainerDied","Data":"0e7d2545ea32c07a615323a1e922402a4e61ff3e18568262e9b1d67d61314fe2"} May 27 23:41:19.733544 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:19.733512 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6qfrg" event={"ID":"95ce23f5-a9ec-4203-9875-1f8bd5254019","Type":"ContainerStarted","Data":"e5fd918b052af2ce6ade318f7a0b3706b59dc4e83cc1b7ee765db99cf8662908"} May 27 23:41:19.742554 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:19.742513 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-48nz8" podStartSLOduration=4.177657728 podStartE2EDuration="22.742501835s" podCreationTimestamp="2026-05-27 23:40:57 +0000 UTC" firstStartedPulling="2026-05-27 23:41:00.324258544 +0000 UTC m=+3.251160113" lastFinishedPulling="2026-05-27 23:41:18.889102646 +0000 UTC m=+21.816004220" observedRunningTime="2026-05-27 23:41:19.742055154 +0000 UTC m=+22.668956745" watchObservedRunningTime="2026-05-27 23:41:19.742501835 +0000 UTC m=+22.669403426" May 27 23:41:19.742699 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:19.742670 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-22.ec2.internal" podStartSLOduration=21.742660485000002 podStartE2EDuration="21.742660485s" podCreationTimestamp="2026-05-27 23:40:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 23:41:01.698955876 +0000 UTC m=+4.625857467" watchObservedRunningTime="2026-05-27 23:41:19.742660485 +0000 UTC m=+22.669562093" May 27 23:41:19.758029 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:19.757989 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-k2k6s" podStartSLOduration=4.235821797 podStartE2EDuration="22.757979434s" podCreationTimestamp="2026-05-27 23:40:57 +0000 UTC" firstStartedPulling="2026-05-27 23:41:00.352227225 +0000 UTC m=+3.279128797" lastFinishedPulling="2026-05-27 23:41:18.874384864 +0000 UTC m=+21.801286434" observedRunningTime="2026-05-27 23:41:19.757554321 +0000 UTC m=+22.684455911" watchObservedRunningTime="2026-05-27 23:41:19.757979434 +0000 UTC m=+22.684881025" May 27 23:41:19.776980 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:19.776940 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-6qfrg" podStartSLOduration=4.1667403929999995 podStartE2EDuration="22.776927945s" podCreationTimestamp="2026-05-27 23:40:57 +0000 UTC" firstStartedPulling="2026-05-27 23:41:00.325070123 +0000 UTC m=+3.251971691" lastFinishedPulling="2026-05-27 23:41:18.935257667 +0000 UTC m=+21.862159243" observedRunningTime="2026-05-27 23:41:19.776698195 +0000 UTC m=+22.703599785" watchObservedRunningTime="2026-05-27 23:41:19.776927945 +0000 UTC m=+22.703829534" May 27 23:41:19.810791 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:19.810757 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dv6s4" podStartSLOduration=4.254146116 podStartE2EDuration="22.810747118s" podCreationTimestamp="2026-05-27 23:40:57 +0000 UTC" firstStartedPulling="2026-05-27 23:41:00.317800119 +0000 UTC m=+3.244701706" lastFinishedPulling="2026-05-27 23:41:18.874401135 +0000 UTC m=+21.801302708" observedRunningTime="2026-05-27 23:41:19.792400041 +0000 UTC m=+22.719301631" watchObservedRunningTime="2026-05-27 23:41:19.810747118 +0000 UTC m=+22.737648707" May 27 23:41:19.810911 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:19.810891 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-8hfsr" podStartSLOduration=4.264164553 podStartE2EDuration="22.810887895s" podCreationTimestamp="2026-05-27 23:40:57 +0000 UTC" firstStartedPulling="2026-05-27 23:41:00.32767885 +0000 UTC m=+3.254580418" lastFinishedPulling="2026-05-27 23:41:18.874402185 +0000 UTC m=+21.801303760" observedRunningTime="2026-05-27 23:41:19.810820645 +0000 UTC m=+22.737722234" watchObservedRunningTime="2026-05-27 23:41:19.810887895 +0000 UTC m=+22.737789484" May 27 23:41:20.334140 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:20.334103 2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 27 23:41:20.588146 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:20.588043 2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-27T23:41:20.334125576Z","UUID":"da3b3a5c-04c0-4ba2-89bf-1e1fac2336cc","Handler":null,"Name":"","Endpoint":""} May 27 23:41:20.591035 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:20.591005 2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 27 23:41:20.591035 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:20.591035 2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 27 23:41:20.737672 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:20.737613 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6m78w" event={"ID":"0c0f7a5c-3e27-4d16-8d4f-f646b819f865","Type":"ContainerStarted","Data":"594f92ce09c4ba0e5ec5afbb03ab25943a160b9d79ccc03017cc2cb13a3c74ff"} May 27 23:41:20.739129 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:20.739092 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7tr5v" event={"ID":"340c3057-5db9-47aa-9894-64c7f8db149f","Type":"ContainerStarted","Data":"dc28269459b01acbfad788011d5afe6356dab099c1abc4e33fb212503c9f5004"} May 27 23:41:20.755578 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:20.755531 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7tr5v" podStartSLOduration=5.233408279 podStartE2EDuration="23.755520249s" podCreationTimestamp="2026-05-27 23:40:57 +0000 UTC" firstStartedPulling="2026-05-27 23:41:00.352312341 +0000 UTC m=+3.279213917" lastFinishedPulling="2026-05-27 23:41:18.874424314 +0000 UTC m=+21.801325887" observedRunningTime="2026-05-27 23:41:20.755270747 +0000 UTC m=+23.682172341" watchObservedRunningTime="2026-05-27 23:41:20.755520249 +0000 UTC m=+23.682422049" May 27 23:41:20.937028 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:20.936933 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dv6s4" May 27 23:41:20.938177 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:20.938084 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dv6s4" May 27 23:41:21.646974 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:21.646946 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t87h5" May 27 23:41:21.647109 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:21.647082 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t87h5" podUID="b407d9da-589e-4803-abad-d70c5a21a11a" May 27 23:41:21.647300 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:21.647277 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cwkwk" May 27 23:41:21.647411 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:21.647386 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cwkwk" podUID="6a6ef6f8-506a-4fd5-886a-17d7e66340f8" May 27 23:41:21.742651 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:21.742613 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6m78w" event={"ID":"0c0f7a5c-3e27-4d16-8d4f-f646b819f865","Type":"ContainerStarted","Data":"3b27389db1a01f4afd112e72e336158f3eefadb9c77afb6d61ee1cb7d9e2b275"} May 27 23:41:21.761773 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:21.761714 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6m78w" podStartSLOduration=3.539408711 podStartE2EDuration="24.761698154s" podCreationTimestamp="2026-05-27 23:40:57 +0000 UTC" firstStartedPulling="2026-05-27 23:41:00.323931406 +0000 UTC m=+3.250832988" lastFinishedPulling="2026-05-27 23:41:21.546220854 +0000 UTC m=+24.473122431" observedRunningTime="2026-05-27 23:41:21.761611753 +0000 UTC m=+24.688513344" watchObservedRunningTime="2026-05-27 23:41:21.761698154 +0000 UTC m=+24.688599744" May 27 23:41:22.748302 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:22.748093 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" event={"ID":"c82e3b33-c73d-4543-9baf-2784cc72d33e","Type":"ContainerStarted","Data":"fe11dee6b6c7591896978852b9f0813dd1dc047c535217b38d6060f95d9e16ae"} May 27 23:41:22.748302 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:22.748139 2556 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 27 23:41:23.647338 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:23.647301 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t87h5" May 27 23:41:23.647338 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:23.647323 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cwkwk" May 27 23:41:23.647569 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:23.647442 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t87h5" podUID="b407d9da-589e-4803-abad-d70c5a21a11a" May 27 23:41:23.647569 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:23.647558 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cwkwk" podUID="6a6ef6f8-506a-4fd5-886a-17d7e66340f8" May 27 23:41:24.466167 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:24.466137 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dv6s4" May 27 23:41:24.466619 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:24.466257 2556 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 27 23:41:24.466774 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:24.466758 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dv6s4" May 27 23:41:24.754553 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:24.754480 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" event={"ID":"c82e3b33-c73d-4543-9baf-2784cc72d33e","Type":"ContainerStarted","Data":"06f241d39160bb2604ba81c03769e77bb18fb454016137fbd50fc6db64cfb50c"} May 27 23:41:24.782005 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:24.781961 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" podStartSLOduration=9.194985027 podStartE2EDuration="27.781948618s" podCreationTimestamp="2026-05-27 23:40:57 +0000 UTC" firstStartedPulling="2026-05-27 23:41:00.352292713 +0000 UTC m=+3.279194281" lastFinishedPulling="2026-05-27 23:41:18.93925629 +0000 UTC m=+21.866157872" observedRunningTime="2026-05-27 23:41:24.7804431 +0000 UTC m=+27.707344691" watchObservedRunningTime="2026-05-27 23:41:24.781948618 +0000 UTC m=+27.708850207" May 27 23:41:25.647237 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:25.647209 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t87h5" May 27 23:41:25.647970 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:25.647209 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cwkwk" May 27 23:41:25.647970 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:25.647309 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t87h5" podUID="b407d9da-589e-4803-abad-d70c5a21a11a" May 27 23:41:25.647970 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:25.647376 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cwkwk" podUID="6a6ef6f8-506a-4fd5-886a-17d7e66340f8" May 27 23:41:25.757718 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:25.757529 2556 generic.go:358] "Generic (PLEG): container finished" podID="ff3537f7-1ece-4ffa-a8c8-b42b200cee3a" containerID="a67693f74ea0ab2d6c8e342dcd7886c7fae9e06250eec06306644407ef2125b1" exitCode=0 May 27 23:41:25.757891 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:25.757611 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c4dx6" event={"ID":"ff3537f7-1ece-4ffa-a8c8-b42b200cee3a","Type":"ContainerDied","Data":"a67693f74ea0ab2d6c8e342dcd7886c7fae9e06250eec06306644407ef2125b1"} May 27 23:41:25.758234 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:25.758169 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:41:25.758234 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:25.758209 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:41:25.758234 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:25.758222 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:41:25.773365 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:25.773342 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:41:25.773450 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:25.773414 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:41:26.883412 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:26.883386 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cwkwk"] May 27 23:41:26.883720 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:26.883507 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cwkwk" May 27 23:41:26.883720 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:26.883596 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cwkwk" podUID="6a6ef6f8-506a-4fd5-886a-17d7e66340f8" May 27 23:41:26.888401 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:26.888298 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-t87h5"] May 27 23:41:26.888478 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:26.888411 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t87h5" May 27 23:41:26.888543 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:26.888516 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t87h5" podUID="b407d9da-589e-4803-abad-d70c5a21a11a" May 27 23:41:27.762563 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:27.762527 2556 generic.go:358] "Generic (PLEG): container finished" podID="ff3537f7-1ece-4ffa-a8c8-b42b200cee3a" containerID="09b8d2065f4b09f67b55e8ac639a3d578cab9231f330e59c8e421f9da0aa1da0" exitCode=0 May 27 23:41:27.762748 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:27.762613 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c4dx6" event={"ID":"ff3537f7-1ece-4ffa-a8c8-b42b200cee3a","Type":"ContainerDied","Data":"09b8d2065f4b09f67b55e8ac639a3d578cab9231f330e59c8e421f9da0aa1da0"} May 27 23:41:28.647351 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:28.647273 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cwkwk" May 27 23:41:28.647700 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:28.647392 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cwkwk" podUID="6a6ef6f8-506a-4fd5-886a-17d7e66340f8" May 27 23:41:28.647700 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:28.647404 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t87h5" May 27 23:41:28.647700 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:28.647473 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t87h5" podUID="b407d9da-589e-4803-abad-d70c5a21a11a" May 27 23:41:28.766218 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:28.766180 2556 generic.go:358] "Generic (PLEG): container finished" podID="ff3537f7-1ece-4ffa-a8c8-b42b200cee3a" containerID="449378fa05884a6ff0a75595756898780b3a4544c10cfee954fbad1365407a2d" exitCode=0 May 27 23:41:28.766353 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:28.766242 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c4dx6" event={"ID":"ff3537f7-1ece-4ffa-a8c8-b42b200cee3a","Type":"ContainerDied","Data":"449378fa05884a6ff0a75595756898780b3a4544c10cfee954fbad1365407a2d"} May 27 23:41:30.647373 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:30.647338 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cwkwk" May 27 23:41:30.647827 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:30.647340 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t87h5" May 27 23:41:30.647827 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:30.647441 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cwkwk" podUID="6a6ef6f8-506a-4fd5-886a-17d7e66340f8" May 27 23:41:30.647827 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:30.647560 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t87h5" podUID="b407d9da-589e-4803-abad-d70c5a21a11a" May 27 23:41:31.364219 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:31.364181 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b407d9da-589e-4803-abad-d70c5a21a11a-metrics-certs\") pod \"network-metrics-daemon-t87h5\" (UID: \"b407d9da-589e-4803-abad-d70c5a21a11a\") " pod="openshift-multus/network-metrics-daemon-t87h5" May 27 23:41:31.364484 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:31.364350 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 23:41:31.364484 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:31.364432 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b407d9da-589e-4803-abad-d70c5a21a11a-metrics-certs podName:b407d9da-589e-4803-abad-d70c5a21a11a nodeName:}" failed. No retries permitted until 2026-05-27 23:42:03.364411922 +0000 UTC m=+66.291313503 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b407d9da-589e-4803-abad-d70c5a21a11a-metrics-certs") pod "network-metrics-daemon-t87h5" (UID: "b407d9da-589e-4803-abad-d70c5a21a11a") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 23:41:31.465120 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:31.465085 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wml5g\" (UniqueName: \"kubernetes.io/projected/6a6ef6f8-506a-4fd5-886a-17d7e66340f8-kube-api-access-wml5g\") pod \"network-check-target-cwkwk\" (UID: \"6a6ef6f8-506a-4fd5-886a-17d7e66340f8\") " pod="openshift-network-diagnostics/network-check-target-cwkwk" May 27 23:41:31.465291 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:31.465222 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 23:41:31.465291 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:31.465241 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 23:41:31.465291 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:31.465253 2556 projected.go:194] Error preparing data for projected volume kube-api-access-wml5g for pod openshift-network-diagnostics/network-check-target-cwkwk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 23:41:31.465402 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:31.465303 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a6ef6f8-506a-4fd5-886a-17d7e66340f8-kube-api-access-wml5g podName:6a6ef6f8-506a-4fd5-886a-17d7e66340f8 nodeName:}" failed. No retries permitted until 2026-05-27 23:42:03.465290666 +0000 UTC m=+66.392192235 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wml5g" (UniqueName: "kubernetes.io/projected/6a6ef6f8-506a-4fd5-886a-17d7e66340f8-kube-api-access-wml5g") pod "network-check-target-cwkwk" (UID: "6a6ef6f8-506a-4fd5-886a-17d7e66340f8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 23:41:31.886768 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:31.886731 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-22.ec2.internal" event="NodeReady" May 27 23:41:31.887200 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:31.886875 2556 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 27 23:41:31.940732 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:31.940692 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zjddg"] May 27 23:41:31.942815 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:31.942792 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-z52tg"] May 27 23:41:31.942964 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:31.942946 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zjddg" May 27 23:41:31.944763 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:31.944740 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z52tg" May 27 23:41:31.947432 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:31.947414 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 27 23:41:31.950183 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:31.948189 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 27 23:41:31.950183 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:31.948229 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 27 23:41:31.950183 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:31.948294 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 27 23:41:31.950183 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:31.948342 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2gd8z\"" May 27 23:41:31.950183 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:31.948423 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mpjmq\"" May 27 23:41:31.950183 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:31.948660 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 27 23:41:31.955790 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:31.955768 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zjddg"] May 27 23:41:31.958570 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:31.958539 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z52tg"] May 27 23:41:32.069746 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:32.069708 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzbpn\" (UniqueName: \"kubernetes.io/projected/68b5c5a2-0e83-40b4-a3d8-fa07001d58f9-kube-api-access-dzbpn\") pod \"dns-default-z52tg\" (UID: \"68b5c5a2-0e83-40b4-a3d8-fa07001d58f9\") " pod="openshift-dns/dns-default-z52tg" May 27 23:41:32.069941 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:32.069786 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68b5c5a2-0e83-40b4-a3d8-fa07001d58f9-tmp-dir\") pod \"dns-default-z52tg\" (UID: \"68b5c5a2-0e83-40b4-a3d8-fa07001d58f9\") " pod="openshift-dns/dns-default-z52tg" May 27 23:41:32.069941 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:32.069836 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68b5c5a2-0e83-40b4-a3d8-fa07001d58f9-metrics-tls\") pod \"dns-default-z52tg\" (UID: \"68b5c5a2-0e83-40b4-a3d8-fa07001d58f9\") " pod="openshift-dns/dns-default-z52tg" May 27 23:41:32.069941 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:32.069862 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37275969-1a75-4d59-b8e2-ed044ddcc3e9-cert\") pod \"ingress-canary-zjddg\" (UID: \"37275969-1a75-4d59-b8e2-ed044ddcc3e9\") " pod="openshift-ingress-canary/ingress-canary-zjddg" May 27 23:41:32.070071 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:32.069941 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hc4t\" (UniqueName: \"kubernetes.io/projected/37275969-1a75-4d59-b8e2-ed044ddcc3e9-kube-api-access-9hc4t\") pod \"ingress-canary-zjddg\" (UID: \"37275969-1a75-4d59-b8e2-ed044ddcc3e9\") " pod="openshift-ingress-canary/ingress-canary-zjddg" May 27 23:41:32.070071 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:32.069987 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/68b5c5a2-0e83-40b4-a3d8-fa07001d58f9-config-volume\") pod \"dns-default-z52tg\" (UID: \"68b5c5a2-0e83-40b4-a3d8-fa07001d58f9\") " pod="openshift-dns/dns-default-z52tg" May 27 23:41:32.171426 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:32.171335 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68b5c5a2-0e83-40b4-a3d8-fa07001d58f9-metrics-tls\") pod \"dns-default-z52tg\" (UID: \"68b5c5a2-0e83-40b4-a3d8-fa07001d58f9\") " pod="openshift-dns/dns-default-z52tg" May 27 23:41:32.171426 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:32.171381 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37275969-1a75-4d59-b8e2-ed044ddcc3e9-cert\") pod \"ingress-canary-zjddg\" (UID: \"37275969-1a75-4d59-b8e2-ed044ddcc3e9\") " pod="openshift-ingress-canary/ingress-canary-zjddg" May 27 23:41:32.171660 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:32.171495 2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 23:41:32.171660 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:32.171522 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9hc4t\" (UniqueName: \"kubernetes.io/projected/37275969-1a75-4d59-b8e2-ed044ddcc3e9-kube-api-access-9hc4t\") pod \"ingress-canary-zjddg\" (UID: \"37275969-1a75-4d59-b8e2-ed044ddcc3e9\") " pod="openshift-ingress-canary/ingress-canary-zjddg" May 27 23:41:32.171660 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:32.171559 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37275969-1a75-4d59-b8e2-ed044ddcc3e9-cert podName:37275969-1a75-4d59-b8e2-ed044ddcc3e9 nodeName:}" failed. No retries permitted until 2026-05-27 23:41:32.671539822 +0000 UTC m=+35.598441405 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/37275969-1a75-4d59-b8e2-ed044ddcc3e9-cert") pod "ingress-canary-zjddg" (UID: "37275969-1a75-4d59-b8e2-ed044ddcc3e9") : secret "canary-serving-cert" not found May 27 23:41:32.171660 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:32.171496 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 23:41:32.171660 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:32.171584 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/68b5c5a2-0e83-40b4-a3d8-fa07001d58f9-config-volume\") pod \"dns-default-z52tg\" (UID: \"68b5c5a2-0e83-40b4-a3d8-fa07001d58f9\") " pod="openshift-dns/dns-default-z52tg" May 27 23:41:32.171660 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:32.171649 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68b5c5a2-0e83-40b4-a3d8-fa07001d58f9-metrics-tls podName:68b5c5a2-0e83-40b4-a3d8-fa07001d58f9 nodeName:}" failed. No retries permitted until 2026-05-27 23:41:32.671618683 +0000 UTC m=+35.598520251 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68b5c5a2-0e83-40b4-a3d8-fa07001d58f9-metrics-tls") pod "dns-default-z52tg" (UID: "68b5c5a2-0e83-40b4-a3d8-fa07001d58f9") : secret "dns-default-metrics-tls" not found May 27 23:41:32.171946 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:32.171689 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dzbpn\" (UniqueName: \"kubernetes.io/projected/68b5c5a2-0e83-40b4-a3d8-fa07001d58f9-kube-api-access-dzbpn\") pod \"dns-default-z52tg\" (UID: \"68b5c5a2-0e83-40b4-a3d8-fa07001d58f9\") " pod="openshift-dns/dns-default-z52tg" May 27 23:41:32.171946 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:32.171748 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68b5c5a2-0e83-40b4-a3d8-fa07001d58f9-tmp-dir\") pod \"dns-default-z52tg\" (UID: \"68b5c5a2-0e83-40b4-a3d8-fa07001d58f9\") " pod="openshift-dns/dns-default-z52tg" May 27 23:41:32.172109 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:32.172091 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68b5c5a2-0e83-40b4-a3d8-fa07001d58f9-tmp-dir\") pod \"dns-default-z52tg\" (UID: \"68b5c5a2-0e83-40b4-a3d8-fa07001d58f9\") " pod="openshift-dns/dns-default-z52tg" May 27 23:41:32.172294 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:32.172275 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/68b5c5a2-0e83-40b4-a3d8-fa07001d58f9-config-volume\") pod \"dns-default-z52tg\" (UID: \"68b5c5a2-0e83-40b4-a3d8-fa07001d58f9\") " pod="openshift-dns/dns-default-z52tg" May 27 23:41:32.183851 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:32.183831 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzbpn\" (UniqueName: \"kubernetes.io/projected/68b5c5a2-0e83-40b4-a3d8-fa07001d58f9-kube-api-access-dzbpn\") pod \"dns-default-z52tg\" (UID: \"68b5c5a2-0e83-40b4-a3d8-fa07001d58f9\") " pod="openshift-dns/dns-default-z52tg" May 27 23:41:32.183967 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:32.183938 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hc4t\" (UniqueName: \"kubernetes.io/projected/37275969-1a75-4d59-b8e2-ed044ddcc3e9-kube-api-access-9hc4t\") pod \"ingress-canary-zjddg\" (UID: \"37275969-1a75-4d59-b8e2-ed044ddcc3e9\") " pod="openshift-ingress-canary/ingress-canary-zjddg" May 27 23:41:32.647793 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:32.647756 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cwkwk" May 27 23:41:32.648015 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:32.647960 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t87h5" May 27 23:41:32.652350 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:32.652324 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 27 23:41:32.653101 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:32.653070 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 27 23:41:32.653231 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:32.653114 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qfthh\"" May 27 23:41:32.653382 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:32.653364 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 27 23:41:32.653448 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:32.653395 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-r6nr2\"" May 27 23:41:32.674296 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:32.674272 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68b5c5a2-0e83-40b4-a3d8-fa07001d58f9-metrics-tls\") pod \"dns-default-z52tg\" (UID: \"68b5c5a2-0e83-40b4-a3d8-fa07001d58f9\") " pod="openshift-dns/dns-default-z52tg" May 27 23:41:32.674429 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:32.674313 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37275969-1a75-4d59-b8e2-ed044ddcc3e9-cert\") pod \"ingress-canary-zjddg\" (UID: \"37275969-1a75-4d59-b8e2-ed044ddcc3e9\") " pod="openshift-ingress-canary/ingress-canary-zjddg" May 27 23:41:32.674496 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:32.674434 2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 23:41:32.674496 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:32.674438 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 23:41:32.674496 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:32.674492 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37275969-1a75-4d59-b8e2-ed044ddcc3e9-cert podName:37275969-1a75-4d59-b8e2-ed044ddcc3e9 nodeName:}" failed. No retries permitted until 2026-05-27 23:41:33.674476427 +0000 UTC m=+36.601378010 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/37275969-1a75-4d59-b8e2-ed044ddcc3e9-cert") pod "ingress-canary-zjddg" (UID: "37275969-1a75-4d59-b8e2-ed044ddcc3e9") : secret "canary-serving-cert" not found May 27 23:41:32.674696 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:32.674507 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68b5c5a2-0e83-40b4-a3d8-fa07001d58f9-metrics-tls podName:68b5c5a2-0e83-40b4-a3d8-fa07001d58f9 nodeName:}" failed. No retries permitted until 2026-05-27 23:41:33.674501097 +0000 UTC m=+36.601402666 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68b5c5a2-0e83-40b4-a3d8-fa07001d58f9-metrics-tls") pod "dns-default-z52tg" (UID: "68b5c5a2-0e83-40b4-a3d8-fa07001d58f9") : secret "dns-default-metrics-tls" not found May 27 23:41:33.681157 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:33.681122 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68b5c5a2-0e83-40b4-a3d8-fa07001d58f9-metrics-tls\") pod \"dns-default-z52tg\" (UID: \"68b5c5a2-0e83-40b4-a3d8-fa07001d58f9\") " pod="openshift-dns/dns-default-z52tg" May 27 23:41:33.681769 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:33.681169 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37275969-1a75-4d59-b8e2-ed044ddcc3e9-cert\") pod \"ingress-canary-zjddg\" (UID: \"37275969-1a75-4d59-b8e2-ed044ddcc3e9\") " pod="openshift-ingress-canary/ingress-canary-zjddg" May 27 23:41:33.681769 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:33.681259 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 23:41:33.681769 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:33.681296 2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 23:41:33.681769 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:33.681336 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68b5c5a2-0e83-40b4-a3d8-fa07001d58f9-metrics-tls podName:68b5c5a2-0e83-40b4-a3d8-fa07001d58f9 nodeName:}" failed. No retries permitted until 2026-05-27 23:41:35.681308802 +0000 UTC m=+38.608210383 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68b5c5a2-0e83-40b4-a3d8-fa07001d58f9-metrics-tls") pod "dns-default-z52tg" (UID: "68b5c5a2-0e83-40b4-a3d8-fa07001d58f9") : secret "dns-default-metrics-tls" not found May 27 23:41:33.681769 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:33.681351 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37275969-1a75-4d59-b8e2-ed044ddcc3e9-cert podName:37275969-1a75-4d59-b8e2-ed044ddcc3e9 nodeName:}" failed. No retries permitted until 2026-05-27 23:41:35.681343991 +0000 UTC m=+38.608245558 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/37275969-1a75-4d59-b8e2-ed044ddcc3e9-cert") pod "ingress-canary-zjddg" (UID: "37275969-1a75-4d59-b8e2-ed044ddcc3e9") : secret "canary-serving-cert" not found May 27 23:41:35.695783 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:35.695750 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68b5c5a2-0e83-40b4-a3d8-fa07001d58f9-metrics-tls\") pod \"dns-default-z52tg\" (UID: \"68b5c5a2-0e83-40b4-a3d8-fa07001d58f9\") " pod="openshift-dns/dns-default-z52tg" May 27 23:41:35.695783 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:35.695784 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37275969-1a75-4d59-b8e2-ed044ddcc3e9-cert\") pod \"ingress-canary-zjddg\" (UID: \"37275969-1a75-4d59-b8e2-ed044ddcc3e9\") " pod="openshift-ingress-canary/ingress-canary-zjddg" May 27 23:41:35.696520 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:35.695904 2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 23:41:35.696520 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:35.695916 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 23:41:35.696520 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:35.695965 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37275969-1a75-4d59-b8e2-ed044ddcc3e9-cert podName:37275969-1a75-4d59-b8e2-ed044ddcc3e9 nodeName:}" failed. No retries permitted until 2026-05-27 23:41:39.695950145 +0000 UTC m=+42.622851719 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/37275969-1a75-4d59-b8e2-ed044ddcc3e9-cert") pod "ingress-canary-zjddg" (UID: "37275969-1a75-4d59-b8e2-ed044ddcc3e9") : secret "canary-serving-cert" not found May 27 23:41:35.696520 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:35.695978 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68b5c5a2-0e83-40b4-a3d8-fa07001d58f9-metrics-tls podName:68b5c5a2-0e83-40b4-a3d8-fa07001d58f9 nodeName:}" failed. No retries permitted until 2026-05-27 23:41:39.695972707 +0000 UTC m=+42.622874275 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68b5c5a2-0e83-40b4-a3d8-fa07001d58f9-metrics-tls") pod "dns-default-z52tg" (UID: "68b5c5a2-0e83-40b4-a3d8-fa07001d58f9") : secret "dns-default-metrics-tls" not found May 27 23:41:35.782268 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:35.782237 2556 generic.go:358] "Generic (PLEG): container finished" podID="ff3537f7-1ece-4ffa-a8c8-b42b200cee3a" containerID="5ca16fb7b927e4b20987f67c2e96c6b2ff0be2c94e9bcccc142af8801dfe73d7" exitCode=0 May 27 23:41:35.782401 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:35.782291 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c4dx6" event={"ID":"ff3537f7-1ece-4ffa-a8c8-b42b200cee3a","Type":"ContainerDied","Data":"5ca16fb7b927e4b20987f67c2e96c6b2ff0be2c94e9bcccc142af8801dfe73d7"} May 27 23:41:36.786209 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:36.786177 2556 generic.go:358] "Generic (PLEG): container finished" podID="ff3537f7-1ece-4ffa-a8c8-b42b200cee3a" containerID="33f5ae47d0680cf86592539b6b076627e22a771fa3552ab14f81a8aeaac258d6" exitCode=0 May 27 23:41:36.786621 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:36.786218 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c4dx6" event={"ID":"ff3537f7-1ece-4ffa-a8c8-b42b200cee3a","Type":"ContainerDied","Data":"33f5ae47d0680cf86592539b6b076627e22a771fa3552ab14f81a8aeaac258d6"} May 27 23:41:37.790485 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:37.790241 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c4dx6" event={"ID":"ff3537f7-1ece-4ffa-a8c8-b42b200cee3a","Type":"ContainerStarted","Data":"7a1fe513bfaad44219637a3a3476dec58b3982924fb5ee2312d58b7e758a0473"} May 27 23:41:37.818543 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:37.818485 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-c4dx6" podStartSLOduration=6.365812887 podStartE2EDuration="40.818470935s" podCreationTimestamp="2026-05-27 23:40:57 +0000 UTC" firstStartedPulling="2026-05-27 23:41:00.32667006 +0000 UTC m=+3.253571642" lastFinishedPulling="2026-05-27 23:41:34.779328123 +0000 UTC m=+37.706229690" observedRunningTime="2026-05-27 23:41:37.817649414 +0000 UTC m=+40.744550995" watchObservedRunningTime="2026-05-27 23:41:37.818470935 +0000 UTC m=+40.745372525" May 27 23:41:39.722000 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:39.721963 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68b5c5a2-0e83-40b4-a3d8-fa07001d58f9-metrics-tls\") pod \"dns-default-z52tg\" (UID: \"68b5c5a2-0e83-40b4-a3d8-fa07001d58f9\") " pod="openshift-dns/dns-default-z52tg" May 27 23:41:39.722000 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:39.722000 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37275969-1a75-4d59-b8e2-ed044ddcc3e9-cert\") pod \"ingress-canary-zjddg\" (UID: \"37275969-1a75-4d59-b8e2-ed044ddcc3e9\") " pod="openshift-ingress-canary/ingress-canary-zjddg" May 27 23:41:39.722406 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:39.722111 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 23:41:39.722406 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:39.722153 2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 23:41:39.722406 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:39.722182 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68b5c5a2-0e83-40b4-a3d8-fa07001d58f9-metrics-tls podName:68b5c5a2-0e83-40b4-a3d8-fa07001d58f9 nodeName:}" failed. No retries permitted until 2026-05-27 23:41:47.722166658 +0000 UTC m=+50.649068226 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68b5c5a2-0e83-40b4-a3d8-fa07001d58f9-metrics-tls") pod "dns-default-z52tg" (UID: "68b5c5a2-0e83-40b4-a3d8-fa07001d58f9") : secret "dns-default-metrics-tls" not found May 27 23:41:39.722406 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:39.722196 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37275969-1a75-4d59-b8e2-ed044ddcc3e9-cert podName:37275969-1a75-4d59-b8e2-ed044ddcc3e9 nodeName:}" failed. No retries permitted until 2026-05-27 23:41:47.722189996 +0000 UTC m=+50.649091564 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/37275969-1a75-4d59-b8e2-ed044ddcc3e9-cert") pod "ingress-canary-zjddg" (UID: "37275969-1a75-4d59-b8e2-ed044ddcc3e9") : secret "canary-serving-cert" not found May 27 23:41:47.780626 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:47.780585 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68b5c5a2-0e83-40b4-a3d8-fa07001d58f9-metrics-tls\") pod \"dns-default-z52tg\" (UID: \"68b5c5a2-0e83-40b4-a3d8-fa07001d58f9\") " pod="openshift-dns/dns-default-z52tg" May 27 23:41:47.780626 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:47.780630 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37275969-1a75-4d59-b8e2-ed044ddcc3e9-cert\") pod \"ingress-canary-zjddg\" (UID: \"37275969-1a75-4d59-b8e2-ed044ddcc3e9\") " pod="openshift-ingress-canary/ingress-canary-zjddg" May 27 23:41:47.781144 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:47.780750 2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 23:41:47.781144 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:47.780756 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 23:41:47.781144 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:47.780824 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37275969-1a75-4d59-b8e2-ed044ddcc3e9-cert podName:37275969-1a75-4d59-b8e2-ed044ddcc3e9 nodeName:}" failed. No retries permitted until 2026-05-27 23:42:03.780789649 +0000 UTC m=+66.707691217 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/37275969-1a75-4d59-b8e2-ed044ddcc3e9-cert") pod "ingress-canary-zjddg" (UID: "37275969-1a75-4d59-b8e2-ed044ddcc3e9") : secret "canary-serving-cert" not found May 27 23:41:47.781144 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:41:47.780837 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68b5c5a2-0e83-40b4-a3d8-fa07001d58f9-metrics-tls podName:68b5c5a2-0e83-40b4-a3d8-fa07001d58f9 nodeName:}" failed. No retries permitted until 2026-05-27 23:42:03.780831166 +0000 UTC m=+66.707732734 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68b5c5a2-0e83-40b4-a3d8-fa07001d58f9-metrics-tls") pod "dns-default-z52tg" (UID: "68b5c5a2-0e83-40b4-a3d8-fa07001d58f9") : secret "dns-default-metrics-tls" not found May 27 23:41:57.781286 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:41:57.781256 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tbcdd" May 27 23:42:03.381283 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:42:03.381236 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b407d9da-589e-4803-abad-d70c5a21a11a-metrics-certs\") pod \"network-metrics-daemon-t87h5\" (UID: \"b407d9da-589e-4803-abad-d70c5a21a11a\") " pod="openshift-multus/network-metrics-daemon-t87h5" May 27 23:42:03.384302 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:42:03.384281 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 27 23:42:03.391690 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:42:03.391667 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 27 23:42:03.391765 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:42:03.391736 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b407d9da-589e-4803-abad-d70c5a21a11a-metrics-certs podName:b407d9da-589e-4803-abad-d70c5a21a11a nodeName:}" failed. No retries permitted until 2026-05-27 23:43:07.391720369 +0000 UTC m=+130.318621937 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b407d9da-589e-4803-abad-d70c5a21a11a-metrics-certs") pod "network-metrics-daemon-t87h5" (UID: "b407d9da-589e-4803-abad-d70c5a21a11a") : secret "metrics-daemon-secret" not found May 27 23:42:03.481888 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:42:03.481842 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wml5g\" (UniqueName: \"kubernetes.io/projected/6a6ef6f8-506a-4fd5-886a-17d7e66340f8-kube-api-access-wml5g\") pod \"network-check-target-cwkwk\" (UID: \"6a6ef6f8-506a-4fd5-886a-17d7e66340f8\") " pod="openshift-network-diagnostics/network-check-target-cwkwk" May 27 23:42:03.484753 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:42:03.484735 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 27 23:42:03.494484 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:42:03.494464 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 27 23:42:03.505245 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:42:03.505220 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wml5g\" (UniqueName: \"kubernetes.io/projected/6a6ef6f8-506a-4fd5-886a-17d7e66340f8-kube-api-access-wml5g\") pod \"network-check-target-cwkwk\" (UID: \"6a6ef6f8-506a-4fd5-886a-17d7e66340f8\") " pod="openshift-network-diagnostics/network-check-target-cwkwk" May 27 23:42:03.562749 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:42:03.562722 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qfthh\"" May 27 23:42:03.570908 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:42:03.570882 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cwkwk" May 27 23:42:03.701199 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:42:03.701155 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cwkwk"] May 27 23:42:03.704904 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:42:03.704865 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a6ef6f8_506a_4fd5_886a_17d7e66340f8.slice/crio-24c70551c135c19410e229c16f73e34f99a8688885c97243f62fffa66660b6c5 WatchSource:0}: Error finding container 24c70551c135c19410e229c16f73e34f99a8688885c97243f62fffa66660b6c5: Status 404 returned error can't find the container with id 24c70551c135c19410e229c16f73e34f99a8688885c97243f62fffa66660b6c5 May 27 23:42:03.784627 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:42:03.784590 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68b5c5a2-0e83-40b4-a3d8-fa07001d58f9-metrics-tls\") pod \"dns-default-z52tg\" (UID: \"68b5c5a2-0e83-40b4-a3d8-fa07001d58f9\") " pod="openshift-dns/dns-default-z52tg" May 27 23:42:03.784627 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:42:03.784629 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37275969-1a75-4d59-b8e2-ed044ddcc3e9-cert\") pod \"ingress-canary-zjddg\" (UID: \"37275969-1a75-4d59-b8e2-ed044ddcc3e9\") " pod="openshift-ingress-canary/ingress-canary-zjddg" May 27 23:42:03.784838 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:42:03.784745 2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 23:42:03.784838 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:42:03.784748 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 23:42:03.784838 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:42:03.784796 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37275969-1a75-4d59-b8e2-ed044ddcc3e9-cert podName:37275969-1a75-4d59-b8e2-ed044ddcc3e9 nodeName:}" failed. No retries permitted until 2026-05-27 23:42:35.784781972 +0000 UTC m=+98.711683541 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/37275969-1a75-4d59-b8e2-ed044ddcc3e9-cert") pod "ingress-canary-zjddg" (UID: "37275969-1a75-4d59-b8e2-ed044ddcc3e9") : secret "canary-serving-cert" not found May 27 23:42:03.784838 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:42:03.784808 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68b5c5a2-0e83-40b4-a3d8-fa07001d58f9-metrics-tls podName:68b5c5a2-0e83-40b4-a3d8-fa07001d58f9 nodeName:}" failed. No retries permitted until 2026-05-27 23:42:35.784802181 +0000 UTC m=+98.711703749 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68b5c5a2-0e83-40b4-a3d8-fa07001d58f9-metrics-tls") pod "dns-default-z52tg" (UID: "68b5c5a2-0e83-40b4-a3d8-fa07001d58f9") : secret "dns-default-metrics-tls" not found May 27 23:42:03.837057 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:42:03.837023 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cwkwk" event={"ID":"6a6ef6f8-506a-4fd5-886a-17d7e66340f8","Type":"ContainerStarted","Data":"24c70551c135c19410e229c16f73e34f99a8688885c97243f62fffa66660b6c5"} May 27 23:42:07.846611 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:42:07.846567 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cwkwk" event={"ID":"6a6ef6f8-506a-4fd5-886a-17d7e66340f8","Type":"ContainerStarted","Data":"fcb117f917863c3e1b2ce321485034681ad93d9f8a7064ded17c9eb9a3cb9277"} May 27 23:42:07.847024 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:42:07.846707 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cwkwk" May 27 23:42:07.862682 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:42:07.862615 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cwkwk" podStartSLOduration=67.838296143 podStartE2EDuration="1m10.862601269s" podCreationTimestamp="2026-05-27 23:40:57 +0000 UTC" firstStartedPulling="2026-05-27 23:42:03.706738669 +0000 UTC m=+66.633640241" lastFinishedPulling="2026-05-27 23:42:06.731043795 +0000 UTC m=+69.657945367" observedRunningTime="2026-05-27 23:42:07.862174429 +0000 UTC m=+70.789076019" watchObservedRunningTime="2026-05-27 23:42:07.862601269 +0000 UTC m=+70.789502858" May 27 23:42:35.806492 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:42:35.806372 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68b5c5a2-0e83-40b4-a3d8-fa07001d58f9-metrics-tls\") pod \"dns-default-z52tg\" (UID: \"68b5c5a2-0e83-40b4-a3d8-fa07001d58f9\") " pod="openshift-dns/dns-default-z52tg" May 27 23:42:35.806492 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:42:35.806413 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37275969-1a75-4d59-b8e2-ed044ddcc3e9-cert\") pod \"ingress-canary-zjddg\" (UID: \"37275969-1a75-4d59-b8e2-ed044ddcc3e9\") " pod="openshift-ingress-canary/ingress-canary-zjddg" May 27 23:42:35.807024 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:42:35.806506 2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 23:42:35.807024 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:42:35.806512 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 23:42:35.807024 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:42:35.806568 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37275969-1a75-4d59-b8e2-ed044ddcc3e9-cert podName:37275969-1a75-4d59-b8e2-ed044ddcc3e9 nodeName:}" failed. No retries permitted until 2026-05-27 23:43:39.806553276 +0000 UTC m=+162.733454844 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/37275969-1a75-4d59-b8e2-ed044ddcc3e9-cert") pod "ingress-canary-zjddg" (UID: "37275969-1a75-4d59-b8e2-ed044ddcc3e9") : secret "canary-serving-cert" not found May 27 23:42:35.807024 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:42:35.806587 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68b5c5a2-0e83-40b4-a3d8-fa07001d58f9-metrics-tls podName:68b5c5a2-0e83-40b4-a3d8-fa07001d58f9 nodeName:}" failed. No retries permitted until 2026-05-27 23:43:39.806573453 +0000 UTC m=+162.733475026 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68b5c5a2-0e83-40b4-a3d8-fa07001d58f9-metrics-tls") pod "dns-default-z52tg" (UID: "68b5c5a2-0e83-40b4-a3d8-fa07001d58f9") : secret "dns-default-metrics-tls" not found May 27 23:42:38.851775 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:42:38.851742 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cwkwk" May 27 23:43:06.249706 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.249631 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-9dngd"] May 27 23:43:06.251487 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.251471 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-9dngd" May 27 23:43:06.254160 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.254137 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" May 27 23:43:06.254283 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.254166 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 27 23:43:06.254369 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.254353 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" May 27 23:43:06.254602 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.254585 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 27 23:43:06.255537 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.255521 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-jl8tb\"" May 27 23:43:06.260997 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.260976 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" May 27 23:43:06.262061 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.262037 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-9dngd"] May 27 23:43:06.310154 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.310127 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlzxr\" (UniqueName: \"kubernetes.io/projected/e5c3a679-8e9c-4649-a2f2-201003fb37d5-kube-api-access-jlzxr\") pod \"insights-operator-78bdfb888c-9dngd\" (UID: \"e5c3a679-8e9c-4649-a2f2-201003fb37d5\") " pod="openshift-insights/insights-operator-78bdfb888c-9dngd" May 27 23:43:06.310281 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.310160 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5c3a679-8e9c-4649-a2f2-201003fb37d5-service-ca-bundle\") pod \"insights-operator-78bdfb888c-9dngd\" (UID: \"e5c3a679-8e9c-4649-a2f2-201003fb37d5\") " pod="openshift-insights/insights-operator-78bdfb888c-9dngd" May 27 23:43:06.310281 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.310219 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5c3a679-8e9c-4649-a2f2-201003fb37d5-tmp\") pod \"insights-operator-78bdfb888c-9dngd\" (UID: \"e5c3a679-8e9c-4649-a2f2-201003fb37d5\") " pod="openshift-insights/insights-operator-78bdfb888c-9dngd" May 27 23:43:06.310281 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.310237 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e5c3a679-8e9c-4649-a2f2-201003fb37d5-snapshots\") pod \"insights-operator-78bdfb888c-9dngd\" (UID: \"e5c3a679-8e9c-4649-a2f2-201003fb37d5\") " pod="openshift-insights/insights-operator-78bdfb888c-9dngd" May 27 23:43:06.310281 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.310253 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e5c3a679-8e9c-4649-a2f2-201003fb37d5-serving-cert\") pod \"insights-operator-78bdfb888c-9dngd\" (UID: \"e5c3a679-8e9c-4649-a2f2-201003fb37d5\") " pod="openshift-insights/insights-operator-78bdfb888c-9dngd" May 27 23:43:06.310281 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.310274 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5c3a679-8e9c-4649-a2f2-201003fb37d5-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-9dngd\" (UID: \"e5c3a679-8e9c-4649-a2f2-201003fb37d5\") " pod="openshift-insights/insights-operator-78bdfb888c-9dngd" May 27 23:43:06.350973 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.350944 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-kg2vj"] May 27 23:43:06.352594 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.352580 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-kg2vj" May 27 23:43:06.354909 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.354889 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" May 27 23:43:06.355082 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.354960 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 27 23:43:06.355082 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.355008 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-65jtn\"" May 27 23:43:06.356177 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.356160 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 27 23:43:06.356343 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.356327 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" May 27 23:43:06.363798 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.363780 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-kg2vj"] May 27 23:43:06.411162 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.411143 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jlzxr\" (UniqueName: \"kubernetes.io/projected/e5c3a679-8e9c-4649-a2f2-201003fb37d5-kube-api-access-jlzxr\") pod \"insights-operator-78bdfb888c-9dngd\" (UID: \"e5c3a679-8e9c-4649-a2f2-201003fb37d5\") " pod="openshift-insights/insights-operator-78bdfb888c-9dngd" May 27 23:43:06.411258 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.411174 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cfff88b2-cd59-4a94-ab7d-6ec94dcccc47-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-kg2vj\" (UID: \"cfff88b2-cd59-4a94-ab7d-6ec94dcccc47\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-kg2vj" May 27 23:43:06.411258 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.411195 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5c3a679-8e9c-4649-a2f2-201003fb37d5-service-ca-bundle\") pod \"insights-operator-78bdfb888c-9dngd\" (UID: \"e5c3a679-8e9c-4649-a2f2-201003fb37d5\") " pod="openshift-insights/insights-operator-78bdfb888c-9dngd" May 27 23:43:06.411258 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.411232 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/cfff88b2-cd59-4a94-ab7d-6ec94dcccc47-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-kg2vj\" (UID: \"cfff88b2-cd59-4a94-ab7d-6ec94dcccc47\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-kg2vj" May 27 23:43:06.411258 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.411257 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5c3a679-8e9c-4649-a2f2-201003fb37d5-tmp\") pod \"insights-operator-78bdfb888c-9dngd\" (UID: \"e5c3a679-8e9c-4649-a2f2-201003fb37d5\") " pod="openshift-insights/insights-operator-78bdfb888c-9dngd" May 27 23:43:06.411439 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.411272 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e5c3a679-8e9c-4649-a2f2-201003fb37d5-snapshots\") pod \"insights-operator-78bdfb888c-9dngd\" (UID: \"e5c3a679-8e9c-4649-a2f2-201003fb37d5\") " pod="openshift-insights/insights-operator-78bdfb888c-9dngd" May 27 23:43:06.411439 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.411290 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e5c3a679-8e9c-4649-a2f2-201003fb37d5-serving-cert\") pod \"insights-operator-78bdfb888c-9dngd\" (UID: \"e5c3a679-8e9c-4649-a2f2-201003fb37d5\") " pod="openshift-insights/insights-operator-78bdfb888c-9dngd" May 27 23:43:06.411439 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.411351 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5c3a679-8e9c-4649-a2f2-201003fb37d5-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-9dngd\" (UID: \"e5c3a679-8e9c-4649-a2f2-201003fb37d5\") " pod="openshift-insights/insights-operator-78bdfb888c-9dngd" May 27 23:43:06.411439 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.411389 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqb6w\" (UniqueName: \"kubernetes.io/projected/cfff88b2-cd59-4a94-ab7d-6ec94dcccc47-kube-api-access-cqb6w\") pod \"cluster-monitoring-operator-6c75959455-kg2vj\" (UID: \"cfff88b2-cd59-4a94-ab7d-6ec94dcccc47\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-kg2vj" May 27 23:43:06.411698 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.411668 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5c3a679-8e9c-4649-a2f2-201003fb37d5-tmp\") pod \"insights-operator-78bdfb888c-9dngd\" (UID: \"e5c3a679-8e9c-4649-a2f2-201003fb37d5\") " pod="openshift-insights/insights-operator-78bdfb888c-9dngd" May 27 23:43:06.411823 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.411803 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5c3a679-8e9c-4649-a2f2-201003fb37d5-service-ca-bundle\") pod \"insights-operator-78bdfb888c-9dngd\" (UID: \"e5c3a679-8e9c-4649-a2f2-201003fb37d5\") " pod="openshift-insights/insights-operator-78bdfb888c-9dngd" May 27 23:43:06.411931 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.411913 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e5c3a679-8e9c-4649-a2f2-201003fb37d5-snapshots\") pod \"insights-operator-78bdfb888c-9dngd\" (UID: \"e5c3a679-8e9c-4649-a2f2-201003fb37d5\") " pod="openshift-insights/insights-operator-78bdfb888c-9dngd" May 27 23:43:06.412140 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.412124 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5c3a679-8e9c-4649-a2f2-201003fb37d5-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-9dngd\" (UID: \"e5c3a679-8e9c-4649-a2f2-201003fb37d5\") " pod="openshift-insights/insights-operator-78bdfb888c-9dngd" May 27 23:43:06.413604 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.413589 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e5c3a679-8e9c-4649-a2f2-201003fb37d5-serving-cert\") pod \"insights-operator-78bdfb888c-9dngd\" (UID: \"e5c3a679-8e9c-4649-a2f2-201003fb37d5\") " pod="openshift-insights/insights-operator-78bdfb888c-9dngd" May 27 23:43:06.419283 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.419264 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlzxr\" (UniqueName: \"kubernetes.io/projected/e5c3a679-8e9c-4649-a2f2-201003fb37d5-kube-api-access-jlzxr\") pod \"insights-operator-78bdfb888c-9dngd\" (UID: \"e5c3a679-8e9c-4649-a2f2-201003fb37d5\") " pod="openshift-insights/insights-operator-78bdfb888c-9dngd" May 27 23:43:06.455402 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.455383 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5dcf54cc8b-h5zzl"] May 27 23:43:06.457413 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.457399 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5dcf54cc8b-h5zzl" May 27 23:43:06.459839 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.459819 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 27 23:43:06.459950 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.459873 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 27 23:43:06.459950 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.459889 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-k2wbn\"" May 27 23:43:06.459950 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.459890 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" May 27 23:43:06.459950 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.459923 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" May 27 23:43:06.460126 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.459893 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" May 27 23:43:06.460198 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.460184 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" May 27 23:43:06.470855 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.470836 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5dcf54cc8b-h5zzl"] May 27 23:43:06.512374 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.512321 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cqb6w\" (UniqueName: \"kubernetes.io/projected/cfff88b2-cd59-4a94-ab7d-6ec94dcccc47-kube-api-access-cqb6w\") pod \"cluster-monitoring-operator-6c75959455-kg2vj\" (UID: \"cfff88b2-cd59-4a94-ab7d-6ec94dcccc47\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-kg2vj" May 27 23:43:06.512374 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.512357 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cfff88b2-cd59-4a94-ab7d-6ec94dcccc47-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-kg2vj\" (UID: \"cfff88b2-cd59-4a94-ab7d-6ec94dcccc47\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-kg2vj" May 27 23:43:06.512517 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.512394 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/cfff88b2-cd59-4a94-ab7d-6ec94dcccc47-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-kg2vj\" (UID: \"cfff88b2-cd59-4a94-ab7d-6ec94dcccc47\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-kg2vj" May 27 23:43:06.512517 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:43:06.512474 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 27 23:43:06.512628 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:43:06.512542 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfff88b2-cd59-4a94-ab7d-6ec94dcccc47-cluster-monitoring-operator-tls podName:cfff88b2-cd59-4a94-ab7d-6ec94dcccc47 nodeName:}" failed. No retries permitted until 2026-05-27 23:43:07.012524766 +0000 UTC m=+129.939426353 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cfff88b2-cd59-4a94-ab7d-6ec94dcccc47-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-kg2vj" (UID: "cfff88b2-cd59-4a94-ab7d-6ec94dcccc47") : secret "cluster-monitoring-operator-tls" not found May 27 23:43:06.512947 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.512930 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/cfff88b2-cd59-4a94-ab7d-6ec94dcccc47-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-kg2vj\" (UID: \"cfff88b2-cd59-4a94-ab7d-6ec94dcccc47\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-kg2vj" May 27 23:43:06.521063 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.521037 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqb6w\" (UniqueName: \"kubernetes.io/projected/cfff88b2-cd59-4a94-ab7d-6ec94dcccc47-kube-api-access-cqb6w\") pod \"cluster-monitoring-operator-6c75959455-kg2vj\" (UID: \"cfff88b2-cd59-4a94-ab7d-6ec94dcccc47\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-kg2vj" May 27 23:43:06.561933 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.561914 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-9dngd" May 27 23:43:06.613754 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.613726 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54d79568-5558-42be-b533-d5842e079979-service-ca-bundle\") pod \"router-default-5dcf54cc8b-h5zzl\" (UID: \"54d79568-5558-42be-b533-d5842e079979\") " pod="openshift-ingress/router-default-5dcf54cc8b-h5zzl" May 27 23:43:06.613992 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.613952 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2vt7\" (UniqueName: \"kubernetes.io/projected/54d79568-5558-42be-b533-d5842e079979-kube-api-access-p2vt7\") pod \"router-default-5dcf54cc8b-h5zzl\" (UID: \"54d79568-5558-42be-b533-d5842e079979\") " pod="openshift-ingress/router-default-5dcf54cc8b-h5zzl" May 27 23:43:06.614216 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.614198 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/54d79568-5558-42be-b533-d5842e079979-stats-auth\") pod \"router-default-5dcf54cc8b-h5zzl\" (UID: \"54d79568-5558-42be-b533-d5842e079979\") " pod="openshift-ingress/router-default-5dcf54cc8b-h5zzl" May 27 23:43:06.614446 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.614368 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/54d79568-5558-42be-b533-d5842e079979-default-certificate\") pod \"router-default-5dcf54cc8b-h5zzl\" (UID: \"54d79568-5558-42be-b533-d5842e079979\") " pod="openshift-ingress/router-default-5dcf54cc8b-h5zzl" May 27 23:43:06.614534 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.614495 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54d79568-5558-42be-b533-d5842e079979-metrics-certs\") pod \"router-default-5dcf54cc8b-h5zzl\" (UID: \"54d79568-5558-42be-b533-d5842e079979\") " pod="openshift-ingress/router-default-5dcf54cc8b-h5zzl" May 27 23:43:06.702389 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.702359 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-9dngd"] May 27 23:43:06.705275 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:43:06.705248 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5c3a679_8e9c_4649_a2f2_201003fb37d5.slice/crio-cce6ff581e79991a2a5f015d1e4f964fa38c3122d5eea89b6eaeb57719f7f0d8 WatchSource:0}: Error finding container cce6ff581e79991a2a5f015d1e4f964fa38c3122d5eea89b6eaeb57719f7f0d8: Status 404 returned error can't find the container with id cce6ff581e79991a2a5f015d1e4f964fa38c3122d5eea89b6eaeb57719f7f0d8 May 27 23:43:06.714791 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.714769 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/54d79568-5558-42be-b533-d5842e079979-stats-auth\") pod \"router-default-5dcf54cc8b-h5zzl\" (UID: \"54d79568-5558-42be-b533-d5842e079979\") " pod="openshift-ingress/router-default-5dcf54cc8b-h5zzl" May 27 23:43:06.714892 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.714808 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/54d79568-5558-42be-b533-d5842e079979-default-certificate\") pod \"router-default-5dcf54cc8b-h5zzl\" (UID: \"54d79568-5558-42be-b533-d5842e079979\") " pod="openshift-ingress/router-default-5dcf54cc8b-h5zzl" May 27 23:43:06.714892 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.714828 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54d79568-5558-42be-b533-d5842e079979-metrics-certs\") pod \"router-default-5dcf54cc8b-h5zzl\" (UID: \"54d79568-5558-42be-b533-d5842e079979\") " pod="openshift-ingress/router-default-5dcf54cc8b-h5zzl" May 27 23:43:06.714969 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:43:06.714909 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 27 23:43:06.714969 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:43:06.714963 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54d79568-5558-42be-b533-d5842e079979-metrics-certs podName:54d79568-5558-42be-b533-d5842e079979 nodeName:}" failed. No retries permitted until 2026-05-27 23:43:07.214947597 +0000 UTC m=+130.141849168 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/54d79568-5558-42be-b533-d5842e079979-metrics-certs") pod "router-default-5dcf54cc8b-h5zzl" (UID: "54d79568-5558-42be-b533-d5842e079979") : secret "router-metrics-certs-default" not found May 27 23:43:06.714969 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.714961 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54d79568-5558-42be-b533-d5842e079979-service-ca-bundle\") pod \"router-default-5dcf54cc8b-h5zzl\" (UID: \"54d79568-5558-42be-b533-d5842e079979\") " pod="openshift-ingress/router-default-5dcf54cc8b-h5zzl" May 27 23:43:06.715109 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.714998 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p2vt7\" (UniqueName: \"kubernetes.io/projected/54d79568-5558-42be-b533-d5842e079979-kube-api-access-p2vt7\") pod \"router-default-5dcf54cc8b-h5zzl\" (UID: \"54d79568-5558-42be-b533-d5842e079979\") " pod="openshift-ingress/router-default-5dcf54cc8b-h5zzl" May 27 23:43:06.715109 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:43:06.715100 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54d79568-5558-42be-b533-d5842e079979-service-ca-bundle podName:54d79568-5558-42be-b533-d5842e079979 nodeName:}" failed. No retries permitted until 2026-05-27 23:43:07.215086239 +0000 UTC m=+130.141987831 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/54d79568-5558-42be-b533-d5842e079979-service-ca-bundle") pod "router-default-5dcf54cc8b-h5zzl" (UID: "54d79568-5558-42be-b533-d5842e079979") : configmap references non-existent config key: service-ca.crt May 27 23:43:06.717122 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.717104 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/54d79568-5558-42be-b533-d5842e079979-default-certificate\") pod \"router-default-5dcf54cc8b-h5zzl\" (UID: \"54d79568-5558-42be-b533-d5842e079979\") " pod="openshift-ingress/router-default-5dcf54cc8b-h5zzl" May 27 23:43:06.717198 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.717139 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/54d79568-5558-42be-b533-d5842e079979-stats-auth\") pod \"router-default-5dcf54cc8b-h5zzl\" (UID: \"54d79568-5558-42be-b533-d5842e079979\") " pod="openshift-ingress/router-default-5dcf54cc8b-h5zzl" May 27 23:43:06.724729 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.724712 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2vt7\" (UniqueName: \"kubernetes.io/projected/54d79568-5558-42be-b533-d5842e079979-kube-api-access-p2vt7\") pod \"router-default-5dcf54cc8b-h5zzl\" (UID: \"54d79568-5558-42be-b533-d5842e079979\") " pod="openshift-ingress/router-default-5dcf54cc8b-h5zzl" May 27 23:43:06.963914 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:06.963875 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-9dngd" event={"ID":"e5c3a679-8e9c-4649-a2f2-201003fb37d5","Type":"ContainerStarted","Data":"cce6ff581e79991a2a5f015d1e4f964fa38c3122d5eea89b6eaeb57719f7f0d8"} May 27 23:43:07.017428 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:07.017401 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cfff88b2-cd59-4a94-ab7d-6ec94dcccc47-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-kg2vj\" (UID: \"cfff88b2-cd59-4a94-ab7d-6ec94dcccc47\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-kg2vj" May 27 23:43:07.017519 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:43:07.017508 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 27 23:43:07.017563 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:43:07.017558 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfff88b2-cd59-4a94-ab7d-6ec94dcccc47-cluster-monitoring-operator-tls podName:cfff88b2-cd59-4a94-ab7d-6ec94dcccc47 nodeName:}" failed. No retries permitted until 2026-05-27 23:43:08.017545778 +0000 UTC m=+130.944447345 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cfff88b2-cd59-4a94-ab7d-6ec94dcccc47-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-kg2vj" (UID: "cfff88b2-cd59-4a94-ab7d-6ec94dcccc47") : secret "cluster-monitoring-operator-tls" not found May 27 23:43:07.219001 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:07.218920 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54d79568-5558-42be-b533-d5842e079979-metrics-certs\") pod \"router-default-5dcf54cc8b-h5zzl\" (UID: \"54d79568-5558-42be-b533-d5842e079979\") " pod="openshift-ingress/router-default-5dcf54cc8b-h5zzl" May 27 23:43:07.219001 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:07.218978 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54d79568-5558-42be-b533-d5842e079979-service-ca-bundle\") pod \"router-default-5dcf54cc8b-h5zzl\" (UID: \"54d79568-5558-42be-b533-d5842e079979\") " pod="openshift-ingress/router-default-5dcf54cc8b-h5zzl" May 27 23:43:07.219163 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:43:07.219077 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 27 23:43:07.219163 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:43:07.219109 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54d79568-5558-42be-b533-d5842e079979-service-ca-bundle podName:54d79568-5558-42be-b533-d5842e079979 nodeName:}" failed. No retries permitted until 2026-05-27 23:43:08.21909429 +0000 UTC m=+131.145995863 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/54d79568-5558-42be-b533-d5842e079979-service-ca-bundle") pod "router-default-5dcf54cc8b-h5zzl" (UID: "54d79568-5558-42be-b533-d5842e079979") : configmap references non-existent config key: service-ca.crt May 27 23:43:07.219163 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:43:07.219136 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54d79568-5558-42be-b533-d5842e079979-metrics-certs podName:54d79568-5558-42be-b533-d5842e079979 nodeName:}" failed. No retries permitted until 2026-05-27 23:43:08.219119924 +0000 UTC m=+131.146021492 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/54d79568-5558-42be-b533-d5842e079979-metrics-certs") pod "router-default-5dcf54cc8b-h5zzl" (UID: "54d79568-5558-42be-b533-d5842e079979") : secret "router-metrics-certs-default" not found May 27 23:43:07.420722 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:07.420684 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b407d9da-589e-4803-abad-d70c5a21a11a-metrics-certs\") pod \"network-metrics-daemon-t87h5\" (UID: \"b407d9da-589e-4803-abad-d70c5a21a11a\") " pod="openshift-multus/network-metrics-daemon-t87h5" May 27 23:43:07.421134 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:43:07.420871 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 27 23:43:07.421134 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:43:07.420942 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b407d9da-589e-4803-abad-d70c5a21a11a-metrics-certs podName:b407d9da-589e-4803-abad-d70c5a21a11a nodeName:}" failed. No retries permitted until 2026-05-27 23:45:09.420922619 +0000 UTC m=+252.347824205 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b407d9da-589e-4803-abad-d70c5a21a11a-metrics-certs") pod "network-metrics-daemon-t87h5" (UID: "b407d9da-589e-4803-abad-d70c5a21a11a") : secret "metrics-daemon-secret" not found May 27 23:43:08.028282 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:08.025825 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cfff88b2-cd59-4a94-ab7d-6ec94dcccc47-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-kg2vj\" (UID: \"cfff88b2-cd59-4a94-ab7d-6ec94dcccc47\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-kg2vj" May 27 23:43:08.028282 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:43:08.026052 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 27 23:43:08.028282 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:43:08.026152 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfff88b2-cd59-4a94-ab7d-6ec94dcccc47-cluster-monitoring-operator-tls podName:cfff88b2-cd59-4a94-ab7d-6ec94dcccc47 nodeName:}" failed. No retries permitted until 2026-05-27 23:43:10.026121637 +0000 UTC m=+132.953023208 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cfff88b2-cd59-4a94-ab7d-6ec94dcccc47-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-kg2vj" (UID: "cfff88b2-cd59-4a94-ab7d-6ec94dcccc47") : secret "cluster-monitoring-operator-tls" not found May 27 23:43:08.227360 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:08.227305 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54d79568-5558-42be-b533-d5842e079979-metrics-certs\") pod \"router-default-5dcf54cc8b-h5zzl\" (UID: \"54d79568-5558-42be-b533-d5842e079979\") " pod="openshift-ingress/router-default-5dcf54cc8b-h5zzl" May 27 23:43:08.227569 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:08.227487 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54d79568-5558-42be-b533-d5842e079979-service-ca-bundle\") pod \"router-default-5dcf54cc8b-h5zzl\" (UID: \"54d79568-5558-42be-b533-d5842e079979\") " pod="openshift-ingress/router-default-5dcf54cc8b-h5zzl" May 27 23:43:08.227569 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:43:08.227500 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 27 23:43:08.227716 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:43:08.227591 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54d79568-5558-42be-b533-d5842e079979-metrics-certs podName:54d79568-5558-42be-b533-d5842e079979 nodeName:}" failed. No retries permitted until 2026-05-27 23:43:10.227570214 +0000 UTC m=+133.154471782 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/54d79568-5558-42be-b533-d5842e079979-metrics-certs") pod "router-default-5dcf54cc8b-h5zzl" (UID: "54d79568-5558-42be-b533-d5842e079979") : secret "router-metrics-certs-default" not found May 27 23:43:08.227716 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:43:08.227629 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54d79568-5558-42be-b533-d5842e079979-service-ca-bundle podName:54d79568-5558-42be-b533-d5842e079979 nodeName:}" failed. No retries permitted until 2026-05-27 23:43:10.227614546 +0000 UTC m=+133.154516119 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/54d79568-5558-42be-b533-d5842e079979-service-ca-bundle") pod "router-default-5dcf54cc8b-h5zzl" (UID: "54d79568-5558-42be-b533-d5842e079979") : configmap references non-existent config key: service-ca.crt May 27 23:43:08.969002 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:08.968969 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-9dngd" event={"ID":"e5c3a679-8e9c-4649-a2f2-201003fb37d5","Type":"ContainerStarted","Data":"e94d6f2e1da53b3dad326260479a2fa31f0837b0547e2dc5cccc9dd0e8865b10"} May 27 23:43:08.985587 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:08.985507 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-9dngd" podStartSLOduration=0.89132255 podStartE2EDuration="2.985491324s" podCreationTimestamp="2026-05-27 23:43:06 +0000 UTC" firstStartedPulling="2026-05-27 23:43:06.708495067 +0000 UTC m=+129.635396634" lastFinishedPulling="2026-05-27 23:43:08.802663834 +0000 UTC m=+131.729565408" observedRunningTime="2026-05-27 23:43:08.985278986 +0000 UTC m=+131.912180583" watchObservedRunningTime="2026-05-27 23:43:08.985491324 +0000 UTC m=+131.912392915" May 27 23:43:10.042955 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:10.042915 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cfff88b2-cd59-4a94-ab7d-6ec94dcccc47-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-kg2vj\" (UID: \"cfff88b2-cd59-4a94-ab7d-6ec94dcccc47\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-kg2vj" May 27 23:43:10.043422 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:43:10.043021 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 27 23:43:10.043422 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:43:10.043108 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfff88b2-cd59-4a94-ab7d-6ec94dcccc47-cluster-monitoring-operator-tls podName:cfff88b2-cd59-4a94-ab7d-6ec94dcccc47 nodeName:}" failed. No retries permitted until 2026-05-27 23:43:14.043091433 +0000 UTC m=+136.969993001 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cfff88b2-cd59-4a94-ab7d-6ec94dcccc47-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-kg2vj" (UID: "cfff88b2-cd59-4a94-ab7d-6ec94dcccc47") : secret "cluster-monitoring-operator-tls" not found May 27 23:43:10.244575 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:10.244534 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54d79568-5558-42be-b533-d5842e079979-metrics-certs\") pod \"router-default-5dcf54cc8b-h5zzl\" (UID: \"54d79568-5558-42be-b533-d5842e079979\") " pod="openshift-ingress/router-default-5dcf54cc8b-h5zzl" May 27 23:43:10.244784 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:10.244598 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54d79568-5558-42be-b533-d5842e079979-service-ca-bundle\") pod \"router-default-5dcf54cc8b-h5zzl\" (UID: \"54d79568-5558-42be-b533-d5842e079979\") " pod="openshift-ingress/router-default-5dcf54cc8b-h5zzl" May 27 23:43:10.244784 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:43:10.244722 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 27 23:43:10.244784 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:43:10.244759 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54d79568-5558-42be-b533-d5842e079979-service-ca-bundle podName:54d79568-5558-42be-b533-d5842e079979 nodeName:}" failed. No retries permitted until 2026-05-27 23:43:14.244738469 +0000 UTC m=+137.171640054 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/54d79568-5558-42be-b533-d5842e079979-service-ca-bundle") pod "router-default-5dcf54cc8b-h5zzl" (UID: "54d79568-5558-42be-b533-d5842e079979") : configmap references non-existent config key: service-ca.crt May 27 23:43:10.244784 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:43:10.244786 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54d79568-5558-42be-b533-d5842e079979-metrics-certs podName:54d79568-5558-42be-b533-d5842e079979 nodeName:}" failed. No retries permitted until 2026-05-27 23:43:14.244777512 +0000 UTC m=+137.171679079 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/54d79568-5558-42be-b533-d5842e079979-metrics-certs") pod "router-default-5dcf54cc8b-h5zzl" (UID: "54d79568-5558-42be-b533-d5842e079979") : secret "router-metrics-certs-default" not found May 27 23:43:11.976334 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:11.976307 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8hfsr_cd79991b-47fe-457f-b415-c8ecd5c442c9/dns-node-resolver/0.log" May 27 23:43:12.976775 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:12.976743 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k2k6s_e682bdbf-0081-4b2e-b8fc-bf23a7a18612/node-ca/0.log" May 27 23:43:14.070919 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:14.070869 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cfff88b2-cd59-4a94-ab7d-6ec94dcccc47-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-kg2vj\" (UID: \"cfff88b2-cd59-4a94-ab7d-6ec94dcccc47\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-kg2vj" May 27 23:43:14.071303 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:43:14.071034 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 27 23:43:14.071303 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:43:14.071098 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfff88b2-cd59-4a94-ab7d-6ec94dcccc47-cluster-monitoring-operator-tls podName:cfff88b2-cd59-4a94-ab7d-6ec94dcccc47 nodeName:}" failed. No retries permitted until 2026-05-27 23:43:22.071080206 +0000 UTC m=+144.997981780 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cfff88b2-cd59-4a94-ab7d-6ec94dcccc47-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-kg2vj" (UID: "cfff88b2-cd59-4a94-ab7d-6ec94dcccc47") : secret "cluster-monitoring-operator-tls" not found May 27 23:43:14.272804 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:14.272769 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54d79568-5558-42be-b533-d5842e079979-service-ca-bundle\") pod \"router-default-5dcf54cc8b-h5zzl\" (UID: \"54d79568-5558-42be-b533-d5842e079979\") " pod="openshift-ingress/router-default-5dcf54cc8b-h5zzl" May 27 23:43:14.272961 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:14.272844 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54d79568-5558-42be-b533-d5842e079979-metrics-certs\") pod \"router-default-5dcf54cc8b-h5zzl\" (UID: \"54d79568-5558-42be-b533-d5842e079979\") " pod="openshift-ingress/router-default-5dcf54cc8b-h5zzl" May 27 23:43:14.272961 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:43:14.272932 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 27 23:43:14.272961 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:43:14.272948 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54d79568-5558-42be-b533-d5842e079979-service-ca-bundle podName:54d79568-5558-42be-b533-d5842e079979 nodeName:}" failed. No retries permitted until 2026-05-27 23:43:22.272927857 +0000 UTC m=+145.199829440 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/54d79568-5558-42be-b533-d5842e079979-service-ca-bundle") pod "router-default-5dcf54cc8b-h5zzl" (UID: "54d79568-5558-42be-b533-d5842e079979") : configmap references non-existent config key: service-ca.crt May 27 23:43:14.273063 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:43:14.272980 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54d79568-5558-42be-b533-d5842e079979-metrics-certs podName:54d79568-5558-42be-b533-d5842e079979 nodeName:}" failed. No retries permitted until 2026-05-27 23:43:22.272967326 +0000 UTC m=+145.199868905 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/54d79568-5558-42be-b533-d5842e079979-metrics-certs") pod "router-default-5dcf54cc8b-h5zzl" (UID: "54d79568-5558-42be-b533-d5842e079979") : secret "router-metrics-certs-default" not found May 27 23:43:15.065145 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:15.065113 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fcsm9"] May 27 23:43:15.068169 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:15.068152 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fcsm9" May 27 23:43:15.070606 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:15.070584 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" May 27 23:43:15.071304 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:15.071289 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-x7xs7\"" May 27 23:43:15.071526 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:15.071310 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" May 27 23:43:15.075083 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:15.075063 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fcsm9"] May 27 23:43:15.179403 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:15.179368 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tlbd\" (UniqueName: \"kubernetes.io/projected/600f0038-338c-4c69-8ec0-3d4d2678230d-kube-api-access-9tlbd\") pod \"volume-data-source-validator-5cf8c89d64-fcsm9\" (UID: \"600f0038-338c-4c69-8ec0-3d4d2678230d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fcsm9" May 27 23:43:15.280339 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:15.280296 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9tlbd\" (UniqueName: \"kubernetes.io/projected/600f0038-338c-4c69-8ec0-3d4d2678230d-kube-api-access-9tlbd\") pod \"volume-data-source-validator-5cf8c89d64-fcsm9\" (UID: \"600f0038-338c-4c69-8ec0-3d4d2678230d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fcsm9" May 27 23:43:15.288426 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:15.288403 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tlbd\" (UniqueName: \"kubernetes.io/projected/600f0038-338c-4c69-8ec0-3d4d2678230d-kube-api-access-9tlbd\") pod \"volume-data-source-validator-5cf8c89d64-fcsm9\" (UID: \"600f0038-338c-4c69-8ec0-3d4d2678230d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fcsm9" May 27 23:43:15.377043 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:15.376948 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fcsm9" May 27 23:43:15.491268 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:15.491235 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fcsm9"] May 27 23:43:15.495307 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:43:15.495281 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod600f0038_338c_4c69_8ec0_3d4d2678230d.slice/crio-083a875f8b78f77d1515e1bc9b686b38cd6da0cf4b25998f04b7e79951debc44 WatchSource:0}: Error finding container 083a875f8b78f77d1515e1bc9b686b38cd6da0cf4b25998f04b7e79951debc44: Status 404 returned error can't find the container with id 083a875f8b78f77d1515e1bc9b686b38cd6da0cf4b25998f04b7e79951debc44 May 27 23:43:15.983051 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:15.983019 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fcsm9" event={"ID":"600f0038-338c-4c69-8ec0-3d4d2678230d","Type":"ContainerStarted","Data":"083a875f8b78f77d1515e1bc9b686b38cd6da0cf4b25998f04b7e79951debc44"} May 27 23:43:16.183204 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:16.183172 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-2gwp8"] May 27 23:43:16.185917 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:16.185892 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-2gwp8" May 27 23:43:16.188257 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:16.188234 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" May 27 23:43:16.188257 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:16.188234 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" May 27 23:43:16.188546 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:16.188521 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" May 27 23:43:16.188630 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:16.188598 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" May 27 23:43:16.189273 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:16.189251 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-r24qn\"" May 27 23:43:16.194570 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:16.194550 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" May 27 23:43:16.194814 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:16.194789 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-2gwp8"] May 27 23:43:16.287386 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:16.287297 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/22a67c11-9c99-4758-acfb-78339ce3604b-trusted-ca\") pod \"console-operator-76dff48d59-2gwp8\" (UID: \"22a67c11-9c99-4758-acfb-78339ce3604b\") " pod="openshift-console-operator/console-operator-76dff48d59-2gwp8" May 27 23:43:16.287386 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:16.287348 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw8qw\" (UniqueName: \"kubernetes.io/projected/22a67c11-9c99-4758-acfb-78339ce3604b-kube-api-access-zw8qw\") pod \"console-operator-76dff48d59-2gwp8\" (UID: \"22a67c11-9c99-4758-acfb-78339ce3604b\") " pod="openshift-console-operator/console-operator-76dff48d59-2gwp8" May 27 23:43:16.287602 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:16.287439 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/22a67c11-9c99-4758-acfb-78339ce3604b-serving-cert\") pod \"console-operator-76dff48d59-2gwp8\" (UID: \"22a67c11-9c99-4758-acfb-78339ce3604b\") " pod="openshift-console-operator/console-operator-76dff48d59-2gwp8" May 27 23:43:16.287602 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:16.287519 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/22a67c11-9c99-4758-acfb-78339ce3604b-config\") pod \"console-operator-76dff48d59-2gwp8\" (UID: \"22a67c11-9c99-4758-acfb-78339ce3604b\") " pod="openshift-console-operator/console-operator-76dff48d59-2gwp8" May 27 23:43:16.388021 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:16.387978 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/22a67c11-9c99-4758-acfb-78339ce3604b-serving-cert\") pod \"console-operator-76dff48d59-2gwp8\" (UID: \"22a67c11-9c99-4758-acfb-78339ce3604b\") " pod="openshift-console-operator/console-operator-76dff48d59-2gwp8" May 27 23:43:16.388021 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:16.388033 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/22a67c11-9c99-4758-acfb-78339ce3604b-config\") pod \"console-operator-76dff48d59-2gwp8\" (UID: \"22a67c11-9c99-4758-acfb-78339ce3604b\") " pod="openshift-console-operator/console-operator-76dff48d59-2gwp8" May 27 23:43:16.388260 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:16.388237 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/22a67c11-9c99-4758-acfb-78339ce3604b-trusted-ca\") pod \"console-operator-76dff48d59-2gwp8\" (UID: \"22a67c11-9c99-4758-acfb-78339ce3604b\") " pod="openshift-console-operator/console-operator-76dff48d59-2gwp8" May 27 23:43:16.388308 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:16.388270 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zw8qw\" (UniqueName: \"kubernetes.io/projected/22a67c11-9c99-4758-acfb-78339ce3604b-kube-api-access-zw8qw\") pod \"console-operator-76dff48d59-2gwp8\" (UID: \"22a67c11-9c99-4758-acfb-78339ce3604b\") " pod="openshift-console-operator/console-operator-76dff48d59-2gwp8" May 27 23:43:16.388687 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:16.388624 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/22a67c11-9c99-4758-acfb-78339ce3604b-config\") pod \"console-operator-76dff48d59-2gwp8\" (UID: \"22a67c11-9c99-4758-acfb-78339ce3604b\") " pod="openshift-console-operator/console-operator-76dff48d59-2gwp8" May 27 23:43:16.389345 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:16.389323 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/22a67c11-9c99-4758-acfb-78339ce3604b-trusted-ca\") pod \"console-operator-76dff48d59-2gwp8\" (UID: \"22a67c11-9c99-4758-acfb-78339ce3604b\") " pod="openshift-console-operator/console-operator-76dff48d59-2gwp8" May 27 23:43:16.390438 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:16.390406 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/22a67c11-9c99-4758-acfb-78339ce3604b-serving-cert\") pod \"console-operator-76dff48d59-2gwp8\" (UID: \"22a67c11-9c99-4758-acfb-78339ce3604b\") " pod="openshift-console-operator/console-operator-76dff48d59-2gwp8" May 27 23:43:16.397311 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:16.397277 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw8qw\" (UniqueName: \"kubernetes.io/projected/22a67c11-9c99-4758-acfb-78339ce3604b-kube-api-access-zw8qw\") pod \"console-operator-76dff48d59-2gwp8\" (UID: \"22a67c11-9c99-4758-acfb-78339ce3604b\") " pod="openshift-console-operator/console-operator-76dff48d59-2gwp8" May 27 23:43:16.497474 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:16.497441 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-2gwp8" May 27 23:43:16.838222 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:16.838175 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-2gwp8"] May 27 23:43:16.842724 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:43:16.842697 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22a67c11_9c99_4758_acfb_78339ce3604b.slice/crio-6be76c5247da372ed74db36ef3a1572d63a2131372475d9f5e4f68406b970d98 WatchSource:0}: Error finding container 6be76c5247da372ed74db36ef3a1572d63a2131372475d9f5e4f68406b970d98: Status 404 returned error can't find the container with id 6be76c5247da372ed74db36ef3a1572d63a2131372475d9f5e4f68406b970d98 May 27 23:43:16.986697 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:16.986596 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fcsm9" event={"ID":"600f0038-338c-4c69-8ec0-3d4d2678230d","Type":"ContainerStarted","Data":"eb87129c5dc05ac999caa364eee45ca937fa50bb7471e0fc76256ded29f960f0"} May 27 23:43:16.987511 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:16.987485 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-2gwp8" event={"ID":"22a67c11-9c99-4758-acfb-78339ce3604b","Type":"ContainerStarted","Data":"6be76c5247da372ed74db36ef3a1572d63a2131372475d9f5e4f68406b970d98"} May 27 23:43:17.006247 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:17.006200 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fcsm9" podStartSLOduration=0.733807889 podStartE2EDuration="2.006185495s" podCreationTimestamp="2026-05-27 23:43:15 +0000 UTC" firstStartedPulling="2026-05-27 23:43:15.497426186 +0000 UTC m=+138.424327754" lastFinishedPulling="2026-05-27 23:43:16.769803789 +0000 UTC m=+139.696705360" observedRunningTime="2026-05-27 23:43:17.004705153 +0000 UTC m=+139.931606741" watchObservedRunningTime="2026-05-27 23:43:17.006185495 +0000 UTC m=+139.933087085" May 27 23:43:18.992687 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:18.992660 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-2gwp8_22a67c11-9c99-4758-acfb-78339ce3604b/console-operator/0.log" May 27 23:43:18.993034 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:18.992699 2556 generic.go:358] "Generic (PLEG): container finished" podID="22a67c11-9c99-4758-acfb-78339ce3604b" containerID="55dc2b2a92175e8700fa2aa2571f2dbeffaa0f03fdc65ca43c22d2c0aa2859cb" exitCode=255 May 27 23:43:18.993034 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:18.992732 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-2gwp8" event={"ID":"22a67c11-9c99-4758-acfb-78339ce3604b","Type":"ContainerDied","Data":"55dc2b2a92175e8700fa2aa2571f2dbeffaa0f03fdc65ca43c22d2c0aa2859cb"} May 27 23:43:18.993034 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:18.992953 2556 scope.go:117] "RemoveContainer" containerID="55dc2b2a92175e8700fa2aa2571f2dbeffaa0f03fdc65ca43c22d2c0aa2859cb" May 27 23:43:19.995805 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:19.995777 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-2gwp8_22a67c11-9c99-4758-acfb-78339ce3604b/console-operator/1.log" May 27 23:43:19.996195 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:19.996112 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-2gwp8_22a67c11-9c99-4758-acfb-78339ce3604b/console-operator/0.log" May 27 23:43:19.996195 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:19.996146 2556 generic.go:358] "Generic (PLEG): container finished" podID="22a67c11-9c99-4758-acfb-78339ce3604b" containerID="727d73efc7031cf44cd1c545d1e701d09f5495eb35e5ec768f6bf40cce9adaca" exitCode=255 May 27 23:43:19.996195 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:19.996179 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-2gwp8" event={"ID":"22a67c11-9c99-4758-acfb-78339ce3604b","Type":"ContainerDied","Data":"727d73efc7031cf44cd1c545d1e701d09f5495eb35e5ec768f6bf40cce9adaca"} May 27 23:43:19.996299 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:19.996208 2556 scope.go:117] "RemoveContainer" containerID="55dc2b2a92175e8700fa2aa2571f2dbeffaa0f03fdc65ca43c22d2c0aa2859cb" May 27 23:43:19.996467 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:19.996452 2556 scope.go:117] "RemoveContainer" containerID="727d73efc7031cf44cd1c545d1e701d09f5495eb35e5ec768f6bf40cce9adaca" May 27 23:43:19.996630 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:43:19.996613 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-2gwp8_openshift-console-operator(22a67c11-9c99-4758-acfb-78339ce3604b)\"" pod="openshift-console-operator/console-operator-76dff48d59-2gwp8" podUID="22a67c11-9c99-4758-acfb-78339ce3604b" May 27 23:43:20.481304 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:20.481272 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-9x9xx"] May 27 23:43:20.485308 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:20.485287 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-9x9xx" May 27 23:43:20.487851 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:20.487823 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-9p2v6\"" May 27 23:43:20.487851 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:20.487847 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" May 27 23:43:20.488029 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:20.487850 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" May 27 23:43:20.492427 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:20.492401 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-9x9xx"] May 27 23:43:20.622067 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:20.622034 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmtp9\" (UniqueName: \"kubernetes.io/projected/9daf9a14-d55f-4e66-935a-30ddf20a6d6e-kube-api-access-lmtp9\") pod \"migrator-b985f5d89-9x9xx\" (UID: \"9daf9a14-d55f-4e66-935a-30ddf20a6d6e\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-9x9xx" May 27 23:43:20.723114 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:20.723079 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lmtp9\" (UniqueName: \"kubernetes.io/projected/9daf9a14-d55f-4e66-935a-30ddf20a6d6e-kube-api-access-lmtp9\") pod \"migrator-b985f5d89-9x9xx\" (UID: \"9daf9a14-d55f-4e66-935a-30ddf20a6d6e\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-9x9xx" May 27 23:43:20.730706 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:20.730680 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmtp9\" (UniqueName: \"kubernetes.io/projected/9daf9a14-d55f-4e66-935a-30ddf20a6d6e-kube-api-access-lmtp9\") pod \"migrator-b985f5d89-9x9xx\" (UID: \"9daf9a14-d55f-4e66-935a-30ddf20a6d6e\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-9x9xx" May 27 23:43:20.793839 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:20.793773 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-9x9xx" May 27 23:43:20.909181 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:20.909150 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-9x9xx"] May 27 23:43:20.912918 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:43:20.912886 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9daf9a14_d55f_4e66_935a_30ddf20a6d6e.slice/crio-5db22ba16de3ee5d1f462c411561481a83c9212e4e58a35ffba45bcc02ac3264 WatchSource:0}: Error finding container 5db22ba16de3ee5d1f462c411561481a83c9212e4e58a35ffba45bcc02ac3264: Status 404 returned error can't find the container with id 5db22ba16de3ee5d1f462c411561481a83c9212e4e58a35ffba45bcc02ac3264 May 27 23:43:20.999421 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:20.999395 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-2gwp8_22a67c11-9c99-4758-acfb-78339ce3604b/console-operator/1.log" May 27 23:43:20.999861 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:20.999821 2556 scope.go:117] "RemoveContainer" containerID="727d73efc7031cf44cd1c545d1e701d09f5495eb35e5ec768f6bf40cce9adaca" May 27 23:43:21.000046 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:43:21.000017 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-2gwp8_openshift-console-operator(22a67c11-9c99-4758-acfb-78339ce3604b)\"" pod="openshift-console-operator/console-operator-76dff48d59-2gwp8" podUID="22a67c11-9c99-4758-acfb-78339ce3604b" May 27 23:43:21.000521 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:21.000499 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-9x9xx" event={"ID":"9daf9a14-d55f-4e66-935a-30ddf20a6d6e","Type":"ContainerStarted","Data":"5db22ba16de3ee5d1f462c411561481a83c9212e4e58a35ffba45bcc02ac3264"} May 27 23:43:22.005336 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:22.005304 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-9x9xx" event={"ID":"9daf9a14-d55f-4e66-935a-30ddf20a6d6e","Type":"ContainerStarted","Data":"1bfbf965a859a7ba7295344d8c3f007afb83345e58d54a01bcd68fccd12ed1f8"} May 27 23:43:22.005336 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:22.005338 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-9x9xx" event={"ID":"9daf9a14-d55f-4e66-935a-30ddf20a6d6e","Type":"ContainerStarted","Data":"6d5225d40a55006079366576360e158df2147720a6ac417fc3b518fcf0e2382f"} May 27 23:43:22.021201 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:22.021160 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-9x9xx" podStartSLOduration=1.059573031 podStartE2EDuration="2.02114767s" podCreationTimestamp="2026-05-27 23:43:20 +0000 UTC" firstStartedPulling="2026-05-27 23:43:20.914879585 +0000 UTC m=+143.841781157" lastFinishedPulling="2026-05-27 23:43:21.876454214 +0000 UTC m=+144.803355796" observedRunningTime="2026-05-27 23:43:22.020796253 +0000 UTC m=+144.947697843" watchObservedRunningTime="2026-05-27 23:43:22.02114767 +0000 UTC m=+144.948049260" May 27 23:43:22.135258 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:22.135178 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cfff88b2-cd59-4a94-ab7d-6ec94dcccc47-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-kg2vj\" (UID: \"cfff88b2-cd59-4a94-ab7d-6ec94dcccc47\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-kg2vj" May 27 23:43:22.135401 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:43:22.135276 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 27 23:43:22.135401 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:43:22.135328 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfff88b2-cd59-4a94-ab7d-6ec94dcccc47-cluster-monitoring-operator-tls podName:cfff88b2-cd59-4a94-ab7d-6ec94dcccc47 nodeName:}" failed. No retries permitted until 2026-05-27 23:43:38.135314301 +0000 UTC m=+161.062215868 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cfff88b2-cd59-4a94-ab7d-6ec94dcccc47-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-kg2vj" (UID: "cfff88b2-cd59-4a94-ab7d-6ec94dcccc47") : secret "cluster-monitoring-operator-tls" not found May 27 23:43:22.336454 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:22.336419 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54d79568-5558-42be-b533-d5842e079979-service-ca-bundle\") pod \"router-default-5dcf54cc8b-h5zzl\" (UID: \"54d79568-5558-42be-b533-d5842e079979\") " pod="openshift-ingress/router-default-5dcf54cc8b-h5zzl" May 27 23:43:22.336603 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:22.336511 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54d79568-5558-42be-b533-d5842e079979-metrics-certs\") pod \"router-default-5dcf54cc8b-h5zzl\" (UID: \"54d79568-5558-42be-b533-d5842e079979\") " pod="openshift-ingress/router-default-5dcf54cc8b-h5zzl" May 27 23:43:22.336603 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:43:22.336580 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54d79568-5558-42be-b533-d5842e079979-service-ca-bundle podName:54d79568-5558-42be-b533-d5842e079979 nodeName:}" failed. No retries permitted until 2026-05-27 23:43:38.336564072 +0000 UTC m=+161.263465639 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/54d79568-5558-42be-b533-d5842e079979-service-ca-bundle") pod "router-default-5dcf54cc8b-h5zzl" (UID: "54d79568-5558-42be-b533-d5842e079979") : configmap references non-existent config key: service-ca.crt May 27 23:43:22.336767 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:43:22.336612 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 27 23:43:22.336767 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:43:22.336692 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54d79568-5558-42be-b533-d5842e079979-metrics-certs podName:54d79568-5558-42be-b533-d5842e079979 nodeName:}" failed. No retries permitted until 2026-05-27 23:43:38.336673953 +0000 UTC m=+161.263575537 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/54d79568-5558-42be-b533-d5842e079979-metrics-certs") pod "router-default-5dcf54cc8b-h5zzl" (UID: "54d79568-5558-42be-b533-d5842e079979") : secret "router-metrics-certs-default" not found May 27 23:43:23.538472 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:23.538434 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-h6vzt"] May 27 23:43:23.541303 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:23.541288 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-h6vzt" May 27 23:43:23.543885 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:23.543861 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" May 27 23:43:23.544287 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:23.544270 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" May 27 23:43:23.544999 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:23.544980 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" May 27 23:43:23.545122 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:23.545014 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-8n8wq\"" May 27 23:43:23.545122 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:23.545034 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" May 27 23:43:23.551791 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:23.551770 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-h6vzt"] May 27 23:43:23.634629 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:23.634586 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8svnk"] May 27 23:43:23.637719 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:23.637696 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8svnk" May 27 23:43:23.640092 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:23.640067 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7hw44\"" May 27 23:43:23.640498 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:23.640481 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 27 23:43:23.640577 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:23.640489 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 27 23:43:23.647533 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:23.647507 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f79b7e41-f37b-4d95-b5b5-226d275393db-signing-cabundle\") pod \"service-ca-67d667c7d-h6vzt\" (UID: \"f79b7e41-f37b-4d95-b5b5-226d275393db\") " pod="openshift-service-ca/service-ca-67d667c7d-h6vzt" May 27 23:43:23.647692 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:23.647553 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p5k4\" (UniqueName: \"kubernetes.io/projected/f79b7e41-f37b-4d95-b5b5-226d275393db-kube-api-access-2p5k4\") pod \"service-ca-67d667c7d-h6vzt\" (UID: \"f79b7e41-f37b-4d95-b5b5-226d275393db\") " pod="openshift-service-ca/service-ca-67d667c7d-h6vzt" May 27 23:43:23.647692 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:23.647624 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f79b7e41-f37b-4d95-b5b5-226d275393db-signing-key\") pod \"service-ca-67d667c7d-h6vzt\" (UID: \"f79b7e41-f37b-4d95-b5b5-226d275393db\") " pod="openshift-service-ca/service-ca-67d667c7d-h6vzt" May 27 23:43:23.650382 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:23.650366 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8svnk"] May 27 23:43:23.748852 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:23.748822 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f79b7e41-f37b-4d95-b5b5-226d275393db-signing-key\") pod \"service-ca-67d667c7d-h6vzt\" (UID: \"f79b7e41-f37b-4d95-b5b5-226d275393db\") " pod="openshift-service-ca/service-ca-67d667c7d-h6vzt" May 27 23:43:23.749031 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:23.748874 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8a9d6f2e-4c75-499a-9483-c2fab94c7187-crio-socket\") pod \"insights-runtime-extractor-8svnk\" (UID: \"8a9d6f2e-4c75-499a-9483-c2fab94c7187\") " pod="openshift-insights/insights-runtime-extractor-8svnk" May 27 23:43:23.749031 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:23.748899 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8a9d6f2e-4c75-499a-9483-c2fab94c7187-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8svnk\" (UID: \"8a9d6f2e-4c75-499a-9483-c2fab94c7187\") " pod="openshift-insights/insights-runtime-extractor-8svnk" May 27 23:43:23.749031 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:23.748927 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f79b7e41-f37b-4d95-b5b5-226d275393db-signing-cabundle\") pod \"service-ca-67d667c7d-h6vzt\" (UID: \"f79b7e41-f37b-4d95-b5b5-226d275393db\") " pod="openshift-service-ca/service-ca-67d667c7d-h6vzt" May 27 23:43:23.749031 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:23.748962 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2p5k4\" (UniqueName: \"kubernetes.io/projected/f79b7e41-f37b-4d95-b5b5-226d275393db-kube-api-access-2p5k4\") pod \"service-ca-67d667c7d-h6vzt\" (UID: \"f79b7e41-f37b-4d95-b5b5-226d275393db\") " pod="openshift-service-ca/service-ca-67d667c7d-h6vzt" May 27 23:43:23.749031 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:23.749026 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dh2n\" (UniqueName: \"kubernetes.io/projected/8a9d6f2e-4c75-499a-9483-c2fab94c7187-kube-api-access-4dh2n\") pod \"insights-runtime-extractor-8svnk\" (UID: \"8a9d6f2e-4c75-499a-9483-c2fab94c7187\") " pod="openshift-insights/insights-runtime-extractor-8svnk" May 27 23:43:23.749288 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:23.749126 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a9d6f2e-4c75-499a-9483-c2fab94c7187-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8svnk\" (UID: \"8a9d6f2e-4c75-499a-9483-c2fab94c7187\") " pod="openshift-insights/insights-runtime-extractor-8svnk" May 27 23:43:23.749288 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:23.749166 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8a9d6f2e-4c75-499a-9483-c2fab94c7187-data-volume\") pod \"insights-runtime-extractor-8svnk\" (UID: \"8a9d6f2e-4c75-499a-9483-c2fab94c7187\") " pod="openshift-insights/insights-runtime-extractor-8svnk" May 27 23:43:23.749542 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:23.749525 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f79b7e41-f37b-4d95-b5b5-226d275393db-signing-cabundle\") pod \"service-ca-67d667c7d-h6vzt\" (UID: \"f79b7e41-f37b-4d95-b5b5-226d275393db\") " pod="openshift-service-ca/service-ca-67d667c7d-h6vzt" May 27 23:43:23.751256 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:23.751233 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f79b7e41-f37b-4d95-b5b5-226d275393db-signing-key\") pod \"service-ca-67d667c7d-h6vzt\" (UID: \"f79b7e41-f37b-4d95-b5b5-226d275393db\") " pod="openshift-service-ca/service-ca-67d667c7d-h6vzt" May 27 23:43:23.758519 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:23.758500 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p5k4\" (UniqueName: \"kubernetes.io/projected/f79b7e41-f37b-4d95-b5b5-226d275393db-kube-api-access-2p5k4\") pod \"service-ca-67d667c7d-h6vzt\" (UID: \"f79b7e41-f37b-4d95-b5b5-226d275393db\") " pod="openshift-service-ca/service-ca-67d667c7d-h6vzt" May 27 23:43:23.850185 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:23.850101 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-h6vzt" May 27 23:43:23.850312 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:23.850238 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a9d6f2e-4c75-499a-9483-c2fab94c7187-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8svnk\" (UID: \"8a9d6f2e-4c75-499a-9483-c2fab94c7187\") " pod="openshift-insights/insights-runtime-extractor-8svnk" May 27 23:43:23.850312 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:23.850267 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8a9d6f2e-4c75-499a-9483-c2fab94c7187-data-volume\") pod \"insights-runtime-extractor-8svnk\" (UID: \"8a9d6f2e-4c75-499a-9483-c2fab94c7187\") " pod="openshift-insights/insights-runtime-extractor-8svnk" May 27 23:43:23.850312 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:23.850296 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8a9d6f2e-4c75-499a-9483-c2fab94c7187-crio-socket\") pod \"insights-runtime-extractor-8svnk\" (UID: \"8a9d6f2e-4c75-499a-9483-c2fab94c7187\") " pod="openshift-insights/insights-runtime-extractor-8svnk" May 27 23:43:23.850407 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:23.850350 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8a9d6f2e-4c75-499a-9483-c2fab94c7187-crio-socket\") pod \"insights-runtime-extractor-8svnk\" (UID: \"8a9d6f2e-4c75-499a-9483-c2fab94c7187\") " pod="openshift-insights/insights-runtime-extractor-8svnk" May 27 23:43:23.850407 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:23.850393 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8a9d6f2e-4c75-499a-9483-c2fab94c7187-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8svnk\" (UID: \"8a9d6f2e-4c75-499a-9483-c2fab94c7187\") " pod="openshift-insights/insights-runtime-extractor-8svnk" May 27 23:43:23.850473 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:43:23.850405 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 27 23:43:23.850473 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:43:23.850469 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a9d6f2e-4c75-499a-9483-c2fab94c7187-insights-runtime-extractor-tls podName:8a9d6f2e-4c75-499a-9483-c2fab94c7187 nodeName:}" failed. No retries permitted until 2026-05-27 23:43:24.350449066 +0000 UTC m=+147.277350648 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8a9d6f2e-4c75-499a-9483-c2fab94c7187-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8svnk" (UID: "8a9d6f2e-4c75-499a-9483-c2fab94c7187") : secret "insights-runtime-extractor-tls" not found May 27 23:43:23.850551 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:23.850509 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4dh2n\" (UniqueName: \"kubernetes.io/projected/8a9d6f2e-4c75-499a-9483-c2fab94c7187-kube-api-access-4dh2n\") pod \"insights-runtime-extractor-8svnk\" (UID: \"8a9d6f2e-4c75-499a-9483-c2fab94c7187\") " pod="openshift-insights/insights-runtime-extractor-8svnk" May 27 23:43:23.850665 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:23.850626 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8a9d6f2e-4c75-499a-9483-c2fab94c7187-data-volume\") pod \"insights-runtime-extractor-8svnk\" (UID: \"8a9d6f2e-4c75-499a-9483-c2fab94c7187\") " pod="openshift-insights/insights-runtime-extractor-8svnk" May 27 23:43:23.851070 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:23.850853 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8a9d6f2e-4c75-499a-9483-c2fab94c7187-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8svnk\" (UID: \"8a9d6f2e-4c75-499a-9483-c2fab94c7187\") " pod="openshift-insights/insights-runtime-extractor-8svnk" May 27 23:43:23.860757 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:23.860739 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dh2n\" (UniqueName: \"kubernetes.io/projected/8a9d6f2e-4c75-499a-9483-c2fab94c7187-kube-api-access-4dh2n\") pod \"insights-runtime-extractor-8svnk\" (UID: \"8a9d6f2e-4c75-499a-9483-c2fab94c7187\") " pod="openshift-insights/insights-runtime-extractor-8svnk" May 27 23:43:23.967881 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:23.967844 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-h6vzt"] May 27 23:43:23.971332 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:43:23.971310 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf79b7e41_f37b_4d95_b5b5_226d275393db.slice/crio-689933a7c4f6438d3c95ee8af2e7d73e93cf3dbb7372dc4e8fbd1c54cc3d6f2d WatchSource:0}: Error finding container 689933a7c4f6438d3c95ee8af2e7d73e93cf3dbb7372dc4e8fbd1c54cc3d6f2d: Status 404 returned error can't find the container with id 689933a7c4f6438d3c95ee8af2e7d73e93cf3dbb7372dc4e8fbd1c54cc3d6f2d May 27 23:43:24.011210 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:24.011177 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-h6vzt" event={"ID":"f79b7e41-f37b-4d95-b5b5-226d275393db","Type":"ContainerStarted","Data":"689933a7c4f6438d3c95ee8af2e7d73e93cf3dbb7372dc4e8fbd1c54cc3d6f2d"} May 27 23:43:24.353986 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:24.353932 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a9d6f2e-4c75-499a-9483-c2fab94c7187-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8svnk\" (UID: \"8a9d6f2e-4c75-499a-9483-c2fab94c7187\") " pod="openshift-insights/insights-runtime-extractor-8svnk" May 27 23:43:24.354202 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:43:24.354115 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 27 23:43:24.354202 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:43:24.354193 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a9d6f2e-4c75-499a-9483-c2fab94c7187-insights-runtime-extractor-tls podName:8a9d6f2e-4c75-499a-9483-c2fab94c7187 nodeName:}" failed. No retries permitted until 2026-05-27 23:43:25.354173725 +0000 UTC m=+148.281075296 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8a9d6f2e-4c75-499a-9483-c2fab94c7187-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8svnk" (UID: "8a9d6f2e-4c75-499a-9483-c2fab94c7187") : secret "insights-runtime-extractor-tls" not found May 27 23:43:25.362813 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:25.362763 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a9d6f2e-4c75-499a-9483-c2fab94c7187-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8svnk\" (UID: \"8a9d6f2e-4c75-499a-9483-c2fab94c7187\") " pod="openshift-insights/insights-runtime-extractor-8svnk" May 27 23:43:25.363276 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:43:25.362920 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 27 23:43:25.363276 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:43:25.363001 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a9d6f2e-4c75-499a-9483-c2fab94c7187-insights-runtime-extractor-tls podName:8a9d6f2e-4c75-499a-9483-c2fab94c7187 nodeName:}" failed. No retries permitted until 2026-05-27 23:43:27.362976928 +0000 UTC m=+150.289878503 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8a9d6f2e-4c75-499a-9483-c2fab94c7187-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8svnk" (UID: "8a9d6f2e-4c75-499a-9483-c2fab94c7187") : secret "insights-runtime-extractor-tls" not found May 27 23:43:26.017584 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:26.017549 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-h6vzt" event={"ID":"f79b7e41-f37b-4d95-b5b5-226d275393db","Type":"ContainerStarted","Data":"295cb89a1d9f597f3e281dbd128e88aadeede9ee09f635d34d04bd06e1b08b55"} May 27 23:43:26.039235 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:26.039184 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-h6vzt" podStartSLOduration=1.392001651 podStartE2EDuration="3.039172719s" podCreationTimestamp="2026-05-27 23:43:23 +0000 UTC" firstStartedPulling="2026-05-27 23:43:23.973058805 +0000 UTC m=+146.899960373" lastFinishedPulling="2026-05-27 23:43:25.620229869 +0000 UTC m=+148.547131441" observedRunningTime="2026-05-27 23:43:26.038611268 +0000 UTC m=+148.965512859" watchObservedRunningTime="2026-05-27 23:43:26.039172719 +0000 UTC m=+148.966074309" May 27 23:43:26.498169 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:26.498138 2556 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-2gwp8" May 27 23:43:26.498508 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:26.498185 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-2gwp8" May 27 23:43:26.498612 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:26.498598 2556 scope.go:117] "RemoveContainer" containerID="727d73efc7031cf44cd1c545d1e701d09f5495eb35e5ec768f6bf40cce9adaca" May 27 23:43:26.498852 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:43:26.498831 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-2gwp8_openshift-console-operator(22a67c11-9c99-4758-acfb-78339ce3604b)\"" pod="openshift-console-operator/console-operator-76dff48d59-2gwp8" podUID="22a67c11-9c99-4758-acfb-78339ce3604b" May 27 23:43:27.382378 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:27.382342 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a9d6f2e-4c75-499a-9483-c2fab94c7187-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8svnk\" (UID: \"8a9d6f2e-4c75-499a-9483-c2fab94c7187\") " pod="openshift-insights/insights-runtime-extractor-8svnk" May 27 23:43:27.382561 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:43:27.382487 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 27 23:43:27.382610 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:43:27.382566 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a9d6f2e-4c75-499a-9483-c2fab94c7187-insights-runtime-extractor-tls podName:8a9d6f2e-4c75-499a-9483-c2fab94c7187 nodeName:}" failed. No retries permitted until 2026-05-27 23:43:31.382543843 +0000 UTC m=+154.309445416 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8a9d6f2e-4c75-499a-9483-c2fab94c7187-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8svnk" (UID: "8a9d6f2e-4c75-499a-9483-c2fab94c7187") : secret "insights-runtime-extractor-tls" not found May 27 23:43:31.411210 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:31.411165 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a9d6f2e-4c75-499a-9483-c2fab94c7187-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8svnk\" (UID: \"8a9d6f2e-4c75-499a-9483-c2fab94c7187\") " pod="openshift-insights/insights-runtime-extractor-8svnk" May 27 23:43:31.411592 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:43:31.411299 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 27 23:43:31.411592 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:43:31.411357 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a9d6f2e-4c75-499a-9483-c2fab94c7187-insights-runtime-extractor-tls podName:8a9d6f2e-4c75-499a-9483-c2fab94c7187 nodeName:}" failed. No retries permitted until 2026-05-27 23:43:39.411337392 +0000 UTC m=+162.338238966 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8a9d6f2e-4c75-499a-9483-c2fab94c7187-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8svnk" (UID: "8a9d6f2e-4c75-499a-9483-c2fab94c7187") : secret "insights-runtime-extractor-tls" not found May 27 23:43:34.955912 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:43:34.955869 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-zjddg" podUID="37275969-1a75-4d59-b8e2-ed044ddcc3e9" May 27 23:43:34.963034 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:43:34.963005 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-z52tg" podUID="68b5c5a2-0e83-40b4-a3d8-fa07001d58f9" May 27 23:43:35.037836 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:35.037804 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z52tg" May 27 23:43:35.037961 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:35.037804 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zjddg" May 27 23:43:35.665500 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:43:35.665454 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-t87h5" podUID="b407d9da-589e-4803-abad-d70c5a21a11a" May 27 23:43:38.166759 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:38.166702 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cfff88b2-cd59-4a94-ab7d-6ec94dcccc47-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-kg2vj\" (UID: \"cfff88b2-cd59-4a94-ab7d-6ec94dcccc47\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-kg2vj" May 27 23:43:38.169135 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:38.169115 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cfff88b2-cd59-4a94-ab7d-6ec94dcccc47-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-kg2vj\" (UID: \"cfff88b2-cd59-4a94-ab7d-6ec94dcccc47\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-kg2vj" May 27 23:43:38.368598 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:38.368559 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54d79568-5558-42be-b533-d5842e079979-service-ca-bundle\") pod \"router-default-5dcf54cc8b-h5zzl\" (UID: \"54d79568-5558-42be-b533-d5842e079979\") " pod="openshift-ingress/router-default-5dcf54cc8b-h5zzl" May 27 23:43:38.368598 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:38.368607 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54d79568-5558-42be-b533-d5842e079979-metrics-certs\") pod \"router-default-5dcf54cc8b-h5zzl\" (UID: \"54d79568-5558-42be-b533-d5842e079979\") " pod="openshift-ingress/router-default-5dcf54cc8b-h5zzl" May 27 23:43:38.369210 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:38.369182 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54d79568-5558-42be-b533-d5842e079979-service-ca-bundle\") pod \"router-default-5dcf54cc8b-h5zzl\" (UID: \"54d79568-5558-42be-b533-d5842e079979\") " pod="openshift-ingress/router-default-5dcf54cc8b-h5zzl" May 27 23:43:38.370836 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:38.370811 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54d79568-5558-42be-b533-d5842e079979-metrics-certs\") pod \"router-default-5dcf54cc8b-h5zzl\" (UID: \"54d79568-5558-42be-b533-d5842e079979\") " pod="openshift-ingress/router-default-5dcf54cc8b-h5zzl" May 27 23:43:38.461074 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:38.461052 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-kg2vj" May 27 23:43:38.565499 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:38.565475 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5dcf54cc8b-h5zzl" May 27 23:43:38.578710 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:38.578682 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-kg2vj"] May 27 23:43:38.581183 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:43:38.581152 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfff88b2_cd59_4a94_ab7d_6ec94dcccc47.slice/crio-4bc97929cfd0841565fd3df52663be8b28cfc00864e1bfc9c711fe85aaf9a61b WatchSource:0}: Error finding container 4bc97929cfd0841565fd3df52663be8b28cfc00864e1bfc9c711fe85aaf9a61b: Status 404 returned error can't find the container with id 4bc97929cfd0841565fd3df52663be8b28cfc00864e1bfc9c711fe85aaf9a61b May 27 23:43:38.688740 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:38.688710 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5dcf54cc8b-h5zzl"] May 27 23:43:38.691570 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:43:38.691541 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54d79568_5558_42be_b533_d5842e079979.slice/crio-a34de9fd1367dcdbdd08be63bc3a23a94f1de6c2e2c26e736c720d01c3b59970 WatchSource:0}: Error finding container a34de9fd1367dcdbdd08be63bc3a23a94f1de6c2e2c26e736c720d01c3b59970: Status 404 returned error can't find the container with id a34de9fd1367dcdbdd08be63bc3a23a94f1de6c2e2c26e736c720d01c3b59970 May 27 23:43:39.048509 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:39.048420 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5dcf54cc8b-h5zzl" event={"ID":"54d79568-5558-42be-b533-d5842e079979","Type":"ContainerStarted","Data":"19d8a4a48a40d004043ce0dbd7c3d664cd181f03b0d1a5c6e0891fa1a1c7d3b3"} May 27 23:43:39.048509 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:39.048461 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5dcf54cc8b-h5zzl" event={"ID":"54d79568-5558-42be-b533-d5842e079979","Type":"ContainerStarted","Data":"a34de9fd1367dcdbdd08be63bc3a23a94f1de6c2e2c26e736c720d01c3b59970"} May 27 23:43:39.049394 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:39.049367 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-kg2vj" event={"ID":"cfff88b2-cd59-4a94-ab7d-6ec94dcccc47","Type":"ContainerStarted","Data":"4bc97929cfd0841565fd3df52663be8b28cfc00864e1bfc9c711fe85aaf9a61b"} May 27 23:43:39.067513 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:39.067473 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-5dcf54cc8b-h5zzl" podStartSLOduration=33.067460521 podStartE2EDuration="33.067460521s" podCreationTimestamp="2026-05-27 23:43:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 23:43:39.065848578 +0000 UTC m=+161.992750179" watchObservedRunningTime="2026-05-27 23:43:39.067460521 +0000 UTC m=+161.994362142" May 27 23:43:39.477374 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:39.477335 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a9d6f2e-4c75-499a-9483-c2fab94c7187-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8svnk\" (UID: \"8a9d6f2e-4c75-499a-9483-c2fab94c7187\") " pod="openshift-insights/insights-runtime-extractor-8svnk" May 27 23:43:39.479831 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:39.479800 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a9d6f2e-4c75-499a-9483-c2fab94c7187-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8svnk\" (UID: \"8a9d6f2e-4c75-499a-9483-c2fab94c7187\") " pod="openshift-insights/insights-runtime-extractor-8svnk" May 27 23:43:39.546120 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:39.546089 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8svnk" May 27 23:43:39.565979 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:39.565949 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5dcf54cc8b-h5zzl" May 27 23:43:39.569086 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:39.569060 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5dcf54cc8b-h5zzl" May 27 23:43:39.687046 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:39.687014 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8svnk"] May 27 23:43:39.880722 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:39.880625 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68b5c5a2-0e83-40b4-a3d8-fa07001d58f9-metrics-tls\") pod \"dns-default-z52tg\" (UID: \"68b5c5a2-0e83-40b4-a3d8-fa07001d58f9\") " pod="openshift-dns/dns-default-z52tg" May 27 23:43:39.880722 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:39.880716 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37275969-1a75-4d59-b8e2-ed044ddcc3e9-cert\") pod \"ingress-canary-zjddg\" (UID: \"37275969-1a75-4d59-b8e2-ed044ddcc3e9\") " pod="openshift-ingress-canary/ingress-canary-zjddg" May 27 23:43:39.883341 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:39.883320 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37275969-1a75-4d59-b8e2-ed044ddcc3e9-cert\") pod \"ingress-canary-zjddg\" (UID: \"37275969-1a75-4d59-b8e2-ed044ddcc3e9\") " pod="openshift-ingress-canary/ingress-canary-zjddg" May 27 23:43:39.883477 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:39.883322 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68b5c5a2-0e83-40b4-a3d8-fa07001d58f9-metrics-tls\") pod \"dns-default-z52tg\" (UID: \"68b5c5a2-0e83-40b4-a3d8-fa07001d58f9\") " pod="openshift-dns/dns-default-z52tg" May 27 23:43:40.051932 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:40.051893 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5dcf54cc8b-h5zzl" May 27 23:43:40.053177 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:40.053154 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5dcf54cc8b-h5zzl" May 27 23:43:40.099853 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:43:40.099820 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a9d6f2e_4c75_499a_9483_c2fab94c7187.slice/crio-425b84cc9cc511228b03303f83375191b1b9c15327fe79d1eaff3ed091e09e6a WatchSource:0}: Error finding container 425b84cc9cc511228b03303f83375191b1b9c15327fe79d1eaff3ed091e09e6a: Status 404 returned error can't find the container with id 425b84cc9cc511228b03303f83375191b1b9c15327fe79d1eaff3ed091e09e6a May 27 23:43:40.141123 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:40.141097 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2gd8z\"" May 27 23:43:40.141208 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:40.141144 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mpjmq\"" May 27 23:43:40.149368 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:40.149349 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zjddg" May 27 23:43:40.149475 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:40.149456 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z52tg" May 27 23:43:40.292874 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:40.292843 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zjddg"] May 27 23:43:40.296501 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:43:40.296469 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37275969_1a75_4d59_b8e2_ed044ddcc3e9.slice/crio-9e01bfcf33dbe96cc16d49f65888b81979418192f7ff31f60f0037c49448a5a7 WatchSource:0}: Error finding container 9e01bfcf33dbe96cc16d49f65888b81979418192f7ff31f60f0037c49448a5a7: Status 404 returned error can't find the container with id 9e01bfcf33dbe96cc16d49f65888b81979418192f7ff31f60f0037c49448a5a7 May 27 23:43:40.311277 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:40.311243 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z52tg"] May 27 23:43:40.648388 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:40.648011 2556 scope.go:117] "RemoveContainer" containerID="727d73efc7031cf44cd1c545d1e701d09f5495eb35e5ec768f6bf40cce9adaca" May 27 23:43:41.057166 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:41.057123 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zjddg" event={"ID":"37275969-1a75-4d59-b8e2-ed044ddcc3e9","Type":"ContainerStarted","Data":"9e01bfcf33dbe96cc16d49f65888b81979418192f7ff31f60f0037c49448a5a7"} May 27 23:43:41.059407 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:41.059339 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8svnk" event={"ID":"8a9d6f2e-4c75-499a-9483-c2fab94c7187","Type":"ContainerStarted","Data":"0fe06bcea00d498e97a8b1b13e4d919aa0256fe19bea011764c3fa9a9b13a180"} May 27 23:43:41.059407 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:41.059368 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8svnk" event={"ID":"8a9d6f2e-4c75-499a-9483-c2fab94c7187","Type":"ContainerStarted","Data":"278b7c12ae6ee48c365ac24c21cc2b8b5419128e8a377278404e0c100a7015c2"} May 27 23:43:41.059407 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:41.059383 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8svnk" event={"ID":"8a9d6f2e-4c75-499a-9483-c2fab94c7187","Type":"ContainerStarted","Data":"425b84cc9cc511228b03303f83375191b1b9c15327fe79d1eaff3ed091e09e6a"} May 27 23:43:41.062154 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:41.062014 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-kg2vj" event={"ID":"cfff88b2-cd59-4a94-ab7d-6ec94dcccc47","Type":"ContainerStarted","Data":"77cf81306d18831833c371f258bd27eaaa6f2b11a96fd97c3770892a95b9e588"} May 27 23:43:41.063453 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:41.063401 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z52tg" event={"ID":"68b5c5a2-0e83-40b4-a3d8-fa07001d58f9","Type":"ContainerStarted","Data":"d31fb70576972b00dde6efd8549b62cb3c12ef35e0a2038986e62037d077973a"} May 27 23:43:41.065211 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:41.065186 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-2gwp8_22a67c11-9c99-4758-acfb-78339ce3604b/console-operator/1.log" May 27 23:43:41.065372 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:41.065346 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-2gwp8" event={"ID":"22a67c11-9c99-4758-acfb-78339ce3604b","Type":"ContainerStarted","Data":"631da65d60a14d9e096c7661ee6f07cd911750de2833bf456e9acea9c0f545c2"} May 27 23:43:41.065715 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:41.065675 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-2gwp8" May 27 23:43:41.084108 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:41.083960 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-kg2vj" podStartSLOduration=33.528547904 podStartE2EDuration="35.083945647s" podCreationTimestamp="2026-05-27 23:43:06 +0000 UTC" firstStartedPulling="2026-05-27 23:43:38.582941914 +0000 UTC m=+161.509843485" lastFinishedPulling="2026-05-27 23:43:40.13833966 +0000 UTC m=+163.065241228" observedRunningTime="2026-05-27 23:43:41.083289028 +0000 UTC m=+164.010190623" watchObservedRunningTime="2026-05-27 23:43:41.083945647 +0000 UTC m=+164.010847239" May 27 23:43:41.534081 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:41.534030 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-2gwp8" May 27 23:43:41.560506 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:41.560060 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-2gwp8" podStartSLOduration=23.787924885 podStartE2EDuration="25.560042907s" podCreationTimestamp="2026-05-27 23:43:16 +0000 UTC" firstStartedPulling="2026-05-27 23:43:16.844504024 +0000 UTC m=+139.771405594" lastFinishedPulling="2026-05-27 23:43:18.616622046 +0000 UTC m=+141.543523616" observedRunningTime="2026-05-27 23:43:41.106341633 +0000 UTC m=+164.033243223" watchObservedRunningTime="2026-05-27 23:43:41.560042907 +0000 UTC m=+164.486944498" May 27 23:43:43.072221 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:43.072120 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z52tg" event={"ID":"68b5c5a2-0e83-40b4-a3d8-fa07001d58f9","Type":"ContainerStarted","Data":"02a431ee92f0637c32c648f1121221737964aa1041a896cd446b4ec249b1653b"} May 27 23:43:43.072221 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:43.072165 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z52tg" event={"ID":"68b5c5a2-0e83-40b4-a3d8-fa07001d58f9","Type":"ContainerStarted","Data":"351463cbb7a0eb454f4a262d2bea0bcf7fb1d52a2084571b23b47c458e9ed59a"} May 27 23:43:43.072791 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:43.072255 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-z52tg" May 27 23:43:43.073530 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:43.073506 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zjddg" event={"ID":"37275969-1a75-4d59-b8e2-ed044ddcc3e9","Type":"ContainerStarted","Data":"f2c1de0ef37563255f646de2e47bbbc6b887870f9641bafc7e939b69fb49fd11"} May 27 23:43:43.075302 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:43.075277 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8svnk" event={"ID":"8a9d6f2e-4c75-499a-9483-c2fab94c7187","Type":"ContainerStarted","Data":"f23e36384209a0fbf9314d3a4bc05b8efa8a4e1f5e685d12e642136f311aabde"} May 27 23:43:43.089759 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:43.089718 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-z52tg" podStartSLOduration=129.594378995 podStartE2EDuration="2m12.089704915s" podCreationTimestamp="2026-05-27 23:41:31 +0000 UTC" firstStartedPulling="2026-05-27 23:43:40.31726755 +0000 UTC m=+163.244169131" lastFinishedPulling="2026-05-27 23:43:42.81259347 +0000 UTC m=+165.739495051" observedRunningTime="2026-05-27 23:43:43.088898669 +0000 UTC m=+166.015800258" watchObservedRunningTime="2026-05-27 23:43:43.089704915 +0000 UTC m=+166.016606498" May 27 23:43:43.104399 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:43.104352 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zjddg" podStartSLOduration=129.586124486 podStartE2EDuration="2m12.104341079s" podCreationTimestamp="2026-05-27 23:41:31 +0000 UTC" firstStartedPulling="2026-05-27 23:43:40.299155765 +0000 UTC m=+163.226057334" lastFinishedPulling="2026-05-27 23:43:42.817372354 +0000 UTC m=+165.744273927" observedRunningTime="2026-05-27 23:43:43.103466141 +0000 UTC m=+166.030367731" watchObservedRunningTime="2026-05-27 23:43:43.104341079 +0000 UTC m=+166.031242668" May 27 23:43:43.123356 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:43.123308 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8svnk" podStartSLOduration=17.47405179 podStartE2EDuration="20.123297445s" podCreationTimestamp="2026-05-27 23:43:23 +0000 UTC" firstStartedPulling="2026-05-27 23:43:40.163713513 +0000 UTC m=+163.090615094" lastFinishedPulling="2026-05-27 23:43:42.812959177 +0000 UTC m=+165.739860749" observedRunningTime="2026-05-27 23:43:43.122203321 +0000 UTC m=+166.049104911" watchObservedRunningTime="2026-05-27 23:43:43.123297445 +0000 UTC m=+166.050199035" May 27 23:43:47.650968 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:47.650892 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t87h5" May 27 23:43:50.147654 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.147611 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jggpr"] May 27 23:43:50.152990 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.152965 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jggpr" May 27 23:43:50.154629 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.154606 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-54xfh"] May 27 23:43:50.157691 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.157664 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-57dgk\"" May 27 23:43:50.157974 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.157948 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 27 23:43:50.158310 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.158294 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 27 23:43:50.158560 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.158547 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 27 23:43:50.161620 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.159304 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 27 23:43:50.163944 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.163921 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-54xfh" May 27 23:43:50.164390 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.164371 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-vxglz"] May 27 23:43:50.166615 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.166595 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" May 27 23:43:50.166890 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.166874 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" May 27 23:43:50.167416 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.167400 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-sx6p6\"" May 27 23:43:50.167502 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.167427 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" May 27 23:43:50.167797 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.167781 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-vxglz" May 27 23:43:50.170293 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.170278 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-8w8xj\"" May 27 23:43:50.170614 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.170595 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" May 27 23:43:50.170857 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.170832 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" May 27 23:43:50.186606 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.186550 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-54xfh"] May 27 23:43:50.187794 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.187761 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-vxglz"] May 27 23:43:50.261056 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.261014 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d9975022-42da-47db-882a-12200463bb3e-sys\") pod \"node-exporter-jggpr\" (UID: \"d9975022-42da-47db-882a-12200463bb3e\") " pod="openshift-monitoring/node-exporter-jggpr" May 27 23:43:50.261056 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.261060 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d9975022-42da-47db-882a-12200463bb3e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jggpr\" (UID: \"d9975022-42da-47db-882a-12200463bb3e\") " pod="openshift-monitoring/node-exporter-jggpr" May 27 23:43:50.261270 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.261118 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d9975022-42da-47db-882a-12200463bb3e-root\") pod \"node-exporter-jggpr\" (UID: \"d9975022-42da-47db-882a-12200463bb3e\") " pod="openshift-monitoring/node-exporter-jggpr" May 27 23:43:50.261270 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.261154 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56d2bb1d-3c6a-4c89-95c0-b0f84398fb62-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-54xfh\" (UID: \"56d2bb1d-3c6a-4c89-95c0-b0f84398fb62\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-54xfh" May 27 23:43:50.261270 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.261199 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d9975022-42da-47db-882a-12200463bb3e-node-exporter-tls\") pod \"node-exporter-jggpr\" (UID: \"d9975022-42da-47db-882a-12200463bb3e\") " pod="openshift-monitoring/node-exporter-jggpr" May 27 23:43:50.261270 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.261229 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d9975022-42da-47db-882a-12200463bb3e-node-exporter-wtmp\") pod \"node-exporter-jggpr\" (UID: \"d9975022-42da-47db-882a-12200463bb3e\") " pod="openshift-monitoring/node-exporter-jggpr" May 27 23:43:50.261426 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.261270 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4n6s\" (UniqueName: \"kubernetes.io/projected/d9975022-42da-47db-882a-12200463bb3e-kube-api-access-b4n6s\") pod \"node-exporter-jggpr\" (UID: \"d9975022-42da-47db-882a-12200463bb3e\") " pod="openshift-monitoring/node-exporter-jggpr" May 27 23:43:50.261426 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.261309 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d9975022-42da-47db-882a-12200463bb3e-node-exporter-textfile\") pod \"node-exporter-jggpr\" (UID: \"d9975022-42da-47db-882a-12200463bb3e\") " pod="openshift-monitoring/node-exporter-jggpr" May 27 23:43:50.261426 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.261336 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0bf7d54-6be1-411d-a7cb-38c2f4da44ec-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-vxglz\" (UID: \"e0bf7d54-6be1-411d-a7cb-38c2f4da44ec\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vxglz" May 27 23:43:50.261426 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.261363 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d9975022-42da-47db-882a-12200463bb3e-node-exporter-accelerators-collector-config\") pod \"node-exporter-jggpr\" (UID: \"d9975022-42da-47db-882a-12200463bb3e\") " pod="openshift-monitoring/node-exporter-jggpr" May 27 23:43:50.261426 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.261389 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56d2bb1d-3c6a-4c89-95c0-b0f84398fb62-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-54xfh\" (UID: \"56d2bb1d-3c6a-4c89-95c0-b0f84398fb62\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-54xfh" May 27 23:43:50.261629 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.261475 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/56d2bb1d-3c6a-4c89-95c0-b0f84398fb62-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-54xfh\" (UID: \"56d2bb1d-3c6a-4c89-95c0-b0f84398fb62\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-54xfh" May 27 23:43:50.261629 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.261510 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/56d2bb1d-3c6a-4c89-95c0-b0f84398fb62-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-54xfh\" (UID: \"56d2bb1d-3c6a-4c89-95c0-b0f84398fb62\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-54xfh" May 27 23:43:50.261629 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.261568 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e0bf7d54-6be1-411d-a7cb-38c2f4da44ec-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-vxglz\" (UID: \"e0bf7d54-6be1-411d-a7cb-38c2f4da44ec\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vxglz" May 27 23:43:50.261629 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.261611 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b2fq\" (UniqueName: \"kubernetes.io/projected/56d2bb1d-3c6a-4c89-95c0-b0f84398fb62-kube-api-access-8b2fq\") pod \"kube-state-metrics-54fd6bc5c4-54xfh\" (UID: \"56d2bb1d-3c6a-4c89-95c0-b0f84398fb62\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-54xfh" May 27 23:43:50.261804 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.261660 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9975022-42da-47db-882a-12200463bb3e-metrics-client-ca\") pod \"node-exporter-jggpr\" (UID: \"d9975022-42da-47db-882a-12200463bb3e\") " pod="openshift-monitoring/node-exporter-jggpr" May 27 23:43:50.261804 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.261693 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0bf7d54-6be1-411d-a7cb-38c2f4da44ec-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-vxglz\" (UID: \"e0bf7d54-6be1-411d-a7cb-38c2f4da44ec\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vxglz" May 27 23:43:50.261804 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.261723 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rp8sk\" (UniqueName: \"kubernetes.io/projected/e0bf7d54-6be1-411d-a7cb-38c2f4da44ec-kube-api-access-rp8sk\") pod \"openshift-state-metrics-9c959559f-vxglz\" (UID: \"e0bf7d54-6be1-411d-a7cb-38c2f4da44ec\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vxglz" May 27 23:43:50.261804 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.261755 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/56d2bb1d-3c6a-4c89-95c0-b0f84398fb62-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-54xfh\" (UID: \"56d2bb1d-3c6a-4c89-95c0-b0f84398fb62\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-54xfh" May 27 23:43:50.363073 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.363038 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/56d2bb1d-3c6a-4c89-95c0-b0f84398fb62-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-54xfh\" (UID: \"56d2bb1d-3c6a-4c89-95c0-b0f84398fb62\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-54xfh" May 27 23:43:50.363241 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.363085 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d9975022-42da-47db-882a-12200463bb3e-sys\") pod \"node-exporter-jggpr\" (UID: \"d9975022-42da-47db-882a-12200463bb3e\") " pod="openshift-monitoring/node-exporter-jggpr" May 27 23:43:50.363241 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.363115 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d9975022-42da-47db-882a-12200463bb3e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jggpr\" (UID: \"d9975022-42da-47db-882a-12200463bb3e\") " pod="openshift-monitoring/node-exporter-jggpr" May 27 23:43:50.363241 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.363145 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d9975022-42da-47db-882a-12200463bb3e-root\") pod \"node-exporter-jggpr\" (UID: \"d9975022-42da-47db-882a-12200463bb3e\") " pod="openshift-monitoring/node-exporter-jggpr" May 27 23:43:50.363241 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.363170 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56d2bb1d-3c6a-4c89-95c0-b0f84398fb62-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-54xfh\" (UID: \"56d2bb1d-3c6a-4c89-95c0-b0f84398fb62\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-54xfh" May 27 23:43:50.363460 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.363236 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d9975022-42da-47db-882a-12200463bb3e-sys\") pod \"node-exporter-jggpr\" (UID: \"d9975022-42da-47db-882a-12200463bb3e\") " pod="openshift-monitoring/node-exporter-jggpr" May 27 23:43:50.363460 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.363250 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d9975022-42da-47db-882a-12200463bb3e-root\") pod \"node-exporter-jggpr\" (UID: \"d9975022-42da-47db-882a-12200463bb3e\") " pod="openshift-monitoring/node-exporter-jggpr" May 27 23:43:50.363460 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.363294 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d9975022-42da-47db-882a-12200463bb3e-node-exporter-tls\") pod \"node-exporter-jggpr\" (UID: \"d9975022-42da-47db-882a-12200463bb3e\") " pod="openshift-monitoring/node-exporter-jggpr" May 27 23:43:50.363460 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.363323 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d9975022-42da-47db-882a-12200463bb3e-node-exporter-wtmp\") pod \"node-exporter-jggpr\" (UID: \"d9975022-42da-47db-882a-12200463bb3e\") " pod="openshift-monitoring/node-exporter-jggpr" May 27 23:43:50.363460 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.363345 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b4n6s\" (UniqueName: \"kubernetes.io/projected/d9975022-42da-47db-882a-12200463bb3e-kube-api-access-b4n6s\") pod \"node-exporter-jggpr\" (UID: \"d9975022-42da-47db-882a-12200463bb3e\") " pod="openshift-monitoring/node-exporter-jggpr" May 27 23:43:50.363460 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.363372 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d9975022-42da-47db-882a-12200463bb3e-node-exporter-textfile\") pod \"node-exporter-jggpr\" (UID: \"d9975022-42da-47db-882a-12200463bb3e\") " pod="openshift-monitoring/node-exporter-jggpr" May 27 23:43:50.363460 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.363398 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0bf7d54-6be1-411d-a7cb-38c2f4da44ec-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-vxglz\" (UID: \"e0bf7d54-6be1-411d-a7cb-38c2f4da44ec\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vxglz" May 27 23:43:50.363460 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.363424 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d9975022-42da-47db-882a-12200463bb3e-node-exporter-accelerators-collector-config\") pod \"node-exporter-jggpr\" (UID: \"d9975022-42da-47db-882a-12200463bb3e\") " pod="openshift-monitoring/node-exporter-jggpr" May 27 23:43:50.363460 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.363452 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56d2bb1d-3c6a-4c89-95c0-b0f84398fb62-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-54xfh\" (UID: \"56d2bb1d-3c6a-4c89-95c0-b0f84398fb62\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-54xfh" May 27 23:43:50.363941 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.363489 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/56d2bb1d-3c6a-4c89-95c0-b0f84398fb62-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-54xfh\" (UID: \"56d2bb1d-3c6a-4c89-95c0-b0f84398fb62\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-54xfh" May 27 23:43:50.363941 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.363514 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/56d2bb1d-3c6a-4c89-95c0-b0f84398fb62-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-54xfh\" (UID: \"56d2bb1d-3c6a-4c89-95c0-b0f84398fb62\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-54xfh" May 27 23:43:50.363941 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.363557 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e0bf7d54-6be1-411d-a7cb-38c2f4da44ec-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-vxglz\" (UID: \"e0bf7d54-6be1-411d-a7cb-38c2f4da44ec\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vxglz" May 27 23:43:50.363941 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.363601 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8b2fq\" (UniqueName: \"kubernetes.io/projected/56d2bb1d-3c6a-4c89-95c0-b0f84398fb62-kube-api-access-8b2fq\") pod \"kube-state-metrics-54fd6bc5c4-54xfh\" (UID: \"56d2bb1d-3c6a-4c89-95c0-b0f84398fb62\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-54xfh" May 27 23:43:50.363941 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.363673 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9975022-42da-47db-882a-12200463bb3e-metrics-client-ca\") pod \"node-exporter-jggpr\" (UID: \"d9975022-42da-47db-882a-12200463bb3e\") " pod="openshift-monitoring/node-exporter-jggpr" May 27 23:43:50.363941 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.363708 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0bf7d54-6be1-411d-a7cb-38c2f4da44ec-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-vxglz\" (UID: \"e0bf7d54-6be1-411d-a7cb-38c2f4da44ec\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vxglz" May 27 23:43:50.363941 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.363739 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rp8sk\" (UniqueName: \"kubernetes.io/projected/e0bf7d54-6be1-411d-a7cb-38c2f4da44ec-kube-api-access-rp8sk\") pod \"openshift-state-metrics-9c959559f-vxglz\" (UID: \"e0bf7d54-6be1-411d-a7cb-38c2f4da44ec\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vxglz" May 27 23:43:50.363941 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:43:50.363788 2556 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found May 27 23:43:50.363941 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.363857 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/56d2bb1d-3c6a-4c89-95c0-b0f84398fb62-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-54xfh\" (UID: \"56d2bb1d-3c6a-4c89-95c0-b0f84398fb62\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-54xfh" May 27 23:43:50.363941 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:43:50.363880 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56d2bb1d-3c6a-4c89-95c0-b0f84398fb62-kube-state-metrics-tls podName:56d2bb1d-3c6a-4c89-95c0-b0f84398fb62 nodeName:}" failed. No retries permitted until 2026-05-27 23:43:50.863853153 +0000 UTC m=+173.790754724 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/56d2bb1d-3c6a-4c89-95c0-b0f84398fb62-kube-state-metrics-tls") pod "kube-state-metrics-54fd6bc5c4-54xfh" (UID: "56d2bb1d-3c6a-4c89-95c0-b0f84398fb62") : secret "kube-state-metrics-tls" not found May 27 23:43:50.364464 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.364010 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56d2bb1d-3c6a-4c89-95c0-b0f84398fb62-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-54xfh\" (UID: \"56d2bb1d-3c6a-4c89-95c0-b0f84398fb62\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-54xfh" May 27 23:43:50.364464 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.364163 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/56d2bb1d-3c6a-4c89-95c0-b0f84398fb62-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-54xfh\" (UID: \"56d2bb1d-3c6a-4c89-95c0-b0f84398fb62\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-54xfh" May 27 23:43:50.364464 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.364429 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d9975022-42da-47db-882a-12200463bb3e-node-exporter-wtmp\") pod \"node-exporter-jggpr\" (UID: \"d9975022-42da-47db-882a-12200463bb3e\") " pod="openshift-monitoring/node-exporter-jggpr" May 27 23:43:50.364694 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.364672 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9975022-42da-47db-882a-12200463bb3e-metrics-client-ca\") pod \"node-exporter-jggpr\" (UID: \"d9975022-42da-47db-882a-12200463bb3e\") " pod="openshift-monitoring/node-exporter-jggpr" May 27 23:43:50.364776 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.364692 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0bf7d54-6be1-411d-a7cb-38c2f4da44ec-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-vxglz\" (UID: \"e0bf7d54-6be1-411d-a7cb-38c2f4da44ec\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vxglz" May 27 23:43:50.364776 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.364728 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d9975022-42da-47db-882a-12200463bb3e-node-exporter-accelerators-collector-config\") pod \"node-exporter-jggpr\" (UID: \"d9975022-42da-47db-882a-12200463bb3e\") " pod="openshift-monitoring/node-exporter-jggpr" May 27 23:43:50.364961 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.364939 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d9975022-42da-47db-882a-12200463bb3e-node-exporter-textfile\") pod \"node-exporter-jggpr\" (UID: \"d9975022-42da-47db-882a-12200463bb3e\") " pod="openshift-monitoring/node-exporter-jggpr" May 27 23:43:50.366857 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.366823 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d9975022-42da-47db-882a-12200463bb3e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jggpr\" (UID: \"d9975022-42da-47db-882a-12200463bb3e\") " pod="openshift-monitoring/node-exporter-jggpr" May 27 23:43:50.366975 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.366932 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0bf7d54-6be1-411d-a7cb-38c2f4da44ec-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-vxglz\" (UID: \"e0bf7d54-6be1-411d-a7cb-38c2f4da44ec\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vxglz" May 27 23:43:50.367150 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.367126 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d9975022-42da-47db-882a-12200463bb3e-node-exporter-tls\") pod \"node-exporter-jggpr\" (UID: \"d9975022-42da-47db-882a-12200463bb3e\") " pod="openshift-monitoring/node-exporter-jggpr" May 27 23:43:50.367554 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.367530 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56d2bb1d-3c6a-4c89-95c0-b0f84398fb62-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-54xfh\" (UID: \"56d2bb1d-3c6a-4c89-95c0-b0f84398fb62\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-54xfh" May 27 23:43:50.367669 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.367617 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e0bf7d54-6be1-411d-a7cb-38c2f4da44ec-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-vxglz\" (UID: \"e0bf7d54-6be1-411d-a7cb-38c2f4da44ec\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vxglz" May 27 23:43:50.375930 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.375887 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4n6s\" (UniqueName: \"kubernetes.io/projected/d9975022-42da-47db-882a-12200463bb3e-kube-api-access-b4n6s\") pod \"node-exporter-jggpr\" (UID: \"d9975022-42da-47db-882a-12200463bb3e\") " pod="openshift-monitoring/node-exporter-jggpr" May 27 23:43:50.376035 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.376021 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b2fq\" (UniqueName: \"kubernetes.io/projected/56d2bb1d-3c6a-4c89-95c0-b0f84398fb62-kube-api-access-8b2fq\") pod \"kube-state-metrics-54fd6bc5c4-54xfh\" (UID: \"56d2bb1d-3c6a-4c89-95c0-b0f84398fb62\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-54xfh" May 27 23:43:50.376436 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.376293 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rp8sk\" (UniqueName: \"kubernetes.io/projected/e0bf7d54-6be1-411d-a7cb-38c2f4da44ec-kube-api-access-rp8sk\") pod \"openshift-state-metrics-9c959559f-vxglz\" (UID: \"e0bf7d54-6be1-411d-a7cb-38c2f4da44ec\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vxglz" May 27 23:43:50.469067 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.469043 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jggpr" May 27 23:43:50.477075 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:43:50.477050 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9975022_42da_47db_882a_12200463bb3e.slice/crio-df81c9724a1327e97277a47d9157148b782c0bb72594395f858b089ac697fd00 WatchSource:0}: Error finding container df81c9724a1327e97277a47d9157148b782c0bb72594395f858b089ac697fd00: Status 404 returned error can't find the container with id df81c9724a1327e97277a47d9157148b782c0bb72594395f858b089ac697fd00 May 27 23:43:50.480334 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.480314 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-vxglz" May 27 23:43:50.615443 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.615407 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-vxglz"] May 27 23:43:50.620281 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:43:50.620252 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0bf7d54_6be1_411d_a7cb_38c2f4da44ec.slice/crio-b95cc887ab8fd68df8d873a9a33ddeca02977593b86d930c88e555e94c1ef9b3 WatchSource:0}: Error finding container b95cc887ab8fd68df8d873a9a33ddeca02977593b86d930c88e555e94c1ef9b3: Status 404 returned error can't find the container with id b95cc887ab8fd68df8d873a9a33ddeca02977593b86d930c88e555e94c1ef9b3 May 27 23:43:50.867696 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.867660 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/56d2bb1d-3c6a-4c89-95c0-b0f84398fb62-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-54xfh\" (UID: \"56d2bb1d-3c6a-4c89-95c0-b0f84398fb62\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-54xfh" May 27 23:43:50.870240 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:50.870216 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/56d2bb1d-3c6a-4c89-95c0-b0f84398fb62-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-54xfh\" (UID: \"56d2bb1d-3c6a-4c89-95c0-b0f84398fb62\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-54xfh" May 27 23:43:51.075281 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.075208 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-54xfh" May 27 23:43:51.098272 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.098228 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jggpr" event={"ID":"d9975022-42da-47db-882a-12200463bb3e","Type":"ContainerStarted","Data":"df81c9724a1327e97277a47d9157148b782c0bb72594395f858b089ac697fd00"} May 27 23:43:51.100303 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.100277 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-vxglz" event={"ID":"e0bf7d54-6be1-411d-a7cb-38c2f4da44ec","Type":"ContainerStarted","Data":"f4597482fbe01895b88a1784727a33df8ab73724b83ea639af8f69cec517e67c"} May 27 23:43:51.100440 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.100314 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-vxglz" event={"ID":"e0bf7d54-6be1-411d-a7cb-38c2f4da44ec","Type":"ContainerStarted","Data":"3d99745e6791473654c2b61d0490d6a49f59147aa8d674368f39ecd3ef7676ea"} May 27 23:43:51.100440 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.100330 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-vxglz" event={"ID":"e0bf7d54-6be1-411d-a7cb-38c2f4da44ec","Type":"ContainerStarted","Data":"b95cc887ab8fd68df8d873a9a33ddeca02977593b86d930c88e555e94c1ef9b3"} May 27 23:43:51.222226 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.222059 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-54xfh"] May 27 23:43:51.262901 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.262872 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 23:43:51.267203 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.267174 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 27 23:43:51.270009 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.269982 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 27 23:43:51.270128 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.270005 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 27 23:43:51.270241 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.270223 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-w88hk\"" May 27 23:43:51.270312 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.270249 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 27 23:43:51.270910 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.270876 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 27 23:43:51.271166 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.271149 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 27 23:43:51.271257 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.271197 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 27 23:43:51.271407 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.271392 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 27 23:43:51.271557 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.271395 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 27 23:43:51.271876 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.271338 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 27 23:43:51.281150 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.281119 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 23:43:51.372602 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.372006 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/317230ab-b3eb-4589-8672-e88816788de8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:43:51.372602 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.372055 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/317230ab-b3eb-4589-8672-e88816788de8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:43:51.372602 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.372098 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/317230ab-b3eb-4589-8672-e88816788de8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:43:51.372602 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.372128 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/317230ab-b3eb-4589-8672-e88816788de8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:43:51.372602 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.372164 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/317230ab-b3eb-4589-8672-e88816788de8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:43:51.372602 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.372210 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/317230ab-b3eb-4589-8672-e88816788de8-web-config\") pod \"alertmanager-main-0\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:43:51.372602 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.372375 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/317230ab-b3eb-4589-8672-e88816788de8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:43:51.372602 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.372423 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szspk\" (UniqueName: \"kubernetes.io/projected/317230ab-b3eb-4589-8672-e88816788de8-kube-api-access-szspk\") pod \"alertmanager-main-0\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:43:51.372602 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.372455 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/317230ab-b3eb-4589-8672-e88816788de8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:43:51.372602 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.372486 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/317230ab-b3eb-4589-8672-e88816788de8-config-volume\") pod \"alertmanager-main-0\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:43:51.372602 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.372512 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/317230ab-b3eb-4589-8672-e88816788de8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:43:51.372602 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.372537 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/317230ab-b3eb-4589-8672-e88816788de8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:43:51.372602 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.372566 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/317230ab-b3eb-4589-8672-e88816788de8-config-out\") pod \"alertmanager-main-0\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:43:51.387090 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:43:51.387058 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56d2bb1d_3c6a_4c89_95c0_b0f84398fb62.slice/crio-6fc4ffc1258e7b4711d0a17a74eb7a86031910f6562309508f3df6ef4b1ba964 WatchSource:0}: Error finding container 6fc4ffc1258e7b4711d0a17a74eb7a86031910f6562309508f3df6ef4b1ba964: Status 404 returned error can't find the container with id 6fc4ffc1258e7b4711d0a17a74eb7a86031910f6562309508f3df6ef4b1ba964 May 27 23:43:51.473705 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.473676 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/317230ab-b3eb-4589-8672-e88816788de8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:43:51.473816 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.473727 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-szspk\" (UniqueName: \"kubernetes.io/projected/317230ab-b3eb-4589-8672-e88816788de8-kube-api-access-szspk\") pod \"alertmanager-main-0\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:43:51.473816 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.473754 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/317230ab-b3eb-4589-8672-e88816788de8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:43:51.473816 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.473783 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/317230ab-b3eb-4589-8672-e88816788de8-config-volume\") pod \"alertmanager-main-0\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:43:51.473816 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.473801 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/317230ab-b3eb-4589-8672-e88816788de8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:43:51.474023 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.473818 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/317230ab-b3eb-4589-8672-e88816788de8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:43:51.474023 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.473837 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/317230ab-b3eb-4589-8672-e88816788de8-config-out\") pod \"alertmanager-main-0\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:43:51.474023 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.473872 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/317230ab-b3eb-4589-8672-e88816788de8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:43:51.474023 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.473893 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/317230ab-b3eb-4589-8672-e88816788de8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:43:51.474023 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.473920 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/317230ab-b3eb-4589-8672-e88816788de8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:43:51.474023 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.473939 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/317230ab-b3eb-4589-8672-e88816788de8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:43:51.474023 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.473972 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/317230ab-b3eb-4589-8672-e88816788de8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:43:51.474023 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.474011 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/317230ab-b3eb-4589-8672-e88816788de8-web-config\") pod \"alertmanager-main-0\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:43:51.477666 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.476979 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/317230ab-b3eb-4589-8672-e88816788de8-web-config\") pod \"alertmanager-main-0\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:43:51.477666 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.477121 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/317230ab-b3eb-4589-8672-e88816788de8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:43:51.477666 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.477258 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/317230ab-b3eb-4589-8672-e88816788de8-config-out\") pod \"alertmanager-main-0\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:43:51.477666 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.477281 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/317230ab-b3eb-4589-8672-e88816788de8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:43:51.477666 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:43:51.477391 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/317230ab-b3eb-4589-8672-e88816788de8-alertmanager-trusted-ca-bundle podName:317230ab-b3eb-4589-8672-e88816788de8 nodeName:}" failed. No retries permitted until 2026-05-27 23:43:51.977370668 +0000 UTC m=+174.904272253 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/317230ab-b3eb-4589-8672-e88816788de8-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "317230ab-b3eb-4589-8672-e88816788de8") : configmap references non-existent config key: ca-bundle.crt May 27 23:43:51.477666 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.477467 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/317230ab-b3eb-4589-8672-e88816788de8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:43:51.478613 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.478553 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/317230ab-b3eb-4589-8672-e88816788de8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:43:51.478766 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.478740 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/317230ab-b3eb-4589-8672-e88816788de8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:43:51.479013 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.478989 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/317230ab-b3eb-4589-8672-e88816788de8-config-volume\") pod \"alertmanager-main-0\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:43:51.479658 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.479460 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/317230ab-b3eb-4589-8672-e88816788de8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:43:51.479841 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.479821 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/317230ab-b3eb-4589-8672-e88816788de8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:43:51.480735 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.480716 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/317230ab-b3eb-4589-8672-e88816788de8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:43:51.481837 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.481817 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szspk\" (UniqueName: \"kubernetes.io/projected/317230ab-b3eb-4589-8672-e88816788de8-kube-api-access-szspk\") pod \"alertmanager-main-0\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:43:51.979206 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.979168 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/317230ab-b3eb-4589-8672-e88816788de8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:43:51.980045 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:51.980017 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/317230ab-b3eb-4589-8672-e88816788de8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:43:52.105194 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:52.105151 2556 generic.go:358] "Generic (PLEG): container finished" podID="d9975022-42da-47db-882a-12200463bb3e" containerID="bd4a9e05a3dc4b609e2de662079565e7ed22edd01e32572681dace42110aa727" exitCode=0 May 27 23:43:52.105360 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:52.105243 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jggpr" event={"ID":"d9975022-42da-47db-882a-12200463bb3e","Type":"ContainerDied","Data":"bd4a9e05a3dc4b609e2de662079565e7ed22edd01e32572681dace42110aa727"} May 27 23:43:52.107594 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:52.107553 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-vxglz" event={"ID":"e0bf7d54-6be1-411d-a7cb-38c2f4da44ec","Type":"ContainerStarted","Data":"37c511ab9974ad73f351eb785792aa8716636b10b5b0c3e6e2a95858a282adbd"} May 27 23:43:52.108729 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:52.108693 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-54xfh" event={"ID":"56d2bb1d-3c6a-4c89-95c0-b0f84398fb62","Type":"ContainerStarted","Data":"6fc4ffc1258e7b4711d0a17a74eb7a86031910f6562309508f3df6ef4b1ba964"} May 27 23:43:52.144219 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:52.144178 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-vxglz" podStartSLOduration=1.164460836 podStartE2EDuration="2.144162938s" podCreationTimestamp="2026-05-27 23:43:50 +0000 UTC" firstStartedPulling="2026-05-27 23:43:50.752731776 +0000 UTC m=+173.679633347" lastFinishedPulling="2026-05-27 23:43:51.732433881 +0000 UTC m=+174.659335449" observedRunningTime="2026-05-27 23:43:52.143770032 +0000 UTC m=+175.070671625" watchObservedRunningTime="2026-05-27 23:43:52.144162938 +0000 UTC m=+175.071064595" May 27 23:43:52.168885 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:52.168865 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-858566d955-vkh8p"] May 27 23:43:52.172065 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:52.172045 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-858566d955-vkh8p" May 27 23:43:52.176012 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:52.175991 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" May 27 23:43:52.176109 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:52.175991 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" May 27 23:43:52.176331 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:52.176316 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" May 27 23:43:52.176688 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:52.176521 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-f5k2qldhsljbd\"" May 27 23:43:52.176811 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:52.176795 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" May 27 23:43:52.177668 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:52.176945 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-kqtg9\"" May 27 23:43:52.177668 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:52.177180 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" May 27 23:43:52.180933 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:52.180908 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 27 23:43:52.190080 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:52.190061 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-858566d955-vkh8p"] May 27 23:43:52.281380 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:52.281283 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/12e0297c-e34c-47c6-a917-8085789d1247-secret-grpc-tls\") pod \"thanos-querier-858566d955-vkh8p\" (UID: \"12e0297c-e34c-47c6-a917-8085789d1247\") " pod="openshift-monitoring/thanos-querier-858566d955-vkh8p" May 27 23:43:52.281380 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:52.281333 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/12e0297c-e34c-47c6-a917-8085789d1247-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-858566d955-vkh8p\" (UID: \"12e0297c-e34c-47c6-a917-8085789d1247\") " pod="openshift-monitoring/thanos-querier-858566d955-vkh8p" May 27 23:43:52.281380 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:52.281363 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/12e0297c-e34c-47c6-a917-8085789d1247-metrics-client-ca\") pod \"thanos-querier-858566d955-vkh8p\" (UID: \"12e0297c-e34c-47c6-a917-8085789d1247\") " pod="openshift-monitoring/thanos-querier-858566d955-vkh8p" May 27 23:43:52.281961 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:52.281415 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/12e0297c-e34c-47c6-a917-8085789d1247-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-858566d955-vkh8p\" (UID: \"12e0297c-e34c-47c6-a917-8085789d1247\") " pod="openshift-monitoring/thanos-querier-858566d955-vkh8p" May 27 23:43:52.281961 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:52.281493 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvqxs\" (UniqueName: \"kubernetes.io/projected/12e0297c-e34c-47c6-a917-8085789d1247-kube-api-access-rvqxs\") pod \"thanos-querier-858566d955-vkh8p\" (UID: \"12e0297c-e34c-47c6-a917-8085789d1247\") " pod="openshift-monitoring/thanos-querier-858566d955-vkh8p" May 27 23:43:52.281961 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:52.281557 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/12e0297c-e34c-47c6-a917-8085789d1247-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-858566d955-vkh8p\" (UID: \"12e0297c-e34c-47c6-a917-8085789d1247\") " pod="openshift-monitoring/thanos-querier-858566d955-vkh8p" May 27 23:43:52.281961 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:52.281600 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/12e0297c-e34c-47c6-a917-8085789d1247-secret-thanos-querier-tls\") pod \"thanos-querier-858566d955-vkh8p\" (UID: \"12e0297c-e34c-47c6-a917-8085789d1247\") " pod="openshift-monitoring/thanos-querier-858566d955-vkh8p" May 27 23:43:52.281961 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:52.281655 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/12e0297c-e34c-47c6-a917-8085789d1247-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-858566d955-vkh8p\" (UID: \"12e0297c-e34c-47c6-a917-8085789d1247\") " pod="openshift-monitoring/thanos-querier-858566d955-vkh8p" May 27 23:43:52.382367 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:52.382340 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/12e0297c-e34c-47c6-a917-8085789d1247-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-858566d955-vkh8p\" (UID: \"12e0297c-e34c-47c6-a917-8085789d1247\") " pod="openshift-monitoring/thanos-querier-858566d955-vkh8p" May 27 23:43:52.382492 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:52.382383 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/12e0297c-e34c-47c6-a917-8085789d1247-metrics-client-ca\") pod \"thanos-querier-858566d955-vkh8p\" (UID: \"12e0297c-e34c-47c6-a917-8085789d1247\") " pod="openshift-monitoring/thanos-querier-858566d955-vkh8p" May 27 23:43:52.382492 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:52.382433 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/12e0297c-e34c-47c6-a917-8085789d1247-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-858566d955-vkh8p\" (UID: \"12e0297c-e34c-47c6-a917-8085789d1247\") " pod="openshift-monitoring/thanos-querier-858566d955-vkh8p" May 27 23:43:52.382492 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:52.382473 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rvqxs\" (UniqueName: \"kubernetes.io/projected/12e0297c-e34c-47c6-a917-8085789d1247-kube-api-access-rvqxs\") pod \"thanos-querier-858566d955-vkh8p\" (UID: \"12e0297c-e34c-47c6-a917-8085789d1247\") " pod="openshift-monitoring/thanos-querier-858566d955-vkh8p" May 27 23:43:52.382677 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:52.382522 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/12e0297c-e34c-47c6-a917-8085789d1247-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-858566d955-vkh8p\" (UID: \"12e0297c-e34c-47c6-a917-8085789d1247\") " pod="openshift-monitoring/thanos-querier-858566d955-vkh8p" May 27 23:43:52.382677 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:52.382551 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/12e0297c-e34c-47c6-a917-8085789d1247-secret-thanos-querier-tls\") pod \"thanos-querier-858566d955-vkh8p\" (UID: \"12e0297c-e34c-47c6-a917-8085789d1247\") " pod="openshift-monitoring/thanos-querier-858566d955-vkh8p" May 27 23:43:52.382677 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:52.382620 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/12e0297c-e34c-47c6-a917-8085789d1247-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-858566d955-vkh8p\" (UID: \"12e0297c-e34c-47c6-a917-8085789d1247\") " pod="openshift-monitoring/thanos-querier-858566d955-vkh8p" May 27 23:43:52.382841 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:52.382696 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/12e0297c-e34c-47c6-a917-8085789d1247-secret-grpc-tls\") pod \"thanos-querier-858566d955-vkh8p\" (UID: \"12e0297c-e34c-47c6-a917-8085789d1247\") " pod="openshift-monitoring/thanos-querier-858566d955-vkh8p" May 27 23:43:52.383482 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:52.383431 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/12e0297c-e34c-47c6-a917-8085789d1247-metrics-client-ca\") pod \"thanos-querier-858566d955-vkh8p\" (UID: \"12e0297c-e34c-47c6-a917-8085789d1247\") " pod="openshift-monitoring/thanos-querier-858566d955-vkh8p" May 27 23:43:52.385681 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:52.385500 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/12e0297c-e34c-47c6-a917-8085789d1247-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-858566d955-vkh8p\" (UID: \"12e0297c-e34c-47c6-a917-8085789d1247\") " pod="openshift-monitoring/thanos-querier-858566d955-vkh8p" May 27 23:43:52.385681 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:52.385521 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/12e0297c-e34c-47c6-a917-8085789d1247-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-858566d955-vkh8p\" (UID: \"12e0297c-e34c-47c6-a917-8085789d1247\") " pod="openshift-monitoring/thanos-querier-858566d955-vkh8p" May 27 23:43:52.385879 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:52.385737 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/12e0297c-e34c-47c6-a917-8085789d1247-secret-grpc-tls\") pod \"thanos-querier-858566d955-vkh8p\" (UID: \"12e0297c-e34c-47c6-a917-8085789d1247\") " pod="openshift-monitoring/thanos-querier-858566d955-vkh8p" May 27 23:43:52.386010 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:52.385986 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/12e0297c-e34c-47c6-a917-8085789d1247-secret-thanos-querier-tls\") pod \"thanos-querier-858566d955-vkh8p\" (UID: \"12e0297c-e34c-47c6-a917-8085789d1247\") " pod="openshift-monitoring/thanos-querier-858566d955-vkh8p" May 27 23:43:52.386010 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:52.386005 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/12e0297c-e34c-47c6-a917-8085789d1247-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-858566d955-vkh8p\" (UID: \"12e0297c-e34c-47c6-a917-8085789d1247\") " pod="openshift-monitoring/thanos-querier-858566d955-vkh8p" May 27 23:43:52.386166 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:52.386121 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/12e0297c-e34c-47c6-a917-8085789d1247-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-858566d955-vkh8p\" (UID: \"12e0297c-e34c-47c6-a917-8085789d1247\") " pod="openshift-monitoring/thanos-querier-858566d955-vkh8p" May 27 23:43:52.391047 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:52.391025 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvqxs\" (UniqueName: \"kubernetes.io/projected/12e0297c-e34c-47c6-a917-8085789d1247-kube-api-access-rvqxs\") pod \"thanos-querier-858566d955-vkh8p\" (UID: \"12e0297c-e34c-47c6-a917-8085789d1247\") " pod="openshift-monitoring/thanos-querier-858566d955-vkh8p" May 27 23:43:52.483585 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:52.483562 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-858566d955-vkh8p" May 27 23:43:52.618969 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:52.618940 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 23:43:52.625874 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:43:52.625842 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod317230ab_b3eb_4589_8672_e88816788de8.slice/crio-6553ee8712c6231f5900479f28cfb68dd0238b49115c2db75b6b4c1f690878a3 WatchSource:0}: Error finding container 6553ee8712c6231f5900479f28cfb68dd0238b49115c2db75b6b4c1f690878a3: Status 404 returned error can't find the container with id 6553ee8712c6231f5900479f28cfb68dd0238b49115c2db75b6b4c1f690878a3 May 27 23:43:52.663816 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:52.663793 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-858566d955-vkh8p"] May 27 23:43:52.667160 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:43:52.667136 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12e0297c_e34c_47c6_a917_8085789d1247.slice/crio-f0ed0a66f780459fea4b472d6752e042c8828f9887a510f487b77ac1136ace6d WatchSource:0}: Error finding container f0ed0a66f780459fea4b472d6752e042c8828f9887a510f487b77ac1136ace6d: Status 404 returned error can't find the container with id f0ed0a66f780459fea4b472d6752e042c8828f9887a510f487b77ac1136ace6d May 27 23:43:53.081003 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:53.080798 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-z52tg" May 27 23:43:53.119072 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:53.118174 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-54xfh" event={"ID":"56d2bb1d-3c6a-4c89-95c0-b0f84398fb62","Type":"ContainerStarted","Data":"2e913f2c35e178031500e6ca23494cb8b0ee898d92f4c1f12e1e2903e1f078d6"} May 27 23:43:53.119072 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:53.118218 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-54xfh" event={"ID":"56d2bb1d-3c6a-4c89-95c0-b0f84398fb62","Type":"ContainerStarted","Data":"8d2acb41de5b53ebadfd84adfbf1156dc42e51485f7410284424c221c11893e5"} May 27 23:43:53.119072 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:53.118233 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-54xfh" event={"ID":"56d2bb1d-3c6a-4c89-95c0-b0f84398fb62","Type":"ContainerStarted","Data":"4472ea70beeba86663bdf8ade747c98a53af773120dfbd6f727d571d84dca143"} May 27 23:43:53.122886 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:53.122848 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-858566d955-vkh8p" event={"ID":"12e0297c-e34c-47c6-a917-8085789d1247","Type":"ContainerStarted","Data":"f0ed0a66f780459fea4b472d6752e042c8828f9887a510f487b77ac1136ace6d"} May 27 23:43:53.126598 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:53.126026 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jggpr" event={"ID":"d9975022-42da-47db-882a-12200463bb3e","Type":"ContainerStarted","Data":"455d7ac1bbc8562fb41ccd0f34a70579fc2afef50e4a3627bcc31f65ed872753"} May 27 23:43:53.126598 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:53.126055 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jggpr" event={"ID":"d9975022-42da-47db-882a-12200463bb3e","Type":"ContainerStarted","Data":"3417504f4328d3a53eac9c4659db64a3667f9e16ff683d151c5fd3c304369232"} May 27 23:43:53.129452 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:53.129426 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"317230ab-b3eb-4589-8672-e88816788de8","Type":"ContainerStarted","Data":"6553ee8712c6231f5900479f28cfb68dd0238b49115c2db75b6b4c1f690878a3"} May 27 23:43:53.165819 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:53.165305 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-54xfh" podStartSLOduration=2.045330842 podStartE2EDuration="3.165288189s" podCreationTimestamp="2026-05-27 23:43:50 +0000 UTC" firstStartedPulling="2026-05-27 23:43:51.390577481 +0000 UTC m=+174.317479052" lastFinishedPulling="2026-05-27 23:43:52.51053482 +0000 UTC m=+175.437436399" observedRunningTime="2026-05-27 23:43:53.142458616 +0000 UTC m=+176.069360207" watchObservedRunningTime="2026-05-27 23:43:53.165288189 +0000 UTC m=+176.092189780" May 27 23:43:53.166735 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:53.166689 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jggpr" podStartSLOduration=2.210131013 podStartE2EDuration="3.166678192s" podCreationTimestamp="2026-05-27 23:43:50 +0000 UTC" firstStartedPulling="2026-05-27 23:43:50.478760362 +0000 UTC m=+173.405661943" lastFinishedPulling="2026-05-27 23:43:51.435307542 +0000 UTC m=+174.362209122" observedRunningTime="2026-05-27 23:43:53.165259505 +0000 UTC m=+176.092161095" watchObservedRunningTime="2026-05-27 23:43:53.166678192 +0000 UTC m=+176.093579784" May 27 23:43:54.133914 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:54.133818 2556 generic.go:358] "Generic (PLEG): container finished" podID="317230ab-b3eb-4589-8672-e88816788de8" containerID="2501f145af577f920a8f82561f8eb72c06c20cdf7d524bfe8a952a09341c8c3d" exitCode=0 May 27 23:43:54.134360 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:54.133987 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"317230ab-b3eb-4589-8672-e88816788de8","Type":"ContainerDied","Data":"2501f145af577f920a8f82561f8eb72c06c20cdf7d524bfe8a952a09341c8c3d"} May 27 23:43:55.140809 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:55.140765 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-858566d955-vkh8p" event={"ID":"12e0297c-e34c-47c6-a917-8085789d1247","Type":"ContainerStarted","Data":"5480a5bfbf1fc941ecbecf7491708a3719fb52d4c2449f12f35cb7342464d041"} May 27 23:43:55.140809 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:55.140810 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-858566d955-vkh8p" event={"ID":"12e0297c-e34c-47c6-a917-8085789d1247","Type":"ContainerStarted","Data":"2b9e9c18367c1c525230d478cc76e126ef8060a57c05e2d9314f7ee28c039454"} May 27 23:43:55.141356 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:55.140823 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-858566d955-vkh8p" event={"ID":"12e0297c-e34c-47c6-a917-8085789d1247","Type":"ContainerStarted","Data":"3df57ed1ae6533c48d1c1ffe65f84166e1a4d7ca96cc44a2bb3404e4033119e7"} May 27 23:43:55.406879 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:55.406805 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7b5f79b6fb-ds858"] May 27 23:43:55.414432 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:55.414407 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7b5f79b6fb-ds858" May 27 23:43:55.417176 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:55.416999 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" May 27 23:43:55.417176 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:55.417064 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" May 27 23:43:55.417176 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:55.417110 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" May 27 23:43:55.417176 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:55.417068 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-zwj6f\"" May 27 23:43:55.417461 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:55.417186 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" May 27 23:43:55.417521 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:55.417513 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" May 27 23:43:55.422561 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:55.422536 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7b5f79b6fb-ds858"] May 27 23:43:55.426264 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:55.426242 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" May 27 23:43:55.511863 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:55.511832 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c760e55e-066e-4510-b003-e581df699e1f-serving-certs-ca-bundle\") pod \"telemeter-client-7b5f79b6fb-ds858\" (UID: \"c760e55e-066e-4510-b003-e581df699e1f\") " pod="openshift-monitoring/telemeter-client-7b5f79b6fb-ds858" May 27 23:43:55.512015 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:55.511877 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxnw5\" (UniqueName: \"kubernetes.io/projected/c760e55e-066e-4510-b003-e581df699e1f-kube-api-access-lxnw5\") pod \"telemeter-client-7b5f79b6fb-ds858\" (UID: \"c760e55e-066e-4510-b003-e581df699e1f\") " pod="openshift-monitoring/telemeter-client-7b5f79b6fb-ds858" May 27 23:43:55.512015 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:55.511950 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c760e55e-066e-4510-b003-e581df699e1f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7b5f79b6fb-ds858\" (UID: \"c760e55e-066e-4510-b003-e581df699e1f\") " pod="openshift-monitoring/telemeter-client-7b5f79b6fb-ds858" May 27 23:43:55.512015 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:55.511986 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c760e55e-066e-4510-b003-e581df699e1f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7b5f79b6fb-ds858\" (UID: \"c760e55e-066e-4510-b003-e581df699e1f\") " pod="openshift-monitoring/telemeter-client-7b5f79b6fb-ds858" May 27 23:43:55.512015 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:55.512014 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c760e55e-066e-4510-b003-e581df699e1f-telemeter-client-tls\") pod \"telemeter-client-7b5f79b6fb-ds858\" (UID: \"c760e55e-066e-4510-b003-e581df699e1f\") " pod="openshift-monitoring/telemeter-client-7b5f79b6fb-ds858" May 27 23:43:55.512142 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:55.512044 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c760e55e-066e-4510-b003-e581df699e1f-secret-telemeter-client\") pod \"telemeter-client-7b5f79b6fb-ds858\" (UID: \"c760e55e-066e-4510-b003-e581df699e1f\") " pod="openshift-monitoring/telemeter-client-7b5f79b6fb-ds858" May 27 23:43:55.512142 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:55.512077 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c760e55e-066e-4510-b003-e581df699e1f-federate-client-tls\") pod \"telemeter-client-7b5f79b6fb-ds858\" (UID: \"c760e55e-066e-4510-b003-e581df699e1f\") " pod="openshift-monitoring/telemeter-client-7b5f79b6fb-ds858" May 27 23:43:55.512142 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:55.512091 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c760e55e-066e-4510-b003-e581df699e1f-metrics-client-ca\") pod \"telemeter-client-7b5f79b6fb-ds858\" (UID: \"c760e55e-066e-4510-b003-e581df699e1f\") " pod="openshift-monitoring/telemeter-client-7b5f79b6fb-ds858" May 27 23:43:55.613437 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:55.613413 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c760e55e-066e-4510-b003-e581df699e1f-serving-certs-ca-bundle\") pod \"telemeter-client-7b5f79b6fb-ds858\" (UID: \"c760e55e-066e-4510-b003-e581df699e1f\") " pod="openshift-monitoring/telemeter-client-7b5f79b6fb-ds858" May 27 23:43:55.613540 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:55.613447 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lxnw5\" (UniqueName: \"kubernetes.io/projected/c760e55e-066e-4510-b003-e581df699e1f-kube-api-access-lxnw5\") pod \"telemeter-client-7b5f79b6fb-ds858\" (UID: \"c760e55e-066e-4510-b003-e581df699e1f\") " pod="openshift-monitoring/telemeter-client-7b5f79b6fb-ds858" May 27 23:43:55.613540 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:55.613476 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c760e55e-066e-4510-b003-e581df699e1f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7b5f79b6fb-ds858\" (UID: \"c760e55e-066e-4510-b003-e581df699e1f\") " pod="openshift-monitoring/telemeter-client-7b5f79b6fb-ds858" May 27 23:43:55.613540 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:55.613505 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c760e55e-066e-4510-b003-e581df699e1f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7b5f79b6fb-ds858\" (UID: \"c760e55e-066e-4510-b003-e581df699e1f\") " pod="openshift-monitoring/telemeter-client-7b5f79b6fb-ds858" May 27 23:43:55.613723 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:55.613543 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c760e55e-066e-4510-b003-e581df699e1f-telemeter-client-tls\") pod \"telemeter-client-7b5f79b6fb-ds858\" (UID: \"c760e55e-066e-4510-b003-e581df699e1f\") " pod="openshift-monitoring/telemeter-client-7b5f79b6fb-ds858" May 27 23:43:55.613723 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:55.613598 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c760e55e-066e-4510-b003-e581df699e1f-secret-telemeter-client\") pod \"telemeter-client-7b5f79b6fb-ds858\" (UID: \"c760e55e-066e-4510-b003-e581df699e1f\") " pod="openshift-monitoring/telemeter-client-7b5f79b6fb-ds858" May 27 23:43:55.613723 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:55.613656 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c760e55e-066e-4510-b003-e581df699e1f-federate-client-tls\") pod \"telemeter-client-7b5f79b6fb-ds858\" (UID: \"c760e55e-066e-4510-b003-e581df699e1f\") " pod="openshift-monitoring/telemeter-client-7b5f79b6fb-ds858" May 27 23:43:55.613723 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:55.613681 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c760e55e-066e-4510-b003-e581df699e1f-metrics-client-ca\") pod \"telemeter-client-7b5f79b6fb-ds858\" (UID: \"c760e55e-066e-4510-b003-e581df699e1f\") " pod="openshift-monitoring/telemeter-client-7b5f79b6fb-ds858" May 27 23:43:55.614229 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:55.614195 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c760e55e-066e-4510-b003-e581df699e1f-serving-certs-ca-bundle\") pod \"telemeter-client-7b5f79b6fb-ds858\" (UID: \"c760e55e-066e-4510-b003-e581df699e1f\") " pod="openshift-monitoring/telemeter-client-7b5f79b6fb-ds858" May 27 23:43:55.614379 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:55.614332 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c760e55e-066e-4510-b003-e581df699e1f-metrics-client-ca\") pod \"telemeter-client-7b5f79b6fb-ds858\" (UID: \"c760e55e-066e-4510-b003-e581df699e1f\") " pod="openshift-monitoring/telemeter-client-7b5f79b6fb-ds858" May 27 23:43:55.614533 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:55.614479 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c760e55e-066e-4510-b003-e581df699e1f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7b5f79b6fb-ds858\" (UID: \"c760e55e-066e-4510-b003-e581df699e1f\") " pod="openshift-monitoring/telemeter-client-7b5f79b6fb-ds858" May 27 23:43:55.616494 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:55.616450 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c760e55e-066e-4510-b003-e581df699e1f-secret-telemeter-client\") pod \"telemeter-client-7b5f79b6fb-ds858\" (UID: \"c760e55e-066e-4510-b003-e581df699e1f\") " pod="openshift-monitoring/telemeter-client-7b5f79b6fb-ds858" May 27 23:43:55.616763 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:55.616744 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c760e55e-066e-4510-b003-e581df699e1f-federate-client-tls\") pod \"telemeter-client-7b5f79b6fb-ds858\" (UID: \"c760e55e-066e-4510-b003-e581df699e1f\") " pod="openshift-monitoring/telemeter-client-7b5f79b6fb-ds858" May 27 23:43:55.616763 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:55.616752 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c760e55e-066e-4510-b003-e581df699e1f-telemeter-client-tls\") pod \"telemeter-client-7b5f79b6fb-ds858\" (UID: \"c760e55e-066e-4510-b003-e581df699e1f\") " pod="openshift-monitoring/telemeter-client-7b5f79b6fb-ds858" May 27 23:43:55.617156 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:55.617137 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c760e55e-066e-4510-b003-e581df699e1f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7b5f79b6fb-ds858\" (UID: \"c760e55e-066e-4510-b003-e581df699e1f\") " pod="openshift-monitoring/telemeter-client-7b5f79b6fb-ds858" May 27 23:43:55.622386 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:55.622363 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxnw5\" (UniqueName: \"kubernetes.io/projected/c760e55e-066e-4510-b003-e581df699e1f-kube-api-access-lxnw5\") pod \"telemeter-client-7b5f79b6fb-ds858\" (UID: \"c760e55e-066e-4510-b003-e581df699e1f\") " pod="openshift-monitoring/telemeter-client-7b5f79b6fb-ds858" May 27 23:43:55.726494 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:55.726438 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7b5f79b6fb-ds858" May 27 23:43:55.883003 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:55.882971 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7b5f79b6fb-ds858"] May 27 23:43:55.885195 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:43:55.885173 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc760e55e_066e_4510_b003_e581df699e1f.slice/crio-825c625f641f1a3a0ad658836f2fb19f7c4d46c2989d5d9071f96577af4964b2 WatchSource:0}: Error finding container 825c625f641f1a3a0ad658836f2fb19f7c4d46c2989d5d9071f96577af4964b2: Status 404 returned error can't find the container with id 825c625f641f1a3a0ad658836f2fb19f7c4d46c2989d5d9071f96577af4964b2 May 27 23:43:56.147029 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.146991 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-858566d955-vkh8p" event={"ID":"12e0297c-e34c-47c6-a917-8085789d1247","Type":"ContainerStarted","Data":"1898496170ac1bfa13c63b8bfdf382be537bbf583e47f82bf6859d5a4579bc5e"} May 27 23:43:56.147029 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.147030 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-858566d955-vkh8p" event={"ID":"12e0297c-e34c-47c6-a917-8085789d1247","Type":"ContainerStarted","Data":"4afd84e92a5c38d569f14e11ed4916c2543d45aa46fd620e3b6ee04fbb5589ed"} May 27 23:43:56.147507 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.147044 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-858566d955-vkh8p" event={"ID":"12e0297c-e34c-47c6-a917-8085789d1247","Type":"ContainerStarted","Data":"77b5806aeb4424be130cbc4eb5514a54d6ed93f99512f5964e1bd025a52591a9"} May 27 23:43:56.147507 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.147184 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-858566d955-vkh8p" May 27 23:43:56.148082 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.148061 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b5f79b6fb-ds858" event={"ID":"c760e55e-066e-4510-b003-e581df699e1f","Type":"ContainerStarted","Data":"825c625f641f1a3a0ad658836f2fb19f7c4d46c2989d5d9071f96577af4964b2"} May 27 23:43:56.150548 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.150531 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"317230ab-b3eb-4589-8672-e88816788de8","Type":"ContainerStarted","Data":"c0bc514c9020b48e11edbe83ced2dda98055bfbd89216f98f9b97bf98665b6ce"} May 27 23:43:56.150599 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.150554 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"317230ab-b3eb-4589-8672-e88816788de8","Type":"ContainerStarted","Data":"e77dd1d60c754d1404557a44cd0ef0096faedc6bf63a23ae316ae2aa2a000922"} May 27 23:43:56.150599 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.150565 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"317230ab-b3eb-4589-8672-e88816788de8","Type":"ContainerStarted","Data":"8c5d1ab49893f941c8a3852b315e85f759b7902bccf4b624039686f54a7d3716"} May 27 23:43:56.150599 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.150573 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"317230ab-b3eb-4589-8672-e88816788de8","Type":"ContainerStarted","Data":"ae102a9d8dfd3b635676046db96573442b10cf4b6ecf971ed70f0f0822dec7ae"} May 27 23:43:56.150599 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.150581 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"317230ab-b3eb-4589-8672-e88816788de8","Type":"ContainerStarted","Data":"5440f19ace271a7edbad4a03028934493259b7bb804f52ab5ddc7b6d5ce23a84"} May 27 23:43:56.150599 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.150590 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"317230ab-b3eb-4589-8672-e88816788de8","Type":"ContainerStarted","Data":"860c21edb7b607c8d4eb3b91e8acc584f508e20fc2998fd7f5d2acbeb84e9775"} May 27 23:43:56.172741 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.172665 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-858566d955-vkh8p" podStartSLOduration=1.275607764 podStartE2EDuration="4.172652921s" podCreationTimestamp="2026-05-27 23:43:52 +0000 UTC" firstStartedPulling="2026-05-27 23:43:52.670995147 +0000 UTC m=+175.597896729" lastFinishedPulling="2026-05-27 23:43:55.568040317 +0000 UTC m=+178.494941886" observedRunningTime="2026-05-27 23:43:56.171739734 +0000 UTC m=+179.098641322" watchObservedRunningTime="2026-05-27 23:43:56.172652921 +0000 UTC m=+179.099554510" May 27 23:43:56.198890 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.198849 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.259502029 podStartE2EDuration="5.198837196s" podCreationTimestamp="2026-05-27 23:43:51 +0000 UTC" firstStartedPulling="2026-05-27 23:43:52.628124073 +0000 UTC m=+175.555025641" lastFinishedPulling="2026-05-27 23:43:55.56745924 +0000 UTC m=+178.494360808" observedRunningTime="2026-05-27 23:43:56.197269279 +0000 UTC m=+179.124170868" watchObservedRunningTime="2026-05-27 23:43:56.198837196 +0000 UTC m=+179.125738785" May 27 23:43:56.405331 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.405298 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 27 23:43:56.409070 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.409054 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.411854 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.411834 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 27 23:43:56.413858 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.413826 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 27 23:43:56.413962 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.413857 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 27 23:43:56.413962 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.413935 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 27 23:43:56.414058 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.414002 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 27 23:43:56.414234 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.414218 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 27 23:43:56.414951 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.414788 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 27 23:43:56.415090 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.415073 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 27 23:43:56.418680 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.415383 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 27 23:43:56.418680 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.415408 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 27 23:43:56.418680 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.416729 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 27 23:43:56.418680 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.417119 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-78hema5s28shu\"" May 27 23:43:56.418680 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.417488 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 27 23:43:56.418680 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.417838 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-z4t74\"" May 27 23:43:56.421626 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.421607 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 27 23:43:56.424038 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.423987 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 27 23:43:56.523497 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.523460 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-config\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.523631 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.523510 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.523631 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.523542 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.523631 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.523576 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3ed4027-ef2d-43f2-b791-294fa6589ece-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.523631 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.523601 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.523631 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.523629 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f3ed4027-ef2d-43f2-b791-294fa6589ece-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.523929 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.523697 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3ed4027-ef2d-43f2-b791-294fa6589ece-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.523929 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.523753 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.523929 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.523807 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f3ed4027-ef2d-43f2-b791-294fa6589ece-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.523929 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.523832 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mzlc\" (UniqueName: \"kubernetes.io/projected/f3ed4027-ef2d-43f2-b791-294fa6589ece-kube-api-access-7mzlc\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.523929 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.523880 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.524155 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.523954 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.524155 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.523991 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-web-config\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.524155 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.524021 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.524155 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.524049 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f3ed4027-ef2d-43f2-b791-294fa6589ece-config-out\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.524155 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.524070 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3ed4027-ef2d-43f2-b791-294fa6589ece-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.524155 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.524128 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f3ed4027-ef2d-43f2-b791-294fa6589ece-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.524371 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.524194 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3ed4027-ef2d-43f2-b791-294fa6589ece-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.624926 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.624884 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.625093 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.624950 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.625093 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.624977 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-web-config\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.625093 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.624999 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.625093 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.625030 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f3ed4027-ef2d-43f2-b791-294fa6589ece-config-out\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.625093 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.625054 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3ed4027-ef2d-43f2-b791-294fa6589ece-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.625093 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.625083 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f3ed4027-ef2d-43f2-b791-294fa6589ece-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.625386 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.625116 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3ed4027-ef2d-43f2-b791-294fa6589ece-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.625386 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.625141 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-config\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.625386 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.625178 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.625386 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.625208 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.625386 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.625249 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3ed4027-ef2d-43f2-b791-294fa6589ece-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.625386 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.625275 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.625386 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.625307 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f3ed4027-ef2d-43f2-b791-294fa6589ece-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.625386 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.625340 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3ed4027-ef2d-43f2-b791-294fa6589ece-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.625386 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.625386 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.625837 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.625442 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f3ed4027-ef2d-43f2-b791-294fa6589ece-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.625837 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.625471 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7mzlc\" (UniqueName: \"kubernetes.io/projected/f3ed4027-ef2d-43f2-b791-294fa6589ece-kube-api-access-7mzlc\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.627978 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.626735 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3ed4027-ef2d-43f2-b791-294fa6589ece-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.628470 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.628437 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f3ed4027-ef2d-43f2-b791-294fa6589ece-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.628764 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.628734 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f3ed4027-ef2d-43f2-b791-294fa6589ece-config-out\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.630105 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.629120 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3ed4027-ef2d-43f2-b791-294fa6589ece-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.630105 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.629797 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3ed4027-ef2d-43f2-b791-294fa6589ece-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.630105 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.629968 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.630105 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.630077 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3ed4027-ef2d-43f2-b791-294fa6589ece-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.630356 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.630115 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-config\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.630356 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.630131 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f3ed4027-ef2d-43f2-b791-294fa6589ece-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.630356 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.630335 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.630561 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.630536 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.630935 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.630915 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-web-config\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.631778 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.631735 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.631861 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.631813 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.632309 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.632276 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.632387 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.632338 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.632773 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.632754 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f3ed4027-ef2d-43f2-b791-294fa6589ece-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.634845 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.634824 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mzlc\" (UniqueName: \"kubernetes.io/projected/f3ed4027-ef2d-43f2-b791-294fa6589ece-kube-api-access-7mzlc\") pod \"prometheus-k8s-0\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.721045 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.720997 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 27 23:43:56.868793 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:56.868764 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 27 23:43:56.870946 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:43:56.870922 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3ed4027_ef2d_43f2_b791_294fa6589ece.slice/crio-f7b3b02d4b07720873bddfb52fcf3ee941209b3559773999feac1dd37662ca8a WatchSource:0}: Error finding container f7b3b02d4b07720873bddfb52fcf3ee941209b3559773999feac1dd37662ca8a: Status 404 returned error can't find the container with id f7b3b02d4b07720873bddfb52fcf3ee941209b3559773999feac1dd37662ca8a May 27 23:43:57.156387 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:57.156355 2556 generic.go:358] "Generic (PLEG): container finished" podID="f3ed4027-ef2d-43f2-b791-294fa6589ece" containerID="3c179ec94cae437de5ac3233bfcd6da6f93c1fdf5844323883f2238ddb9256b8" exitCode=0 May 27 23:43:57.156858 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:57.156456 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3ed4027-ef2d-43f2-b791-294fa6589ece","Type":"ContainerDied","Data":"3c179ec94cae437de5ac3233bfcd6da6f93c1fdf5844323883f2238ddb9256b8"} May 27 23:43:57.156858 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:57.156498 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3ed4027-ef2d-43f2-b791-294fa6589ece","Type":"ContainerStarted","Data":"f7b3b02d4b07720873bddfb52fcf3ee941209b3559773999feac1dd37662ca8a"} May 27 23:43:58.162321 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:58.162281 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b5f79b6fb-ds858" event={"ID":"c760e55e-066e-4510-b003-e581df699e1f","Type":"ContainerStarted","Data":"3321dd03148a9a930c745885b73bce3f1aad0853660cc515d98c0c9f54ee7395"} May 27 23:43:58.162321 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:58.162325 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b5f79b6fb-ds858" event={"ID":"c760e55e-066e-4510-b003-e581df699e1f","Type":"ContainerStarted","Data":"b458487d9a65c3b164c264b1f9a14880c29cd3a2008fcccd2e9697e4a685f35d"} May 27 23:43:58.162798 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:58.162340 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b5f79b6fb-ds858" event={"ID":"c760e55e-066e-4510-b003-e581df699e1f","Type":"ContainerStarted","Data":"3dd5d7243b2faaca6d6c4fbc78d685de49e1a5efcca0a034a2afa3ea49cd8534"} May 27 23:43:58.185449 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:43:58.185405 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7b5f79b6fb-ds858" podStartSLOduration=1.5502642770000001 podStartE2EDuration="3.185388866s" podCreationTimestamp="2026-05-27 23:43:55 +0000 UTC" firstStartedPulling="2026-05-27 23:43:55.887259591 +0000 UTC m=+178.814161162" lastFinishedPulling="2026-05-27 23:43:57.522384169 +0000 UTC m=+180.449285751" observedRunningTime="2026-05-27 23:43:58.183655701 +0000 UTC m=+181.110557289" watchObservedRunningTime="2026-05-27 23:43:58.185388866 +0000 UTC m=+181.112290459" May 27 23:44:00.171225 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:44:00.171198 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3ed4027-ef2d-43f2-b791-294fa6589ece","Type":"ContainerStarted","Data":"eebda7d4d835dc5384be0e690493e14f157a0ac6e73a198ef0eaebbda6ac321c"} May 27 23:44:00.171526 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:44:00.171231 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3ed4027-ef2d-43f2-b791-294fa6589ece","Type":"ContainerStarted","Data":"48803f17f32ca3466c7ef45f8a4b73c13afc0e554870054bf315460f3cf874c7"} May 27 23:44:00.171526 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:44:00.171240 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3ed4027-ef2d-43f2-b791-294fa6589ece","Type":"ContainerStarted","Data":"c7cf9f610d465a0fa762f7777b7a56e8768d9cb76b6a5c1bd6e4fd76ff5f08aa"} May 27 23:44:00.171526 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:44:00.171250 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3ed4027-ef2d-43f2-b791-294fa6589ece","Type":"ContainerStarted","Data":"e02e4b004989e0dc2cfbbf7d03f88219638f1d0f3c1394798b0505ead8d77e18"} May 27 23:44:00.171526 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:44:00.171258 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3ed4027-ef2d-43f2-b791-294fa6589ece","Type":"ContainerStarted","Data":"81d8c5b4c5eb26d5727f21fa507cb75a82fa1a1ff7b56c7029d2d2d2ec6baa3d"} May 27 23:44:01.176806 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:44:01.176767 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3ed4027-ef2d-43f2-b791-294fa6589ece","Type":"ContainerStarted","Data":"722663a21d124393ac1b6622ace8a1997e7311c3a054999da110d2d793ba4fb4"} May 27 23:44:01.210854 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:44:01.210799 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.5638446889999997 podStartE2EDuration="5.210781046s" podCreationTimestamp="2026-05-27 23:43:56 +0000 UTC" firstStartedPulling="2026-05-27 23:43:57.157957277 +0000 UTC m=+180.084858845" lastFinishedPulling="2026-05-27 23:43:59.804893632 +0000 UTC m=+182.731795202" observedRunningTime="2026-05-27 23:44:01.208601177 +0000 UTC m=+184.135502778" watchObservedRunningTime="2026-05-27 23:44:01.210781046 +0000 UTC m=+184.137682637" May 27 23:44:01.721283 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:44:01.721249 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 27 23:44:02.163810 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:44:02.163742 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-858566d955-vkh8p" May 27 23:44:30.268517 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:44:30.268484 2556 generic.go:358] "Generic (PLEG): container finished" podID="e5c3a679-8e9c-4649-a2f2-201003fb37d5" containerID="e94d6f2e1da53b3dad326260479a2fa31f0837b0547e2dc5cccc9dd0e8865b10" exitCode=0 May 27 23:44:30.268959 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:44:30.268566 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-9dngd" event={"ID":"e5c3a679-8e9c-4649-a2f2-201003fb37d5","Type":"ContainerDied","Data":"e94d6f2e1da53b3dad326260479a2fa31f0837b0547e2dc5cccc9dd0e8865b10"} May 27 23:44:30.268959 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:44:30.268945 2556 scope.go:117] "RemoveContainer" containerID="e94d6f2e1da53b3dad326260479a2fa31f0837b0547e2dc5cccc9dd0e8865b10" May 27 23:44:31.273752 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:44:31.273715 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-9dngd" event={"ID":"e5c3a679-8e9c-4649-a2f2-201003fb37d5","Type":"ContainerStarted","Data":"de46b098e1b78d30bfc892aeff1d1b266a44324e599e02f6da9993cb46cfa686"} May 27 23:44:56.721420 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:44:56.721383 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 27 23:44:56.737267 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:44:56.737242 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 27 23:44:57.368757 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:44:57.368729 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:09.501379 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:09.501334 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b407d9da-589e-4803-abad-d70c5a21a11a-metrics-certs\") pod \"network-metrics-daemon-t87h5\" (UID: \"b407d9da-589e-4803-abad-d70c5a21a11a\") " pod="openshift-multus/network-metrics-daemon-t87h5" May 27 23:45:09.503872 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:09.503850 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b407d9da-589e-4803-abad-d70c5a21a11a-metrics-certs\") pod \"network-metrics-daemon-t87h5\" (UID: \"b407d9da-589e-4803-abad-d70c5a21a11a\") " pod="openshift-multus/network-metrics-daemon-t87h5" May 27 23:45:09.554620 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:09.554588 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-r6nr2\"" May 27 23:45:09.562898 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:09.562867 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t87h5" May 27 23:45:09.699499 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:09.699393 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-t87h5"] May 27 23:45:09.702355 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:45:09.702323 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb407d9da_589e_4803_abad_d70c5a21a11a.slice/crio-4ce9a96b3d0005cd85d20e3362176568697c84103775e24733b3366d8c9833f2 WatchSource:0}: Error finding container 4ce9a96b3d0005cd85d20e3362176568697c84103775e24733b3366d8c9833f2: Status 404 returned error can't find the container with id 4ce9a96b3d0005cd85d20e3362176568697c84103775e24733b3366d8c9833f2 May 27 23:45:10.398597 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:10.398560 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t87h5" event={"ID":"b407d9da-589e-4803-abad-d70c5a21a11a","Type":"ContainerStarted","Data":"4ce9a96b3d0005cd85d20e3362176568697c84103775e24733b3366d8c9833f2"} May 27 23:45:10.524263 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:10.524219 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 23:45:10.524856 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:10.524806 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="317230ab-b3eb-4589-8672-e88816788de8" containerName="alertmanager" containerID="cri-o://860c21edb7b607c8d4eb3b91e8acc584f508e20fc2998fd7f5d2acbeb84e9775" gracePeriod=120 May 27 23:45:10.525005 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:10.524865 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="317230ab-b3eb-4589-8672-e88816788de8" containerName="kube-rbac-proxy-metric" containerID="cri-o://e77dd1d60c754d1404557a44cd0ef0096faedc6bf63a23ae316ae2aa2a000922" gracePeriod=120 May 27 23:45:10.525005 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:10.524909 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="317230ab-b3eb-4589-8672-e88816788de8" containerName="kube-rbac-proxy-web" containerID="cri-o://ae102a9d8dfd3b635676046db96573442b10cf4b6ecf971ed70f0f0822dec7ae" gracePeriod=120 May 27 23:45:10.525005 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:10.524940 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="317230ab-b3eb-4589-8672-e88816788de8" containerName="config-reloader" containerID="cri-o://5440f19ace271a7edbad4a03028934493259b7bb804f52ab5ddc7b6d5ce23a84" gracePeriod=120 May 27 23:45:10.525005 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:10.524953 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="317230ab-b3eb-4589-8672-e88816788de8" containerName="kube-rbac-proxy" containerID="cri-o://8c5d1ab49893f941c8a3852b315e85f759b7902bccf4b624039686f54a7d3716" gracePeriod=120 May 27 23:45:10.525209 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:10.525024 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="317230ab-b3eb-4589-8672-e88816788de8" containerName="prom-label-proxy" containerID="cri-o://c0bc514c9020b48e11edbe83ced2dda98055bfbd89216f98f9b97bf98665b6ce" gracePeriod=120 May 27 23:45:11.405255 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:11.405215 2556 generic.go:358] "Generic (PLEG): container finished" podID="317230ab-b3eb-4589-8672-e88816788de8" containerID="c0bc514c9020b48e11edbe83ced2dda98055bfbd89216f98f9b97bf98665b6ce" exitCode=0 May 27 23:45:11.405255 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:11.405245 2556 generic.go:358] "Generic (PLEG): container finished" podID="317230ab-b3eb-4589-8672-e88816788de8" containerID="8c5d1ab49893f941c8a3852b315e85f759b7902bccf4b624039686f54a7d3716" exitCode=0 May 27 23:45:11.405255 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:11.405258 2556 generic.go:358] "Generic (PLEG): container finished" podID="317230ab-b3eb-4589-8672-e88816788de8" containerID="5440f19ace271a7edbad4a03028934493259b7bb804f52ab5ddc7b6d5ce23a84" exitCode=0 May 27 23:45:11.405255 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:11.405266 2556 generic.go:358] "Generic (PLEG): container finished" podID="317230ab-b3eb-4589-8672-e88816788de8" containerID="860c21edb7b607c8d4eb3b91e8acc584f508e20fc2998fd7f5d2acbeb84e9775" exitCode=0 May 27 23:45:11.405536 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:11.405283 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"317230ab-b3eb-4589-8672-e88816788de8","Type":"ContainerDied","Data":"c0bc514c9020b48e11edbe83ced2dda98055bfbd89216f98f9b97bf98665b6ce"} May 27 23:45:11.405536 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:11.405315 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"317230ab-b3eb-4589-8672-e88816788de8","Type":"ContainerDied","Data":"8c5d1ab49893f941c8a3852b315e85f759b7902bccf4b624039686f54a7d3716"} May 27 23:45:11.405536 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:11.405324 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"317230ab-b3eb-4589-8672-e88816788de8","Type":"ContainerDied","Data":"5440f19ace271a7edbad4a03028934493259b7bb804f52ab5ddc7b6d5ce23a84"} May 27 23:45:11.405536 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:11.405333 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"317230ab-b3eb-4589-8672-e88816788de8","Type":"ContainerDied","Data":"860c21edb7b607c8d4eb3b91e8acc584f508e20fc2998fd7f5d2acbeb84e9775"} May 27 23:45:11.406768 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:11.406746 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t87h5" event={"ID":"b407d9da-589e-4803-abad-d70c5a21a11a","Type":"ContainerStarted","Data":"88324854b81807aa7d0c402ec4429adfef6479893f6cdce3e3191a0b9b1e905e"} May 27 23:45:11.406768 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:11.406772 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t87h5" event={"ID":"b407d9da-589e-4803-abad-d70c5a21a11a","Type":"ContainerStarted","Data":"ff5d3619cfd5e4bb24b22bbc58137cbe4f85b4eb9e7b4fc606d521d23e9afb1d"} May 27 23:45:11.422765 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:11.422713 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-t87h5" podStartSLOduration=253.502572499 podStartE2EDuration="4m14.42269901s" podCreationTimestamp="2026-05-27 23:40:57 +0000 UTC" firstStartedPulling="2026-05-27 23:45:09.704069793 +0000 UTC m=+252.630971364" lastFinishedPulling="2026-05-27 23:45:10.624196284 +0000 UTC m=+253.551097875" observedRunningTime="2026-05-27 23:45:11.422658626 +0000 UTC m=+254.349560233" watchObservedRunningTime="2026-05-27 23:45:11.42269901 +0000 UTC m=+254.349600602" May 27 23:45:11.873168 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:11.873146 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 27 23:45:11.923191 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:11.923156 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/317230ab-b3eb-4589-8672-e88816788de8-config-out\") pod \"317230ab-b3eb-4589-8672-e88816788de8\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " May 27 23:45:11.923373 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:11.923236 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/317230ab-b3eb-4589-8672-e88816788de8-metrics-client-ca\") pod \"317230ab-b3eb-4589-8672-e88816788de8\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " May 27 23:45:11.923373 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:11.923290 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/317230ab-b3eb-4589-8672-e88816788de8-web-config\") pod \"317230ab-b3eb-4589-8672-e88816788de8\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " May 27 23:45:11.923373 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:11.923317 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/317230ab-b3eb-4589-8672-e88816788de8-secret-alertmanager-main-tls\") pod \"317230ab-b3eb-4589-8672-e88816788de8\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " May 27 23:45:11.923373 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:11.923351 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/317230ab-b3eb-4589-8672-e88816788de8-cluster-tls-config\") pod \"317230ab-b3eb-4589-8672-e88816788de8\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " May 27 23:45:11.923576 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:11.923384 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-szspk\" (UniqueName: \"kubernetes.io/projected/317230ab-b3eb-4589-8672-e88816788de8-kube-api-access-szspk\") pod \"317230ab-b3eb-4589-8672-e88816788de8\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " May 27 23:45:11.923576 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:11.923432 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/317230ab-b3eb-4589-8672-e88816788de8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"317230ab-b3eb-4589-8672-e88816788de8\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " May 27 23:45:11.923576 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:11.923470 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/317230ab-b3eb-4589-8672-e88816788de8-secret-alertmanager-kube-rbac-proxy-web\") pod \"317230ab-b3eb-4589-8672-e88816788de8\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " May 27 23:45:11.923576 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:11.923501 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/317230ab-b3eb-4589-8672-e88816788de8-alertmanager-trusted-ca-bundle\") pod \"317230ab-b3eb-4589-8672-e88816788de8\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " May 27 23:45:11.923576 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:11.923534 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/317230ab-b3eb-4589-8672-e88816788de8-tls-assets\") pod \"317230ab-b3eb-4589-8672-e88816788de8\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " May 27 23:45:11.923576 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:11.923570 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/317230ab-b3eb-4589-8672-e88816788de8-alertmanager-main-db\") pod \"317230ab-b3eb-4589-8672-e88816788de8\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " May 27 23:45:11.923899 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:11.923600 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/317230ab-b3eb-4589-8672-e88816788de8-config-volume\") pod \"317230ab-b3eb-4589-8672-e88816788de8\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " May 27 23:45:11.923899 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:11.923664 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/317230ab-b3eb-4589-8672-e88816788de8-secret-alertmanager-kube-rbac-proxy\") pod \"317230ab-b3eb-4589-8672-e88816788de8\" (UID: \"317230ab-b3eb-4589-8672-e88816788de8\") " May 27 23:45:11.923899 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:11.923680 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/317230ab-b3eb-4589-8672-e88816788de8-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "317230ab-b3eb-4589-8672-e88816788de8" (UID: "317230ab-b3eb-4589-8672-e88816788de8"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 23:45:11.924044 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:11.923915 2556 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/317230ab-b3eb-4589-8672-e88816788de8-metrics-client-ca\") on node \"ip-10-0-128-22.ec2.internal\" DevicePath \"\"" May 27 23:45:11.924787 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:11.924753 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/317230ab-b3eb-4589-8672-e88816788de8-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "317230ab-b3eb-4589-8672-e88816788de8" (UID: "317230ab-b3eb-4589-8672-e88816788de8"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 23:45:11.925203 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:11.925165 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/317230ab-b3eb-4589-8672-e88816788de8-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "317230ab-b3eb-4589-8672-e88816788de8" (UID: "317230ab-b3eb-4589-8672-e88816788de8"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 23:45:11.926161 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:11.926138 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/317230ab-b3eb-4589-8672-e88816788de8-config-out" (OuterVolumeSpecName: "config-out") pod "317230ab-b3eb-4589-8672-e88816788de8" (UID: "317230ab-b3eb-4589-8672-e88816788de8"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 23:45:11.927968 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:11.927946 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/317230ab-b3eb-4589-8672-e88816788de8-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "317230ab-b3eb-4589-8672-e88816788de8" (UID: "317230ab-b3eb-4589-8672-e88816788de8"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 23:45:11.928177 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:11.928034 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/317230ab-b3eb-4589-8672-e88816788de8-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "317230ab-b3eb-4589-8672-e88816788de8" (UID: "317230ab-b3eb-4589-8672-e88816788de8"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 23:45:11.928990 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:11.928961 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/317230ab-b3eb-4589-8672-e88816788de8-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "317230ab-b3eb-4589-8672-e88816788de8" (UID: "317230ab-b3eb-4589-8672-e88816788de8"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 23:45:11.929402 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:11.929360 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/317230ab-b3eb-4589-8672-e88816788de8-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "317230ab-b3eb-4589-8672-e88816788de8" (UID: "317230ab-b3eb-4589-8672-e88816788de8"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 23:45:11.929935 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:11.929845 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/317230ab-b3eb-4589-8672-e88816788de8-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "317230ab-b3eb-4589-8672-e88816788de8" (UID: "317230ab-b3eb-4589-8672-e88816788de8"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 23:45:11.930253 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:11.930216 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/317230ab-b3eb-4589-8672-e88816788de8-config-volume" (OuterVolumeSpecName: "config-volume") pod "317230ab-b3eb-4589-8672-e88816788de8" (UID: "317230ab-b3eb-4589-8672-e88816788de8"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 23:45:11.930344 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:11.930321 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/317230ab-b3eb-4589-8672-e88816788de8-kube-api-access-szspk" (OuterVolumeSpecName: "kube-api-access-szspk") pod "317230ab-b3eb-4589-8672-e88816788de8" (UID: "317230ab-b3eb-4589-8672-e88816788de8"). InnerVolumeSpecName "kube-api-access-szspk". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 23:45:11.934747 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:11.934659 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/317230ab-b3eb-4589-8672-e88816788de8-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "317230ab-b3eb-4589-8672-e88816788de8" (UID: "317230ab-b3eb-4589-8672-e88816788de8"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 23:45:11.939979 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:11.939957 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/317230ab-b3eb-4589-8672-e88816788de8-web-config" (OuterVolumeSpecName: "web-config") pod "317230ab-b3eb-4589-8672-e88816788de8" (UID: "317230ab-b3eb-4589-8672-e88816788de8"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 23:45:12.024425 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.024327 2556 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/317230ab-b3eb-4589-8672-e88816788de8-web-config\") on node \"ip-10-0-128-22.ec2.internal\" DevicePath \"\"" May 27 23:45:12.024425 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.024359 2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/317230ab-b3eb-4589-8672-e88816788de8-secret-alertmanager-main-tls\") on node \"ip-10-0-128-22.ec2.internal\" DevicePath \"\"" May 27 23:45:12.024425 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.024377 2556 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/317230ab-b3eb-4589-8672-e88816788de8-cluster-tls-config\") on node \"ip-10-0-128-22.ec2.internal\" DevicePath \"\"" May 27 23:45:12.024425 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.024389 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-szspk\" (UniqueName: \"kubernetes.io/projected/317230ab-b3eb-4589-8672-e88816788de8-kube-api-access-szspk\") on node \"ip-10-0-128-22.ec2.internal\" DevicePath \"\"" May 27 23:45:12.024425 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.024403 2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/317230ab-b3eb-4589-8672-e88816788de8-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-128-22.ec2.internal\" DevicePath \"\"" May 27 23:45:12.024425 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.024418 2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/317230ab-b3eb-4589-8672-e88816788de8-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-128-22.ec2.internal\" DevicePath \"\"" May 27 23:45:12.024774 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.024433 2556 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/317230ab-b3eb-4589-8672-e88816788de8-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-128-22.ec2.internal\" DevicePath \"\"" May 27 23:45:12.024774 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.024446 2556 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/317230ab-b3eb-4589-8672-e88816788de8-tls-assets\") on node \"ip-10-0-128-22.ec2.internal\" DevicePath \"\"" May 27 23:45:12.024774 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.024460 2556 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/317230ab-b3eb-4589-8672-e88816788de8-alertmanager-main-db\") on node \"ip-10-0-128-22.ec2.internal\" DevicePath \"\"" May 27 23:45:12.024774 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.024471 2556 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/317230ab-b3eb-4589-8672-e88816788de8-config-volume\") on node \"ip-10-0-128-22.ec2.internal\" DevicePath \"\"" May 27 23:45:12.024774 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.024482 2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/317230ab-b3eb-4589-8672-e88816788de8-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-128-22.ec2.internal\" DevicePath \"\"" May 27 23:45:12.024774 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.024493 2556 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/317230ab-b3eb-4589-8672-e88816788de8-config-out\") on node \"ip-10-0-128-22.ec2.internal\" DevicePath \"\"" May 27 23:45:12.413339 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.413232 2556 generic.go:358] "Generic (PLEG): container finished" podID="317230ab-b3eb-4589-8672-e88816788de8" containerID="e77dd1d60c754d1404557a44cd0ef0096faedc6bf63a23ae316ae2aa2a000922" exitCode=0 May 27 23:45:12.413339 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.413267 2556 generic.go:358] "Generic (PLEG): container finished" podID="317230ab-b3eb-4589-8672-e88816788de8" containerID="ae102a9d8dfd3b635676046db96573442b10cf4b6ecf971ed70f0f0822dec7ae" exitCode=0 May 27 23:45:12.413339 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.413315 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"317230ab-b3eb-4589-8672-e88816788de8","Type":"ContainerDied","Data":"e77dd1d60c754d1404557a44cd0ef0096faedc6bf63a23ae316ae2aa2a000922"} May 27 23:45:12.413583 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.413355 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 27 23:45:12.413583 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.413363 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"317230ab-b3eb-4589-8672-e88816788de8","Type":"ContainerDied","Data":"ae102a9d8dfd3b635676046db96573442b10cf4b6ecf971ed70f0f0822dec7ae"} May 27 23:45:12.413583 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.413380 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"317230ab-b3eb-4589-8672-e88816788de8","Type":"ContainerDied","Data":"6553ee8712c6231f5900479f28cfb68dd0238b49115c2db75b6b4c1f690878a3"} May 27 23:45:12.413583 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.413399 2556 scope.go:117] "RemoveContainer" containerID="c0bc514c9020b48e11edbe83ced2dda98055bfbd89216f98f9b97bf98665b6ce" May 27 23:45:12.421713 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.421690 2556 scope.go:117] "RemoveContainer" containerID="e77dd1d60c754d1404557a44cd0ef0096faedc6bf63a23ae316ae2aa2a000922" May 27 23:45:12.429304 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.429283 2556 scope.go:117] "RemoveContainer" containerID="8c5d1ab49893f941c8a3852b315e85f759b7902bccf4b624039686f54a7d3716" May 27 23:45:12.435868 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.435852 2556 scope.go:117] "RemoveContainer" containerID="ae102a9d8dfd3b635676046db96573442b10cf4b6ecf971ed70f0f0822dec7ae" May 27 23:45:12.439008 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.438987 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 23:45:12.443096 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.443076 2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 23:45:12.444337 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.444320 2556 scope.go:117] "RemoveContainer" containerID="5440f19ace271a7edbad4a03028934493259b7bb804f52ab5ddc7b6d5ce23a84" May 27 23:45:12.451155 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.451134 2556 scope.go:117] "RemoveContainer" containerID="860c21edb7b607c8d4eb3b91e8acc584f508e20fc2998fd7f5d2acbeb84e9775" May 27 23:45:12.458103 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.458082 2556 scope.go:117] "RemoveContainer" containerID="2501f145af577f920a8f82561f8eb72c06c20cdf7d524bfe8a952a09341c8c3d" May 27 23:45:12.465156 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.465139 2556 scope.go:117] "RemoveContainer" containerID="c0bc514c9020b48e11edbe83ced2dda98055bfbd89216f98f9b97bf98665b6ce" May 27 23:45:12.465422 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:45:12.465403 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0bc514c9020b48e11edbe83ced2dda98055bfbd89216f98f9b97bf98665b6ce\": container with ID starting with c0bc514c9020b48e11edbe83ced2dda98055bfbd89216f98f9b97bf98665b6ce not found: ID does not exist" containerID="c0bc514c9020b48e11edbe83ced2dda98055bfbd89216f98f9b97bf98665b6ce" May 27 23:45:12.465469 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.465431 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0bc514c9020b48e11edbe83ced2dda98055bfbd89216f98f9b97bf98665b6ce"} err="failed to get container status \"c0bc514c9020b48e11edbe83ced2dda98055bfbd89216f98f9b97bf98665b6ce\": rpc error: code = NotFound desc = could not find container \"c0bc514c9020b48e11edbe83ced2dda98055bfbd89216f98f9b97bf98665b6ce\": container with ID starting with c0bc514c9020b48e11edbe83ced2dda98055bfbd89216f98f9b97bf98665b6ce not found: ID does not exist" May 27 23:45:12.465520 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.465473 2556 scope.go:117] "RemoveContainer" containerID="e77dd1d60c754d1404557a44cd0ef0096faedc6bf63a23ae316ae2aa2a000922" May 27 23:45:12.465735 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:45:12.465718 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e77dd1d60c754d1404557a44cd0ef0096faedc6bf63a23ae316ae2aa2a000922\": container with ID starting with e77dd1d60c754d1404557a44cd0ef0096faedc6bf63a23ae316ae2aa2a000922 not found: ID does not exist" containerID="e77dd1d60c754d1404557a44cd0ef0096faedc6bf63a23ae316ae2aa2a000922" May 27 23:45:12.465775 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.465742 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e77dd1d60c754d1404557a44cd0ef0096faedc6bf63a23ae316ae2aa2a000922"} err="failed to get container status \"e77dd1d60c754d1404557a44cd0ef0096faedc6bf63a23ae316ae2aa2a000922\": rpc error: code = NotFound desc = could not find container \"e77dd1d60c754d1404557a44cd0ef0096faedc6bf63a23ae316ae2aa2a000922\": container with ID starting with e77dd1d60c754d1404557a44cd0ef0096faedc6bf63a23ae316ae2aa2a000922 not found: ID does not exist" May 27 23:45:12.465775 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.465759 2556 scope.go:117] "RemoveContainer" containerID="8c5d1ab49893f941c8a3852b315e85f759b7902bccf4b624039686f54a7d3716" May 27 23:45:12.465998 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:45:12.465982 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c5d1ab49893f941c8a3852b315e85f759b7902bccf4b624039686f54a7d3716\": container with ID starting with 8c5d1ab49893f941c8a3852b315e85f759b7902bccf4b624039686f54a7d3716 not found: ID does not exist" containerID="8c5d1ab49893f941c8a3852b315e85f759b7902bccf4b624039686f54a7d3716" May 27 23:45:12.466040 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.466003 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c5d1ab49893f941c8a3852b315e85f759b7902bccf4b624039686f54a7d3716"} err="failed to get container status \"8c5d1ab49893f941c8a3852b315e85f759b7902bccf4b624039686f54a7d3716\": rpc error: code = NotFound desc = could not find container \"8c5d1ab49893f941c8a3852b315e85f759b7902bccf4b624039686f54a7d3716\": container with ID starting with 8c5d1ab49893f941c8a3852b315e85f759b7902bccf4b624039686f54a7d3716 not found: ID does not exist" May 27 23:45:12.466040 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.466021 2556 scope.go:117] "RemoveContainer" containerID="ae102a9d8dfd3b635676046db96573442b10cf4b6ecf971ed70f0f0822dec7ae" May 27 23:45:12.466251 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:45:12.466234 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae102a9d8dfd3b635676046db96573442b10cf4b6ecf971ed70f0f0822dec7ae\": container with ID starting with ae102a9d8dfd3b635676046db96573442b10cf4b6ecf971ed70f0f0822dec7ae not found: ID does not exist" containerID="ae102a9d8dfd3b635676046db96573442b10cf4b6ecf971ed70f0f0822dec7ae" May 27 23:45:12.466287 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.466256 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae102a9d8dfd3b635676046db96573442b10cf4b6ecf971ed70f0f0822dec7ae"} err="failed to get container status \"ae102a9d8dfd3b635676046db96573442b10cf4b6ecf971ed70f0f0822dec7ae\": rpc error: code = NotFound desc = could not find container \"ae102a9d8dfd3b635676046db96573442b10cf4b6ecf971ed70f0f0822dec7ae\": container with ID starting with ae102a9d8dfd3b635676046db96573442b10cf4b6ecf971ed70f0f0822dec7ae not found: ID does not exist" May 27 23:45:12.466287 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.466271 2556 scope.go:117] "RemoveContainer" containerID="5440f19ace271a7edbad4a03028934493259b7bb804f52ab5ddc7b6d5ce23a84" May 27 23:45:12.466480 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:45:12.466465 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5440f19ace271a7edbad4a03028934493259b7bb804f52ab5ddc7b6d5ce23a84\": container with ID starting with 5440f19ace271a7edbad4a03028934493259b7bb804f52ab5ddc7b6d5ce23a84 not found: ID does not exist" containerID="5440f19ace271a7edbad4a03028934493259b7bb804f52ab5ddc7b6d5ce23a84" May 27 23:45:12.466521 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.466485 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5440f19ace271a7edbad4a03028934493259b7bb804f52ab5ddc7b6d5ce23a84"} err="failed to get container status \"5440f19ace271a7edbad4a03028934493259b7bb804f52ab5ddc7b6d5ce23a84\": rpc error: code = NotFound desc = could not find container \"5440f19ace271a7edbad4a03028934493259b7bb804f52ab5ddc7b6d5ce23a84\": container with ID starting with 5440f19ace271a7edbad4a03028934493259b7bb804f52ab5ddc7b6d5ce23a84 not found: ID does not exist" May 27 23:45:12.466521 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.466500 2556 scope.go:117] "RemoveContainer" containerID="860c21edb7b607c8d4eb3b91e8acc584f508e20fc2998fd7f5d2acbeb84e9775" May 27 23:45:12.466714 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:45:12.466695 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"860c21edb7b607c8d4eb3b91e8acc584f508e20fc2998fd7f5d2acbeb84e9775\": container with ID starting with 860c21edb7b607c8d4eb3b91e8acc584f508e20fc2998fd7f5d2acbeb84e9775 not found: ID does not exist" containerID="860c21edb7b607c8d4eb3b91e8acc584f508e20fc2998fd7f5d2acbeb84e9775" May 27 23:45:12.466773 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.466716 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"860c21edb7b607c8d4eb3b91e8acc584f508e20fc2998fd7f5d2acbeb84e9775"} err="failed to get container status \"860c21edb7b607c8d4eb3b91e8acc584f508e20fc2998fd7f5d2acbeb84e9775\": rpc error: code = NotFound desc = could not find container \"860c21edb7b607c8d4eb3b91e8acc584f508e20fc2998fd7f5d2acbeb84e9775\": container with ID starting with 860c21edb7b607c8d4eb3b91e8acc584f508e20fc2998fd7f5d2acbeb84e9775 not found: ID does not exist" May 27 23:45:12.466773 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.466729 2556 scope.go:117] "RemoveContainer" containerID="2501f145af577f920a8f82561f8eb72c06c20cdf7d524bfe8a952a09341c8c3d" May 27 23:45:12.466953 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:45:12.466938 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2501f145af577f920a8f82561f8eb72c06c20cdf7d524bfe8a952a09341c8c3d\": container with ID starting with 2501f145af577f920a8f82561f8eb72c06c20cdf7d524bfe8a952a09341c8c3d not found: ID does not exist" containerID="2501f145af577f920a8f82561f8eb72c06c20cdf7d524bfe8a952a09341c8c3d" May 27 23:45:12.466990 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.466975 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2501f145af577f920a8f82561f8eb72c06c20cdf7d524bfe8a952a09341c8c3d"} err="failed to get container status \"2501f145af577f920a8f82561f8eb72c06c20cdf7d524bfe8a952a09341c8c3d\": rpc error: code = NotFound desc = could not find container \"2501f145af577f920a8f82561f8eb72c06c20cdf7d524bfe8a952a09341c8c3d\": container with ID starting with 2501f145af577f920a8f82561f8eb72c06c20cdf7d524bfe8a952a09341c8c3d not found: ID does not exist" May 27 23:45:12.467025 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.466988 2556 scope.go:117] "RemoveContainer" containerID="c0bc514c9020b48e11edbe83ced2dda98055bfbd89216f98f9b97bf98665b6ce" May 27 23:45:12.467221 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.467203 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0bc514c9020b48e11edbe83ced2dda98055bfbd89216f98f9b97bf98665b6ce"} err="failed to get container status \"c0bc514c9020b48e11edbe83ced2dda98055bfbd89216f98f9b97bf98665b6ce\": rpc error: code = NotFound desc = could not find container \"c0bc514c9020b48e11edbe83ced2dda98055bfbd89216f98f9b97bf98665b6ce\": container with ID starting with c0bc514c9020b48e11edbe83ced2dda98055bfbd89216f98f9b97bf98665b6ce not found: ID does not exist" May 27 23:45:12.467265 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.467223 2556 scope.go:117] "RemoveContainer" containerID="e77dd1d60c754d1404557a44cd0ef0096faedc6bf63a23ae316ae2aa2a000922" May 27 23:45:12.467443 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.467423 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e77dd1d60c754d1404557a44cd0ef0096faedc6bf63a23ae316ae2aa2a000922"} err="failed to get container status \"e77dd1d60c754d1404557a44cd0ef0096faedc6bf63a23ae316ae2aa2a000922\": rpc error: code = NotFound desc = could not find container \"e77dd1d60c754d1404557a44cd0ef0096faedc6bf63a23ae316ae2aa2a000922\": container with ID starting with e77dd1d60c754d1404557a44cd0ef0096faedc6bf63a23ae316ae2aa2a000922 not found: ID does not exist" May 27 23:45:12.467522 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.467444 2556 scope.go:117] "RemoveContainer" containerID="8c5d1ab49893f941c8a3852b315e85f759b7902bccf4b624039686f54a7d3716" May 27 23:45:12.470273 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.467910 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c5d1ab49893f941c8a3852b315e85f759b7902bccf4b624039686f54a7d3716"} err="failed to get container status \"8c5d1ab49893f941c8a3852b315e85f759b7902bccf4b624039686f54a7d3716\": rpc error: code = NotFound desc = could not find container \"8c5d1ab49893f941c8a3852b315e85f759b7902bccf4b624039686f54a7d3716\": container with ID starting with 8c5d1ab49893f941c8a3852b315e85f759b7902bccf4b624039686f54a7d3716 not found: ID does not exist" May 27 23:45:12.470273 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.467938 2556 scope.go:117] "RemoveContainer" containerID="ae102a9d8dfd3b635676046db96573442b10cf4b6ecf971ed70f0f0822dec7ae" May 27 23:45:12.470273 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.468277 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae102a9d8dfd3b635676046db96573442b10cf4b6ecf971ed70f0f0822dec7ae"} err="failed to get container status \"ae102a9d8dfd3b635676046db96573442b10cf4b6ecf971ed70f0f0822dec7ae\": rpc error: code = NotFound desc = could not find container \"ae102a9d8dfd3b635676046db96573442b10cf4b6ecf971ed70f0f0822dec7ae\": container with ID starting with ae102a9d8dfd3b635676046db96573442b10cf4b6ecf971ed70f0f0822dec7ae not found: ID does not exist" May 27 23:45:12.470273 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.468301 2556 scope.go:117] "RemoveContainer" containerID="5440f19ace271a7edbad4a03028934493259b7bb804f52ab5ddc7b6d5ce23a84" May 27 23:45:12.470273 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.469237 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5440f19ace271a7edbad4a03028934493259b7bb804f52ab5ddc7b6d5ce23a84"} err="failed to get container status \"5440f19ace271a7edbad4a03028934493259b7bb804f52ab5ddc7b6d5ce23a84\": rpc error: code = NotFound desc = could not find container \"5440f19ace271a7edbad4a03028934493259b7bb804f52ab5ddc7b6d5ce23a84\": container with ID starting with 5440f19ace271a7edbad4a03028934493259b7bb804f52ab5ddc7b6d5ce23a84 not found: ID does not exist" May 27 23:45:12.470273 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.469271 2556 scope.go:117] "RemoveContainer" containerID="860c21edb7b607c8d4eb3b91e8acc584f508e20fc2998fd7f5d2acbeb84e9775" May 27 23:45:12.471206 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.471041 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"860c21edb7b607c8d4eb3b91e8acc584f508e20fc2998fd7f5d2acbeb84e9775"} err="failed to get container status \"860c21edb7b607c8d4eb3b91e8acc584f508e20fc2998fd7f5d2acbeb84e9775\": rpc error: code = NotFound desc = could not find container \"860c21edb7b607c8d4eb3b91e8acc584f508e20fc2998fd7f5d2acbeb84e9775\": container with ID starting with 860c21edb7b607c8d4eb3b91e8acc584f508e20fc2998fd7f5d2acbeb84e9775 not found: ID does not exist" May 27 23:45:12.471206 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.471067 2556 scope.go:117] "RemoveContainer" containerID="2501f145af577f920a8f82561f8eb72c06c20cdf7d524bfe8a952a09341c8c3d" May 27 23:45:12.471560 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.471528 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2501f145af577f920a8f82561f8eb72c06c20cdf7d524bfe8a952a09341c8c3d"} err="failed to get container status \"2501f145af577f920a8f82561f8eb72c06c20cdf7d524bfe8a952a09341c8c3d\": rpc error: code = NotFound desc = could not find container \"2501f145af577f920a8f82561f8eb72c06c20cdf7d524bfe8a952a09341c8c3d\": container with ID starting with 2501f145af577f920a8f82561f8eb72c06c20cdf7d524bfe8a952a09341c8c3d not found: ID does not exist" May 27 23:45:12.473065 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.472600 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 23:45:12.473065 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.473051 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="317230ab-b3eb-4589-8672-e88816788de8" containerName="kube-rbac-proxy" May 27 23:45:12.473065 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.473068 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="317230ab-b3eb-4589-8672-e88816788de8" containerName="kube-rbac-proxy" May 27 23:45:12.473315 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.473089 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="317230ab-b3eb-4589-8672-e88816788de8" containerName="kube-rbac-proxy-web" May 27 23:45:12.473315 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.473098 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="317230ab-b3eb-4589-8672-e88816788de8" containerName="kube-rbac-proxy-web" May 27 23:45:12.473315 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.473107 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="317230ab-b3eb-4589-8672-e88816788de8" containerName="kube-rbac-proxy-metric" May 27 23:45:12.473315 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.473115 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="317230ab-b3eb-4589-8672-e88816788de8" containerName="kube-rbac-proxy-metric" May 27 23:45:12.473315 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.473147 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="317230ab-b3eb-4589-8672-e88816788de8" containerName="init-config-reloader" May 27 23:45:12.473315 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.473154 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="317230ab-b3eb-4589-8672-e88816788de8" containerName="init-config-reloader" May 27 23:45:12.473315 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.473162 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="317230ab-b3eb-4589-8672-e88816788de8" containerName="config-reloader" May 27 23:45:12.473315 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.473169 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="317230ab-b3eb-4589-8672-e88816788de8" containerName="config-reloader" May 27 23:45:12.473315 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.473181 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="317230ab-b3eb-4589-8672-e88816788de8" containerName="prom-label-proxy" May 27 23:45:12.473315 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.473188 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="317230ab-b3eb-4589-8672-e88816788de8" containerName="prom-label-proxy" May 27 23:45:12.473315 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.473198 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="317230ab-b3eb-4589-8672-e88816788de8" containerName="alertmanager" May 27 23:45:12.473315 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.473205 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="317230ab-b3eb-4589-8672-e88816788de8" containerName="alertmanager" May 27 23:45:12.473315 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.473291 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="317230ab-b3eb-4589-8672-e88816788de8" containerName="kube-rbac-proxy" May 27 23:45:12.473315 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.473304 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="317230ab-b3eb-4589-8672-e88816788de8" containerName="prom-label-proxy" May 27 23:45:12.473315 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.473314 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="317230ab-b3eb-4589-8672-e88816788de8" containerName="kube-rbac-proxy-metric" May 27 23:45:12.473315 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.473325 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="317230ab-b3eb-4589-8672-e88816788de8" containerName="alertmanager" May 27 23:45:12.473814 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.473337 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="317230ab-b3eb-4589-8672-e88816788de8" containerName="kube-rbac-proxy-web" May 27 23:45:12.473814 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.473348 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="317230ab-b3eb-4589-8672-e88816788de8" containerName="config-reloader" May 27 23:45:12.480294 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.480272 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 27 23:45:12.482762 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.482741 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 27 23:45:12.482880 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.482788 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-w88hk\"" May 27 23:45:12.482880 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.482741 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 27 23:45:12.482880 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.482775 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 27 23:45:12.483027 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.483006 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 27 23:45:12.483079 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.483062 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 27 23:45:12.483189 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.483167 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 27 23:45:12.483260 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.483238 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 27 23:45:12.483457 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.483441 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 27 23:45:12.488104 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.488084 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 23:45:12.489224 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.489205 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 27 23:45:12.528618 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.528589 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bcdbbf82-9272-45f2-b005-9d72e325a067-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bcdbbf82-9272-45f2-b005-9d72e325a067\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:45:12.528779 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.528624 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcdbbf82-9272-45f2-b005-9d72e325a067-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bcdbbf82-9272-45f2-b005-9d72e325a067\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:45:12.528779 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.528673 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bcdbbf82-9272-45f2-b005-9d72e325a067-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bcdbbf82-9272-45f2-b005-9d72e325a067\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:45:12.528779 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.528690 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfd7w\" (UniqueName: \"kubernetes.io/projected/bcdbbf82-9272-45f2-b005-9d72e325a067-kube-api-access-rfd7w\") pod \"alertmanager-main-0\" (UID: \"bcdbbf82-9272-45f2-b005-9d72e325a067\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:45:12.528779 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.528707 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bcdbbf82-9272-45f2-b005-9d72e325a067-config-out\") pod \"alertmanager-main-0\" (UID: \"bcdbbf82-9272-45f2-b005-9d72e325a067\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:45:12.528779 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.528734 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bcdbbf82-9272-45f2-b005-9d72e325a067-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bcdbbf82-9272-45f2-b005-9d72e325a067\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:45:12.528957 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.528796 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bcdbbf82-9272-45f2-b005-9d72e325a067-web-config\") pod \"alertmanager-main-0\" (UID: \"bcdbbf82-9272-45f2-b005-9d72e325a067\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:45:12.528957 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.528812 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bcdbbf82-9272-45f2-b005-9d72e325a067-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bcdbbf82-9272-45f2-b005-9d72e325a067\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:45:12.528957 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.528850 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bcdbbf82-9272-45f2-b005-9d72e325a067-config-volume\") pod \"alertmanager-main-0\" (UID: \"bcdbbf82-9272-45f2-b005-9d72e325a067\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:45:12.528957 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.528879 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bcdbbf82-9272-45f2-b005-9d72e325a067-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bcdbbf82-9272-45f2-b005-9d72e325a067\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:45:12.528957 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.528928 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bcdbbf82-9272-45f2-b005-9d72e325a067-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bcdbbf82-9272-45f2-b005-9d72e325a067\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:45:12.529122 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.528964 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bcdbbf82-9272-45f2-b005-9d72e325a067-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bcdbbf82-9272-45f2-b005-9d72e325a067\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:45:12.529122 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.528991 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bcdbbf82-9272-45f2-b005-9d72e325a067-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bcdbbf82-9272-45f2-b005-9d72e325a067\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:45:12.629739 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.629707 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bcdbbf82-9272-45f2-b005-9d72e325a067-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bcdbbf82-9272-45f2-b005-9d72e325a067\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:45:12.629912 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.629749 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bcdbbf82-9272-45f2-b005-9d72e325a067-web-config\") pod \"alertmanager-main-0\" (UID: \"bcdbbf82-9272-45f2-b005-9d72e325a067\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:45:12.629912 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.629766 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bcdbbf82-9272-45f2-b005-9d72e325a067-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bcdbbf82-9272-45f2-b005-9d72e325a067\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:45:12.629912 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.629798 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bcdbbf82-9272-45f2-b005-9d72e325a067-config-volume\") pod \"alertmanager-main-0\" (UID: \"bcdbbf82-9272-45f2-b005-9d72e325a067\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:45:12.629912 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.629825 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bcdbbf82-9272-45f2-b005-9d72e325a067-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bcdbbf82-9272-45f2-b005-9d72e325a067\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:45:12.629912 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.629845 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bcdbbf82-9272-45f2-b005-9d72e325a067-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bcdbbf82-9272-45f2-b005-9d72e325a067\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:45:12.629912 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.629862 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bcdbbf82-9272-45f2-b005-9d72e325a067-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bcdbbf82-9272-45f2-b005-9d72e325a067\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:45:12.629912 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.629892 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bcdbbf82-9272-45f2-b005-9d72e325a067-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bcdbbf82-9272-45f2-b005-9d72e325a067\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:45:12.630276 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.629939 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bcdbbf82-9272-45f2-b005-9d72e325a067-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bcdbbf82-9272-45f2-b005-9d72e325a067\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:45:12.630276 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.629969 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcdbbf82-9272-45f2-b005-9d72e325a067-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bcdbbf82-9272-45f2-b005-9d72e325a067\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:45:12.630276 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.629999 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bcdbbf82-9272-45f2-b005-9d72e325a067-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bcdbbf82-9272-45f2-b005-9d72e325a067\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:45:12.630276 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.630020 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rfd7w\" (UniqueName: \"kubernetes.io/projected/bcdbbf82-9272-45f2-b005-9d72e325a067-kube-api-access-rfd7w\") pod \"alertmanager-main-0\" (UID: \"bcdbbf82-9272-45f2-b005-9d72e325a067\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:45:12.630276 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.630043 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bcdbbf82-9272-45f2-b005-9d72e325a067-config-out\") pod \"alertmanager-main-0\" (UID: \"bcdbbf82-9272-45f2-b005-9d72e325a067\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:45:12.630276 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.630207 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bcdbbf82-9272-45f2-b005-9d72e325a067-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bcdbbf82-9272-45f2-b005-9d72e325a067\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:45:12.631446 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.631413 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcdbbf82-9272-45f2-b005-9d72e325a067-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bcdbbf82-9272-45f2-b005-9d72e325a067\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:45:12.632790 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.632697 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bcdbbf82-9272-45f2-b005-9d72e325a067-config-out\") pod \"alertmanager-main-0\" (UID: \"bcdbbf82-9272-45f2-b005-9d72e325a067\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:45:12.633219 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.632937 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bcdbbf82-9272-45f2-b005-9d72e325a067-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bcdbbf82-9272-45f2-b005-9d72e325a067\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:45:12.633219 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.632976 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bcdbbf82-9272-45f2-b005-9d72e325a067-config-volume\") pod \"alertmanager-main-0\" (UID: \"bcdbbf82-9272-45f2-b005-9d72e325a067\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:45:12.633219 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.633151 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bcdbbf82-9272-45f2-b005-9d72e325a067-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bcdbbf82-9272-45f2-b005-9d72e325a067\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:45:12.633219 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.633168 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bcdbbf82-9272-45f2-b005-9d72e325a067-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bcdbbf82-9272-45f2-b005-9d72e325a067\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:45:12.633410 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.633238 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bcdbbf82-9272-45f2-b005-9d72e325a067-web-config\") pod \"alertmanager-main-0\" (UID: \"bcdbbf82-9272-45f2-b005-9d72e325a067\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:45:12.633446 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.633419 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bcdbbf82-9272-45f2-b005-9d72e325a067-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bcdbbf82-9272-45f2-b005-9d72e325a067\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:45:12.633655 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.633616 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bcdbbf82-9272-45f2-b005-9d72e325a067-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bcdbbf82-9272-45f2-b005-9d72e325a067\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:45:12.634103 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.634081 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bcdbbf82-9272-45f2-b005-9d72e325a067-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bcdbbf82-9272-45f2-b005-9d72e325a067\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:45:12.635158 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.635141 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bcdbbf82-9272-45f2-b005-9d72e325a067-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bcdbbf82-9272-45f2-b005-9d72e325a067\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:45:12.641947 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.641929 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfd7w\" (UniqueName: \"kubernetes.io/projected/bcdbbf82-9272-45f2-b005-9d72e325a067-kube-api-access-rfd7w\") pod \"alertmanager-main-0\" (UID: \"bcdbbf82-9272-45f2-b005-9d72e325a067\") " pod="openshift-monitoring/alertmanager-main-0" May 27 23:45:12.791455 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.791422 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 27 23:45:12.930443 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:45:12.930404 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcdbbf82_9272_45f2_b005_9d72e325a067.slice/crio-ed2df09b366489bf9e731b21f572b7cf68bb2994e6b2b6cffc41552b26e40d95 WatchSource:0}: Error finding container ed2df09b366489bf9e731b21f572b7cf68bb2994e6b2b6cffc41552b26e40d95: Status 404 returned error can't find the container with id ed2df09b366489bf9e731b21f572b7cf68bb2994e6b2b6cffc41552b26e40d95 May 27 23:45:12.931390 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:12.931360 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 23:45:13.418901 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:13.418866 2556 generic.go:358] "Generic (PLEG): container finished" podID="bcdbbf82-9272-45f2-b005-9d72e325a067" containerID="846038a0efa0952e279d6f4d29877c13af9f6662f8443b3ea2376454b72bb484" exitCode=0 May 27 23:45:13.419058 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:13.418957 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bcdbbf82-9272-45f2-b005-9d72e325a067","Type":"ContainerDied","Data":"846038a0efa0952e279d6f4d29877c13af9f6662f8443b3ea2376454b72bb484"} May 27 23:45:13.419058 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:13.419000 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bcdbbf82-9272-45f2-b005-9d72e325a067","Type":"ContainerStarted","Data":"ed2df09b366489bf9e731b21f572b7cf68bb2994e6b2b6cffc41552b26e40d95"} May 27 23:45:13.652937 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:13.652906 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="317230ab-b3eb-4589-8672-e88816788de8" path="/var/lib/kubelet/pods/317230ab-b3eb-4589-8672-e88816788de8/volumes" May 27 23:45:14.427486 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:14.427453 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bcdbbf82-9272-45f2-b005-9d72e325a067","Type":"ContainerStarted","Data":"5fdfd1264b1ad489163ef5e5508396148c2642ae7ed4cf9c77064e7c1dee9de6"} May 27 23:45:14.428068 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:14.427492 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bcdbbf82-9272-45f2-b005-9d72e325a067","Type":"ContainerStarted","Data":"b59700fc9bebf5f0e9e60b36de37e5a289cb79f4acced330c394cae619cb8be8"} May 27 23:45:14.428068 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:14.427509 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bcdbbf82-9272-45f2-b005-9d72e325a067","Type":"ContainerStarted","Data":"42199db0f22d462a20ac981c5d0585be02e0e30c2d51882ce1b51374fc55e92c"} May 27 23:45:14.428068 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:14.427520 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bcdbbf82-9272-45f2-b005-9d72e325a067","Type":"ContainerStarted","Data":"de2b2de455b2c41e177a2bf240e440600a32ae39210da353f0f8dacb879466b5"} May 27 23:45:14.428068 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:14.427532 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bcdbbf82-9272-45f2-b005-9d72e325a067","Type":"ContainerStarted","Data":"f3c4781e5d0549aa6fe3d88eb885784982ffe344f8b1ee6eb244e6a1c0bcd18f"} May 27 23:45:14.428068 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:14.427543 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bcdbbf82-9272-45f2-b005-9d72e325a067","Type":"ContainerStarted","Data":"7bdcaa258d0aa69188b4fef6075a50ab86219e26ea5828388e60799b7f8f1dc6"} May 27 23:45:14.468746 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:14.468695 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.4686799170000002 podStartE2EDuration="2.468679917s" podCreationTimestamp="2026-05-27 23:45:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 23:45:14.467347083 +0000 UTC m=+257.394248666" watchObservedRunningTime="2026-05-27 23:45:14.468679917 +0000 UTC m=+257.395581507" May 27 23:45:14.770324 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:14.770289 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 27 23:45:14.770763 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:14.770725 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f3ed4027-ef2d-43f2-b791-294fa6589ece" containerName="prometheus" containerID="cri-o://81d8c5b4c5eb26d5727f21fa507cb75a82fa1a1ff7b56c7029d2d2d2ec6baa3d" gracePeriod=600 May 27 23:45:14.770763 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:14.770731 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f3ed4027-ef2d-43f2-b791-294fa6589ece" containerName="kube-rbac-proxy" containerID="cri-o://eebda7d4d835dc5384be0e690493e14f157a0ac6e73a198ef0eaebbda6ac321c" gracePeriod=600 May 27 23:45:14.770959 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:14.770778 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f3ed4027-ef2d-43f2-b791-294fa6589ece" containerName="thanos-sidecar" containerID="cri-o://c7cf9f610d465a0fa762f7777b7a56e8768d9cb76b6a5c1bd6e4fd76ff5f08aa" gracePeriod=600 May 27 23:45:14.770959 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:14.770802 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f3ed4027-ef2d-43f2-b791-294fa6589ece" containerName="kube-rbac-proxy-thanos" containerID="cri-o://722663a21d124393ac1b6622ace8a1997e7311c3a054999da110d2d793ba4fb4" gracePeriod=600 May 27 23:45:14.770959 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:14.770818 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f3ed4027-ef2d-43f2-b791-294fa6589ece" containerName="config-reloader" containerID="cri-o://e02e4b004989e0dc2cfbbf7d03f88219638f1d0f3c1394798b0505ead8d77e18" gracePeriod=600 May 27 23:45:14.770959 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:14.770783 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f3ed4027-ef2d-43f2-b791-294fa6589ece" containerName="kube-rbac-proxy-web" containerID="cri-o://48803f17f32ca3466c7ef45f8a4b73c13afc0e554870054bf315460f3cf874c7" gracePeriod=600 May 27 23:45:15.019331 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.019306 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.151999 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.151909 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-secret-prometheus-k8s-tls\") pod \"f3ed4027-ef2d-43f2-b791-294fa6589ece\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " May 27 23:45:15.151999 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.151952 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f3ed4027-ef2d-43f2-b791-294fa6589ece-config-out\") pod \"f3ed4027-ef2d-43f2-b791-294fa6589ece\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " May 27 23:45:15.151999 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.151978 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3ed4027-ef2d-43f2-b791-294fa6589ece-configmap-metrics-client-ca\") pod \"f3ed4027-ef2d-43f2-b791-294fa6589ece\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " May 27 23:45:15.151999 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.151996 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f3ed4027-ef2d-43f2-b791-294fa6589ece-prometheus-k8s-db\") pod \"f3ed4027-ef2d-43f2-b791-294fa6589ece\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " May 27 23:45:15.152257 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.152043 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-secret-grpc-tls\") pod \"f3ed4027-ef2d-43f2-b791-294fa6589ece\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " May 27 23:45:15.152257 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.152075 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f3ed4027-ef2d-43f2-b791-294fa6589ece-tls-assets\") pod \"f3ed4027-ef2d-43f2-b791-294fa6589ece\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " May 27 23:45:15.152257 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.152096 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-web-config\") pod \"f3ed4027-ef2d-43f2-b791-294fa6589ece\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " May 27 23:45:15.152257 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.152133 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"f3ed4027-ef2d-43f2-b791-294fa6589ece\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " May 27 23:45:15.152257 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.152163 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3ed4027-ef2d-43f2-b791-294fa6589ece-configmap-serving-certs-ca-bundle\") pod \"f3ed4027-ef2d-43f2-b791-294fa6589ece\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " May 27 23:45:15.152257 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.152190 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3ed4027-ef2d-43f2-b791-294fa6589ece-prometheus-trusted-ca-bundle\") pod \"f3ed4027-ef2d-43f2-b791-294fa6589ece\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " May 27 23:45:15.152257 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.152218 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mzlc\" (UniqueName: \"kubernetes.io/projected/f3ed4027-ef2d-43f2-b791-294fa6589ece-kube-api-access-7mzlc\") pod \"f3ed4027-ef2d-43f2-b791-294fa6589ece\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " May 27 23:45:15.152257 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.152253 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-secret-metrics-client-certs\") pod \"f3ed4027-ef2d-43f2-b791-294fa6589ece\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " May 27 23:45:15.152625 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.152302 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"f3ed4027-ef2d-43f2-b791-294fa6589ece\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " May 27 23:45:15.152625 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.152334 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3ed4027-ef2d-43f2-b791-294fa6589ece-configmap-kubelet-serving-ca-bundle\") pod \"f3ed4027-ef2d-43f2-b791-294fa6589ece\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " May 27 23:45:15.152625 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.152362 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-thanos-prometheus-http-client-file\") pod \"f3ed4027-ef2d-43f2-b791-294fa6589ece\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " May 27 23:45:15.152625 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.152390 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-secret-kube-rbac-proxy\") pod \"f3ed4027-ef2d-43f2-b791-294fa6589ece\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " May 27 23:45:15.152625 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.152389 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3ed4027-ef2d-43f2-b791-294fa6589ece-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "f3ed4027-ef2d-43f2-b791-294fa6589ece" (UID: "f3ed4027-ef2d-43f2-b791-294fa6589ece"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 23:45:15.152625 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.152418 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f3ed4027-ef2d-43f2-b791-294fa6589ece-prometheus-k8s-rulefiles-0\") pod \"f3ed4027-ef2d-43f2-b791-294fa6589ece\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " May 27 23:45:15.152625 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.152466 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-config\") pod \"f3ed4027-ef2d-43f2-b791-294fa6589ece\" (UID: \"f3ed4027-ef2d-43f2-b791-294fa6589ece\") " May 27 23:45:15.153044 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.152695 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3ed4027-ef2d-43f2-b791-294fa6589ece-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "f3ed4027-ef2d-43f2-b791-294fa6589ece" (UID: "f3ed4027-ef2d-43f2-b791-294fa6589ece"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 23:45:15.153044 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.152836 2556 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3ed4027-ef2d-43f2-b791-294fa6589ece-configmap-metrics-client-ca\") on node \"ip-10-0-128-22.ec2.internal\" DevicePath \"\"" May 27 23:45:15.153044 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.152858 2556 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3ed4027-ef2d-43f2-b791-294fa6589ece-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-22.ec2.internal\" DevicePath \"\"" May 27 23:45:15.154405 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.154141 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3ed4027-ef2d-43f2-b791-294fa6589ece-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "f3ed4027-ef2d-43f2-b791-294fa6589ece" (UID: "f3ed4027-ef2d-43f2-b791-294fa6589ece"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 23:45:15.154782 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.154744 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "f3ed4027-ef2d-43f2-b791-294fa6589ece" (UID: "f3ed4027-ef2d-43f2-b791-294fa6589ece"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 23:45:15.154926 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.154804 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "f3ed4027-ef2d-43f2-b791-294fa6589ece" (UID: "f3ed4027-ef2d-43f2-b791-294fa6589ece"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 23:45:15.155124 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.155095 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3ed4027-ef2d-43f2-b791-294fa6589ece-config-out" (OuterVolumeSpecName: "config-out") pod "f3ed4027-ef2d-43f2-b791-294fa6589ece" (UID: "f3ed4027-ef2d-43f2-b791-294fa6589ece"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 23:45:15.155124 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.155118 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3ed4027-ef2d-43f2-b791-294fa6589ece-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "f3ed4027-ef2d-43f2-b791-294fa6589ece" (UID: "f3ed4027-ef2d-43f2-b791-294fa6589ece"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 23:45:15.155288 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.155266 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-config" (OuterVolumeSpecName: "config") pod "f3ed4027-ef2d-43f2-b791-294fa6589ece" (UID: "f3ed4027-ef2d-43f2-b791-294fa6589ece"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 23:45:15.155347 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.155323 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "f3ed4027-ef2d-43f2-b791-294fa6589ece" (UID: "f3ed4027-ef2d-43f2-b791-294fa6589ece"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 23:45:15.155705 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.155679 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3ed4027-ef2d-43f2-b791-294fa6589ece-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "f3ed4027-ef2d-43f2-b791-294fa6589ece" (UID: "f3ed4027-ef2d-43f2-b791-294fa6589ece"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 23:45:15.155798 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.155704 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3ed4027-ef2d-43f2-b791-294fa6589ece-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "f3ed4027-ef2d-43f2-b791-294fa6589ece" (UID: "f3ed4027-ef2d-43f2-b791-294fa6589ece"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 23:45:15.156562 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.156524 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "f3ed4027-ef2d-43f2-b791-294fa6589ece" (UID: "f3ed4027-ef2d-43f2-b791-294fa6589ece"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 23:45:15.156847 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.156825 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3ed4027-ef2d-43f2-b791-294fa6589ece-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "f3ed4027-ef2d-43f2-b791-294fa6589ece" (UID: "f3ed4027-ef2d-43f2-b791-294fa6589ece"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 23:45:15.156975 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.156954 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "f3ed4027-ef2d-43f2-b791-294fa6589ece" (UID: "f3ed4027-ef2d-43f2-b791-294fa6589ece"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 23:45:15.157193 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.157178 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3ed4027-ef2d-43f2-b791-294fa6589ece-kube-api-access-7mzlc" (OuterVolumeSpecName: "kube-api-access-7mzlc") pod "f3ed4027-ef2d-43f2-b791-294fa6589ece" (UID: "f3ed4027-ef2d-43f2-b791-294fa6589ece"). InnerVolumeSpecName "kube-api-access-7mzlc". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 23:45:15.157335 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.157309 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "f3ed4027-ef2d-43f2-b791-294fa6589ece" (UID: "f3ed4027-ef2d-43f2-b791-294fa6589ece"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 23:45:15.157719 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.157698 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "f3ed4027-ef2d-43f2-b791-294fa6589ece" (UID: "f3ed4027-ef2d-43f2-b791-294fa6589ece"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 23:45:15.166406 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.166385 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-web-config" (OuterVolumeSpecName: "web-config") pod "f3ed4027-ef2d-43f2-b791-294fa6589ece" (UID: "f3ed4027-ef2d-43f2-b791-294fa6589ece"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 23:45:15.253816 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.253778 2556 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-secret-grpc-tls\") on node \"ip-10-0-128-22.ec2.internal\" DevicePath \"\"" May 27 23:45:15.253816 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.253808 2556 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f3ed4027-ef2d-43f2-b791-294fa6589ece-tls-assets\") on node \"ip-10-0-128-22.ec2.internal\" DevicePath \"\"" May 27 23:45:15.253816 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.253817 2556 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-web-config\") on node \"ip-10-0-128-22.ec2.internal\" DevicePath \"\"" May 27 23:45:15.253816 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.253827 2556 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-22.ec2.internal\" DevicePath \"\"" May 27 23:45:15.254086 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.253840 2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3ed4027-ef2d-43f2-b791-294fa6589ece-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-22.ec2.internal\" DevicePath \"\"" May 27 23:45:15.254086 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.253850 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7mzlc\" (UniqueName: \"kubernetes.io/projected/f3ed4027-ef2d-43f2-b791-294fa6589ece-kube-api-access-7mzlc\") on node \"ip-10-0-128-22.ec2.internal\" DevicePath \"\"" May 27 23:45:15.254086 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.253860 2556 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-secret-metrics-client-certs\") on node \"ip-10-0-128-22.ec2.internal\" DevicePath \"\"" May 27 23:45:15.254086 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.253869 2556 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-22.ec2.internal\" DevicePath \"\"" May 27 23:45:15.254086 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.253890 2556 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3ed4027-ef2d-43f2-b791-294fa6589ece-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-22.ec2.internal\" DevicePath \"\"" May 27 23:45:15.254086 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.253899 2556 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-22.ec2.internal\" DevicePath \"\"" May 27 23:45:15.254086 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.253908 2556 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-secret-kube-rbac-proxy\") on node \"ip-10-0-128-22.ec2.internal\" DevicePath \"\"" May 27 23:45:15.254086 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.253917 2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f3ed4027-ef2d-43f2-b791-294fa6589ece-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-22.ec2.internal\" DevicePath \"\"" May 27 23:45:15.254086 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.253927 2556 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-config\") on node \"ip-10-0-128-22.ec2.internal\" DevicePath \"\"" May 27 23:45:15.254086 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.253935 2556 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f3ed4027-ef2d-43f2-b791-294fa6589ece-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-22.ec2.internal\" DevicePath \"\"" May 27 23:45:15.254086 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.253944 2556 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f3ed4027-ef2d-43f2-b791-294fa6589ece-config-out\") on node \"ip-10-0-128-22.ec2.internal\" DevicePath \"\"" May 27 23:45:15.254086 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.253952 2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f3ed4027-ef2d-43f2-b791-294fa6589ece-prometheus-k8s-db\") on node \"ip-10-0-128-22.ec2.internal\" DevicePath \"\"" May 27 23:45:15.433444 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.433366 2556 generic.go:358] "Generic (PLEG): container finished" podID="f3ed4027-ef2d-43f2-b791-294fa6589ece" containerID="722663a21d124393ac1b6622ace8a1997e7311c3a054999da110d2d793ba4fb4" exitCode=0 May 27 23:45:15.433444 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.433391 2556 generic.go:358] "Generic (PLEG): container finished" podID="f3ed4027-ef2d-43f2-b791-294fa6589ece" containerID="eebda7d4d835dc5384be0e690493e14f157a0ac6e73a198ef0eaebbda6ac321c" exitCode=0 May 27 23:45:15.433444 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.433398 2556 generic.go:358] "Generic (PLEG): container finished" podID="f3ed4027-ef2d-43f2-b791-294fa6589ece" containerID="48803f17f32ca3466c7ef45f8a4b73c13afc0e554870054bf315460f3cf874c7" exitCode=0 May 27 23:45:15.433444 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.433404 2556 generic.go:358] "Generic (PLEG): container finished" podID="f3ed4027-ef2d-43f2-b791-294fa6589ece" containerID="c7cf9f610d465a0fa762f7777b7a56e8768d9cb76b6a5c1bd6e4fd76ff5f08aa" exitCode=0 May 27 23:45:15.433444 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.433411 2556 generic.go:358] "Generic (PLEG): container finished" podID="f3ed4027-ef2d-43f2-b791-294fa6589ece" containerID="e02e4b004989e0dc2cfbbf7d03f88219638f1d0f3c1394798b0505ead8d77e18" exitCode=0 May 27 23:45:15.433444 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.433420 2556 generic.go:358] "Generic (PLEG): container finished" podID="f3ed4027-ef2d-43f2-b791-294fa6589ece" containerID="81d8c5b4c5eb26d5727f21fa507cb75a82fa1a1ff7b56c7029d2d2d2ec6baa3d" exitCode=0 May 27 23:45:15.433444 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.433435 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3ed4027-ef2d-43f2-b791-294fa6589ece","Type":"ContainerDied","Data":"722663a21d124393ac1b6622ace8a1997e7311c3a054999da110d2d793ba4fb4"} May 27 23:45:15.434126 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.433465 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.434126 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.433482 2556 scope.go:117] "RemoveContainer" containerID="722663a21d124393ac1b6622ace8a1997e7311c3a054999da110d2d793ba4fb4" May 27 23:45:15.434126 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.433469 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3ed4027-ef2d-43f2-b791-294fa6589ece","Type":"ContainerDied","Data":"eebda7d4d835dc5384be0e690493e14f157a0ac6e73a198ef0eaebbda6ac321c"} May 27 23:45:15.434126 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.433600 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3ed4027-ef2d-43f2-b791-294fa6589ece","Type":"ContainerDied","Data":"48803f17f32ca3466c7ef45f8a4b73c13afc0e554870054bf315460f3cf874c7"} May 27 23:45:15.434126 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.433615 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3ed4027-ef2d-43f2-b791-294fa6589ece","Type":"ContainerDied","Data":"c7cf9f610d465a0fa762f7777b7a56e8768d9cb76b6a5c1bd6e4fd76ff5f08aa"} May 27 23:45:15.434126 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.433627 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3ed4027-ef2d-43f2-b791-294fa6589ece","Type":"ContainerDied","Data":"e02e4b004989e0dc2cfbbf7d03f88219638f1d0f3c1394798b0505ead8d77e18"} May 27 23:45:15.434126 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.433666 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3ed4027-ef2d-43f2-b791-294fa6589ece","Type":"ContainerDied","Data":"81d8c5b4c5eb26d5727f21fa507cb75a82fa1a1ff7b56c7029d2d2d2ec6baa3d"} May 27 23:45:15.434126 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.433683 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3ed4027-ef2d-43f2-b791-294fa6589ece","Type":"ContainerDied","Data":"f7b3b02d4b07720873bddfb52fcf3ee941209b3559773999feac1dd37662ca8a"} May 27 23:45:15.441806 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.441621 2556 scope.go:117] "RemoveContainer" containerID="eebda7d4d835dc5384be0e690493e14f157a0ac6e73a198ef0eaebbda6ac321c" May 27 23:45:15.448791 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.448774 2556 scope.go:117] "RemoveContainer" containerID="48803f17f32ca3466c7ef45f8a4b73c13afc0e554870054bf315460f3cf874c7" May 27 23:45:15.455151 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.455135 2556 scope.go:117] "RemoveContainer" containerID="c7cf9f610d465a0fa762f7777b7a56e8768d9cb76b6a5c1bd6e4fd76ff5f08aa" May 27 23:45:15.458910 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.458866 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 27 23:45:15.462719 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.462697 2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 27 23:45:15.463218 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.463207 2556 scope.go:117] "RemoveContainer" containerID="e02e4b004989e0dc2cfbbf7d03f88219638f1d0f3c1394798b0505ead8d77e18" May 27 23:45:15.470187 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.470167 2556 scope.go:117] "RemoveContainer" containerID="81d8c5b4c5eb26d5727f21fa507cb75a82fa1a1ff7b56c7029d2d2d2ec6baa3d" May 27 23:45:15.477654 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.477599 2556 scope.go:117] "RemoveContainer" containerID="3c179ec94cae437de5ac3233bfcd6da6f93c1fdf5844323883f2238ddb9256b8" May 27 23:45:15.484271 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.484238 2556 scope.go:117] "RemoveContainer" containerID="722663a21d124393ac1b6622ace8a1997e7311c3a054999da110d2d793ba4fb4" May 27 23:45:15.484518 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:45:15.484490 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"722663a21d124393ac1b6622ace8a1997e7311c3a054999da110d2d793ba4fb4\": container with ID starting with 722663a21d124393ac1b6622ace8a1997e7311c3a054999da110d2d793ba4fb4 not found: ID does not exist" containerID="722663a21d124393ac1b6622ace8a1997e7311c3a054999da110d2d793ba4fb4" May 27 23:45:15.484592 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.484525 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"722663a21d124393ac1b6622ace8a1997e7311c3a054999da110d2d793ba4fb4"} err="failed to get container status \"722663a21d124393ac1b6622ace8a1997e7311c3a054999da110d2d793ba4fb4\": rpc error: code = NotFound desc = could not find container \"722663a21d124393ac1b6622ace8a1997e7311c3a054999da110d2d793ba4fb4\": container with ID starting with 722663a21d124393ac1b6622ace8a1997e7311c3a054999da110d2d793ba4fb4 not found: ID does not exist" May 27 23:45:15.484592 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.484544 2556 scope.go:117] "RemoveContainer" containerID="eebda7d4d835dc5384be0e690493e14f157a0ac6e73a198ef0eaebbda6ac321c" May 27 23:45:15.484843 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:45:15.484823 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eebda7d4d835dc5384be0e690493e14f157a0ac6e73a198ef0eaebbda6ac321c\": container with ID starting with eebda7d4d835dc5384be0e690493e14f157a0ac6e73a198ef0eaebbda6ac321c not found: ID does not exist" containerID="eebda7d4d835dc5384be0e690493e14f157a0ac6e73a198ef0eaebbda6ac321c" May 27 23:45:15.484964 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.484849 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eebda7d4d835dc5384be0e690493e14f157a0ac6e73a198ef0eaebbda6ac321c"} err="failed to get container status \"eebda7d4d835dc5384be0e690493e14f157a0ac6e73a198ef0eaebbda6ac321c\": rpc error: code = NotFound desc = could not find container \"eebda7d4d835dc5384be0e690493e14f157a0ac6e73a198ef0eaebbda6ac321c\": container with ID starting with eebda7d4d835dc5384be0e690493e14f157a0ac6e73a198ef0eaebbda6ac321c not found: ID does not exist" May 27 23:45:15.484964 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.484868 2556 scope.go:117] "RemoveContainer" containerID="48803f17f32ca3466c7ef45f8a4b73c13afc0e554870054bf315460f3cf874c7" May 27 23:45:15.485143 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:45:15.485125 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48803f17f32ca3466c7ef45f8a4b73c13afc0e554870054bf315460f3cf874c7\": container with ID starting with 48803f17f32ca3466c7ef45f8a4b73c13afc0e554870054bf315460f3cf874c7 not found: ID does not exist" containerID="48803f17f32ca3466c7ef45f8a4b73c13afc0e554870054bf315460f3cf874c7" May 27 23:45:15.485179 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.485148 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48803f17f32ca3466c7ef45f8a4b73c13afc0e554870054bf315460f3cf874c7"} err="failed to get container status \"48803f17f32ca3466c7ef45f8a4b73c13afc0e554870054bf315460f3cf874c7\": rpc error: code = NotFound desc = could not find container \"48803f17f32ca3466c7ef45f8a4b73c13afc0e554870054bf315460f3cf874c7\": container with ID starting with 48803f17f32ca3466c7ef45f8a4b73c13afc0e554870054bf315460f3cf874c7 not found: ID does not exist" May 27 23:45:15.485179 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.485166 2556 scope.go:117] "RemoveContainer" containerID="c7cf9f610d465a0fa762f7777b7a56e8768d9cb76b6a5c1bd6e4fd76ff5f08aa" May 27 23:45:15.485413 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:45:15.485396 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7cf9f610d465a0fa762f7777b7a56e8768d9cb76b6a5c1bd6e4fd76ff5f08aa\": container with ID starting with c7cf9f610d465a0fa762f7777b7a56e8768d9cb76b6a5c1bd6e4fd76ff5f08aa not found: ID does not exist" containerID="c7cf9f610d465a0fa762f7777b7a56e8768d9cb76b6a5c1bd6e4fd76ff5f08aa" May 27 23:45:15.485490 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.485422 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7cf9f610d465a0fa762f7777b7a56e8768d9cb76b6a5c1bd6e4fd76ff5f08aa"} err="failed to get container status \"c7cf9f610d465a0fa762f7777b7a56e8768d9cb76b6a5c1bd6e4fd76ff5f08aa\": rpc error: code = NotFound desc = could not find container \"c7cf9f610d465a0fa762f7777b7a56e8768d9cb76b6a5c1bd6e4fd76ff5f08aa\": container with ID starting with c7cf9f610d465a0fa762f7777b7a56e8768d9cb76b6a5c1bd6e4fd76ff5f08aa not found: ID does not exist" May 27 23:45:15.485490 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.485443 2556 scope.go:117] "RemoveContainer" containerID="e02e4b004989e0dc2cfbbf7d03f88219638f1d0f3c1394798b0505ead8d77e18" May 27 23:45:15.485701 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:45:15.485680 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e02e4b004989e0dc2cfbbf7d03f88219638f1d0f3c1394798b0505ead8d77e18\": container with ID starting with e02e4b004989e0dc2cfbbf7d03f88219638f1d0f3c1394798b0505ead8d77e18 not found: ID does not exist" containerID="e02e4b004989e0dc2cfbbf7d03f88219638f1d0f3c1394798b0505ead8d77e18" May 27 23:45:15.485757 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.485705 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e02e4b004989e0dc2cfbbf7d03f88219638f1d0f3c1394798b0505ead8d77e18"} err="failed to get container status \"e02e4b004989e0dc2cfbbf7d03f88219638f1d0f3c1394798b0505ead8d77e18\": rpc error: code = NotFound desc = could not find container \"e02e4b004989e0dc2cfbbf7d03f88219638f1d0f3c1394798b0505ead8d77e18\": container with ID starting with e02e4b004989e0dc2cfbbf7d03f88219638f1d0f3c1394798b0505ead8d77e18 not found: ID does not exist" May 27 23:45:15.485757 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.485718 2556 scope.go:117] "RemoveContainer" containerID="81d8c5b4c5eb26d5727f21fa507cb75a82fa1a1ff7b56c7029d2d2d2ec6baa3d" May 27 23:45:15.485919 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:45:15.485904 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81d8c5b4c5eb26d5727f21fa507cb75a82fa1a1ff7b56c7029d2d2d2ec6baa3d\": container with ID starting with 81d8c5b4c5eb26d5727f21fa507cb75a82fa1a1ff7b56c7029d2d2d2ec6baa3d not found: ID does not exist" containerID="81d8c5b4c5eb26d5727f21fa507cb75a82fa1a1ff7b56c7029d2d2d2ec6baa3d" May 27 23:45:15.485962 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.485923 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81d8c5b4c5eb26d5727f21fa507cb75a82fa1a1ff7b56c7029d2d2d2ec6baa3d"} err="failed to get container status \"81d8c5b4c5eb26d5727f21fa507cb75a82fa1a1ff7b56c7029d2d2d2ec6baa3d\": rpc error: code = NotFound desc = could not find container \"81d8c5b4c5eb26d5727f21fa507cb75a82fa1a1ff7b56c7029d2d2d2ec6baa3d\": container with ID starting with 81d8c5b4c5eb26d5727f21fa507cb75a82fa1a1ff7b56c7029d2d2d2ec6baa3d not found: ID does not exist" May 27 23:45:15.485962 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.485936 2556 scope.go:117] "RemoveContainer" containerID="3c179ec94cae437de5ac3233bfcd6da6f93c1fdf5844323883f2238ddb9256b8" May 27 23:45:15.486134 ip-10-0-128-22 kubenswrapper[2556]: E0527 23:45:15.486118 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c179ec94cae437de5ac3233bfcd6da6f93c1fdf5844323883f2238ddb9256b8\": container with ID starting with 3c179ec94cae437de5ac3233bfcd6da6f93c1fdf5844323883f2238ddb9256b8 not found: ID does not exist" containerID="3c179ec94cae437de5ac3233bfcd6da6f93c1fdf5844323883f2238ddb9256b8" May 27 23:45:15.486181 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.486140 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c179ec94cae437de5ac3233bfcd6da6f93c1fdf5844323883f2238ddb9256b8"} err="failed to get container status \"3c179ec94cae437de5ac3233bfcd6da6f93c1fdf5844323883f2238ddb9256b8\": rpc error: code = NotFound desc = could not find container \"3c179ec94cae437de5ac3233bfcd6da6f93c1fdf5844323883f2238ddb9256b8\": container with ID starting with 3c179ec94cae437de5ac3233bfcd6da6f93c1fdf5844323883f2238ddb9256b8 not found: ID does not exist" May 27 23:45:15.486181 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.486156 2556 scope.go:117] "RemoveContainer" containerID="722663a21d124393ac1b6622ace8a1997e7311c3a054999da110d2d793ba4fb4" May 27 23:45:15.486358 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.486342 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"722663a21d124393ac1b6622ace8a1997e7311c3a054999da110d2d793ba4fb4"} err="failed to get container status \"722663a21d124393ac1b6622ace8a1997e7311c3a054999da110d2d793ba4fb4\": rpc error: code = NotFound desc = could not find container \"722663a21d124393ac1b6622ace8a1997e7311c3a054999da110d2d793ba4fb4\": container with ID starting with 722663a21d124393ac1b6622ace8a1997e7311c3a054999da110d2d793ba4fb4 not found: ID does not exist" May 27 23:45:15.486400 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.486358 2556 scope.go:117] "RemoveContainer" containerID="eebda7d4d835dc5384be0e690493e14f157a0ac6e73a198ef0eaebbda6ac321c" May 27 23:45:15.486565 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.486546 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eebda7d4d835dc5384be0e690493e14f157a0ac6e73a198ef0eaebbda6ac321c"} err="failed to get container status \"eebda7d4d835dc5384be0e690493e14f157a0ac6e73a198ef0eaebbda6ac321c\": rpc error: code = NotFound desc = could not find container \"eebda7d4d835dc5384be0e690493e14f157a0ac6e73a198ef0eaebbda6ac321c\": container with ID starting with eebda7d4d835dc5384be0e690493e14f157a0ac6e73a198ef0eaebbda6ac321c not found: ID does not exist" May 27 23:45:15.486603 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.486567 2556 scope.go:117] "RemoveContainer" containerID="48803f17f32ca3466c7ef45f8a4b73c13afc0e554870054bf315460f3cf874c7" May 27 23:45:15.486804 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.486784 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48803f17f32ca3466c7ef45f8a4b73c13afc0e554870054bf315460f3cf874c7"} err="failed to get container status \"48803f17f32ca3466c7ef45f8a4b73c13afc0e554870054bf315460f3cf874c7\": rpc error: code = NotFound desc = could not find container \"48803f17f32ca3466c7ef45f8a4b73c13afc0e554870054bf315460f3cf874c7\": container with ID starting with 48803f17f32ca3466c7ef45f8a4b73c13afc0e554870054bf315460f3cf874c7 not found: ID does not exist" May 27 23:45:15.486864 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.486803 2556 scope.go:117] "RemoveContainer" containerID="c7cf9f610d465a0fa762f7777b7a56e8768d9cb76b6a5c1bd6e4fd76ff5f08aa" May 27 23:45:15.486998 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.486982 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7cf9f610d465a0fa762f7777b7a56e8768d9cb76b6a5c1bd6e4fd76ff5f08aa"} err="failed to get container status \"c7cf9f610d465a0fa762f7777b7a56e8768d9cb76b6a5c1bd6e4fd76ff5f08aa\": rpc error: code = NotFound desc = could not find container \"c7cf9f610d465a0fa762f7777b7a56e8768d9cb76b6a5c1bd6e4fd76ff5f08aa\": container with ID starting with c7cf9f610d465a0fa762f7777b7a56e8768d9cb76b6a5c1bd6e4fd76ff5f08aa not found: ID does not exist" May 27 23:45:15.487044 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.486999 2556 scope.go:117] "RemoveContainer" containerID="e02e4b004989e0dc2cfbbf7d03f88219638f1d0f3c1394798b0505ead8d77e18" May 27 23:45:15.487197 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.487178 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e02e4b004989e0dc2cfbbf7d03f88219638f1d0f3c1394798b0505ead8d77e18"} err="failed to get container status \"e02e4b004989e0dc2cfbbf7d03f88219638f1d0f3c1394798b0505ead8d77e18\": rpc error: code = NotFound desc = could not find container \"e02e4b004989e0dc2cfbbf7d03f88219638f1d0f3c1394798b0505ead8d77e18\": container with ID starting with e02e4b004989e0dc2cfbbf7d03f88219638f1d0f3c1394798b0505ead8d77e18 not found: ID does not exist" May 27 23:45:15.487245 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.487197 2556 scope.go:117] "RemoveContainer" containerID="81d8c5b4c5eb26d5727f21fa507cb75a82fa1a1ff7b56c7029d2d2d2ec6baa3d" May 27 23:45:15.487439 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.487394 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81d8c5b4c5eb26d5727f21fa507cb75a82fa1a1ff7b56c7029d2d2d2ec6baa3d"} err="failed to get container status \"81d8c5b4c5eb26d5727f21fa507cb75a82fa1a1ff7b56c7029d2d2d2ec6baa3d\": rpc error: code = NotFound desc = could not find container \"81d8c5b4c5eb26d5727f21fa507cb75a82fa1a1ff7b56c7029d2d2d2ec6baa3d\": container with ID starting with 81d8c5b4c5eb26d5727f21fa507cb75a82fa1a1ff7b56c7029d2d2d2ec6baa3d not found: ID does not exist" May 27 23:45:15.487439 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.487411 2556 scope.go:117] "RemoveContainer" containerID="3c179ec94cae437de5ac3233bfcd6da6f93c1fdf5844323883f2238ddb9256b8" May 27 23:45:15.487696 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.487673 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c179ec94cae437de5ac3233bfcd6da6f93c1fdf5844323883f2238ddb9256b8"} err="failed to get container status \"3c179ec94cae437de5ac3233bfcd6da6f93c1fdf5844323883f2238ddb9256b8\": rpc error: code = NotFound desc = could not find container \"3c179ec94cae437de5ac3233bfcd6da6f93c1fdf5844323883f2238ddb9256b8\": container with ID starting with 3c179ec94cae437de5ac3233bfcd6da6f93c1fdf5844323883f2238ddb9256b8 not found: ID does not exist" May 27 23:45:15.487781 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.487698 2556 scope.go:117] "RemoveContainer" containerID="722663a21d124393ac1b6622ace8a1997e7311c3a054999da110d2d793ba4fb4" May 27 23:45:15.487974 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.487942 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"722663a21d124393ac1b6622ace8a1997e7311c3a054999da110d2d793ba4fb4"} err="failed to get container status \"722663a21d124393ac1b6622ace8a1997e7311c3a054999da110d2d793ba4fb4\": rpc error: code = NotFound desc = could not find container \"722663a21d124393ac1b6622ace8a1997e7311c3a054999da110d2d793ba4fb4\": container with ID starting with 722663a21d124393ac1b6622ace8a1997e7311c3a054999da110d2d793ba4fb4 not found: ID does not exist" May 27 23:45:15.487974 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.487965 2556 scope.go:117] "RemoveContainer" containerID="eebda7d4d835dc5384be0e690493e14f157a0ac6e73a198ef0eaebbda6ac321c" May 27 23:45:15.488576 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.488322 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eebda7d4d835dc5384be0e690493e14f157a0ac6e73a198ef0eaebbda6ac321c"} err="failed to get container status \"eebda7d4d835dc5384be0e690493e14f157a0ac6e73a198ef0eaebbda6ac321c\": rpc error: code = NotFound desc = could not find container \"eebda7d4d835dc5384be0e690493e14f157a0ac6e73a198ef0eaebbda6ac321c\": container with ID starting with eebda7d4d835dc5384be0e690493e14f157a0ac6e73a198ef0eaebbda6ac321c not found: ID does not exist" May 27 23:45:15.488576 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.488348 2556 scope.go:117] "RemoveContainer" containerID="48803f17f32ca3466c7ef45f8a4b73c13afc0e554870054bf315460f3cf874c7" May 27 23:45:15.488755 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.488629 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48803f17f32ca3466c7ef45f8a4b73c13afc0e554870054bf315460f3cf874c7"} err="failed to get container status \"48803f17f32ca3466c7ef45f8a4b73c13afc0e554870054bf315460f3cf874c7\": rpc error: code = NotFound desc = could not find container \"48803f17f32ca3466c7ef45f8a4b73c13afc0e554870054bf315460f3cf874c7\": container with ID starting with 48803f17f32ca3466c7ef45f8a4b73c13afc0e554870054bf315460f3cf874c7 not found: ID does not exist" May 27 23:45:15.488755 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.488672 2556 scope.go:117] "RemoveContainer" containerID="c7cf9f610d465a0fa762f7777b7a56e8768d9cb76b6a5c1bd6e4fd76ff5f08aa" May 27 23:45:15.488916 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.488890 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7cf9f610d465a0fa762f7777b7a56e8768d9cb76b6a5c1bd6e4fd76ff5f08aa"} err="failed to get container status \"c7cf9f610d465a0fa762f7777b7a56e8768d9cb76b6a5c1bd6e4fd76ff5f08aa\": rpc error: code = NotFound desc = could not find container \"c7cf9f610d465a0fa762f7777b7a56e8768d9cb76b6a5c1bd6e4fd76ff5f08aa\": container with ID starting with c7cf9f610d465a0fa762f7777b7a56e8768d9cb76b6a5c1bd6e4fd76ff5f08aa not found: ID does not exist" May 27 23:45:15.488916 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.488916 2556 scope.go:117] "RemoveContainer" containerID="e02e4b004989e0dc2cfbbf7d03f88219638f1d0f3c1394798b0505ead8d77e18" May 27 23:45:15.489147 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.489128 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e02e4b004989e0dc2cfbbf7d03f88219638f1d0f3c1394798b0505ead8d77e18"} err="failed to get container status \"e02e4b004989e0dc2cfbbf7d03f88219638f1d0f3c1394798b0505ead8d77e18\": rpc error: code = NotFound desc = could not find container \"e02e4b004989e0dc2cfbbf7d03f88219638f1d0f3c1394798b0505ead8d77e18\": container with ID starting with e02e4b004989e0dc2cfbbf7d03f88219638f1d0f3c1394798b0505ead8d77e18 not found: ID does not exist" May 27 23:45:15.489147 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.489147 2556 scope.go:117] "RemoveContainer" containerID="81d8c5b4c5eb26d5727f21fa507cb75a82fa1a1ff7b56c7029d2d2d2ec6baa3d" May 27 23:45:15.489402 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.489375 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81d8c5b4c5eb26d5727f21fa507cb75a82fa1a1ff7b56c7029d2d2d2ec6baa3d"} err="failed to get container status \"81d8c5b4c5eb26d5727f21fa507cb75a82fa1a1ff7b56c7029d2d2d2ec6baa3d\": rpc error: code = NotFound desc = could not find container \"81d8c5b4c5eb26d5727f21fa507cb75a82fa1a1ff7b56c7029d2d2d2ec6baa3d\": container with ID starting with 81d8c5b4c5eb26d5727f21fa507cb75a82fa1a1ff7b56c7029d2d2d2ec6baa3d not found: ID does not exist" May 27 23:45:15.489402 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.489395 2556 scope.go:117] "RemoveContainer" containerID="3c179ec94cae437de5ac3233bfcd6da6f93c1fdf5844323883f2238ddb9256b8" May 27 23:45:15.489620 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.489595 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c179ec94cae437de5ac3233bfcd6da6f93c1fdf5844323883f2238ddb9256b8"} err="failed to get container status \"3c179ec94cae437de5ac3233bfcd6da6f93c1fdf5844323883f2238ddb9256b8\": rpc error: code = NotFound desc = could not find container \"3c179ec94cae437de5ac3233bfcd6da6f93c1fdf5844323883f2238ddb9256b8\": container with ID starting with 3c179ec94cae437de5ac3233bfcd6da6f93c1fdf5844323883f2238ddb9256b8 not found: ID does not exist" May 27 23:45:15.489620 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.489612 2556 scope.go:117] "RemoveContainer" containerID="722663a21d124393ac1b6622ace8a1997e7311c3a054999da110d2d793ba4fb4" May 27 23:45:15.489900 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.489870 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"722663a21d124393ac1b6622ace8a1997e7311c3a054999da110d2d793ba4fb4"} err="failed to get container status \"722663a21d124393ac1b6622ace8a1997e7311c3a054999da110d2d793ba4fb4\": rpc error: code = NotFound desc = could not find container \"722663a21d124393ac1b6622ace8a1997e7311c3a054999da110d2d793ba4fb4\": container with ID starting with 722663a21d124393ac1b6622ace8a1997e7311c3a054999da110d2d793ba4fb4 not found: ID does not exist" May 27 23:45:15.489967 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.489900 2556 scope.go:117] "RemoveContainer" containerID="eebda7d4d835dc5384be0e690493e14f157a0ac6e73a198ef0eaebbda6ac321c" May 27 23:45:15.490125 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.490099 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eebda7d4d835dc5384be0e690493e14f157a0ac6e73a198ef0eaebbda6ac321c"} err="failed to get container status \"eebda7d4d835dc5384be0e690493e14f157a0ac6e73a198ef0eaebbda6ac321c\": rpc error: code = NotFound desc = could not find container \"eebda7d4d835dc5384be0e690493e14f157a0ac6e73a198ef0eaebbda6ac321c\": container with ID starting with eebda7d4d835dc5384be0e690493e14f157a0ac6e73a198ef0eaebbda6ac321c not found: ID does not exist" May 27 23:45:15.490125 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.490116 2556 scope.go:117] "RemoveContainer" containerID="48803f17f32ca3466c7ef45f8a4b73c13afc0e554870054bf315460f3cf874c7" May 27 23:45:15.490235 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.490182 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 27 23:45:15.490361 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.490328 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48803f17f32ca3466c7ef45f8a4b73c13afc0e554870054bf315460f3cf874c7"} err="failed to get container status \"48803f17f32ca3466c7ef45f8a4b73c13afc0e554870054bf315460f3cf874c7\": rpc error: code = NotFound desc = could not find container \"48803f17f32ca3466c7ef45f8a4b73c13afc0e554870054bf315460f3cf874c7\": container with ID starting with 48803f17f32ca3466c7ef45f8a4b73c13afc0e554870054bf315460f3cf874c7 not found: ID does not exist" May 27 23:45:15.490424 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.490363 2556 scope.go:117] "RemoveContainer" containerID="c7cf9f610d465a0fa762f7777b7a56e8768d9cb76b6a5c1bd6e4fd76ff5f08aa" May 27 23:45:15.490612 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.490590 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3ed4027-ef2d-43f2-b791-294fa6589ece" containerName="kube-rbac-proxy" May 27 23:45:15.490707 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.490616 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3ed4027-ef2d-43f2-b791-294fa6589ece" containerName="kube-rbac-proxy" May 27 23:45:15.490707 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.490595 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7cf9f610d465a0fa762f7777b7a56e8768d9cb76b6a5c1bd6e4fd76ff5f08aa"} err="failed to get container status \"c7cf9f610d465a0fa762f7777b7a56e8768d9cb76b6a5c1bd6e4fd76ff5f08aa\": rpc error: code = NotFound desc = could not find container \"c7cf9f610d465a0fa762f7777b7a56e8768d9cb76b6a5c1bd6e4fd76ff5f08aa\": container with ID starting with c7cf9f610d465a0fa762f7777b7a56e8768d9cb76b6a5c1bd6e4fd76ff5f08aa not found: ID does not exist" May 27 23:45:15.490707 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.490652 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3ed4027-ef2d-43f2-b791-294fa6589ece" containerName="kube-rbac-proxy-web" May 27 23:45:15.490707 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.490659 2556 scope.go:117] "RemoveContainer" containerID="e02e4b004989e0dc2cfbbf7d03f88219638f1d0f3c1394798b0505ead8d77e18" May 27 23:45:15.490707 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.490662 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3ed4027-ef2d-43f2-b791-294fa6589ece" containerName="kube-rbac-proxy-web" May 27 23:45:15.490936 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.490713 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3ed4027-ef2d-43f2-b791-294fa6589ece" containerName="init-config-reloader" May 27 23:45:15.490936 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.490721 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3ed4027-ef2d-43f2-b791-294fa6589ece" containerName="init-config-reloader" May 27 23:45:15.490936 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.490732 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3ed4027-ef2d-43f2-b791-294fa6589ece" containerName="config-reloader" May 27 23:45:15.490936 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.490737 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3ed4027-ef2d-43f2-b791-294fa6589ece" containerName="config-reloader" May 27 23:45:15.490936 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.490749 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3ed4027-ef2d-43f2-b791-294fa6589ece" containerName="prometheus" May 27 23:45:15.490936 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.490755 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3ed4027-ef2d-43f2-b791-294fa6589ece" containerName="prometheus" May 27 23:45:15.490936 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.490766 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3ed4027-ef2d-43f2-b791-294fa6589ece" containerName="kube-rbac-proxy-thanos" May 27 23:45:15.490936 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.490772 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3ed4027-ef2d-43f2-b791-294fa6589ece" containerName="kube-rbac-proxy-thanos" May 27 23:45:15.490936 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.490780 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3ed4027-ef2d-43f2-b791-294fa6589ece" containerName="thanos-sidecar" May 27 23:45:15.490936 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.490788 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3ed4027-ef2d-43f2-b791-294fa6589ece" containerName="thanos-sidecar" May 27 23:45:15.490936 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.490867 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="f3ed4027-ef2d-43f2-b791-294fa6589ece" containerName="thanos-sidecar" May 27 23:45:15.490936 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.490881 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="f3ed4027-ef2d-43f2-b791-294fa6589ece" containerName="kube-rbac-proxy-web" May 27 23:45:15.490936 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.490891 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="f3ed4027-ef2d-43f2-b791-294fa6589ece" containerName="prometheus" May 27 23:45:15.490936 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.490898 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="f3ed4027-ef2d-43f2-b791-294fa6589ece" containerName="kube-rbac-proxy" May 27 23:45:15.490936 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.490906 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="f3ed4027-ef2d-43f2-b791-294fa6589ece" containerName="kube-rbac-proxy-thanos" May 27 23:45:15.490936 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.490914 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="f3ed4027-ef2d-43f2-b791-294fa6589ece" containerName="config-reloader" May 27 23:45:15.490936 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.490924 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e02e4b004989e0dc2cfbbf7d03f88219638f1d0f3c1394798b0505ead8d77e18"} err="failed to get container status \"e02e4b004989e0dc2cfbbf7d03f88219638f1d0f3c1394798b0505ead8d77e18\": rpc error: code = NotFound desc = could not find container \"e02e4b004989e0dc2cfbbf7d03f88219638f1d0f3c1394798b0505ead8d77e18\": container with ID starting with e02e4b004989e0dc2cfbbf7d03f88219638f1d0f3c1394798b0505ead8d77e18 not found: ID does not exist" May 27 23:45:15.490936 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.490939 2556 scope.go:117] "RemoveContainer" containerID="81d8c5b4c5eb26d5727f21fa507cb75a82fa1a1ff7b56c7029d2d2d2ec6baa3d" May 27 23:45:15.491569 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.491166 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81d8c5b4c5eb26d5727f21fa507cb75a82fa1a1ff7b56c7029d2d2d2ec6baa3d"} err="failed to get container status \"81d8c5b4c5eb26d5727f21fa507cb75a82fa1a1ff7b56c7029d2d2d2ec6baa3d\": rpc error: code = NotFound desc = could not find container \"81d8c5b4c5eb26d5727f21fa507cb75a82fa1a1ff7b56c7029d2d2d2ec6baa3d\": container with ID starting with 81d8c5b4c5eb26d5727f21fa507cb75a82fa1a1ff7b56c7029d2d2d2ec6baa3d not found: ID does not exist" May 27 23:45:15.491569 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.491182 2556 scope.go:117] "RemoveContainer" containerID="3c179ec94cae437de5ac3233bfcd6da6f93c1fdf5844323883f2238ddb9256b8" May 27 23:45:15.491569 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.491388 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c179ec94cae437de5ac3233bfcd6da6f93c1fdf5844323883f2238ddb9256b8"} err="failed to get container status \"3c179ec94cae437de5ac3233bfcd6da6f93c1fdf5844323883f2238ddb9256b8\": rpc error: code = NotFound desc = could not find container \"3c179ec94cae437de5ac3233bfcd6da6f93c1fdf5844323883f2238ddb9256b8\": container with ID starting with 3c179ec94cae437de5ac3233bfcd6da6f93c1fdf5844323883f2238ddb9256b8 not found: ID does not exist" May 27 23:45:15.491569 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.491413 2556 scope.go:117] "RemoveContainer" containerID="722663a21d124393ac1b6622ace8a1997e7311c3a054999da110d2d793ba4fb4" May 27 23:45:15.491733 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.491633 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"722663a21d124393ac1b6622ace8a1997e7311c3a054999da110d2d793ba4fb4"} err="failed to get container status \"722663a21d124393ac1b6622ace8a1997e7311c3a054999da110d2d793ba4fb4\": rpc error: code = NotFound desc = could not find container \"722663a21d124393ac1b6622ace8a1997e7311c3a054999da110d2d793ba4fb4\": container with ID starting with 722663a21d124393ac1b6622ace8a1997e7311c3a054999da110d2d793ba4fb4 not found: ID does not exist" May 27 23:45:15.491733 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.491664 2556 scope.go:117] "RemoveContainer" containerID="eebda7d4d835dc5384be0e690493e14f157a0ac6e73a198ef0eaebbda6ac321c" May 27 23:45:15.491859 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.491843 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eebda7d4d835dc5384be0e690493e14f157a0ac6e73a198ef0eaebbda6ac321c"} err="failed to get container status \"eebda7d4d835dc5384be0e690493e14f157a0ac6e73a198ef0eaebbda6ac321c\": rpc error: code = NotFound desc = could not find container \"eebda7d4d835dc5384be0e690493e14f157a0ac6e73a198ef0eaebbda6ac321c\": container with ID starting with eebda7d4d835dc5384be0e690493e14f157a0ac6e73a198ef0eaebbda6ac321c not found: ID does not exist" May 27 23:45:15.491907 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.491859 2556 scope.go:117] "RemoveContainer" containerID="48803f17f32ca3466c7ef45f8a4b73c13afc0e554870054bf315460f3cf874c7" May 27 23:45:15.492100 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.492082 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48803f17f32ca3466c7ef45f8a4b73c13afc0e554870054bf315460f3cf874c7"} err="failed to get container status \"48803f17f32ca3466c7ef45f8a4b73c13afc0e554870054bf315460f3cf874c7\": rpc error: code = NotFound desc = could not find container \"48803f17f32ca3466c7ef45f8a4b73c13afc0e554870054bf315460f3cf874c7\": container with ID starting with 48803f17f32ca3466c7ef45f8a4b73c13afc0e554870054bf315460f3cf874c7 not found: ID does not exist" May 27 23:45:15.492148 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.492101 2556 scope.go:117] "RemoveContainer" containerID="c7cf9f610d465a0fa762f7777b7a56e8768d9cb76b6a5c1bd6e4fd76ff5f08aa" May 27 23:45:15.492314 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.492296 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7cf9f610d465a0fa762f7777b7a56e8768d9cb76b6a5c1bd6e4fd76ff5f08aa"} err="failed to get container status \"c7cf9f610d465a0fa762f7777b7a56e8768d9cb76b6a5c1bd6e4fd76ff5f08aa\": rpc error: code = NotFound desc = could not find container \"c7cf9f610d465a0fa762f7777b7a56e8768d9cb76b6a5c1bd6e4fd76ff5f08aa\": container with ID starting with c7cf9f610d465a0fa762f7777b7a56e8768d9cb76b6a5c1bd6e4fd76ff5f08aa not found: ID does not exist" May 27 23:45:15.492363 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.492314 2556 scope.go:117] "RemoveContainer" containerID="e02e4b004989e0dc2cfbbf7d03f88219638f1d0f3c1394798b0505ead8d77e18" May 27 23:45:15.492543 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.492523 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e02e4b004989e0dc2cfbbf7d03f88219638f1d0f3c1394798b0505ead8d77e18"} err="failed to get container status \"e02e4b004989e0dc2cfbbf7d03f88219638f1d0f3c1394798b0505ead8d77e18\": rpc error: code = NotFound desc = could not find container \"e02e4b004989e0dc2cfbbf7d03f88219638f1d0f3c1394798b0505ead8d77e18\": container with ID starting with e02e4b004989e0dc2cfbbf7d03f88219638f1d0f3c1394798b0505ead8d77e18 not found: ID does not exist" May 27 23:45:15.492543 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.492542 2556 scope.go:117] "RemoveContainer" containerID="81d8c5b4c5eb26d5727f21fa507cb75a82fa1a1ff7b56c7029d2d2d2ec6baa3d" May 27 23:45:15.492769 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.492752 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81d8c5b4c5eb26d5727f21fa507cb75a82fa1a1ff7b56c7029d2d2d2ec6baa3d"} err="failed to get container status \"81d8c5b4c5eb26d5727f21fa507cb75a82fa1a1ff7b56c7029d2d2d2ec6baa3d\": rpc error: code = NotFound desc = could not find container \"81d8c5b4c5eb26d5727f21fa507cb75a82fa1a1ff7b56c7029d2d2d2ec6baa3d\": container with ID starting with 81d8c5b4c5eb26d5727f21fa507cb75a82fa1a1ff7b56c7029d2d2d2ec6baa3d not found: ID does not exist" May 27 23:45:15.492833 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.492769 2556 scope.go:117] "RemoveContainer" containerID="3c179ec94cae437de5ac3233bfcd6da6f93c1fdf5844323883f2238ddb9256b8" May 27 23:45:15.492988 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.492961 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c179ec94cae437de5ac3233bfcd6da6f93c1fdf5844323883f2238ddb9256b8"} err="failed to get container status \"3c179ec94cae437de5ac3233bfcd6da6f93c1fdf5844323883f2238ddb9256b8\": rpc error: code = NotFound desc = could not find container \"3c179ec94cae437de5ac3233bfcd6da6f93c1fdf5844323883f2238ddb9256b8\": container with ID starting with 3c179ec94cae437de5ac3233bfcd6da6f93c1fdf5844323883f2238ddb9256b8 not found: ID does not exist" May 27 23:45:15.492988 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.492980 2556 scope.go:117] "RemoveContainer" containerID="722663a21d124393ac1b6622ace8a1997e7311c3a054999da110d2d793ba4fb4" May 27 23:45:15.493181 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.493162 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"722663a21d124393ac1b6622ace8a1997e7311c3a054999da110d2d793ba4fb4"} err="failed to get container status \"722663a21d124393ac1b6622ace8a1997e7311c3a054999da110d2d793ba4fb4\": rpc error: code = NotFound desc = could not find container \"722663a21d124393ac1b6622ace8a1997e7311c3a054999da110d2d793ba4fb4\": container with ID starting with 722663a21d124393ac1b6622ace8a1997e7311c3a054999da110d2d793ba4fb4 not found: ID does not exist" May 27 23:45:15.493181 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.493180 2556 scope.go:117] "RemoveContainer" containerID="eebda7d4d835dc5384be0e690493e14f157a0ac6e73a198ef0eaebbda6ac321c" May 27 23:45:15.493348 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.493333 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eebda7d4d835dc5384be0e690493e14f157a0ac6e73a198ef0eaebbda6ac321c"} err="failed to get container status \"eebda7d4d835dc5384be0e690493e14f157a0ac6e73a198ef0eaebbda6ac321c\": rpc error: code = NotFound desc = could not find container \"eebda7d4d835dc5384be0e690493e14f157a0ac6e73a198ef0eaebbda6ac321c\": container with ID starting with eebda7d4d835dc5384be0e690493e14f157a0ac6e73a198ef0eaebbda6ac321c not found: ID does not exist" May 27 23:45:15.493392 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.493348 2556 scope.go:117] "RemoveContainer" containerID="48803f17f32ca3466c7ef45f8a4b73c13afc0e554870054bf315460f3cf874c7" May 27 23:45:15.493580 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.493554 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48803f17f32ca3466c7ef45f8a4b73c13afc0e554870054bf315460f3cf874c7"} err="failed to get container status \"48803f17f32ca3466c7ef45f8a4b73c13afc0e554870054bf315460f3cf874c7\": rpc error: code = NotFound desc = could not find container \"48803f17f32ca3466c7ef45f8a4b73c13afc0e554870054bf315460f3cf874c7\": container with ID starting with 48803f17f32ca3466c7ef45f8a4b73c13afc0e554870054bf315460f3cf874c7 not found: ID does not exist" May 27 23:45:15.493580 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.493579 2556 scope.go:117] "RemoveContainer" containerID="c7cf9f610d465a0fa762f7777b7a56e8768d9cb76b6a5c1bd6e4fd76ff5f08aa" May 27 23:45:15.493922 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.493835 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7cf9f610d465a0fa762f7777b7a56e8768d9cb76b6a5c1bd6e4fd76ff5f08aa"} err="failed to get container status \"c7cf9f610d465a0fa762f7777b7a56e8768d9cb76b6a5c1bd6e4fd76ff5f08aa\": rpc error: code = NotFound desc = could not find container \"c7cf9f610d465a0fa762f7777b7a56e8768d9cb76b6a5c1bd6e4fd76ff5f08aa\": container with ID starting with c7cf9f610d465a0fa762f7777b7a56e8768d9cb76b6a5c1bd6e4fd76ff5f08aa not found: ID does not exist" May 27 23:45:15.493922 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.493851 2556 scope.go:117] "RemoveContainer" containerID="e02e4b004989e0dc2cfbbf7d03f88219638f1d0f3c1394798b0505ead8d77e18" May 27 23:45:15.494086 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.494061 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e02e4b004989e0dc2cfbbf7d03f88219638f1d0f3c1394798b0505ead8d77e18"} err="failed to get container status \"e02e4b004989e0dc2cfbbf7d03f88219638f1d0f3c1394798b0505ead8d77e18\": rpc error: code = NotFound desc = could not find container \"e02e4b004989e0dc2cfbbf7d03f88219638f1d0f3c1394798b0505ead8d77e18\": container with ID starting with e02e4b004989e0dc2cfbbf7d03f88219638f1d0f3c1394798b0505ead8d77e18 not found: ID does not exist" May 27 23:45:15.494086 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.494079 2556 scope.go:117] "RemoveContainer" containerID="81d8c5b4c5eb26d5727f21fa507cb75a82fa1a1ff7b56c7029d2d2d2ec6baa3d" May 27 23:45:15.494282 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.494265 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81d8c5b4c5eb26d5727f21fa507cb75a82fa1a1ff7b56c7029d2d2d2ec6baa3d"} err="failed to get container status \"81d8c5b4c5eb26d5727f21fa507cb75a82fa1a1ff7b56c7029d2d2d2ec6baa3d\": rpc error: code = NotFound desc = could not find container \"81d8c5b4c5eb26d5727f21fa507cb75a82fa1a1ff7b56c7029d2d2d2ec6baa3d\": container with ID starting with 81d8c5b4c5eb26d5727f21fa507cb75a82fa1a1ff7b56c7029d2d2d2ec6baa3d not found: ID does not exist" May 27 23:45:15.494334 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.494282 2556 scope.go:117] "RemoveContainer" containerID="3c179ec94cae437de5ac3233bfcd6da6f93c1fdf5844323883f2238ddb9256b8" May 27 23:45:15.494458 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.494442 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c179ec94cae437de5ac3233bfcd6da6f93c1fdf5844323883f2238ddb9256b8"} err="failed to get container status \"3c179ec94cae437de5ac3233bfcd6da6f93c1fdf5844323883f2238ddb9256b8\": rpc error: code = NotFound desc = could not find container \"3c179ec94cae437de5ac3233bfcd6da6f93c1fdf5844323883f2238ddb9256b8\": container with ID starting with 3c179ec94cae437de5ac3233bfcd6da6f93c1fdf5844323883f2238ddb9256b8 not found: ID does not exist" May 27 23:45:15.496615 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.496595 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.499333 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.499309 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 27 23:45:15.499425 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.499313 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-78hema5s28shu\"" May 27 23:45:15.499425 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.499359 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 27 23:45:15.499748 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.499729 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-z4t74\"" May 27 23:45:15.499877 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.499819 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 27 23:45:15.499968 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.499941 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 27 23:45:15.500059 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.500045 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 27 23:45:15.500259 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.500245 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 27 23:45:15.500344 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.500330 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 27 23:45:15.500384 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.500334 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 27 23:45:15.501796 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.501779 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 27 23:45:15.502091 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.502074 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 27 23:45:15.502328 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.502312 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 27 23:45:15.505485 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.505465 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 27 23:45:15.511611 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.511588 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 27 23:45:15.512280 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.512261 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 27 23:45:15.556129 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.556095 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/52543aa1-2609-4201-98a9-223276c336e6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.556317 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.556143 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/52543aa1-2609-4201-98a9-223276c336e6-web-config\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.556317 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.556215 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/52543aa1-2609-4201-98a9-223276c336e6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.556317 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.556250 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52543aa1-2609-4201-98a9-223276c336e6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.556462 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.556331 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/52543aa1-2609-4201-98a9-223276c336e6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.556462 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.556430 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/52543aa1-2609-4201-98a9-223276c336e6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.556558 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.556467 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/52543aa1-2609-4201-98a9-223276c336e6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.556626 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.556600 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/52543aa1-2609-4201-98a9-223276c336e6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.556736 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.556673 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/52543aa1-2609-4201-98a9-223276c336e6-config\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.556736 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.556701 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/52543aa1-2609-4201-98a9-223276c336e6-config-out\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.556902 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.556868 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-725r9\" (UniqueName: \"kubernetes.io/projected/52543aa1-2609-4201-98a9-223276c336e6-kube-api-access-725r9\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.557000 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.556954 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52543aa1-2609-4201-98a9-223276c336e6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.557060 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.557014 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52543aa1-2609-4201-98a9-223276c336e6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.557060 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.557045 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/52543aa1-2609-4201-98a9-223276c336e6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.557200 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.557071 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/52543aa1-2609-4201-98a9-223276c336e6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.557200 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.557116 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/52543aa1-2609-4201-98a9-223276c336e6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.557200 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.557188 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52543aa1-2609-4201-98a9-223276c336e6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.557333 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.557274 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/52543aa1-2609-4201-98a9-223276c336e6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.651867 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.651831 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3ed4027-ef2d-43f2-b791-294fa6589ece" path="/var/lib/kubelet/pods/f3ed4027-ef2d-43f2-b791-294fa6589ece/volumes" May 27 23:45:15.658240 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.658217 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/52543aa1-2609-4201-98a9-223276c336e6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.658369 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.658254 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52543aa1-2609-4201-98a9-223276c336e6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.658428 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.658373 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/52543aa1-2609-4201-98a9-223276c336e6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.658428 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.658405 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/52543aa1-2609-4201-98a9-223276c336e6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.658529 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.658428 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/52543aa1-2609-4201-98a9-223276c336e6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.658529 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.658456 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/52543aa1-2609-4201-98a9-223276c336e6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.658529 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.658493 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/52543aa1-2609-4201-98a9-223276c336e6-config\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.658735 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.658523 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/52543aa1-2609-4201-98a9-223276c336e6-config-out\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.658735 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.658581 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-725r9\" (UniqueName: \"kubernetes.io/projected/52543aa1-2609-4201-98a9-223276c336e6-kube-api-access-725r9\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.658735 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.658609 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52543aa1-2609-4201-98a9-223276c336e6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.658735 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.658668 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52543aa1-2609-4201-98a9-223276c336e6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.658735 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.658696 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/52543aa1-2609-4201-98a9-223276c336e6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.658735 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.658720 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/52543aa1-2609-4201-98a9-223276c336e6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.659022 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.658749 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/52543aa1-2609-4201-98a9-223276c336e6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.659022 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.658794 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52543aa1-2609-4201-98a9-223276c336e6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.659022 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.658837 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/52543aa1-2609-4201-98a9-223276c336e6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.659022 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.658881 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/52543aa1-2609-4201-98a9-223276c336e6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.659022 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.658907 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/52543aa1-2609-4201-98a9-223276c336e6-web-config\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.659022 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.658914 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/52543aa1-2609-4201-98a9-223276c336e6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.659311 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.659048 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52543aa1-2609-4201-98a9-223276c336e6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.659779 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.659658 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52543aa1-2609-4201-98a9-223276c336e6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.660673 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.660625 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52543aa1-2609-4201-98a9-223276c336e6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.661438 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.661342 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/52543aa1-2609-4201-98a9-223276c336e6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.662193 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.661537 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/52543aa1-2609-4201-98a9-223276c336e6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.662193 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.661584 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/52543aa1-2609-4201-98a9-223276c336e6-config\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.662193 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.661784 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/52543aa1-2609-4201-98a9-223276c336e6-config-out\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.662193 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.661898 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/52543aa1-2609-4201-98a9-223276c336e6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.662193 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.661911 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52543aa1-2609-4201-98a9-223276c336e6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.662504 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.662398 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/52543aa1-2609-4201-98a9-223276c336e6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.662785 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.662762 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/52543aa1-2609-4201-98a9-223276c336e6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.663396 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.663363 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/52543aa1-2609-4201-98a9-223276c336e6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.663479 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.663430 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/52543aa1-2609-4201-98a9-223276c336e6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.663899 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.663875 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/52543aa1-2609-4201-98a9-223276c336e6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.664018 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.663999 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/52543aa1-2609-4201-98a9-223276c336e6-web-config\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.664194 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.664180 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/52543aa1-2609-4201-98a9-223276c336e6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.669976 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.669956 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-725r9\" (UniqueName: \"kubernetes.io/projected/52543aa1-2609-4201-98a9-223276c336e6-kube-api-access-725r9\") pod \"prometheus-k8s-0\" (UID: \"52543aa1-2609-4201-98a9-223276c336e6\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.807492 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.807463 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:15.960633 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:15.960567 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 27 23:45:15.963627 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:45:15.963590 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52543aa1_2609_4201_98a9_223276c336e6.slice/crio-8da33970e51e2b38133b4fa53e149cd59b1b9c4963142f5bf07e890daf1dfab9 WatchSource:0}: Error finding container 8da33970e51e2b38133b4fa53e149cd59b1b9c4963142f5bf07e890daf1dfab9: Status 404 returned error can't find the container with id 8da33970e51e2b38133b4fa53e149cd59b1b9c4963142f5bf07e890daf1dfab9 May 27 23:45:16.438473 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:16.438386 2556 generic.go:358] "Generic (PLEG): container finished" podID="52543aa1-2609-4201-98a9-223276c336e6" containerID="fb10b8e7a5b7e70fdbcfeb5f159d1a1b93f32206e8a9380e7fa7508a955509a8" exitCode=0 May 27 23:45:16.438888 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:16.438474 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"52543aa1-2609-4201-98a9-223276c336e6","Type":"ContainerDied","Data":"fb10b8e7a5b7e70fdbcfeb5f159d1a1b93f32206e8a9380e7fa7508a955509a8"} May 27 23:45:16.438888 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:16.438512 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"52543aa1-2609-4201-98a9-223276c336e6","Type":"ContainerStarted","Data":"8da33970e51e2b38133b4fa53e149cd59b1b9c4963142f5bf07e890daf1dfab9"} May 27 23:45:17.445541 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:17.445502 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"52543aa1-2609-4201-98a9-223276c336e6","Type":"ContainerStarted","Data":"c41fd40dcf2ccf20a84554d0158c33beeb50158f582d847fd8ecc1466088047f"} May 27 23:45:17.445939 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:17.445546 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"52543aa1-2609-4201-98a9-223276c336e6","Type":"ContainerStarted","Data":"b746cf63957fdbcaf46507c213b6b9fcc8fd42d9a390985564bee5f8ea953cbf"} May 27 23:45:17.445939 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:17.445563 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"52543aa1-2609-4201-98a9-223276c336e6","Type":"ContainerStarted","Data":"f21075024f31cd865223eddce0e1436fa53f27db5bebe6c888a98f61b30e0112"} May 27 23:45:17.445939 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:17.445576 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"52543aa1-2609-4201-98a9-223276c336e6","Type":"ContainerStarted","Data":"f428a5a310cfe900f2462e56106c480f58150c73305c2284f3a0e923c1c3506d"} May 27 23:45:17.445939 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:17.445589 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"52543aa1-2609-4201-98a9-223276c336e6","Type":"ContainerStarted","Data":"a24e03c0d813dc735f09778e5d8fabb9f47293b3b98cdfe3f992460850024554"} May 27 23:45:17.445939 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:17.445601 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"52543aa1-2609-4201-98a9-223276c336e6","Type":"ContainerStarted","Data":"1291f41128ba789702e3041c051ae2cd1ab89ce88f8ab1d9ed450736c75d83cd"} May 27 23:45:17.477226 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:17.477148 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.477128217 podStartE2EDuration="2.477128217s" podCreationTimestamp="2026-05-27 23:45:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 23:45:17.474793393 +0000 UTC m=+260.401694982" watchObservedRunningTime="2026-05-27 23:45:17.477128217 +0000 UTC m=+260.404029808" May 27 23:45:20.807933 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:20.807900 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 27 23:45:49.651026 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:49.650996 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-tn9j6"] May 27 23:45:49.654571 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:49.654554 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tn9j6" May 27 23:45:49.657381 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:49.657360 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 27 23:45:49.662485 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:49.662460 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tn9j6"] May 27 23:45:49.766693 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:49.766633 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f835e1e-b024-4c14-b089-1022cf8dde14-original-pull-secret\") pod \"global-pull-secret-syncer-tn9j6\" (UID: \"2f835e1e-b024-4c14-b089-1022cf8dde14\") " pod="kube-system/global-pull-secret-syncer-tn9j6" May 27 23:45:49.766883 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:49.766736 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2f835e1e-b024-4c14-b089-1022cf8dde14-kubelet-config\") pod \"global-pull-secret-syncer-tn9j6\" (UID: \"2f835e1e-b024-4c14-b089-1022cf8dde14\") " pod="kube-system/global-pull-secret-syncer-tn9j6" May 27 23:45:49.766883 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:49.766839 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2f835e1e-b024-4c14-b089-1022cf8dde14-dbus\") pod \"global-pull-secret-syncer-tn9j6\" (UID: \"2f835e1e-b024-4c14-b089-1022cf8dde14\") " pod="kube-system/global-pull-secret-syncer-tn9j6" May 27 23:45:49.867592 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:49.867552 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2f835e1e-b024-4c14-b089-1022cf8dde14-dbus\") pod \"global-pull-secret-syncer-tn9j6\" (UID: \"2f835e1e-b024-4c14-b089-1022cf8dde14\") " pod="kube-system/global-pull-secret-syncer-tn9j6" May 27 23:45:49.867767 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:49.867630 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f835e1e-b024-4c14-b089-1022cf8dde14-original-pull-secret\") pod \"global-pull-secret-syncer-tn9j6\" (UID: \"2f835e1e-b024-4c14-b089-1022cf8dde14\") " pod="kube-system/global-pull-secret-syncer-tn9j6" May 27 23:45:49.867767 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:49.867679 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2f835e1e-b024-4c14-b089-1022cf8dde14-kubelet-config\") pod \"global-pull-secret-syncer-tn9j6\" (UID: \"2f835e1e-b024-4c14-b089-1022cf8dde14\") " pod="kube-system/global-pull-secret-syncer-tn9j6" May 27 23:45:49.867858 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:49.867765 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2f835e1e-b024-4c14-b089-1022cf8dde14-kubelet-config\") pod \"global-pull-secret-syncer-tn9j6\" (UID: \"2f835e1e-b024-4c14-b089-1022cf8dde14\") " pod="kube-system/global-pull-secret-syncer-tn9j6" May 27 23:45:49.867858 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:49.867766 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2f835e1e-b024-4c14-b089-1022cf8dde14-dbus\") pod \"global-pull-secret-syncer-tn9j6\" (UID: \"2f835e1e-b024-4c14-b089-1022cf8dde14\") " pod="kube-system/global-pull-secret-syncer-tn9j6" May 27 23:45:49.869931 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:49.869913 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f835e1e-b024-4c14-b089-1022cf8dde14-original-pull-secret\") pod \"global-pull-secret-syncer-tn9j6\" (UID: \"2f835e1e-b024-4c14-b089-1022cf8dde14\") " pod="kube-system/global-pull-secret-syncer-tn9j6" May 27 23:45:49.964272 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:49.964231 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tn9j6" May 27 23:45:50.101020 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:50.100997 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tn9j6"] May 27 23:45:50.103389 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:45:50.103361 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f835e1e_b024_4c14_b089_1022cf8dde14.slice/crio-2f94cb3024f5f6f487d45302b22d34dc054ccb44294a65f2732c7869bc2c5559 WatchSource:0}: Error finding container 2f94cb3024f5f6f487d45302b22d34dc054ccb44294a65f2732c7869bc2c5559: Status 404 returned error can't find the container with id 2f94cb3024f5f6f487d45302b22d34dc054ccb44294a65f2732c7869bc2c5559 May 27 23:45:50.553919 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:50.553882 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tn9j6" event={"ID":"2f835e1e-b024-4c14-b089-1022cf8dde14","Type":"ContainerStarted","Data":"2f94cb3024f5f6f487d45302b22d34dc054ccb44294a65f2732c7869bc2c5559"} May 27 23:45:54.568404 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:54.568364 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tn9j6" event={"ID":"2f835e1e-b024-4c14-b089-1022cf8dde14","Type":"ContainerStarted","Data":"03f11b057197674d7e40bc57fbbdb5b20356a0cab3b8b992fb9827f574591e8e"} May 27 23:45:54.585403 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:54.585352 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tn9j6" podStartSLOduration=1.5780403729999999 podStartE2EDuration="5.585336485s" podCreationTimestamp="2026-05-27 23:45:49 +0000 UTC" firstStartedPulling="2026-05-27 23:45:50.105185206 +0000 UTC m=+293.032086789" lastFinishedPulling="2026-05-27 23:45:54.112481332 +0000 UTC m=+297.039382901" observedRunningTime="2026-05-27 23:45:54.583174762 +0000 UTC m=+297.510076351" watchObservedRunningTime="2026-05-27 23:45:54.585336485 +0000 UTC m=+297.512238075" May 27 23:45:57.519333 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:57.519299 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-2gwp8_22a67c11-9c99-4758-acfb-78339ce3604b/console-operator/1.log" May 27 23:45:57.520966 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:57.520941 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-2gwp8_22a67c11-9c99-4758-acfb-78339ce3604b/console-operator/1.log" May 27 23:45:57.531431 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:45:57.531408 2556 kubelet.go:1628] "Image garbage collection succeeded" May 27 23:46:15.807805 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:46:15.807773 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 27 23:46:15.823958 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:46:15.823933 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 27 23:46:16.658694 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:46:16.658664 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 27 23:50:57.547340 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:50:57.547302 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-2gwp8_22a67c11-9c99-4758-acfb-78339ce3604b/console-operator/1.log" May 27 23:50:57.547897 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:50:57.547458 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-2gwp8_22a67c11-9c99-4758-acfb-78339ce3604b/console-operator/1.log" May 27 23:53:56.260747 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:53:56.260712 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-test-apply-lqt4t"] May 27 23:53:56.262922 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:53:56.262908 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-lqt4t" May 27 23:53:56.265334 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:53:56.265315 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\"" May 27 23:53:56.265448 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:53:56.265431 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" May 27 23:53:56.266256 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:53:56.266237 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-sr7kj\"" May 27 23:53:56.266353 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:53:56.266286 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" May 27 23:53:56.270400 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:53:56.270381 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-lqt4t"] May 27 23:53:56.381800 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:53:56.381772 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffhrr\" (UniqueName: \"kubernetes.io/projected/8f4b9817-e453-4c90-92e7-80dafd076f50-kube-api-access-ffhrr\") pod \"feast-test-apply-lqt4t\" (UID: \"8f4b9817-e453-4c90-92e7-80dafd076f50\") " pod="test-ns-feast/feast-test-apply-lqt4t" May 27 23:53:56.482250 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:53:56.482204 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ffhrr\" (UniqueName: \"kubernetes.io/projected/8f4b9817-e453-4c90-92e7-80dafd076f50-kube-api-access-ffhrr\") pod \"feast-test-apply-lqt4t\" (UID: \"8f4b9817-e453-4c90-92e7-80dafd076f50\") " pod="test-ns-feast/feast-test-apply-lqt4t" May 27 23:53:56.490871 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:53:56.490839 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffhrr\" (UniqueName: \"kubernetes.io/projected/8f4b9817-e453-4c90-92e7-80dafd076f50-kube-api-access-ffhrr\") pod \"feast-test-apply-lqt4t\" (UID: \"8f4b9817-e453-4c90-92e7-80dafd076f50\") " pod="test-ns-feast/feast-test-apply-lqt4t" May 27 23:53:56.583632 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:53:56.583560 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-lqt4t" May 27 23:53:56.702725 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:53:56.702660 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-lqt4t"] May 27 23:53:56.705503 ip-10-0-128-22 kubenswrapper[2556]: W0527 23:53:56.705470 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8f4b9817_e453_4c90_92e7_80dafd076f50.slice/crio-52febdd054942d5f85c9090dc7109d96c4f351065dc0fbb96bfb92033a5c082b WatchSource:0}: Error finding container 52febdd054942d5f85c9090dc7109d96c4f351065dc0fbb96bfb92033a5c082b: Status 404 returned error can't find the container with id 52febdd054942d5f85c9090dc7109d96c4f351065dc0fbb96bfb92033a5c082b May 27 23:53:56.707144 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:53:56.707126 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 23:53:57.021142 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:53:57.021108 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-lqt4t" event={"ID":"8f4b9817-e453-4c90-92e7-80dafd076f50","Type":"ContainerStarted","Data":"52febdd054942d5f85c9090dc7109d96c4f351065dc0fbb96bfb92033a5c082b"} May 27 23:54:01.770220 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:54:01.770198 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\"" May 27 23:54:02.038865 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:54:02.038783 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-lqt4t" event={"ID":"8f4b9817-e453-4c90-92e7-80dafd076f50","Type":"ContainerStarted","Data":"c6a8808af3c96508adddf986e4284a0a1a6373eae72f9f086ea05f7a97a68503"} May 27 23:54:08.056781 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:54:08.056743 2556 generic.go:358] "Generic (PLEG): container finished" podID="8f4b9817-e453-4c90-92e7-80dafd076f50" containerID="c6a8808af3c96508adddf986e4284a0a1a6373eae72f9f086ea05f7a97a68503" exitCode=0 May 27 23:54:08.057176 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:54:08.056791 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-lqt4t" event={"ID":"8f4b9817-e453-4c90-92e7-80dafd076f50","Type":"ContainerDied","Data":"c6a8808af3c96508adddf986e4284a0a1a6373eae72f9f086ea05f7a97a68503"} May 27 23:54:09.061453 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:54:09.061418 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-lqt4t" event={"ID":"8f4b9817-e453-4c90-92e7-80dafd076f50","Type":"ContainerStarted","Data":"ae74ccbe56394ceab3d5f7402db2fe9cfd9cf5d6da4cd6185132dadad9821a5d"} May 27 23:54:09.077901 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:54:09.077857 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-test-apply-lqt4t" podStartSLOduration=8.017612647 podStartE2EDuration="13.077842471s" podCreationTimestamp="2026-05-27 23:53:56 +0000 UTC" firstStartedPulling="2026-05-27 23:53:56.707281997 +0000 UTC m=+779.634183565" lastFinishedPulling="2026-05-27 23:54:01.76751182 +0000 UTC m=+784.694413389" observedRunningTime="2026-05-27 23:54:09.076442487 +0000 UTC m=+792.003344077" watchObservedRunningTime="2026-05-27 23:54:09.077842471 +0000 UTC m=+792.004744040" May 27 23:54:17.086997 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:54:17.086466 2556 generic.go:358] "Generic (PLEG): container finished" podID="8f4b9817-e453-4c90-92e7-80dafd076f50" containerID="ae74ccbe56394ceab3d5f7402db2fe9cfd9cf5d6da4cd6185132dadad9821a5d" exitCode=0 May 27 23:54:17.086997 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:54:17.086582 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-lqt4t" event={"ID":"8f4b9817-e453-4c90-92e7-80dafd076f50","Type":"ContainerDied","Data":"ae74ccbe56394ceab3d5f7402db2fe9cfd9cf5d6da4cd6185132dadad9821a5d"} May 27 23:54:18.216861 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:54:18.216839 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-lqt4t" May 27 23:54:18.275908 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:54:18.275863 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ffhrr\" (UniqueName: \"kubernetes.io/projected/8f4b9817-e453-4c90-92e7-80dafd076f50-kube-api-access-ffhrr\") pod \"8f4b9817-e453-4c90-92e7-80dafd076f50\" (UID: \"8f4b9817-e453-4c90-92e7-80dafd076f50\") " May 27 23:54:18.277956 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:54:18.277928 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f4b9817-e453-4c90-92e7-80dafd076f50-kube-api-access-ffhrr" (OuterVolumeSpecName: "kube-api-access-ffhrr") pod "8f4b9817-e453-4c90-92e7-80dafd076f50" (UID: "8f4b9817-e453-4c90-92e7-80dafd076f50"). InnerVolumeSpecName "kube-api-access-ffhrr". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 23:54:18.376524 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:54:18.376453 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffhrr\" (UniqueName: \"kubernetes.io/projected/8f4b9817-e453-4c90-92e7-80dafd076f50-kube-api-access-ffhrr\") on node \"ip-10-0-128-22.ec2.internal\" DevicePath \"\"" May 27 23:54:19.093582 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:54:19.093556 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-lqt4t" May 27 23:54:19.093772 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:54:19.093583 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-lqt4t" event={"ID":"8f4b9817-e453-4c90-92e7-80dafd076f50","Type":"ContainerDied","Data":"52febdd054942d5f85c9090dc7109d96c4f351065dc0fbb96bfb92033a5c082b"} May 27 23:54:19.093772 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:54:19.093614 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="52febdd054942d5f85c9090dc7109d96c4f351065dc0fbb96bfb92033a5c082b" May 27 23:54:19.284338 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:54:19.284313 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-lqt4t_8f4b9817-e453-4c90-92e7-80dafd076f50/feast-0/0.log" May 27 23:54:19.290940 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:54:19.290920 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-lqt4t_8f4b9817-e453-4c90-92e7-80dafd076f50/feast-1/0.log" May 27 23:54:53.887410 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:54:53.887373 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-test-apply-lqt4t"] May 27 23:54:53.897139 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:54:53.897113 2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-test-apply-lqt4t"] May 27 23:54:55.651479 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:54:55.651443 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f4b9817-e453-4c90-92e7-80dafd076f50" path="/var/lib/kubelet/pods/8f4b9817-e453-4c90-92e7-80dafd076f50/volumes" May 27 23:55:57.571685 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:55:57.571652 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-2gwp8_22a67c11-9c99-4758-acfb-78339ce3604b/console-operator/1.log" May 27 23:55:57.572751 ip-10-0-128-22 kubenswrapper[2556]: I0527 23:55:57.572729 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-2gwp8_22a67c11-9c99-4758-acfb-78339ce3604b/console-operator/1.log" May 28 00:00:57.596261 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:00:57.596230 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-2gwp8_22a67c11-9c99-4758-acfb-78339ce3604b/console-operator/1.log" May 28 00:00:57.598096 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:00:57.598070 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-2gwp8_22a67c11-9c99-4758-acfb-78339ce3604b/console-operator/1.log" May 28 00:00:57.599096 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:00:57.599075 2556 scope.go:117] "RemoveContainer" containerID="ae74ccbe56394ceab3d5f7402db2fe9cfd9cf5d6da4cd6185132dadad9821a5d" May 28 00:00:57.608301 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:00:57.608283 2556 scope.go:117] "RemoveContainer" containerID="c6a8808af3c96508adddf986e4284a0a1a6373eae72f9f086ea05f7a97a68503" May 28 00:05:57.620585 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:05:57.620558 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-2gwp8_22a67c11-9c99-4758-acfb-78339ce3604b/console-operator/1.log" May 28 00:05:57.623571 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:05:57.623541 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-2gwp8_22a67c11-9c99-4758-acfb-78339ce3604b/console-operator/1.log" May 28 00:10:33.558371 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:33.558341 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tn9j6_2f835e1e-b024-4c14-b089-1022cf8dde14/global-pull-secret-syncer/0.log" May 28 00:10:33.600617 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:33.600591 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dv6s4_fc83aa1e-cc07-4d4a-91d1-df90c691f148/konnectivity-agent/0.log" May 28 00:10:33.692341 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:33.692309 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-22.ec2.internal_ff79473a562eff3ccf42c987addd6ef4/haproxy/0.log" May 28 00:10:37.052012 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:37.051937 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bcdbbf82-9272-45f2-b005-9d72e325a067/alertmanager/0.log" May 28 00:10:37.103195 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:37.103170 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bcdbbf82-9272-45f2-b005-9d72e325a067/config-reloader/0.log" May 28 00:10:37.133417 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:37.133388 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bcdbbf82-9272-45f2-b005-9d72e325a067/kube-rbac-proxy-web/0.log" May 28 00:10:37.165602 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:37.165579 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bcdbbf82-9272-45f2-b005-9d72e325a067/kube-rbac-proxy/0.log" May 28 00:10:37.193632 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:37.193610 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bcdbbf82-9272-45f2-b005-9d72e325a067/kube-rbac-proxy-metric/0.log" May 28 00:10:37.219405 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:37.219384 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bcdbbf82-9272-45f2-b005-9d72e325a067/prom-label-proxy/0.log" May 28 00:10:37.245925 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:37.245900 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bcdbbf82-9272-45f2-b005-9d72e325a067/init-config-reloader/0.log" May 28 00:10:37.288386 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:37.288356 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-kg2vj_cfff88b2-cd59-4a94-ab7d-6ec94dcccc47/cluster-monitoring-operator/0.log" May 28 00:10:37.317415 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:37.317334 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-54xfh_56d2bb1d-3c6a-4c89-95c0-b0f84398fb62/kube-state-metrics/0.log" May 28 00:10:37.339997 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:37.339970 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-54xfh_56d2bb1d-3c6a-4c89-95c0-b0f84398fb62/kube-rbac-proxy-main/0.log" May 28 00:10:37.364958 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:37.364931 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-54xfh_56d2bb1d-3c6a-4c89-95c0-b0f84398fb62/kube-rbac-proxy-self/0.log" May 28 00:10:37.449249 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:37.449223 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jggpr_d9975022-42da-47db-882a-12200463bb3e/node-exporter/0.log" May 28 00:10:37.471656 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:37.471613 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jggpr_d9975022-42da-47db-882a-12200463bb3e/kube-rbac-proxy/0.log" May 28 00:10:37.495977 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:37.495954 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jggpr_d9975022-42da-47db-882a-12200463bb3e/init-textfile/0.log" May 28 00:10:37.674079 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:37.674009 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-vxglz_e0bf7d54-6be1-411d-a7cb-38c2f4da44ec/kube-rbac-proxy-main/0.log" May 28 00:10:37.696337 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:37.696308 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-vxglz_e0bf7d54-6be1-411d-a7cb-38c2f4da44ec/kube-rbac-proxy-self/0.log" May 28 00:10:37.727517 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:37.727481 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-vxglz_e0bf7d54-6be1-411d-a7cb-38c2f4da44ec/openshift-state-metrics/0.log" May 28 00:10:37.760564 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:37.760538 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_52543aa1-2609-4201-98a9-223276c336e6/prometheus/0.log" May 28 00:10:37.780901 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:37.780873 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_52543aa1-2609-4201-98a9-223276c336e6/config-reloader/0.log" May 28 00:10:37.818322 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:37.818293 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_52543aa1-2609-4201-98a9-223276c336e6/thanos-sidecar/0.log" May 28 00:10:37.849453 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:37.849422 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_52543aa1-2609-4201-98a9-223276c336e6/kube-rbac-proxy-web/0.log" May 28 00:10:37.877680 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:37.877625 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_52543aa1-2609-4201-98a9-223276c336e6/kube-rbac-proxy/0.log" May 28 00:10:37.907352 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:37.907326 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_52543aa1-2609-4201-98a9-223276c336e6/kube-rbac-proxy-thanos/0.log" May 28 00:10:37.938525 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:37.938448 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_52543aa1-2609-4201-98a9-223276c336e6/init-config-reloader/0.log" May 28 00:10:38.081976 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:38.081943 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b5f79b6fb-ds858_c760e55e-066e-4510-b003-e581df699e1f/telemeter-client/0.log" May 28 00:10:38.112006 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:38.111981 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b5f79b6fb-ds858_c760e55e-066e-4510-b003-e581df699e1f/reload/0.log" May 28 00:10:38.140042 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:38.140020 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b5f79b6fb-ds858_c760e55e-066e-4510-b003-e581df699e1f/kube-rbac-proxy/0.log" May 28 00:10:38.174169 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:38.174137 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-858566d955-vkh8p_12e0297c-e34c-47c6-a917-8085789d1247/thanos-query/0.log" May 28 00:10:38.200048 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:38.200023 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-858566d955-vkh8p_12e0297c-e34c-47c6-a917-8085789d1247/kube-rbac-proxy-web/0.log" May 28 00:10:38.224468 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:38.224445 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-858566d955-vkh8p_12e0297c-e34c-47c6-a917-8085789d1247/kube-rbac-proxy/0.log" May 28 00:10:38.249680 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:38.249632 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-858566d955-vkh8p_12e0297c-e34c-47c6-a917-8085789d1247/prom-label-proxy/0.log" May 28 00:10:38.273846 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:38.273817 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-858566d955-vkh8p_12e0297c-e34c-47c6-a917-8085789d1247/kube-rbac-proxy-rules/0.log" May 28 00:10:38.296988 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:38.296965 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-858566d955-vkh8p_12e0297c-e34c-47c6-a917-8085789d1247/kube-rbac-proxy-metrics/0.log" May 28 00:10:39.640770 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:39.640736 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-2gwp8_22a67c11-9c99-4758-acfb-78339ce3604b/console-operator/1.log" May 28 00:10:39.644992 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:39.644973 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-2gwp8_22a67c11-9c99-4758-acfb-78339ce3604b/console-operator/2.log" May 28 00:10:39.948142 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:39.948107 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lf7dz/perf-node-gather-daemonset-kj65t"] May 28 00:10:39.948480 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:39.948467 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f4b9817-e453-4c90-92e7-80dafd076f50" containerName="feast-0" May 28 00:10:39.948539 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:39.948482 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f4b9817-e453-4c90-92e7-80dafd076f50" containerName="feast-0" May 28 00:10:39.948539 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:39.948495 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f4b9817-e453-4c90-92e7-80dafd076f50" containerName="feast-1" May 28 00:10:39.948539 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:39.948501 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f4b9817-e453-4c90-92e7-80dafd076f50" containerName="feast-1" May 28 00:10:39.948670 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:39.948555 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="8f4b9817-e453-4c90-92e7-80dafd076f50" containerName="feast-1" May 28 00:10:39.953804 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:39.953779 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lf7dz/perf-node-gather-daemonset-kj65t" May 28 00:10:39.956801 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:39.956775 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lf7dz\"/\"kube-root-ca.crt\"" May 28 00:10:39.957774 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:39.957752 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lf7dz\"/\"openshift-service-ca.crt\"" May 28 00:10:39.958024 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:39.957817 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-lf7dz\"/\"default-dockercfg-mjg96\"" May 28 00:10:39.966023 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:39.965999 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lf7dz/perf-node-gather-daemonset-kj65t"] May 28 00:10:39.995317 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:39.995286 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/edb936b5-8ce8-4aa2-b6c9-9df602d260e7-podres\") pod \"perf-node-gather-daemonset-kj65t\" (UID: \"edb936b5-8ce8-4aa2-b6c9-9df602d260e7\") " pod="openshift-must-gather-lf7dz/perf-node-gather-daemonset-kj65t" May 28 00:10:39.995447 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:39.995325 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/edb936b5-8ce8-4aa2-b6c9-9df602d260e7-sys\") pod \"perf-node-gather-daemonset-kj65t\" (UID: \"edb936b5-8ce8-4aa2-b6c9-9df602d260e7\") " pod="openshift-must-gather-lf7dz/perf-node-gather-daemonset-kj65t" May 28 00:10:39.995447 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:39.995345 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/edb936b5-8ce8-4aa2-b6c9-9df602d260e7-proc\") pod \"perf-node-gather-daemonset-kj65t\" (UID: \"edb936b5-8ce8-4aa2-b6c9-9df602d260e7\") " pod="openshift-must-gather-lf7dz/perf-node-gather-daemonset-kj65t" May 28 00:10:39.995518 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:39.995466 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkw6j\" (UniqueName: \"kubernetes.io/projected/edb936b5-8ce8-4aa2-b6c9-9df602d260e7-kube-api-access-vkw6j\") pod \"perf-node-gather-daemonset-kj65t\" (UID: \"edb936b5-8ce8-4aa2-b6c9-9df602d260e7\") " pod="openshift-must-gather-lf7dz/perf-node-gather-daemonset-kj65t" May 28 00:10:39.995518 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:39.995499 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/edb936b5-8ce8-4aa2-b6c9-9df602d260e7-lib-modules\") pod \"perf-node-gather-daemonset-kj65t\" (UID: \"edb936b5-8ce8-4aa2-b6c9-9df602d260e7\") " pod="openshift-must-gather-lf7dz/perf-node-gather-daemonset-kj65t" May 28 00:10:40.096539 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:40.096502 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vkw6j\" (UniqueName: \"kubernetes.io/projected/edb936b5-8ce8-4aa2-b6c9-9df602d260e7-kube-api-access-vkw6j\") pod \"perf-node-gather-daemonset-kj65t\" (UID: \"edb936b5-8ce8-4aa2-b6c9-9df602d260e7\") " pod="openshift-must-gather-lf7dz/perf-node-gather-daemonset-kj65t" May 28 00:10:40.096748 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:40.096554 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/edb936b5-8ce8-4aa2-b6c9-9df602d260e7-lib-modules\") pod \"perf-node-gather-daemonset-kj65t\" (UID: \"edb936b5-8ce8-4aa2-b6c9-9df602d260e7\") " pod="openshift-must-gather-lf7dz/perf-node-gather-daemonset-kj65t" May 28 00:10:40.096748 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:40.096687 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/edb936b5-8ce8-4aa2-b6c9-9df602d260e7-podres\") pod \"perf-node-gather-daemonset-kj65t\" (UID: \"edb936b5-8ce8-4aa2-b6c9-9df602d260e7\") " pod="openshift-must-gather-lf7dz/perf-node-gather-daemonset-kj65t" May 28 00:10:40.096748 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:40.096728 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/edb936b5-8ce8-4aa2-b6c9-9df602d260e7-sys\") pod \"perf-node-gather-daemonset-kj65t\" (UID: \"edb936b5-8ce8-4aa2-b6c9-9df602d260e7\") " pod="openshift-must-gather-lf7dz/perf-node-gather-daemonset-kj65t" May 28 00:10:40.096748 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:40.096742 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/edb936b5-8ce8-4aa2-b6c9-9df602d260e7-lib-modules\") pod \"perf-node-gather-daemonset-kj65t\" (UID: \"edb936b5-8ce8-4aa2-b6c9-9df602d260e7\") " pod="openshift-must-gather-lf7dz/perf-node-gather-daemonset-kj65t" May 28 00:10:40.096884 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:40.096757 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/edb936b5-8ce8-4aa2-b6c9-9df602d260e7-proc\") pod \"perf-node-gather-daemonset-kj65t\" (UID: \"edb936b5-8ce8-4aa2-b6c9-9df602d260e7\") " pod="openshift-must-gather-lf7dz/perf-node-gather-daemonset-kj65t" May 28 00:10:40.096884 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:40.096805 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/edb936b5-8ce8-4aa2-b6c9-9df602d260e7-proc\") pod \"perf-node-gather-daemonset-kj65t\" (UID: \"edb936b5-8ce8-4aa2-b6c9-9df602d260e7\") " pod="openshift-must-gather-lf7dz/perf-node-gather-daemonset-kj65t" May 28 00:10:40.096884 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:40.096815 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/edb936b5-8ce8-4aa2-b6c9-9df602d260e7-podres\") pod \"perf-node-gather-daemonset-kj65t\" (UID: \"edb936b5-8ce8-4aa2-b6c9-9df602d260e7\") " pod="openshift-must-gather-lf7dz/perf-node-gather-daemonset-kj65t" May 28 00:10:40.096884 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:40.096855 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/edb936b5-8ce8-4aa2-b6c9-9df602d260e7-sys\") pod \"perf-node-gather-daemonset-kj65t\" (UID: \"edb936b5-8ce8-4aa2-b6c9-9df602d260e7\") " pod="openshift-must-gather-lf7dz/perf-node-gather-daemonset-kj65t" May 28 00:10:40.105652 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:40.105619 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkw6j\" (UniqueName: \"kubernetes.io/projected/edb936b5-8ce8-4aa2-b6c9-9df602d260e7-kube-api-access-vkw6j\") pod \"perf-node-gather-daemonset-kj65t\" (UID: \"edb936b5-8ce8-4aa2-b6c9-9df602d260e7\") " pod="openshift-must-gather-lf7dz/perf-node-gather-daemonset-kj65t" May 28 00:10:40.265192 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:40.265092 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lf7dz/perf-node-gather-daemonset-kj65t" May 28 00:10:40.391232 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:40.391206 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lf7dz/perf-node-gather-daemonset-kj65t"] May 28 00:10:40.393735 ip-10-0-128-22 kubenswrapper[2556]: W0528 00:10:40.393700 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podedb936b5_8ce8_4aa2_b6c9_9df602d260e7.slice/crio-c484da9e7ba97d6e542b5cbcb8d3c33bfb85732b112f4b2ea0b03f70e75815a0 WatchSource:0}: Error finding container c484da9e7ba97d6e542b5cbcb8d3c33bfb85732b112f4b2ea0b03f70e75815a0: Status 404 returned error can't find the container with id c484da9e7ba97d6e542b5cbcb8d3c33bfb85732b112f4b2ea0b03f70e75815a0 May 28 00:10:40.395293 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:40.395276 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 00:10:40.412848 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:40.412826 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-fcsm9_600f0038-338c-4c69-8ec0-3d4d2678230d/volume-data-source-validator/0.log" May 28 00:10:41.068851 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:41.068815 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lf7dz/perf-node-gather-daemonset-kj65t" event={"ID":"edb936b5-8ce8-4aa2-b6c9-9df602d260e7","Type":"ContainerStarted","Data":"90b16f250057ad005b17c992c5e7969f30e0f74581838700109614ac9e6f4cce"} May 28 00:10:41.068851 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:41.068852 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lf7dz/perf-node-gather-daemonset-kj65t" event={"ID":"edb936b5-8ce8-4aa2-b6c9-9df602d260e7","Type":"ContainerStarted","Data":"c484da9e7ba97d6e542b5cbcb8d3c33bfb85732b112f4b2ea0b03f70e75815a0"} May 28 00:10:41.069319 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:41.068925 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-lf7dz/perf-node-gather-daemonset-kj65t" May 28 00:10:41.085772 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:41.085719 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-lf7dz/perf-node-gather-daemonset-kj65t" podStartSLOduration=2.085699121 podStartE2EDuration="2.085699121s" podCreationTimestamp="2026-05-28 00:10:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 00:10:41.08477332 +0000 UTC m=+1784.011674934" watchObservedRunningTime="2026-05-28 00:10:41.085699121 +0000 UTC m=+1784.012600716" May 28 00:10:41.126038 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:41.126015 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z52tg_68b5c5a2-0e83-40b4-a3d8-fa07001d58f9/dns/0.log" May 28 00:10:41.146866 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:41.146840 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z52tg_68b5c5a2-0e83-40b4-a3d8-fa07001d58f9/kube-rbac-proxy/0.log" May 28 00:10:41.167874 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:41.167850 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8hfsr_cd79991b-47fe-457f-b415-c8ecd5c442c9/dns-node-resolver/0.log" May 28 00:10:41.638937 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:41.638908 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k2k6s_e682bdbf-0081-4b2e-b8fc-bf23a7a18612/node-ca/0.log" May 28 00:10:42.337170 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:42.337139 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5dcf54cc8b-h5zzl_54d79568-5558-42be-b533-d5842e079979/router/0.log" May 28 00:10:42.672858 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:42.672780 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zjddg_37275969-1a75-4d59-b8e2-ed044ddcc3e9/serve-healthcheck-canary/0.log" May 28 00:10:42.988865 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:42.988824 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-9dngd_e5c3a679-8e9c-4649-a2f2-201003fb37d5/insights-operator/0.log" May 28 00:10:42.989178 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:42.989160 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-9dngd_e5c3a679-8e9c-4649-a2f2-201003fb37d5/insights-operator/1.log" May 28 00:10:43.008717 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:43.008690 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8svnk_8a9d6f2e-4c75-499a-9483-c2fab94c7187/kube-rbac-proxy/0.log" May 28 00:10:43.027489 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:43.027463 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8svnk_8a9d6f2e-4c75-499a-9483-c2fab94c7187/exporter/0.log" May 28 00:10:43.047040 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:43.047010 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8svnk_8a9d6f2e-4c75-499a-9483-c2fab94c7187/extractor/0.log" May 28 00:10:47.084598 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:47.084526 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-lf7dz/perf-node-gather-daemonset-kj65t" May 28 00:10:47.169146 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:47.169115 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-9x9xx_9daf9a14-d55f-4e66-935a-30ddf20a6d6e/migrator/0.log" May 28 00:10:47.195018 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:47.194989 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-9x9xx_9daf9a14-d55f-4e66-935a-30ddf20a6d6e/graceful-termination/0.log" May 28 00:10:48.320575 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:48.320543 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6qfrg_95ce23f5-a9ec-4203-9875-1f8bd5254019/kube-multus/0.log" May 28 00:10:48.344727 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:48.344704 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c4dx6_ff3537f7-1ece-4ffa-a8c8-b42b200cee3a/kube-multus-additional-cni-plugins/0.log" May 28 00:10:48.365921 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:48.365888 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c4dx6_ff3537f7-1ece-4ffa-a8c8-b42b200cee3a/egress-router-binary-copy/0.log" May 28 00:10:48.386763 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:48.386735 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c4dx6_ff3537f7-1ece-4ffa-a8c8-b42b200cee3a/cni-plugins/0.log" May 28 00:10:48.409186 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:48.409163 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c4dx6_ff3537f7-1ece-4ffa-a8c8-b42b200cee3a/bond-cni-plugin/0.log" May 28 00:10:48.432740 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:48.432716 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c4dx6_ff3537f7-1ece-4ffa-a8c8-b42b200cee3a/routeoverride-cni/0.log" May 28 00:10:48.459311 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:48.459287 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c4dx6_ff3537f7-1ece-4ffa-a8c8-b42b200cee3a/whereabouts-cni-bincopy/0.log" May 28 00:10:48.480224 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:48.480203 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c4dx6_ff3537f7-1ece-4ffa-a8c8-b42b200cee3a/whereabouts-cni/0.log" May 28 00:10:48.968229 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:48.968161 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-t87h5_b407d9da-589e-4803-abad-d70c5a21a11a/network-metrics-daemon/0.log" May 28 00:10:48.995039 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:48.995010 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-t87h5_b407d9da-589e-4803-abad-d70c5a21a11a/kube-rbac-proxy/0.log" May 28 00:10:50.547121 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:50.547091 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tbcdd_c82e3b33-c73d-4543-9baf-2784cc72d33e/ovn-controller/0.log" May 28 00:10:50.575118 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:50.575092 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tbcdd_c82e3b33-c73d-4543-9baf-2784cc72d33e/ovn-acl-logging/0.log" May 28 00:10:50.595710 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:50.595688 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tbcdd_c82e3b33-c73d-4543-9baf-2784cc72d33e/kube-rbac-proxy-node/0.log" May 28 00:10:50.622099 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:50.622075 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tbcdd_c82e3b33-c73d-4543-9baf-2784cc72d33e/kube-rbac-proxy-ovn-metrics/0.log" May 28 00:10:50.644973 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:50.644949 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tbcdd_c82e3b33-c73d-4543-9baf-2784cc72d33e/northd/0.log" May 28 00:10:50.667188 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:50.667127 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tbcdd_c82e3b33-c73d-4543-9baf-2784cc72d33e/nbdb/0.log" May 28 00:10:50.692288 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:50.692269 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tbcdd_c82e3b33-c73d-4543-9baf-2784cc72d33e/sbdb/0.log" May 28 00:10:50.787549 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:50.787521 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tbcdd_c82e3b33-c73d-4543-9baf-2784cc72d33e/ovnkube-controller/0.log" May 28 00:10:51.681881 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:51.681854 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-cwkwk_6a6ef6f8-506a-4fd5-886a-17d7e66340f8/network-check-target-container/0.log" May 28 00:10:52.574852 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:52.574828 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-7tr5v_340c3057-5db9-47aa-9894-64c7f8db149f/iptables-alerter/0.log" May 28 00:10:53.177062 ip-10-0-128-22 kubenswrapper[2556]: I0528 00:10:53.177012 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-48nz8_3f829d62-45c3-4fae-bc63-1227501d75e2/tuned/0.log"